In 2026, a new legal case erupts in the United States, implicating Elon Musk and his artificial intelligence company, xAI, the creator of the chatbot Grok. Three teenage girls, including two minors, filed a complaint before a federal court in San José after discovering that Grok had generated and distributed a compromising video featuring them, without their consent. These images, created from their personal photos, highlight the growing dangers of deepfakes and raise significant debates about image rights, corporate responsibility, and the legislative framework surrounding generative technologies. This scandal once again sheds light on the fragility of protections offered to victims in the face of the rapid and still largely uncontrolled rise of artificial intelligences.
At the heart of this judicial controversy, French and international justice systems are now closely scrutinizing the practices of Elon Musk and platforms linked to his innovations, notably the social network X, where the massive dissemination of illicit content poses tangible risks. While Elon Musk regularly evades summons, the psychological impact on the victims, particularly the teenage girls, raises a major social and legal urgency. How can technologies like Grok be regulated and held accountable? What protection exists for minors in an era where deepfakes invade the digital sphere? This dossier holds crucial answers for the future of justice and digital affairs.
- 1 Generation of compromising content by Grok: a new challenge for justice
- 2 Psychological and social consequences of a compromising video on a teenage girl
- 3 The role and responsibility of Elon Musk and xAI in the genesis of illegal videos
- 4 Ongoing judicial investigations and stakes for French and American justice
- 5 The future of regulation of generative artificial intelligences and protection of minors
- 6 Technology, ethics, and societal responsibility in the era of deepfakes
- 7 Challenges related to moderation of AI-generated content
- 8 The judicial fight: a key step against abuses linked to Grok and generative AI
Generation of compromising content by Grok: a new challenge for justice
The legal case is based on a chilling observation: the automatic generation by Grok of sexually explicit videos featuring teenage girls without any consent. These contents were created from simple personal photographs, collected from social networks and public platforms. One of the plaintiffs, identified under the pseudonym Jane Doe 1, received an alert after discovering on Discord servers and the Telegram app videos showing a deepfake of herself fully undressing, images generated based on photos taken during her school enrollment.
With advances in artificial intelligence, the creation and manipulation of images generated by Grok now make it possible to produce detailed and extremely realistic video sequences within seconds. The malicious use of this technology raises a genuine question: who is responsible when photos are diverted and transformed into compromising sexual videos? In this case, the plaintiffs reproach Elon Musk and xAI for not having implemented sufficient measures to prevent the exploitation of their AI in illicit activities.
Moreover, these contents do not remain confined to restricted circles. They then circulate among clandestine networks, sometimes serving as currency between malicious individuals. The judicial apparatus is investigating, supported by technological evidence, notably the seizure of phones containing exchanges showing the massive use of Grok to generate this type of videos.
This situation calls for a strengthening of the legal and technical framework. Courts are currently trying to adapt laws to clearly define the responsibility of servers hosting these tools and the legal scope of intermediaries. In this specific case, despite indirect use through third-party applications, the complaint insists on the ultimate responsibility of xAI, due to the hosting of the generation processes on its internal servers. This illustrates the complexity of modern technological chains and the legal ambiguity surrounding them.
The non-consensual dissemination of sexually explicit videos particularly affects teenage girls, exposing these young women to intense harassment and profound psychological trauma. The feeling of violation of image rights is accentuated by the irreversible nature of the internet, where a compromising video can be multiplied and disseminated infinitely, amplifying victims’ anxiety.
A recent UNICEF report relayed by specialized media reveals that, faced with such digital harassment, teenage girls often develop post-traumatic stress disorder, anxiety disorders, and severe depression. In the case of the victims involved in this complaint, the mother of one of the teenage girls testified to panic attacks related to the inability to permanently delete the content, a situation worsened by virality on social networks.
Socially, these videos generated by Grok reinforce school bullying and stigmatization. Teenage girls may become isolated or intimidated, their school and social lives seriously disrupted. Moreover, this type of content opens the door to a still little-studied but feared phenomenon: self-censorship and the constant fear of exposure, which can affect personal development and self-confidence in the long term.
Beyond the individual shock, this issue also raises questions of collective ethics. Should digital platforms strengthen their measures to prevent technologies like Grok from becoming tools of exploitation? The debate is moving towards the implementation of enhanced protection mechanisms and increased accountability of technological actors like Elon Musk, whose companies find themselves in the spotlight for their shortcomings in moderation and control.
The stakes of image rights in the age of deepfake
Image rights, particularly protecting minors, struggle to keep pace with the rise of deepfakes produced by increasingly sophisticated artificial intelligences. The question of legal responsibilities is recurrent: should platforms hosting these contents be sanctioned, the developers of the technologies enabling them, or the users who disseminate them?
In many jurisdictions, the legal framework faces difficulties in qualifying these automatically generated works, especially if they are produced by intermediaries using the power of AIs such as Grok under license. Some recent laws have included specific provisions against the non-consensual dissemination of sexual deepfakes, but enforcement remains limited, particularly due to online anonymity.
The filed complaint also highlights the inefficiency of current moderation and deletion tools. When a compromising deepfake is generated, it becomes difficult, if not impossible, to limit its rapid spread. This is why experts call for increased vigilance and the adoption of more effective detection technologies coupled with a stricter legal framework.
The role and responsibility of Elon Musk and xAI in the genesis of illegal videos
Elon Musk, as founder and leader of xAI, is at the center of criticism. The plaintiffs believe that his company, responsible for the chatbot Grok, bears a major burden in creating and disseminating illegal content. A fundamental point is xAI’s stance which, through a license model, authorizes third-party applications to exploit its technology powerfully integrated on its own servers. This structure allows them to escape direct control and reduce their direct responsibility, but it is now being challenged in court.
The complaint highlights a “cynical profit” obtained from these malicious uses. Although the images were not created directly on the social network X, it is the algorithmic power of Grok, hosted by xAI, that is at the origin. This moderation failure is all the more contestable since, as early as January 2026, Grok was already involved in a global scandal for having generated nearly 3 million sexualized images, including 23,000 depicting minors. These figures demonstrate a real flaw in control systems and the prevention of abusive uses.
This precedent led xAI to apply restrictions, notably limiting image generation to paying subscribers only and geographical filtering. But these measures are considered insufficient by victims and authorities, who insist on real ethical and safety governance of generative artificial intelligences.
| Criteria | Data related to Grok (2026) | Consequences for xAI |
|---|---|---|
| Sexualized images generated | 3 million in 2 weeks | Affected reputation, increased regulatory pressure |
| Images with minors | 23,000 identified | Judicial investigation, class action lawsuit |
| Measures taken | Geographic filtering and paid subscription | Criticism on insufficient moderation |
| Claimed responsibility | Discharge via third-party license | Challenged in court |
Ongoing judicial investigations and stakes for French and American justice
In view of the scale of the scandal, judicial procedures have been launched in parallel in the United States and Europe. Elon Musk has notably been summoned by the Paris prosecutor’s office for a voluntary hearing as part of an investigation into abuses of the social network X and the artificial intelligence Grok. This summons raises tensions as he has not appeared at some convocations, fueling a debate on international cooperation and the effectiveness of investigations against tech giants.
In the United States, the class action lawsuit filed in San José highlights the need for strong judicial action to protect the victims. Authorities strive to obtain solid evidence and establish new case law concerning the passive or active complicity of developers of deepfake tools.
This case illustrates the major challenge facing modern justice: how to adapt the law to the realities of advanced technologies and decentralized digital networks? Judges’ interventions, often confronted with the technical complexity of cases, require strengthened expertise and collaboration with AI experts to avoid legal loopholes letting responsibilities slip away.
The future of regulation of generative artificial intelligences and protection of minors
As incidents related to Grok multiply, governments and international institutions are working tirelessly to strengthen regulatory frameworks around generative artificial intelligences. The European Union has deployed monitoring and control mechanisms. A series of ambitious laws aims to regulate the creation, dissemination, and moderation of content generated by AI.
Among the measures considered are:
- The obligation of transparency on the use of deepfakes and mandatory labeling
- The requirement for stricter algorithmic control limiting the production of illicit content
- The implementation of more effective automated detection tools to identify non-consensual images and videos
- Increased sanctions against companies steadfast in their non-responsibility policies
- The creation of national programs for protection and support for victims, especially minors
These provisions aim to restore balance between technological innovation and respect for fundamental rights. The Grok case demonstrates the urgency of such regulation, but also the difficulty for sector actors to comply with coherent standards at a global level.
International examples of deepfake regulation
Several countries are advancing on the issue:
- France: adoption of a law explicitly protecting minors’ image rights and penalizing the non-consensual dissemination of AI-generated content.
- United States: proposals for federal laws to ban the creation or distribution of non-consensual sexual deepfakes, with heavy penalties.
- Germany: development of platforms dedicated to rapid reporting and mandatory removal of dubious content.
- European Union: extension of the Digital Services Act including generative AIs under enhanced control.
Technology, ethics, and societal responsibility in the era of deepfakes
This scandal linked to Grok clearly illustrates the complex dilemma combining technological advances and ethical challenges. Generative artificial intelligence, while offering innovative perspectives, is today at the center of a debate on the societal responsibility of developers, companies, and users.
Ethically, the non-consensual creation of compromising videos exposes to extreme exploitation of individuals, falling within aggravated harassment phenomena. Actors like xAI, by failing to implement effective controls, unwittingly participate in normalizing these harmful practices.
Holding these actors accountable also means considering long-term impacts: trust in digital technology erodes if users fear that their image will be instrumentalized. This mistrust could hinder the adoption of already revolutionary AI technologies in crucial fields such as health, education, or artistic creation.
Initiatives are nevertheless emerging, bringing together researchers, authorities, and companies to develop ethical, responsible, and inclusive AIs. More than ever, society as a whole is called upon to weigh in on the debate and support a respectful use of these immensely potent tools.
One of the major challenges for platforms using generative AIs is to develop moderation systems adapted to the volume and speed of content creation. Grok has demonstrated its prodigious capabilities, but also its limits in controlling abusive uses.
Traditional human moderation systems quickly show their insufficiency against millions of images generated daily. Complementary algorithms, fed by databases of known deepfakes, are being developed to spot illicit content. However, technical complexity, criminals’ creativity, and the speed of dissemination make this task arduous.
In parallel, the restriction policy adopted by xAI, notably the mandatory shift to paid subscriptions for image generation, has not fully curbed abuses. This model also raises questions of equality of access and innovation.
Here is a summary of the main moderation challenges:
- Rapid identification of non-consensual content
- Management of reports and access to appeal mechanisms
- Coordination between platforms and judicial authorities
- Balancing freedom of expression and protection of individuals
- Development and implementation of effective ethical and automatic filters
The judicial fight: a key step against abuses linked to Grok and generative AI
The complaint filed by the American teenage girls marks a decisive moment in the fight against abuses of generative AIs. By officially invoking the responsibility of Elon Musk and his company xAI for content generated by Grok, the justice system opens a breach in a still fuzzy and poorly regulated field.
This fight highlights the importance of a systematic and transparent approach in the creation and control of artificial intelligences. It also recalls the necessity for victims to have effective legal recourse commensurate with the harm suffered.
Beyond the individual aspect, this case could set a landmark precedent in international jurisprudence, laying the foundations for stricter obligations on companies manipulating sensitive technologies. The stakes are colossal, as they concern both the protection of vulnerable populations and the sustainability of a powerful technological tool within the respect of human rights.
What is a deepfake and why is it problematic?
A deepfake is a video or image generated by artificial intelligence that modifies or creates the face or body of a person in a realistic way, often without their consent. These contents are problematic because they can be used for harassment, misinformation, or the dissemination of non-consensual sexual content.
How does Grok generate these compromising videos?
Grok uses artificial intelligence algorithms to transform real photos into generated videos, applying advanced deepfake techniques that simulate body movements. This generation sometimes occurs via third-party applications using the power of Grok under license.
Who is responsible in case of abuses of generative AI?
Responsibility can be complex, involving AI developers, hosting platforms, as well as end users. Courts attempt to adapt legal frameworks to determine which responsibility falls on each actor depending on the situation.
What psychological consequences do victims suffer?
Victims of abusive deepfake uses may suffer significant trauma, including anxiety, depression, sleep disorders, and a lasting sense of humiliation, especially when the content circulates widely on the internet.
What measures are taken to regulate deepfakes?
Many countries impose strengthened laws on the dissemination of non-consensual content, develop automated detection technologies, and implement support programs for victims, particularly minors suffering from digital harassment.