Grok generates over 20,000 images of children and minors in 11 days! The EU launches an investigation, with a maximum penalty of 6% of annual revenue

The European Union has officially launched an investigation into X and Grok deepfake controversy under the Digital Services Act, involving minors’ content and platform governance failures, potentially facing hefty fines.

Regulatory Iron Fist Returns! The EU Officially Launches DSA Compliance Investigation on X Platform

According to BBC reports, the European Commission announced on January 26th that it has initiated legal proceedings against the social media platform X, owned by billionaire Elon Musk. The core trigger for this action is Grok, an AI chatbot built into the platform, which is accused of generating millions of unauthorized deepfake sexual images in a very short period, some involving inappropriate content related to minors.

Image source: European Union Commission announces the initiation of legal proceedings against X platform owned by billionaire Elon Musk

Preliminary investigations by regulatory authorities reveal that users can issue commands to Grok to modify real portrait photos into virtual synthetic images. The misuse of such technology has raised serious concerns within the EU regarding AI safety and the spread of illegal content. The EU will evaluate whether the X platform has fulfilled its legal obligations under the Digital Services Act (DSA), including risk assessments of illegal content, mitigation measures, and whether AI-generated or manipulated media are clearly marked.

Further Reading
Grok involved in sexual exploitation, monitored by 9 major regions! UK launches investigation, potential hefty fines for violations
Elon Musk’s Grok image manipulation chaos! Cosplayers and minors undressed by AI, multiple countries investigate

Shocking Data Revelation: One Child Sexual Image Every 41 Seconds

According to the latest report from the Center for Countering Digital Hate (CCDH), Grok produced approximately 3 million sexually suggestive deepfake images within just 11 days from late December 2025 to early January 2026. The data shows that among these, 23,338 images involved minors in sexualized portrayals. Calculated, this means an image infringing on children’s rights is generated every 41 seconds on average.

Although Musk initially mocked such reports, calling them “lies of the mainstream media,” and claimed that the system is designed to reject all illegal requests, researchers pointed out that the core issue is Grok, while possibly filtering out fully nude content, can easily generate images of minors wearing revealing clothing or posing provocatively. As of mid-January, about one-third of these controversial images still remain on the X platform, indicating significant loopholes in the platform’s content moderation mechanisms for synthetic media.

Political Storm and Delay Controversy: From Greenland Crisis to Irish Officials’ Withdrawal

This scandal has caused a major upheaval in European politics, with several Irish government ministers taking drastic actions by collectively shutting down their X accounts in protest. European Parliament member Regina Doherty publicly supported the EU Commission’s decision, emphasizing that no company operating within the EU should be above the law, and called for immediate and effective sanctions against behaviors that harm women and children.

Notably, according to German media Handelsblatt, the EU initially planned to launch this investigation earlier but was delayed due to the diplomatic crisis caused by US President Donald Trump’s proposal to acquire Greenland. Additionally, X platform had already been fined €120 million in December 2025 for violations of DSA regulations, including misleading blue checkmarks and insufficient ad transparency. This fine was criticized by US politicians like Marco Rubio as targeted attacks against American tech companies.

Further Reading
Pause tariffs on EU imports! Trump discusses Greenland in Davos: wants it but won’t use force to seize

Maximum Fine of 6% of Annual Revenue, the Ultimate Test of AI Regulation Era

With the formal process now underway, X platform could face extremely heavy financial penalties. Under the Digital Services Act, if found to have committed serious violations, the EU Commission can impose fines up to 6% of the company’s global annual turnover. This case is not only a compliance review of X but also a key test of how the EU responds to emerging technological challenges under the AI Act and DSA frameworks.

Regulators are closely monitoring whether X can implement effective remedial measures, such as xAI’s announcement to impose geographic restrictions in illegal regions and add technical barriers to image generation to prevent users from digitally “undressing” others. However, for digital security advocates, the outcome of this investigation will determine whether large tech platforms can truly take social responsibility for protecting users from harms caused by synthetic media while pursuing technological innovation.