In its statement, Ofcom noted that the Grok chatbot is used to create and disseminate unacceptable images, raising serious concerns. If violations are found, the X platform could face a fine of up to 10% of its global turnover or £18 million (about €21 million), depending on which amount is greater.
If X fails to comply with the regulator's requirements, Ofcom may seek a court order for a complete block of access to the platform in the UK.
Keir Starmer, the Prime Minister of the UK, expressed his opinion on the Grok situation on Thursday during a broadcast on Greatest Hits radio, calling it a "shame" and "unacceptable." He promised that necessary measures would be taken.
Liz Kendall, the Minister of Science, Innovation, and Technology, is expected to make a statement in the House of Commons on Monday regarding the Grok situation. Her predecessor, now Minister of Trade Peter Kyle, commented on the BBC Breakfast program, calling Grok's behavior outrageous and noting that the chatbot had not been properly tested.
"Recently, I met a woman who discovered that AI had created and published her image in a bikini against the backdrop of Auschwitz, and it made me feel nauseous," he added.
The BBC reviewed several examples of AI-generated images where women were "undressed" without their consent and "forced" into sexual poses. One woman reported that over a hundred sexualized images had been created featuring her.
As Bloomberg reported on January 7, from January 5 to 6, Grok generated about 6,700 sexualized images per hour.
Elon Musk, the owner of X, stated on one hand that those who use Grok to create illegal content will face consequences, as will those who publish such content. On the other hand, he commented that the UK government is looking for excuses for censorship, pointing out that other AI platforms are not subjected to similar scrutiny.
Musk also posted an image of a toaster in a bikini with a comment that Grok can "dress" anything, and shared photos of Starmer in a women's swimsuit, referencing the possibility of creating similar images by other AIs. He added that "they just want to limit freedom of speech."
After a shooting incident in Minneapolis, some X users used Grok to "undress" a photo of the victim, as well as a new photo of her body. When AFP requested a comment on this, xAI responded with a standard automated message: "Traditional media lies."
The official X Safety account claims that content related to sexualized violence against children is removed, and accounts disseminating it are restricted. Elon Musk also supported this statement.
This week, Ofcom reported that it had "urgently reached out to X and xAI" regarding the Grok feature, warning that an investigation may begin depending on their response. On Friday, an Ofcom representative stated that the regulator had "received a response" and is now "conducting an expedited assessment urgently."
Ofcom intends to determine whether X is violating the law by not removing illegal content quickly enough. The regulator will also check whether "appropriate measures" have been taken to prevent users in the UK from accessing such content, including "intimate images created without consent" and sexually explicit materials involving children.
An Ofcom representative did not specify the timeline for the investigation but emphasized that it has "the highest priority."
"Platforms are obligated to protect people in the UK from illegal content," Ofcom stated. "We will not hesitate to conduct an investigation if we suspect that companies are not fulfilling their duties, especially when it comes to protecting children."
On Thursday, Grok announced that image generation and editing are now available only to paid subscribers. However, a representative of the British Prime Minister noted that this merely turns the AI function into a paid service and does not address existing issues.
"This is an insult to the victims of misogyny and sexual violence," added Starmer's office.
Thomas Renier, a representative of the European Commission, stated: "This does not change our fundamental position—whether it's a paid subscription or free. We do not want to see such images. It's that simple."
"We demand that platforms ensure that their systems do not allow the creation of illegal content," he continued.
The European Commission has already begun an investigation into cases of explicit images of young girls created by Grok after the introduction of a paid feature called Spicy Mode last summer.
"This is not 'spicy.' This is illegal. This is outrageous. This is disgusting. It has no place in Europe," noted Renier.
Cliff Steinhauer from the National Cybersecurity Alliance expressed the opinion that making image generation tools in Grok available only to paid subscribers may reduce the level of abuse but will not eliminate the vulnerabilities that led to the creation of unacceptable content.
"Access restrictions alone are not enough for comprehensive protection, as malicious actors can find workarounds. Real user protection must be built into the foundation of such tools," he noted.
Recently, Grok was blocked in Malaysia and Indonesia, and France and India are also considering taking action. This is not the first scandal involving Grok: in July, the chatbot praised Adolf Hitler, calling itself MechaHitler, and made anti-Semitic comments. xAI then promised to block such statements before they were published.
