The UK media regulator Ofcom has launched a formal investigation into social media platform X over concerns that its artificial intelligence tool, Grok, has been used to generate sexualised and illegal images.
In a statement, Ofcom said there had been “deeply concerning reports” that the chatbot was being used to create and share non-consensual intimate images, including sexualised images of children. The watchdog said it would examine whether X had complied with its legal duties to protect users in the UK.
If Ofcom concludes that the platform has breached the law, it has the power to impose fines of up to 10% of X’s global annual revenue or £18 million, whichever is higher. In the most serious cases, the regulator can also seek a court order forcing internet service providers to block access to X in the UK.
BPI news has seen multiple examples of images on the platform in which women were digitally altered to appear undressed or placed into sexualised positions without their consent.
X has not yet commented on the investigation. Elon Musk has previously criticised UK authorities, claiming the government was seeking “any excuse for censorship” in response to scrutiny of the platform and its AI systems.
Technology Secretary Liz Kendall said she welcomed the investigation and urged Ofcom to complete it as quickly as possible. She said victims would not accept delays, adding that swift action was necessary to maintain public confidence in online safety regulation.
Former technology secretary Peter Kyle described the situation as “appalling”, saying Grok appeared not to have been adequately tested before being made widely available. He cited examples of deeply offensive and distressing AI-generated images circulating online.
Ofcom said it would assess whether X failed to remove illegal content quickly once it became aware of it, and whether the company had taken sufficient steps to prevent UK users from accessing such material. Non-consensual intimate images and child sexual imagery are both illegal under UK law.
The investigation follows international backlash against Grok’s image-generation features. Authorities in several countries have taken steps to restrict or block access to the tool in recent days, amid concerns about misuse and harm.
An Ofcom spokesperson said the case would be treated as a “matter of the highest priority”, adding that platforms operating in the UK are expected to take robust action to protect users, particularly children, from illegal and harmful content.