Government Demands Action Over ‘Appalling’ Grok AI Deepfakes
The government has demanded that social media platform X take immediate action in response to the misuse of its AI chatbot, Grok, which has been implicated in generating sexualized images of women and children without their consent. The Technology Secretary, Liz Kendall, characterized the situation as “absolutely appalling” and emphasized the government’s zero tolerance for the spread of degrading and abusive content.
Legal Obligations and Regulatory Response
Kendall stated, “We cannot and will not allow the proliferation of these images,” asserting that platforms have a clear legal duty to act. This intervention follows urgent communications from the media regulator Ofcom to X and its AI subsidiary, xAI, regarding concerns that Grok was producing what Ofcom termed “undressed images” of real individuals.
Ofcom’s spokesperson noted, “Based on their response we will undertake a swift assessment to determine whether there are potential compliance issues that warrant investigation.” Kendall expressed her full support for Ofcom’s approach and any necessary enforcement actions.
Balancing Free Speech and Legal Compliance
The Technology Secretary clarified that the issue at hand is about enforcing the law, not limiting free expression. “Services and operators have a clear obligation to act appropriately,” she stated. The government has prioritized intimate image abuse and cyberflashing under the Online Safety Act, which includes cases involving AI-generated images.
Concerns Over Grok’s Functionality
Grok, a free virtual assistant with premium features, responds to user prompts when tagged in posts on X. Reports indicate that users have manipulated real pictures through Grok to place women in sexualized scenarios. The Internet Watch Foundation (IWF) has identified “criminal imagery” of underage girls reportedly created using Grok.
Concerns have intensified since X introduced an “Edit Image” button, allowing users to alter images using text prompts without needing to upload the original photograph or obtain consent from individuals depicted.
Impact on Individuals
Several women affected by this feature have described the experience as dehumanizing. Dr. Daisy Dixon, a frequent user of X, reported that her everyday photographs were altered to sexualize her, leaving her feeling “humiliated” and fearful for her safety. While she found the Technology Secretary’s intervention “heartening,” she expressed frustration over X’s lack of accountability, stating, “I don’t want to open my X app anymore as I’m frightened about what I might see.”
Platform’s Response and Political Pressure
X has stated that it takes action against illegal content on the platform, including child sexual abuse material. The platform asserted, “Anyone using or prompting Grok to make illegal content will suffer the same consequences as if they uploaded illegal content.”
The leader of the Liberal Democrats, Sir Ed Davey, has urged the government to act swiftly to prevent the creation of sexualized images using the chatbot. He suggested that reducing access to X could be an option if concerns are substantiated, emphasizing the need for accountability from high-profile figures like Elon Musk.
Legal Framework and Future Implications
The Online Safety Act makes it illegal to create or share intimate or sexually explicit images without a person’s consent, including those generated using AI. The law obligates tech firms to take appropriate steps to limit users’ exposure to such material and to remove it quickly once identified.
