The UK’s safeguarding minister has urged law enforcement to actively pursue individuals who are utilizing Elon Musk’s Grok platform to produce harmful deepfake images involving children.
Jess Phillips expressed her concerns to The Mirror, emphasizing the need for accountability as outrage mounts over the misuse of X’s artificial intelligence tool, Grok, which has been producing manipulated images, including those of minors, without consent.
Phillips strongly condemned the existence of such functionalities, highlighting the devastating impact on individuals’ lives due to this form of abuse. She criticized X, previously known as Twitter, for announcing Grok’s deepfake creation feature as a “premium service” for paying users, dismissing it as an inadequate response.
Insisting that perpetrators of AI-generated images should face severe consequences, Phillips called for a relentless pursuit by law enforcement. She emphasized that tools creating non-consensual and degrading content should not be tolerated, whether accessible to paying or non-paying users, urging X to cooperate with regulators to ensure compliance with the law.
Furthermore, Phillips underscored the legal obligation of social media platforms to remove such content promptly, warning of substantial fines by regulator Ofcom for non-compliance. She emphasized the government’s commitment to combatting child sexual abuse and enforcing strict penalties for those involved in creating or distributing illicit AI-generated content.
Additionally, celebrities like Maya Jama have demanded an end to the platform’s creation of manipulated images of them. Proposed legislation aims to criminalize the creation, possession, and distribution of harmful AI-generated images of children, carrying potential prison sentences of up to five years.
Labour’s strategy against violence towards women and girls pledges to outlaw apps that produce deepfake images without consent, aligning with the government’s efforts to address this issue. Phillips reiterated the government’s readiness to enforce legislation prohibiting the creation of intimate deepfake images without consent, emphasizing the urgency of implementing these measures.
With concerns raised by Ofcom regarding Grok’s inappropriate content, Musk’s X and xAI have been urged to address the issue promptly. Musk affirmed that individuals misusing Grok to create illegal content will face consequences equivalent to uploading such material, stressing the company’s commitment to rectifying safeguard lapses.
Overall, the government and regulatory bodies are collaborating to tackle the misuse of AI technology for producing harmful content, emphasizing the need for swift and decisive action to protect individuals, especially children, from the negative impacts of deepfake imagery.