A new law will criminalize the creation or distribution of non-consensual intimate images starting this week in response to the rise of sexualized deepfakes on the social media platform previously known as Twitter, now referred to as X. Technology Secretary Liz Kendall labeled the AI-generated images produced by X’s AI chatbot Grok as “weapons of abuse,” prompting Ofcom to launch an investigation into the platform’s compliance with the Online Safety Act.
The legislation will prohibit the creation or sharing of fake nude images through apps and tools designed for non-consensual purposes. Offenders may face severe penalties under the Crime and Policing Bill, which aims to tackle the dissemination of harmful content at its root.
Ms. Kendall emphasized the devastating impact of such content, especially on women and girls, urging swift action to prevent further harm. She urged X to take immediate steps to prevent the circulation of illegal and abusive material on its platform, even before the completion of the Ofcom inquiry.
At a recent Labour Party meeting, Keir Starmer condemned X’s inaction in protecting victims of abuse, calling for urgent intervention to safeguard vulnerable individuals. Ofcom’s ongoing investigation into Grok’s potential facilitation of sexualized content involving children underscores the importance of platform accountability and safeguarding vulnerable users.
The Internet Watch Foundation uncovered illicit imagery linked to Grok, prompting X to acknowledge security lapses and pledge corrective measures. In response to criticisms, X announced plans to monetize deepfake creation through Grok, drawing strong criticism for profiting from abusive practices.
Efforts to address these concerns are underway, with calls for swift regulatory action to protect users and uphold online safety standards.