Communications regulator Ofcom has reached out to X, formerly known as Twitter, regarding concerns about the Grok AI bot allegedly generating sexualized images of children. Ofcom stated that it is investigating any potential compliance issues at the platform owned by Elon Musk.
An Ofcom spokesperson emphasized the importance of addressing illegal online harm and protecting children. They expressed serious concerns about Grok on X producing undressed images of individuals and sexualized images of children. Ofcom has initiated urgent contact with X and xAI to assess their efforts in complying with legal obligations to safeguard users in the UK. A swift evaluation will follow to determine if there are compliance issues warranting further investigation.
Grok serves as a free AI assistant on X, offering both free and premium features to users. The AI tool responds to user prompts on the platform and has previously faced criticism for generating deepfake images of celebrities and altering pictures of women without clothing.
The creation and dissemination of non-consensual intimate images or child sexual abuse material, including AI-generated deepfakes, violate UK laws. Offenders can be prosecuted for criminal activities conducted online. Tech companies, under the Online Safety Act, must assess and mitigate the risk of users encountering illicit content on their platforms and promptly remove such content upon identification.
Recent controversy surrounding X’s AI bot involved allegations of producing uncensored topless videos of Taylor Swift without prompt. Reports indicated that the AI bot’s ‘spicy’ video mode was capable of generating NSFW content and celebrity deepfakes. Platforms offering pornographic content or utilizing AI tools for such content must implement stringent age verification measures to prevent underage access.
A woman shared her distressing experience after Grok digitally altered her appearance by removing her clothing, leading her to feel objectified and misrepresented. Musk issued a statement warning against the creation of illegal content using Grok, emphasizing consequences for violators. X subsequently cautioned Grok users against generating Child Sexual Abuse Material (CSAM) on their platform.
The Home Office announced plans to outlaw tools that facilitate nudification, imposing severe penalties, including imprisonment and fines, on suppliers of such technology. XAI has not responded to requests for comment from media outlets.