Elon Musk has been told to take urgent action to stop X’s Grok AI tool generating indecent deepfake images of children and women.
Technology Secretary Liz Kendall said the US tech billionaire must intervene after cases of the system being used to make sexualised images of real people were highlighted in recent days.
Regulator Ofcom has already asked X and xAI to set out the steps it is taking to comply with legal obligations to protect UK users of the social media platform.
But the intervention of the minister threatens to open a new front in the war between the UK government and Mr Musk, who has already lashed out at British moves to regulate social media.
‘What we have been seeing online in recent days has been absolutely appalling, and unacceptable in decent society,’ Ms Kendall said this afternoon.
‘No one should have to go through the ordeal of seeing intimate deepfakes of themselves online.
‘We cannot and will not allow the proliferation of these demeaning and degrading images, which are disproportionately aimed at women and girls.
‘X needs to deal with this urgently. It is absolutely right that Ofcom is looking into this as a matter of urgency and it has my full backing to take any enforcement action it deems necessary.’
Ofcom has ‘urgently contacted’ X and xAI over the sexualised images of children, which Grok admitted to in a post on the social media platform
Under the Online Safety Act in the UK, social media firms must prevent and remove child sexual abuse material when they become aware of it.
The act also outlaws the use of AI to generate pornographic images, also known as deepfakes, of people without their consent.
But X users have highlighted cases in recent days where innocent images of women and female child actors have been manipulated by Grok after users’ requests to digitally alter or remove clothing.
Ms Kendall said efforts to curb the spread of sexualised deepfakes were not an attempt to restrict free speech.
Donald Trump’s US administration has hit out at European regulators for attempts to regulate what appears online on American platforms.
But Ms Kendall said: ‘Services and operators have a clear obligation to act appropriately. This is not about restricting freedom of speech but upholding the law.
‘We have made intimate image abuse and cyberflashing priority offences under the Online Safety Act – including where images are AI-generated. This means platforms must prevent such content from appearing online and act swiftly to remove it if it does.
‘Violence against women and girls stains our society – and that is why we have also legislated to ban the creation of explicit deepfakes without consent, which are both degrading and harmful.
‘Make no mistake – the UK will not tolerate the endless proliferation of disgusting and abusive material online. We must all come together to stamp it out.’
Ofcom has made ‘urgent contact’ with Elon Musk‘s social media platform X after serious concerns that its AI tool Grok can generate ‘sexualised images of children’.
A post on the Grok X account admitted this, saying: ‘isolated cases where users prompted for and received AI images depicting minors in minimal clothing’.
Join the debate
How should tech giants be held accountable when their AI creates potentially harmful images?
Elon Musk appears to be aware of the technology being used to undress people after he posted a picture of himself in a bikini with laughing emojis
It added: ‘xAI has safeguards, but improvements are ongoing to block such requests entirely.’
Ofcom has contacted X urgently to see what these improvements could mean and how X and xAI will protect users of the social media platform in the UK but they have not yet opened an investigation.
A spokesman for the regulator said: ‘Tackling illegal online harm and protecting children remain urgent priorities for Ofcom.
‘We are aware of serious concerns raised about a feature on Grok on X that produces undressed images of people and sexualised images of children.
‘We have made urgent contact with X and xAI to understand what steps they have taken to comply with their legal duties to protect users in the UK.
‘Based on their response we will undertake a swift assessment to determine whether there are potential compliance issues that warrant investigation.’
When requested for a comment about the sexualised images of children on the platform, xAI replied with an automatically generated email saying ‘legacy media lies’.
Elon Musk appears to be aware of the technology being used to undress people, as he posted a generated picture of himself in a bikini.
The original post of this appears to have been deleted, but he reposted another user’s reply to it with laughing emojis.
Internet Watch Foundation chief executive Kerry Smith said: ‘The IWF has received a number of reports from the public relating to suspected child sexual abuse imagery on X generated by the AI chatbot Grok.
‘We are still working through these reports but, so far, we have not seen any imagery which crosses the legal threshold for being considered child sexual abuse in the UK.’
She urged the Government to require AI firms to build safety measures into their products to prevent harmful content.
A Home Office spokesman said: ‘We are legislating to ban nudification tools in all their forms, including the use of AI models for this purpose.
‘Intimate image abuse is a devastating crime which disproportionately affects women and girls.
‘Under this new criminal offence, any individuals or companies who design or supply these nudification tools will face a prison sentence and substantial fines.’