{"id":364074,"date":"2026-01-11T07:45:07","date_gmt":"2026-01-11T07:45:07","guid":{"rendered":"https:\/\/www.newsbeep.com\/uk\/364074\/"},"modified":"2026-01-11T07:45:07","modified_gmt":"2026-01-11T07:45:07","slug":"uk-considers-ban-on-x-as-anger-over-sexualised-ai-images","status":"publish","type":"post","link":"https:\/\/www.newsbeep.com\/uk\/364074\/","title":{"rendered":"UK considers ban on X as anger over sexualised AI images …"},"content":{"rendered":"

The UK is hoping to build an \u00adinformal \u201ccoalition of decency\u201d in its response to Grok and X after the chatbot began enabling users to create non-\u00adconsensual sexualised images of women and children.<\/p>\n

Last week Keir Starmer said an update of Grok \u2013 an AI tool which allows users to alter clothed images of women and children by making them appear in bikinis and sexually suggestive poses \u2013 was \u201cdisgraceful\u2026 disgusting, and it\u2019s not to be tolerated\u201d.<\/p>\n

The Internet Watch Foundation (IWF), which monitors child sexual abuse material (CSAM) online, claimed it had found illegal imagery of girls aged 11 to 13 on the dark web that appear to have been generated using the Grok app.<\/p>\n

In response to the allegations, Grok\u2019s parent company, xAI, sent The\u00a0Observer an automated email: \u201cLegacy Media Lies\u201d. Previously, Grok said it had \u201cidentified lapses in safeguards and [is] urgently fixing them\u201d.<\/p>\n

Ofcom, the media watchdog with responsibility for online safety, is undertaking a quickfire \u00adinvestigation, expected to conclude as early as this week. The prime minister said he had told the regulator that \u201call options (should) be on the table\u201d.<\/p>\n

Technology secretary Liz Kendall said \ufeffOfcom would have her \u201cfull support\u201d if it decided to block the platform owned by Elon Musk.<\/p>\n

\u201cNo business model should be built on the exploitation and abuse of women and children,\u201d Kendall told The Observer.<\/p>\n

\u201cThe Online Safety Act includes the power to apply to the courts to block services from being accessed in the United Kingdom if they refuse to comply with UK law,\u201d she said. \u201cIf we reach a point where Ofcom decides to use them, they will have the full support of this government.\u201d<\/p>\n

Musk accused the government of being \u201cfascist\u201d.<\/p>\n

Government insiders told The Observer that while they believed an outright ban was unlikely, \ufeffa range of other options was on the table.<\/p>\n

NewslettersChoose the newsletters you want to receive<\/p>\n

Clear, calm analysis on the stories driving the day\u2019s news.<\/p>\n

The very best of our journalism, reviews and ideas \u2013 curated each day.<\/p>\n

A dispatch from The Observer\u2019s kitchen table \u2013 from Nigel Slater\u2019s recipes to interviews, features and hot tips.<\/p>\n

<\/p>\n

For information about how The Observer protects your data, read our Privacy Policy<\/a><\/p>\n

Under the Online Safety Act, Ofcom can fine companies up to \u00a318m or 10% of qualifying worldwide revenue, whichever is greater. \ufeffKendall said that she expects Ofcom to update on next steps \u2013 and the future in the UK of Musk\u2019s businesses X and xAI \u2013 \u201cin days, not weeks\u201d.<\/p>\n

Insiders noted that conversations were taking place with Australia, Canada and key member states in the EU, and that even Maga-friendly Republicans increasingly believed that \u201cthe will to uphold decency in public life is taking precedence over free speech\u201d. JD Vance, the US vice-president, called the situation \u201centirely unacceptable\u201d, David Lammy told the Guardian.<\/p>\n

Not everyone agrees, however. Anna Paulina Luna, a US Republican congresswoman and ally of Donald Trump, tweeted that she would bring forward legislation to \u201csanction not only Starmer, but Britain as a whole\u201d if a ban was implemented.<\/p>\n

Conversations among allies are understood to be taking place about showing a united front rather than taking any coordinated action, given each country\u2019s unique regulatory environment.<\/p>\n

Australia\u2019s prime minister Anthony Albanese has backed Starmer for raising the issue already, saying: \u201cThe use of generative artificial intelligence to exploit or sexualise people without their consent is abhorrent.\u201d<\/p>\n

Canada\u2019s minister for AI, Evan Solomon, posted \u2013 on X \u2013 that his government was legislating \u201cto include deepfakes as intimate images for the offence of publication of an intimate image without consent\u201d.<\/p>\n

At home, Starmer is under pressure, including from his backbenchers, over the government\u2019s \ufeffuse of X as one of its primary vehicles for communication. Last week dozens of MPs, as well as the women and equalities select committee, said they would no longer be using the platform. Sarah Owen, chair of the \u00adcommittee, said: \u201cIt\u2019s completely incompatible to stay on a site that platforms and creates… NCII (non consensual intimate images) with our work.\u201d<\/p>\n

Insiders said that while there was an \u201copen conversation\u201d about remaining on X, change was unlikely while the platform was still accessible.<\/p>\n

There has been no government spend on X since 2023, which marks part of a wider trend: the social media site recorded a 58.3% fall in UK revenues from \u00a369.1m in 2023 to \u00a328.9m last year, according to the latest financial figures published at Companies House covering the year to 31 December 2024.<\/p>\n

Even if action is taken against Grok, the row exposes the whack-a-mole AI environment that regulators \u2013 and citizens \u2013 now find themselves in.<\/p>\n

Defending his platform, Musk reposted images of Starmer in a bikini that had been created by Google\u2019s Gemini AI tool and OpenAI\u2019s ChatGPT.<\/p>\n

A growing market of chatbots and AI companion services explicitly permit sexual content, typically through niche apps and standalone websites offering erotic roleplay. Ofcom has already used its new powers against such services, fining the operator of an AI\u00a0nudification site \u00a350,000 for failing to introduce effective age checks to stop children accessing \u00adpornographic content.<\/p>\n

\u2018No business… should be built on the abuse and exploitation of women and children\u2019\u2018No business… should be built on the abuse and exploitation of women and children\u2019<\/p>\n

Liz Kendall, technology secretary<\/p>\n

For now, most mainstream assistants, with the exception of Grok, heavily restrict pornographic content. But OpenAI, the marker of ChatGPT, which had 15.1 million monthly UK users in July 2025, has said it plans to debut \u201cerotica\u201d in the coming months. It is not clear exactly what shape these changes will take and whether they will involve the generation of sexualised images, audio or video in addition to sexual roleplay with the chatbot.<\/p>\n

\u201cI think it is extremely difficult to launch sexual content generators safely and responsibly,\u201d said IWF chief technology officer Dan Sexton. \u201cWhen the specific purpose is to create sexual images, videos and text, the risk of misuse is incredibly high. Furthermore, this kind of technology can often serve to reinforce misogyny and gender inequality \u2013 root causes of violence against women and girls (VAWG).\u201d<\/p>\n

OpenAI says its usage policies prohibit using any OpenAI service for exploiting, endangering or sexualising anyone under 18, and that the company strictly prohibits the use of its services for any non-consensual intimate content or sexual violence, or to use another person\u2019s likeness without their consent.<\/p>\n

\u201cWe also care very much about the principle of treating adult users like adults,\u201d CEO Sam Altman posted on X in October. \u201cAs AI becomes more important in people’s lives, allowing a lot of freedom for people to use AI in the ways that they want is an important part of our mission.\u201d<\/p>\n

The company is liaising with Ofcom before the release of the new feature.<\/p>\n

Photograph by Jonathan Raa\/NurPhoto\/Getty Images<\/p>\n","protected":false},"excerpt":{"rendered":"The UK is hoping to build an \u00adinformal \u201ccoalition of decency\u201d in its response to Grok and X…\n","protected":false},"author":2,"featured_media":364075,"comment_status":"","ping_status":"","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[3],"tags":[733,7503,995,59,57,58,50,56,54,55,35312],"class_list":["post-364074","post","type-post","status-publish","format-standard","has-post-thumbnail","category-united-kingdom","tag-artificial-intelligence","tag-children","tag-elon-musk","tag-gb","tag-great-britain","tag-greatbritain","tag-news","tag-uk","tag-united-kingdom","tag-unitedkingdom","tag-x"],"_links":{"self":[{"href":"https:\/\/www.newsbeep.com\/uk\/wp-json\/wp\/v2\/posts\/364074","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.newsbeep.com\/uk\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.newsbeep.com\/uk\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.newsbeep.com\/uk\/wp-json\/wp\/v2\/users\/2"}],"replies":[{"embeddable":true,"href":"https:\/\/www.newsbeep.com\/uk\/wp-json\/wp\/v2\/comments?post=364074"}],"version-history":[{"count":0,"href":"https:\/\/www.newsbeep.com\/uk\/wp-json\/wp\/v2\/posts\/364074\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/www.newsbeep.com\/uk\/wp-json\/wp\/v2\/media\/364075"}],"wp:attachment":[{"href":"https:\/\/www.newsbeep.com\/uk\/wp-json\/wp\/v2\/media?parent=364074"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.newsbeep.com\/uk\/wp-json\/wp\/v2\/categories?post=364074"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.newsbeep.com\/uk\/wp-json\/wp\/v2\/tags?post=364074"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}