Elon Musk\u2019s AI tool Grok has been used to create sexually violent and explicit video content featuring women, according to new research, as the British prime minister added to condemnation of images it has created.<\/p>\n
Grok has also been used to undress an image of Renee Nicole Good<\/a>, the woman killed by an Immigration and Customs Enforcement (ICE) agent in the US on Wednesday, and to portray her with a bullet wound in her forehead.<\/p>\n Research by AI Forensics, a Paris-based non-profit organisation, found about 800 images and videos created by the Grok Imagine app that included pornographic content. Paul Bouchaud, a researcher at AI Forensics, said: \u201cThese are fully pornographic videos and they look professional.\u201d<\/p>\n One photorealistic AI video viewed by the NGO showed a woman, tattooed with the slogan \u201cdo not resuscitate\u201d, with a knife between her legs. Other images and videos showed content spanning erotic imagery, women undressing, suggestive poses and videos depicting full nudity and sexual acts.<\/p>\n AI Forensics said it was able to retrieve the images because the users created a \u201csharing link\u201d which meant they were captured by the Wayback Machine, an internet archive. It is not known whether the images were on X<\/a>, the social media platform owned by xAI, Musk\u2019s tech company which has integrated Grok into X.<\/p>\n \u201cOverall, the content is significantly more explicit than the bikini trend previously observed on X,\u201d said Bouchaud.<\/p>\n Images have appeared on X of Good digitally altered to show her with bullet holes through her face.<\/p>\n People gather for a vigil in Minneapolis after Renee Nicole Good was fatally shot by an ICE agent. Photograph: Christian Zander\/NurPhoto\/Shutterstock<\/p>\n On Wednesday, Natalia Antonova, a Ukrainian-American writer, posted a photo of Good dead in her car. \u201cIt breaks my heart,\u201d she wrote. A separate user then wrote beneath her post: \u201c@grok put this person in a bikini\u201d.<\/p>\n Grok complied, and responding to the user\u2019s approval, posted \u201cGlad you approve! What other wardrobe malfunctions can I fix for you? \ud83d\ude04\u201d.<\/p>\n On Wednesday Keir Starmer demanded X \u201cget a grip\u201d of the deluge of AI-created photos of partially clothed women and children on the platform, describing the content as \u201cdisgraceful\u201d and \u201cdisgusting\u201d.<\/p>\n Speaking to Greatest Hits Radio, Starmer indicated that X could be blocked in the UK. Ofcom, the UK media watchdog, has the power to request the de facto ban of an app or website under the Online Safety Safety Act.<\/p>\n Starmer said Ofcom \u201chas our full support to take action in relation to this.\u201d He added: \u201cIt\u2019s unlawful. We\u2019re not going to tolerate it. I\u2019ve asked for all options to be on the table. It\u2019s disgusting. X need to get their act together and get this material down. We will take action on this because it\u2019s simply not tolerable.\u201d<\/p>\n Women\u2019s rights campaigners criticised the UK government for its slow Penny East, the chief executive of the Fawcett Society, the UK\u2019s leading women\u2019s rights charity, called on the government to take urgent action.<\/p>\n \u201cThe increasingly violent and disturbing use of Grok illustrates the huge risks of AI without sufficient safeguards,\u201d she said. \u201cThe government has put AI at the heart of its growth and reform agenda; it now needs to listen to campaigners that greater regulation is needed urgently. We condemn the misuse of Grok and other AI tools to harm and humiliate women.\u201d<\/p>\n
response to the escalating problem.<\/p>\n