When Ashley St. Clair asked Grok, the generative artificial intelligence reply bot built into the X platform, to stop creating sexually suggestive pictures of her, Grok said it would stop. <\/p>\n
But it didn\u2019t. Since then, St. Clair, known as a high-profile conservative content creator who has a child with X\u2019s owner, Elon Musk, said she has seen Grok generate numerous other images of her, some based on photos from when she was a minor.<\/p>\n
Grok \u201cstated that it would not be producing any more of these images of me, and what ensued was countless more images produced by Grok at user requests that were much more explicit, and eventually, some of those were underage,\u201d St. Clair said. \u201cPhotos of me of 14 years old, undressed and put in a bikini.\u201d<\/p>\n
The introduction in December of an image editing feature in Grok has sparked intense scrutiny as people have used it to generate a wave of images depicting women and children<\/a> with their clothes removed down to highly revealing swimsuits or underwear. St. Clair is one of many women whose photos have been altered by Grok, with some turned into sexualized videos.<\/p>\n On Saturday, Musk wrote, \u201cAnyone using Grok to make illegal content will suffer the same consequences as if they upload illegal content,\u201d in response to another user\u2019s post defending Grok<\/a> from criticism over the controversy. X\u2019s safety account also posted<\/a> that it would be removing posts, as well as \u201cpermanently suspending accounts, and working with local governments and law enforcement as necessary\u201d to address the issue. <\/p>\n The tool allows users to prompt Grok to adjust any image uploaded to the platform by any user by using AI prompts. In a nonsexual example posted Sunday<\/a>, a user prompted Grok to insert a swastika onto an image of a surrealist, crying face.But a scroll through Grok\u2019s replies shows that overwhelmingly, Grok\u2019s ability to remove or alter clothes from images has become the prominent meme for the tool.<\/p>\n xAI, the company that created Grok and now owns X, didn\u2019t respond to a request for comment addressing St. Clair\u2019s statements. Musk didn\u2019t respond to a request for comment.<\/p>\n St. Clair, best known for her fiery online commentary, began posting about the issue Sunday after a friend brought it to her attention, she said in an interview Monday.<\/p>\n St. Clair said that in the first post she saw, a user asked Grok to put her in a bikini. She said that when she asked Grok to remove the post and told it she didn\u2019t consent to the image, it replied that the post was \u201chumorous.\u201d<\/a> From there, the posts only got worse, she said. More people began prompting Grok to create sexualized deepfakes of her, and some of the deepfakes were turned into videos. NBC News has reviewed a selection of the images.<\/p>\n Many of the images remained online Monday evening, though some accounts that made the requests to Grok have been suspended and the images have been removed.<\/p>\n Ofcom, which regulates communications industries in the United Kingdom, said Monday<\/a> that it is \u201caware of serious concerns raised about a feature on Grok on X that produces undressed images of people and sexualised images of children\u201d and that it \u201cmade urgent contact with X and xAI to understand what steps they have taken to comply with their legal duties to protect users in the UK.\u201d<\/p>\n The use of generative AI to create realistic images has exploded in recent years and along with it growing outcry over using such programs to create sexually explicit images and videos of real people, often called deepfakes. Many platforms have instituted rules against creating or posting fake, sexualized images of people without their consent. Musk has embraced using AI to create sexually charged content<\/a>, integrating a sexualized \u201cspicy\u201d mode into text chats and conversations with Grok \u201ccompanions.\u201d<\/p>\n xAI\u2019s policy states that it forbids users to create content that sexualizes children<\/a> but doesn\u2019t have rules against generating sexual images of adults. But it\u2019s not clear that xAI\u2019s policies were implemented in the guardrails imposed on the new image editing feature. <\/p>\n Last week, after the rollout of that update, users quickly began asking the bot to generate lewd images, like the ones depicting St. Clair. While many inappropriate images that Grok has posted have been taken down, Grok continues to produce sexualized images of nonconsenting parties, including children, according to an NBC News review of Grok\u2019s output. xAI and Musk didn\u2019t respond to a request for comment.<\/p>\n St. Clair said one user asked Grok to produce a sexually explicit video of her based on a photo that included her son\u2019s backpack. \u201cMy toddler\u2019s backpack was in the background. The backpack he wears to school every day. And I had to wake up and watch him put that on his back and walk into school,\u201d she said. <\/p>\n St. Clair told NBC News she has \u201clost count\u201d of how many AI-generated images of herself she has seen in the past few days. She added that she believes Musk has \u201cprobably seen it\u201d but that she has \u201czero desire\u201d to reach out to him personally. \u201cI don\u2019t think that would be right for me to handle this with resources not available to the countless other women and children this has been happening to, so I have been going through the primary resources available to everyone else,\u201d she said.<\/p>\n As controversy around the feature has continued, Musk has celebrated other images edited by Grok, such as one of a toaster in a bikini, and has shared numerous posts over the last week celebrating Grok\u2019s latest update and its image-generation capabilities. <\/p>\n As the AI-altered images continue to circulate online, government and advocacy groups have begun drawing attention to the issue. <\/p>\n Politico reported<\/a> that the French authorities would be investigating X over the creation of nonconsensual deepfakes using Grok on the platform, adding to a previous investigation into the platform following the chatbot\u2019s antisemitic posts in November.Over the last several years, X has appeared to step away from many content moderation practices used to police objectionable content.<\/p>\n In June, Thorn, a California-based nonprofit organization that works with tech companies to provide technology that can detect and address child sexual abuse content, told NBC News that it had terminated its contract with X after the platform stopped paying invoices for Thorn\u2019s work. X said it was moving forward with its own technology to detect and address child sexual abuse material, but in the wake of the contract termination, NBC News observed<\/a> a surge in seemingly automated X accounts flooding hashtags with hundreds of posts per hour advertising the sale of the illegal material.<\/p>\n Fallon McNulty, the executive director of the exploited children division at the National Center for Missing & Exploited Children, told NBC News that NCMEC has been receiving reports over the past few days from members of the public about posts circulating on X that have been created with Grok.<\/p>\n She said xAI is usually \u201con par with some of the other AI companies\u201d when it comes to reporting to NCMEC\u2019s CyberTipline. From 2023 to 2024, X\u2019s reports increased by 150%, according to NCMEC\u2019s reports.<\/p>\n \u201cWhat is so concerning is how accessible and easy to use this technology is. When it is coming from a large platform, it almost serves to normalize something, and it certainly reaches a wider audience, which is similarly very concerning,\u201d McNulty said. \u201cBut again, without those proper safeguards in place, it is so alarming the ease at which an offender can access this type of tech and create that imagery that\u2019s going to be harmful to children and to survivors.\u201d<\/p>\n St. Clair said the issue raised larger concerns for her about AI\u2019s being a male-dominated industry serving other male-dominated industries. \u201cWhen you\u2019re building an LLM [large language model], especially one that has contracts with the government, and you\u2019re pushing women out of the dialog, you\u2019re creating a model and a monster that\u2019s going to be inherently biased towards men. Absolutely,\u201d she said, referring to potential reasons xAI has struggled to address the issue.<\/p>\n She thinks the only way to address the issue is for other members of the AI community speak out against it. \u201cThe pressure needs to come from the AI industry itself, because they\u2019re only going to regulate themselves if they speak out. They\u2019re only going to do something if the other gatekeepers of capital are the ones to speak out on this.\u201d<\/p>\n","protected":false},"excerpt":{"rendered":"When Ashley St. Clair asked Grok, the generative artificial intelligence reply bot built into the X platform, to…\n","protected":false},"author":2,"featured_media":219829,"comment_status":"","ping_status":"","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[32],"tags":[430,156,111,139,69],"class_list":{"0":"post-219828","1":"post","2":"type-post","3":"status-publish","4":"format-standard","5":"has-post-thumbnail","7":"category-celebrities","8":"tag-celebrities","9":"tag-entertainment","10":"tag-new-zealand","11":"tag-newzealand","12":"tag-nz"},"_links":{"self":[{"href":"https:\/\/www.newsbeep.com\/nz\/wp-json\/wp\/v2\/posts\/219828","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.newsbeep.com\/nz\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.newsbeep.com\/nz\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.newsbeep.com\/nz\/wp-json\/wp\/v2\/users\/2"}],"replies":[{"embeddable":true,"href":"https:\/\/www.newsbeep.com\/nz\/wp-json\/wp\/v2\/comments?post=219828"}],"version-history":[{"count":0,"href":"https:\/\/www.newsbeep.com\/nz\/wp-json\/wp\/v2\/posts\/219828\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/www.newsbeep.com\/nz\/wp-json\/wp\/v2\/media\/219829"}],"wp:attachment":[{"href":"https:\/\/www.newsbeep.com\/nz\/wp-json\/wp\/v2\/media?parent=219828"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.newsbeep.com\/nz\/wp-json\/wp\/v2\/categories?post=219828"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.newsbeep.com\/nz\/wp-json\/wp\/v2\/tags?post=219828"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}