There is tremendous confusion about what happens to be true on Grok at any given moment. Grok has offered responses with misleading details, claiming at one point, for instance, that it had restricted image generation<\/a> to paying X subscribers while still allowing direct access on X to free users. Though Musk has claimed that new guardrails prevent Grok from undressing people, our testing showed that isn\u2019t necessarily true<\/a>. Using a free account on Grok, The Verge was able to generate deepfake images of real people in skimpy clothing, in sexually suggestive positions, after new rules were supposedly in effect. As of this writing, some egregious prompts appear to have been blocked, but people are remarkably clever at getting around rules-based bans.<\/p>\n In the past, payment providers have been aggressive about cutting access to websites thought to have a significant presence of CSAM<\/p>\n X does seem to have at least partially restricted Grok\u2019s image editing features to paid subscribers, however \u2014 which makes it very likely that for at least some of these objectionable images, money is actually changing hands. You can purchase a subscription to X on Stripe or through the Apple and Google app stores using your credit card. Musk has also suggested<\/a> through his posts<\/a> that he doesn\u2019t think undressing people is a problem. This isn\u2019t X\u2019s first brush with AI porn, either \u2014 it\u2019s repeatedly had a problem moderating nude deepfakes of Taylor Swift<\/a>, whether or not they are generated by Grok<\/a>.<\/p>\n In the past, payment providers have been aggressive about cutting access to websites thought to have a significant presence of CSAM \u2014 or even legal, consensually produced sexual content. In 2020, Mastercard and Visa banned Pornhub<\/a> after a New York Times article noted the prevalence of CSAM on the platform<\/a>. In May 2025, Civitai was cut off by its credit card processor<\/a> because \u201cthey do not wish to support platforms that allow AI-generated explicit content,\u201d Civitai CEO Justin Maier told 404 Media. In July 2025, payment processors pressured Valve into removing adult games<\/a>.<\/p>\n In fact, at times financial institutions have threatened people and platforms because it seems like they didn\u2019t want reputational risk. In 2014, adult performer Eden Alexander\u2019s fundraiser for a hospital stay<\/a> was shut down by payments company WePay because of a retweet. Also in 2014, JPMorganChase abruptly shut down several porn stars\u2019 bank accounts<\/a>. In 2021, OnlyFans briefly tried to ban sexually explicit content<\/a> because banks didn\u2019t like it. (Widespread backlash to the move quickly made OnlyFans reverse itself<\/a>.) This is legal, consensual sexual content \u2014 and it was deemed too hot to handle.<\/p>\n \u201cThe industry is no longer willing to self-regulate for something as universally agreed on as the most abhorrent thing out there.\u201d<\/p>\n But Musk\u2019s boutique revenge porn and CSAM generator is, apparently, just fine.<\/p>\n It\u2019s a striking reversal. \u201cThe industry is no longer willing to self-regulate for something as universally agreed on as the most abhorrent thing out there,\u201d which is CSAM, says Lana Swartz, the author of New Money: How Payment Became Social Media, of the inaction by Stripe and the credit card companies.<\/p>\n Visa, Mastercard, American Express, Stripe, and Discover did not return requests for comment. The US Financial Coalition Against Child Sexual Exploitation \u2014 an industry group composed of payments processors, banks, and credit card companies \u2014 also did not return a request for comment. On its website, FCACSE brags that \u201cAs a result of its efforts, the use of credit cards to purchase child sexual abuse content online has been virtually eliminated globally.\u201d<\/p>\n Sexualized images of children are not the only problem with Grok\u2019s image generation<\/p>\n In the past, \u201cpeople who did completely legal stuff were cut off from banks,\u201d notes Riana Pfefferkorn, a policy fellow at the Stanford Institute for Human-Centered Artificial Intelligence. There are incentives to overenforce boundaries around questionable images \u2014 and traditionally, that\u2019s what the financial industry has done. So why is X different? It\u2019s run by Elon Musk. \u201cHe\u2019s the richest man in the world, he has close ties to the US government, and he\u2019s incredibly litigious,\u201d says Pfefferkorn. In fact, Musk has previously filed suit against the Center for Countering Digital Hate; in a now-dismissed lawsuit, he claimed it illegally collected data<\/a> showing an increase in hate speech after he bought the platform formerly known as Twitter.<\/p>\n Sexualized images of children are not the only problem with Grok\u2019s image generation. The New York Times estimated that 1.8 million images the AI generated in a nine-day time period, or about 44 percent of posts, were sexualized images of adult women \u2014 which, depending on how explicit they are, can also be illegal to spread. Using different tools, the Center for Countering Digital Hate estimated that more than half of Grok\u2019s images contained sexualized imagery of men, women, and children.<\/p>\n The explosion of sexualized images took place after Musk posted an AI-edited image of himself in a bikini on December 31st. A week later, X\u2019s head of product, Nikita Bier, posted<\/a> that the previous four days were also the highest-engagement days on X ever.<\/p>\n Lawyer Carrie Goldberg, whose history includes challenging Section 230 in a stalking lawsuit against Grindr<\/a> and another suit that ultimately shut down chat client Omegle<\/a>, is representing Ashley St. Clair, the mother of one of Musk\u2019s children, in a case against X. St. Clair is one of many women Grok undressed \u2014 and now she\u2019s suing the platform<\/a>, arguing that X has created a public nuisance. \u201cIn the St. Clair case we are only focused on xAI and Grok because they are so directly liable from our perspective,\u201d she said in an email. \u201cBut I could envision other sources of liability.\u201d She specifically cited distributors like Apple and Google\u2019s app stores<\/a> as areas of interest.<\/p>\n \u201cA lot of this could end up in court, and it\u2019s going to be up to judges to make decisions about what\u2019s \u2018sexually explicit.\u2019\u201d<\/p>\n There are other potential legal wrinkles. In 2022, Visa was sued for offering payment services to Pornhub<\/a>, because allegedly Visa knew Pornhub wasn\u2019t adequately moderating CSAM. Other lawsuits followed<\/a>. While the judge in the Visa case rejected the claim that Pornhub wasn\u2019t liable because of Section 230, he also tentatively dismissed the claims against Visa in 2025<\/a>, though the woman who filed suit could file an amended complaint<\/a>.<\/p>\n \u201cA lot of this could end up in court, and it\u2019s going to be up to judges to make decisions about what\u2019s \u2018sexually explicit,\u2019\u201d says David Evan Harris, a public scholar at the University of California, Berkeley. Still, 45 states have criminalized AI-generated CSAM<\/a>. The federal Take It Down Act criminalizes deepfake nudes<\/a>. The state of California has issued a cease and desist to Musk and X<\/a>, after announcing an investigation into Grok\u2019s images. Grok may be violating California\u2019s deepfake porn ban<\/a> \u2014 and California is just one of at least 23 states that have passed such laws<\/a>.<\/p>\n That should matter to payment processors, because if they are knowingly transmitting money that\u2019s the proceeds of a crime, they are engaged in money laundering \u2014 which can have serious consequences. The office of California Attorney General Rob Bonta declined to comment on whether Stripe, credit cards, or the app stores were also part of the Grok probe, citing an ongoing investigation. Money laundering laws are part of the reason financial institutions have been so leery of any website that\u2019s been accused of containing CSAM.<\/p>\n But X has created a situation where payment processors are hugely disincentivized to take the law seriously. That\u2019s because any state that files suit against processors over X is likely to be attacked by Musk for \u201ccensoring\u201d X\u2019s right-wing base. Plus, Musk \u2014 and possibly his buddy, US President Donald Trump \u2014 could throw a lot of resources behind getting payment processors off the hook.<\/p>\n It seems when it comes to CSAM and deepfakes, the financial industry is no longer willing to regulate itself. So, then, who will regulate it?<\/p>\n Follow topics and authors from this story to see more like this in your personalized homepage feed and to receive email updates.Elizabeth LopattoClose Elizabeth Lopatto<\/p>\n Posts from this author will be added to your daily email digest and your homepage feed.<\/p>\n FollowFollow<\/p>\n See All by Elizabeth Lopatto<\/a><\/p>\n AIClose<\/p>\n AI<\/p>\n Posts from this topic will be added to your daily email digest and your homepage feed.<\/p>\n FollowFollow<\/p>\n See All AI<\/a><\/p>\n BusinessClose<\/p>\n Business<\/p>\n Posts from this topic will be added to your daily email digest and your homepage feed.<\/p>\n FollowFollow<\/p>\n See All Business<\/a><\/p>\n ReportClose<\/p>\n Report<\/p>\n Posts from this topic will be added to your daily email digest and your homepage feed.<\/p>\n FollowFollow<\/p>\n See All Report<\/a><\/p>\n TechClose<\/p>\n Tech<\/p>\n Posts from this topic will be added to your daily email digest and your homepage feed.<\/p>\n FollowFollow<\/p>\n See All Tech<\/a><\/p>\n Twitter – XClose<\/p>\n Twitter – X<\/p>\n Posts from this topic will be added to your daily email digest and your homepage feed.<\/p>\n FollowFollow<\/p>\n![\"Elizabeth](\"https:\/\/www.newsbeep.com\/us\/wp-content\/uploads\/2026\/01\/ELIZABETH_LOPATTO.0.jpg\"\/)
<\/p>\n