Anadolu/Anadolu Agency via Getty Images
2026-01-16T21:51:30.765Z
Share
Email
X
Bluesky
Threads
lighning bolt icon
An icon in the shape of a lightning bolt.
Impact Link
Save
Saved
Read in app
This story is available exclusively to Business Insider
subscribers. Become an Insider
and start reading now.
Have an account? Log in.
California sent xAI a cease-and-desist letter, demanding that it prevent the allowance of deepfake images of minors.
Elon Musk’s xAI faces sustained criticism over allegations that Grok is creating nonconsensual sexualized images.
The letter, sent by AG Rob Bonta, threatens legal action if the deepfakes are not stopped.
California Attorney General Rob Bonta has demanded that xAI prevent its chatbot, Grok, from creating sexualized deepfake images of children.
Bonta’s office sent a cease-and-desist letter to Elon Musk’s AI startup on Friday after sustained criticism over the bot’s ability to create nonconsensual sexualized images, including those of minors.
The letter demanded that xAI prevent Grok from creating sexualized images of people who did not request the image be made, or were minors when the image was created. Failure to stop such images from being created or distributed would be considered a violation of the state’s revenge porn, child pornography, unlawful recording, and unfair business practice statutes, the letter states.
xAI was given until January 20 at 5 p.m. to comply with the order.
Earlier this week, social media platform X, which is owned by xAI, said that it implemented restrictions on Grok.
“We have implemented technological measures to prevent the Grok account from allowing the editing of images of real people in revealing clothing such as bikinis,” X’s safety account said in a blog post on the platform on Wednesday. “This restriction applies to all users, including paid subscribers.”
However, that didn’t stop the X or Grok app from creating sexualized images, Business Insider’s Henry Chandonnet found on Thursday.
Representatives for the CA Attorney General’s office did not immediately respond to requests for comment from Business Insider.
In an automated response to Business Insider, xAI said, “Legacy Media Lies.”
This is a developing story. Please check back for updates.