SACRAMENTO, Calif. — California is stepping up digital safety, becoming the first state in the nation to implement certain protections on social media and artificial intelligence platforms — a move aimed at keeping children and other users safe online.
Governor Gavin Newsom signed more than 10 bills into law over the weekend, each focused on addressing online dangers that evolve faster than technology laws can keep up.
“There are problems that remain around technology because technology moves faster than the law,” said Sen. Angelique Ashby (D-Sacramento).
Local law enforcement leaders say they’ve seen that firsthand and applauded legislators over these “first steps.”
“The predators are out there,” said Sgt. Amar Gandhi, spokesperson for the Sacramento County Sheriff’s Office. “They evolve much faster than law enforcement does, so law enforcement is always playing catch-up to some of these tactics, and the legislators [are] playing catch-up on that.”
Among the new laws is Senate Bill 243, authored by Sen. Steve Padilla (D-San Diego), which targets AI companion chatbots. Padilla said some users have formed emotional attachments to bots, believing they were interacting with real people.
“There have been tragic cases with users who really believed they were interacting with a human being who was capable of empathy and understanding,” Padilla said. “If a conversation goes where it should not go, that is flagged, and connections to professional help and assistance to parents is made available.”
The bill follows a reported case in Florida, where a 14-year-old died by suicide after forming an emotional and sexual relationship with a chatbot.
And the parents of a 16-year-old in Orange County who died by suicide are suing OpenAI, the company behind ChatGPT, for assisting with taking his own life.
Under SB 243, AI systems must include reminders that users are talking to bots, not humans.
Another measure, SB 50, authored by Ashby, focuses on protecting domestic violence survivors from digital harassment and monitoring.
“When you separate that relationship, whether you do it through the court or a restraining order or even through a therapist, there are problems that remain around technology,” Ashby said.
She said abusers can still gain access through shared digital accounts — from bank apps to streaming services to smart doorbells. Under SB 50, once documentation of abuse is submitted, tech platforms have two days to remove the abuser’s access.
“The person would no longer be able to use that site or that app,” Ashby said. “Whatever the individual is using as the platform for abuse, they would not be able to access that particular individual anymore.”
Gandhi said education remains critical: “It’s up to parents, it’s up to the guardians, the grandparents, and everybody else. Make these kids aware that sometimes, who you’re talking to is not who you think they are.”
A few senators voted against SB 243, citing vague language in the bill.
On tips for families, Sgt. Gandhi emphasized, “It’s up to parents, it’s up to the guardians, the grandparents, and everybody else. Make these kids aware that again, sometimes who you’re talking to is not who you think they are.”
He added, “Really, it’s an open relationship with your kids. You’ve got to have that big line of communication and talking to them, making sure they’re comfortable telling you that maybe they did mess up, but being comfortable enough to go, hey mom, dad, I messed up.”
Watch more: California lawmakers push AI safety bill after teen’s suicide
ABC10: Watch, Download, Read