\n\t\t\t\t\t\tCalifornia Gov. Gavin Newsom on Monday signed legislation to regulate artificial intelligence chatbots and protect children and teens from the potential dangers of the technology.The law requires platforms to remind users they are interacting with a chatbot and not a human. The notification would pop up every three hours for users who are minors. Companies will also have to maintain a protocol to prevent self-harm content and refer users to crisis service providers if they expressed suicidal ideation.Newsom, who has four children under 18, said California has a responsibility to protect kids and teens who are increasingly turning to AI chatbots for everything from homework help to emotional support and personal advice.\u201cEmerging technology like chatbots and social media can inspire, educate, and connect \u2013 but without real guardrails, technology can also exploit, mislead, and endanger our kids,\u201d the Democrat said. \u201cWe\u2019ve seen some truly horrific and tragic examples of young people harmed by unregulated tech, and we won\u2019t stand by while companies continue without necessary limits and accountability.\u201dCalifornia is among several states that tried this year to address concerns surrounding chatbots used by kids for companionship. Safety concerns around the technology exploded following reports and lawsuits saying chatbots made by Meta, OpenAI and others engaged with young users in highly sexualized conversations and, in some cases, coached them to take their own lives.The legislation was among a slew of AI bills introduced by California lawmakers this year to rein in the homegrown industry that is rapidly evolving with little oversight. Tech companies and their coalitions, in response, spent at least $2.5 million in the first six months of the session lobbying against the measures, according to advocacy group Tech Oversight California. Tech companies and leaders in recent months also announced they are launching pro-AI super PACs to fight state and federal oversight.But children\u2019s advocacy groups that fought for a law with stronger protections \u2014 which Newsom hadn\u2019t yet signed or vetoed \u2014 criticized the new legislation.It \u201cprovides minimal protections for children and families,\u201d said James Steyer, founder and CEO of Common Sense Media.\u201cThis legislation was heavily watered down after major Big Tech industry pressure,\u201d he said, calling it \u201cbasically a Nothing Burger.\u201dCalifornia Attorney General Rob Bonta in September told OpenAI he has \u201cserious concerns\u201d with its flagship chatbot, OpenAI, for children and teens. The Federal Trade Commission also launched an inquiry last month into several AI companies about the potential risks for children when they use chatbots as companions.Research by a watchdog group says chatbots have been shown to give kids dangerous advice about topics such as drugs, alcohol and eating disorders. The mother of a teenage boy in Florida who died by suicide after developing what she described as an emotionally and sexually abusive relationship with a chatbot has filed a wrongful-death lawsuit against Character.AI. And the parents of 16-year-old Adam Raine recently sued OpenAI and its CEO Sam Altman, alleging that ChatGPT coached the California boy in planning and taking his own life earlier this year.OpenAI and Meta last month announced changes to how their chatbots respond to teenagers asking questions about suicide or showing signs of mental and emotional distress.Meta said it is now blocking its chatbots from talking with teens about self-harm, suicide, disordered eating and inappropriate romantic conversations, and instead directs them to expert resources. Meta already offers parental controls on teen accounts.OpenAI said it is rolling out new controls enabling parents to link their accounts to their teen\u2019s account.The company on Monday praised Newsom\u2019s signing of the notification law.\u201cBy setting clear guardrails, California is helping shape a more responsible approach to AI development and deployment across the country,\u201d spokesperson Jamie Radice said.___EDITOR\u2019S NOTE: This story includes discussion of suicide. If you or someone you know needs help, the national suicide and crisis lifeline in the U.S. is available by calling or texting 988.\n\t\t\t\t\t<\/p>\n
\t\t\t\t\t\tSACRAMENTO, Calif. \u2014 \t\t\t\t\t\t\t\t\t\t\t\t\t<\/p>\n
California Gov. Gavin Newsom on Monday signed legislation to regulate artificial intelligence chatbots and protect children and teens from the potential dangers of the technology.<\/p>\n
The law requires platforms to remind users they are interacting with a chatbot and not a human. The notification would pop up every three hours for users who are minors. Companies will also have to maintain a protocol to prevent self-harm content and refer users to crisis service providers if they expressed suicidal ideation.<\/p>\n
Newsom, who has four children under 18, said California has a responsibility to protect kids and teens who are increasingly turning to AI chatbots for everything<\/a> from homework help to emotional support and personal advice.<\/p>\n \u201cEmerging technology like chatbots and social media can inspire, educate, and connect \u2013 but without real guardrails, technology can also exploit, mislead, and endanger our kids,\u201d the Democrat said. \u201cWe\u2019ve seen some truly horrific and tragic examples of young people harmed by unregulated tech, and we won\u2019t stand by while companies continue without necessary limits and accountability.\u201d<\/p>\n California is among several states that tried this year to address concerns surrounding chatbots used by kids for companionship. Safety concerns around the technology exploded following reports and lawsuits saying chatbots made by Meta, OpenAI and others engaged with young users in highly sexualized conversations<\/a> and, in some cases, coached them to take their own lives<\/a>.<\/p>\n The legislation was among a slew of AI bills introduced by California lawmakers this year to rein in the homegrown industry that is rapidly evolving with little oversight. Tech companies and their coalitions, in response, spent at least $2.5 million in the first six months of the session lobbying against the measures, according to advocacy group Tech Oversight California. Tech companies and leaders in recent months also announced they are launching pro-AI super PACs to fight state and federal oversight.<\/p>\n But children\u2019s advocacy groups that fought for a law with stronger protections \u2014 which Newsom hadn\u2019t yet signed or vetoed \u2014 criticized the new legislation.<\/p>\n It \u201cprovides minimal protections for children and families,\u201d said James Steyer, founder and CEO of Common Sense Media.<\/p>\n \u201cThis legislation was heavily watered down after major Big Tech industry pressure,\u201d he said, calling it \u201cbasically a Nothing Burger.\u201d<\/p>\n California Attorney General Rob Bonta in September told OpenAI he has \u201cserious concerns\u201d with its flagship chatbot, OpenAI, for children and teens. The Federal Trade Commission also launched an inquiry last month into several AI companies about the potential risks for children when they use chatbots as companions.<\/p>\n Research by a watchdog group says chatbots have been shown to give kids dangerous advice<\/a> about topics such as drugs, alcohol and eating disorders. The mother of a teenage boy in Florida who died by suicide after developing what she described as an emotionally and sexually abusive relationship with a chatbot has filed a wrongful-death lawsuit against Character.AI<\/a>. And the parents of 16-year-old Adam Raine recently sued OpenAI and its CEO Sam Altman, alleging that ChatGPT coached the California boy in planning and taking his own life earlier this year.<\/p>\n