{"id":76683,"date":"2025-10-13T23:43:15","date_gmt":"2025-10-13T23:43:15","guid":{"rendered":"https:\/\/www.newsbeep.com\/nz\/76683\/"},"modified":"2025-10-13T23:43:15","modified_gmt":"2025-10-13T23:43:15","slug":"california-enacts-first-us-law-requiring-ai-chatbot-safety-measures","status":"publish","type":"post","link":"https:\/\/www.newsbeep.com\/nz\/76683\/","title":{"rendered":"California enacts first US law requiring AI chatbot safety measures"},"content":{"rendered":"<p class=\"iNwUpnfLcxPBLSL\" style=\"display:none\">Padilla referred to recent teen suicides including that of the 14-year-old son of Florida mother Megan Garcia.<\/p>\n<p class=\"iNwUpnfLcxPBLSL\" style=\"display:none\">Megan Garcia\u2019s son, Sewell, had fallen in love with a Game of Thrones-inspired chatbot on Character.AI, a platform that allows users \u2013 many of them young people \u2013 to interact with beloved characters as friends or lovers.<\/p>\n<p class=\"iNwUpnfLcxPBLSL\" style=\"display:none\">When Sewell struggled with suicidal thoughts, the chatbot urged him to \u201ccome home\u201d.<\/p>\n<p class=\"iNwUpnfLcxPBLSL\" style=\"display:none\">Seconds later, Sewell shot himself with his father\u2019s handgun, according to the lawsuit Garcia filed against Character.AI.<\/p>\n<p class=\"iNwUpnfLcxPBLSL\" style=\"display:none\">\u201cToday, California has ensured that a companion chatbot will not be able to speak to a child or vulnerable individual about suicide, nor will a chatbot be able to help a person to plan his or her own suicide,\u201d Garcia said of the new law.<\/p>\n<p class=\"iNwUpnfLcxPBLSL\" style=\"display:none\">\u201cFinally, there is a law that requires companies to protect their users who express suicidal ideations to chatbots.\u201d<\/p>\n<p class=\"iNwUpnfLcxPBLSL\" style=\"display:none\">National rules aimed at curbing AI risks do not exist in the United States, with the White House seeking to block individual states from creating their own.<\/p>\n<p class=\"iNwUpnfLcxPBLSL\" style=\"display:none\">The new California law sets guardrails that include reminding users that chatbots are AI-generated and mandating that people who express thoughts of self-harm or suicide be referred to crisis service providers.<\/p>\n<p class=\"iNwUpnfLcxPBLSL\" style=\"display:none\">\u201cThis law is an important first step in protecting kids and others from the emotional harms that result from AI companion chatbots which have been unleashed on the citizens of California without proper safeguards,\u201d said Jai Jaisimha, co-founder of Transparency Coalition nonprofit group devoted to the safe development of the technology.<\/p>\n<p>Creators accountable <\/p>\n<p class=\"iNwUpnfLcxPBLSL\" style=\"display:none\">The landmark chatbot safety measure was among a slew of bills signed into law  crafted to prevent AI platforms from doing harm to users.<\/p>\n<p class=\"iNwUpnfLcxPBLSL\" style=\"display:none\">New legislation included a ban on chatbots passing themselves off as healthcare professionals and making it clear that those who create or use AI tools are accountable for the consequences and can\u2019t dodge liability by claiming the technology acted autonomously, according to Newsom\u2019s office.<\/p>\n<p class=\"iNwUpnfLcxPBLSL\" style=\"display:none\">California also ramped up penalties for deepfake porn, allowing victims to seek as much as US$250,000 ($436,262.50) per infraction from those who aid in distribution of nonconsensual sexually explicit material.<\/p>\n<p class=\"iNwUpnfLcxPBLSL\" style=\"display:none\">-Agence France-Presse<\/p>\n","protected":false},"excerpt":{"rendered":"Padilla referred to recent teen suicides including that of the 14-year-old son of Florida mother Megan Garcia. Megan&hellip;\n","protected":false},"author":2,"featured_media":76684,"comment_status":"","ping_status":"","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[20],"tags":[365,9556,363,364,179,9473,4035,59796,59794,1888,32954,71,44661,25807,10053,9557,296,8307,12514,546,111,58148,139,69,15400,59795,29511,6302,31706,9100,145,59797,3040,16550],"class_list":["post-76683","post","type-post","status-publish","format-standard","has-post-thumbnail","category-artificial-intelligence","tag-ai","tag-artificial","tag-artificial-intelligence","tag-artificialintelligence","tag-california","tag-chatbot","tag-chatbots","tag-defying","tag-enacts","tag-first","tag-firstofitskind","tag-from","tag-gavin","tag-governor","tag-house","tag-intelligence","tag-into","tag-law","tag-leave","tag-measures","tag-new-zealand","tag-newsom","tag-newzealand","tag-nz","tag-push","tag-regulating","tag-requiring","tag-safety","tag-signed","tag-such","tag-technology","tag-unchecked","tag-us","tag-white"],"_links":{"self":[{"href":"https:\/\/www.newsbeep.com\/nz\/wp-json\/wp\/v2\/posts\/76683","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.newsbeep.com\/nz\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.newsbeep.com\/nz\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.newsbeep.com\/nz\/wp-json\/wp\/v2\/users\/2"}],"replies":[{"embeddable":true,"href":"https:\/\/www.newsbeep.com\/nz\/wp-json\/wp\/v2\/comments?post=76683"}],"version-history":[{"count":0,"href":"https:\/\/www.newsbeep.com\/nz\/wp-json\/wp\/v2\/posts\/76683\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/www.newsbeep.com\/nz\/wp-json\/wp\/v2\/media\/76684"}],"wp:attachment":[{"href":"https:\/\/www.newsbeep.com\/nz\/wp-json\/wp\/v2\/media?parent=76683"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.newsbeep.com\/nz\/wp-json\/wp\/v2\/categories?post=76683"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.newsbeep.com\/nz\/wp-json\/wp\/v2\/tags?post=76683"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}