As the mother of a teen boy who killed himself after using a chatbot, Maria Raine said she was dealing with constant grief. <\/p>\n
\u201cThe loss never gets easier,\u201d she said, \u201cbut I have to advocate for him.\u201d<\/p>\n
So on Monday, she spoke before a crowd of reporters with the goal of regulating the human-like computer programs in whom her son once confided.<\/p>\n
\u201cWe need to have guardrails on these products,\u201d Raine said at the news conference Monday in Sacramento.<\/p>\n
The legislation, Assembly Bill 2023<\/a> and state Senate Bill 1119<\/a>, would require operators of so-called companion chatbots to perform and document a comprehensive risk assessment each year to identify hazards to minors posed by the product\u2019s design or configuration. Operators would submit to an independent audit of their compliance with those provisions, and the auditor would send a report to the attorney general. The bills would authorize public prosecutors to enforce the measure with civil actions. <\/p>\n A companion chatbot is a computer program that simulates human conversations to provide users with entertainment or emotional support. It can also retrieve and summarize information, and many students use the technology to help with studying or schoolwork. <\/p>\n \u201cThis technology is relatively new, but both anecdotal and scholarly evidence continues to show that the impacts of these interactions between chatbots and users, particularly youth, can be extremely dangerous,\u201d said state Sen. Steve Padilla (D-Chula Vista), who introduced the bills along with Assemblymembers Rebecca Bauer-Kahan (D-Orinda) and Buffy Wicks (D-Oakland). <\/p>\n \u201cCompanion chatbots do not have the same capacity for empathy as a human being,\u201d Padilla said, \u201cand yet the nature of the technology can create this perception.\u201d<\/p>\n The legislation also would require operators to provide a \u201cclear referral\u201d to crisis resources if a minor has expressed suicidal ideation or the intent to self-harm. If that child\u2019s account is linked to a parent\u2019s account, it would direct operators to notify the parent within 24 hours. <\/p>\n