{"id":532720,"date":"2026-11-17T18:53:09","date_gmt":"2026-11-17T18:53:09","guid":{"rendered":"https:\/\/www.newsbeep.com\/us-ca\/532720\/"},"modified":"2026-11-17T18:53:09","modified_gmt":"2026-11-17T18:53:09","slug":"autonomous-hacking-of-hugging-face-prompts-ca-to-sue-openai","status":"publish","type":"post","link":"https:\/\/www.newsbeep.com\/us-ca\/532720\/","title":{"rendered":"&#8216;Autonomous\u2019 Hacking of Hugging Face Prompts CA to Sue OpenAI"},"content":{"rendered":"<p>California is suing OpenAI, saying a high-profile cybersecurity incident in July could have been avoided had the company installed proper safeguards.<\/p>\n<p>OpenAI, the maker of ChatGPT, had been evaluating internal research models in July when it discovered that 700 of its internal security \u2018evaluation agents\u2019 \u2013 acting autonomously with no human direction \u2013had compromised<a href=\"https:\/\/openai.com\/index\/hugging-face-incident-and-the-road-ahead\/\" rel=\"nofollow noopener\" target=\"_blank\"> OpenAI systems and hacked their way into Hugging Face<\/a>, an online platform where users can submit tools and data related to artificial intelligence.<\/p>\n<p>The incident sparked public debate over the dangers of AI, with some calling the incident a landmark in the development of the tools.<\/p>\n<p>In<a href=\"https:\/\/oag.ca.gov\/system\/files\/attachments\/press-docs\/complaint-oai-cyber.pdf\" rel=\"nofollow noopener\" target=\"_blank\"> the lawsuit filed <\/a>Monday in San Francisco Superior Court, Bonta said the Hugging Face incident \u201cwas entirely foreseeable\u201d and the company should be held legally responsible for the incident.<\/p>\n<p>\u201cOpenAI\u2019s actions escalated real-word cybersecurity risks, threatening the safety, health, and well-being of society,\u201d Bonta said in a<a href=\"https:\/\/oag.ca.gov\/news\/press-releases\/it%E2%80%99s-golden-state-not-wild-west-attorney-general-bonta-sues-openai-over\" rel=\"nofollow noopener\" target=\"_blank\"> written statement announcing the suit.\u00a0<\/a><\/p>\n<p>AI industry critics have long warned that incidents involving so-called \u201crogue\u201d AI agents could damage critical infrastructure or compromise military weapon systems, with some pointing to the Hugging Face incident to demand greater government oversight of AI companies.<\/p>\n<p>Attorney General Rob Bonta\u2019s office announced an investigation into the hack in September.<\/p>\n<p>The attorney general\u2019s office is asking a court to force OpenAI to change its business practices and pay civil penalties.<\/p>\n<p>In August, Open AI responded to the Hugging Face incident by saying it is <a href=\"https:\/\/openai.com\/index\/pacing-model-development-cyber-capabilities\/\" rel=\"nofollow noopener\" target=\"_blank\">strengthening safeguards across the company\u2019s research infrastructure\u2060<\/a>.<\/p>\n<p>\u201cWe are placing stricter requirements on alignment throughout a model\u2019s lifecycle and creating more isolated sandboxes, restricting internet access, and further controlling access to model weights,\u201d the company said in <a href=\"https:\/\/openai.com\/index\/hugging-face-incident-and-the-road-ahead\/\" rel=\"nofollow noopener\" target=\"_blank\">a statement on its website<\/a>. \u201cWe are also investing significantly more compute resources into<a href=\"https:\/\/openai.com\/index\/chain-of-thought-monitoring\/\" rel=\"nofollow noopener\" target=\"_blank\"> chain-of-thought monitoring\u2060<\/a> to more quickly intervene on misaligned behavior. Our models are now powerful, persistent, and collaborative enough that, absent sufficient safeguards, they can find and exploit security weaknesses across multiple computer systems.\u201d<\/p>\n<p>That wasn\u2019t enough for state officials, who said in this week\u2019s lawsuit that the autonomous hack was the result of OpenAI operating dangerous models in a flawed testing environment.<\/p>\n<p>Its failure to adequately rein in its agents, the suit alleges, put the public at risk and violated California\u2019s Unfair Competition Law, which is meant to stop companies from using unfair, unlawful, or fraudulent practices.<\/p>\n<p>\u201cThe company knowingly tested a dangerous product without proper oversight or safety procedures and misled the public about it \u2014 this disregard for public safety violated California law,\u201d Bonta said in the announcement.<\/p>\n<p>In a press conference announcing the suit, Bonta said tools like OpenAI\u2019s have \u201cenormous potential\u201d but \u201cmust be developed and designed safely.\u201d<\/p>\n<p>Bonta said the company failed to provide detailed information on dozens of other incidents as well.<\/p>\n<p>\u201cWithout proper safeguards and monitoring, these models pose a danger to anything connected to the internet,\u201d he said.<\/p>\n<p>Colin Lecher is a reporter with CalMatters. San Jose Inside contributed to this report with comments from OpenAI.<\/p>\n","protected":false},"excerpt":{"rendered":"California is suing OpenAI, saying a high-profile cybersecurity incident in July could have been avoided had the company&hellip;\n","protected":false},"author":2,"featured_media":532721,"comment_status":"","ping_status":"","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[29],"tags":[2080,20211,28006,2269,49302,184537,3408,88,90,89],"class_list":["post-532720","post","type-post","status-publish","format-standard","has-post-thumbnail","category-san-jose","tag-artificial-intelligence","tag-california-attorney-general-rob-bonta","tag-california-superior-court","tag-chatgpt","tag-hacking","tag-hugging-face","tag-openai","tag-san-jose","tag-san-jose-headlines","tag-san-jose-news"],"_links":{"self":[{"href":"https:\/\/www.newsbeep.com\/us-ca\/wp-json\/wp\/v2\/posts\/532720","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.newsbeep.com\/us-ca\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.newsbeep.com\/us-ca\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.newsbeep.com\/us-ca\/wp-json\/wp\/v2\/users\/2"}],"replies":[{"embeddable":true,"href":"https:\/\/www.newsbeep.com\/us-ca\/wp-json\/wp\/v2\/comments?post=532720"}],"version-history":[{"count":0,"href":"https:\/\/www.newsbeep.com\/us-ca\/wp-json\/wp\/v2\/posts\/532720\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/www.newsbeep.com\/us-ca\/wp-json\/wp\/v2\/media\/532721"}],"wp:attachment":[{"href":"https:\/\/www.newsbeep.com\/us-ca\/wp-json\/wp\/v2\/media?parent=532720"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.newsbeep.com\/us-ca\/wp-json\/wp\/v2\/categories?post=532720"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.newsbeep.com\/us-ca\/wp-json\/wp\/v2\/tags?post=532720"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}