http:\/\/www.bozemandailychronicle.com offers audio versions of articles using Instaread. Some words may be mispronounced.\n <\/p>\n
NEW YORK (AP) \u2014 Artificial intelligence insiders warned New York City’s leaders about the dangers of the emerging technology on Monday, calling for greater oversight as local governments move to respond to mounting concerns that the systems could endanger humanity<\/a>.<\/p>\n At a hearing of the New York City Council, recently departed employees of Anthropic, OpenAI and Google DeepMind described a reckless culture at the firms, saying the biggest tech companies are racing to create technology they do not understand<\/a> how to control.<\/p>\n \u201cThe companies run on a startup mindset: Move fast, break things, fix them later. That works for a photo sharing app. It does not work for building the most powerful technology ever built,” said Jacob Coxon, a former engineer at Anthropic<\/a> who has become a leading voice for regulation.<\/p>\n State and city governments have been considering ways to regulate AI as the Trump administration has taken a passive approach and Congress has proven inactive. President Donald Trump has dismissed AI fears as a \u201choax\u201d and signed an agreement late last month that largely allows the companies to self-police<\/a>.<\/p>\n Coxon was a little-known engineer at Anthropic until he announced his departure through a series of social media posts that caught global attention. He told the Council that AI could have tremendous upsides, but without transparency and safeguards, it’s more likely that things will spiral out of control.<\/p>\n \u201cOn the current path, I think it is more likely than not that humanity loses control to these AIs and it could end in human extinction,\u201d Coxon said.<\/p>\n A panel of AI company staffers \u2014 representing tech giants OpenAI, Anthropic, Google and Meta \u2014 also testified at the hearing in Manhattan on Monday, telling officials that their systems are already improving people’s daily lives and stressing that they are laser-focused on safety.<\/p>\n \u201cI share your commitment to ensuring that technology is developed safely and that its benefits are widely shared,\u201d said Morgan Dwyer of OpenAI.<\/p>\n At one point during the hearing, Julie Menin, the speaker of the City Council, asked each company representatives to \u201cquantify the risk posed by AI in the worst case catastrophic scenario.\u201d<\/p>\n Dwyer answered: \u201cI don\u2019t know \u2014 I also don\u2019t think it matters whether it\u2019s 1% or 10% or 20% chance that something catastrophic will go wrong. None of these levels is remotely acceptable. We should not train models that we cannot make an extremely strong case that we can keep under human control.”<\/p>\n Menin slammed the response as \u201cflippant at best.”<\/p>\n \u201cI would say that the percentage chance doesn\u2019t matter. What matters is the commitment to safety, and that is what OpenAI is committed to doing,” Dwyer said.<\/p>\n The City Council is considering several AI regulations, including proposals to require companies to disclose information about AI tools, require third-party approval for AI systems in the city and allow whistleblowers to receive a portion of fines from AI companies that violate laws.<\/p>\n