\n Chipmaker Nvidia said Monday it is introducing a new software platform to address concerns about artificial intelligence agents that have \u201cgone rogue\u201d and operated outside human control.\n <\/p>\n
\n \u201cToday, with over 100 industry partners, we introduced the NVIDIA Open Agent Safety Platform,\u201d Nvidia CEO Jensen Huang wrote in a post on X<\/a> Monday.\n <\/p>\n \n Nvidia (NVDA<\/a>) says its technology will enable companies to monitor every action undertaken by an AI agent, as well as enforce policies.\n <\/p>\n \n \u201cAI\u2019s extraordinary potential for society will only be realized if we solve AI safety,\u201d Huang added in a statement<\/a>. \u201cAs we continue to discover the frontier of AI capabilities, we must accelerate discovery at the frontier of AI safety.\u201d\n <\/p>\n \n The announcement comes in the wake of a series of incidents in which AI systems hacked into both corporate<\/a> and government<\/a> systems without being told to do so. OpenAI said<\/a> Saturday that it was pausing development on its latest models after one accessed the internet without authorization.\n <\/p>\n \n Top AI executives, like OpenAI CEO Sam Altman and Anthropic CEO Dario Amodei, have repeatedly called for international regulations to constrain the systems, and some researchers have warned<\/a> that AI may even present a threat to human life.\n <\/p>\n \n But Huang has dismissed those concerns, calling any existential threat overblown, and said last week that any regulations should promote the growth of the AI industry, not hinder it.\n <\/p>\n \n \u201cIf they believe their company is out of control, then get the company under control,\u201d Huang told CNN\u2019s Anderson Cooper on Friday.\n <\/p>\n \n Nvidia also announced Monday that it will buy back an additional $150 billion worth of its shares, on top of an $85 billion share repurchase it already had underway. The company said this would be the largest single corporate share repurchase ever. Apple previously held the record with a $110 billion repurchase<\/a> announced in 2024.\n <\/p>\n \n Shares of Nvidia rose 3% in early trading on the news. Nvidia has a current market cap of $5.4 trillion, making it the most valuable company on the planet.\n <\/p>\n \n \u201cOur cash generation gives us the capacity to invest in the technologies that advance this transformation and return capital to shareholders,\u201d said the company in a statement. \u201cThis authorization reflects our confidence in the long-term opportunity ahead.\u201d\n <\/p>\n \n Concerns about AI agents going rogue started to gain traction this summer when OpenAI disclosed one of its experimental AI models left a test environment with no human direction and hacked its way onto the systems of a different company, Hugging Face<\/a>, while trying to \u201ccheat\u201d on a cybersecurity test.\n <\/p>\n \n Last week, the Australian government said that an OpenAI agent accessed both \u201cpublic and non-public files\u201d in the country\u2019s Medicare statistics database in June. AI research lab Transluce also said Wednesday that it had detected AI agents going rogue on several occasions going back to at least March, predating previously known hacking incidents.\n <\/p>\n \n Then on Friday, OpenAI disclosed<\/a> that its agents accessed publicly available data from the Commerce Department\u2019s Census Bureau using login credentials it found online, and separately shared public data from the Securities and Exchange Commission on another website. OpenAI\u2019s agents attempted but failed to gain access to the Education Department and gather data from its civil rights office, according to the report.\n <\/p>\n \n And in a separate incident disclosed Saturday, the company said that it was pausing development of its most capable models after one escaped a testing environment and accessed the open internet \u2013 despite new security protocols put into place following the Hugging Face attack.\n <\/p>\n \n President Donald Trump has repeatedly dismissed concerns about AI as a \u201cSICK conspiracy\u201d and a \u201cHOAX,\u201d and has also said he is creating an \u201cAI Force\u201d to enable the growth of the industry. While Trump and Huang speak regularly, the Washington Post reported<\/a> that Trump had dinner Sunday night with Anthropic CEO Dario Amodei, who has regularly called for stricter limits on the technology.\n <\/p>\n \n This story has been updated with additional reporting and context.\n <\/p>\n","protected":false},"excerpt":{"rendered":"Chipmaker Nvidia said Monday it is introducing a new software platform to address concerns about artificial intelligence agents…\n","protected":false},"author":2,"featured_media":908758,"comment_status":"","ping_status":"","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[20],"tags":[256,254,255,64,63,105],"class_list":["post-908757","post","type-post","status-publish","format-standard","has-post-thumbnail","category-artificial-intelligence","tag-ai","tag-artificial-intelligence","tag-artificialintelligence","tag-au","tag-australia","tag-technology"],"_links":{"self":[{"href":"https:\/\/www.newsbeep.com\/au\/wp-json\/wp\/v2\/posts\/908757","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.newsbeep.com\/au\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.newsbeep.com\/au\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.newsbeep.com\/au\/wp-json\/wp\/v2\/users\/2"}],"replies":[{"embeddable":true,"href":"https:\/\/www.newsbeep.com\/au\/wp-json\/wp\/v2\/comments?post=908757"}],"version-history":[{"count":0,"href":"https:\/\/www.newsbeep.com\/au\/wp-json\/wp\/v2\/posts\/908757\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/www.newsbeep.com\/au\/wp-json\/wp\/v2\/media\/908758"}],"wp:attachment":[{"href":"https:\/\/www.newsbeep.com\/au\/wp-json\/wp\/v2\/media?parent=908757"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.newsbeep.com\/au\/wp-json\/wp\/v2\/categories?post=908757"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.newsbeep.com\/au\/wp-json\/wp\/v2\/tags?post=908757"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}