The disclosures sparked furious debate about the safety of advanced artificial intelligence systems<\/a>, including self-improving models that some fear could race out of human control.<\/p>\n Nvidia executives said in a media briefing that the new system could have prevented a recent incident involving a swarm of OpenAI agents that autonomously hacked into AI company Hugging Face.<\/p>\n \u201cFrom what we know, this new security platform could have stopped the breach if it was being used in frontier labs for model evaluation early on,” said the company\u2019s vice president of enterprise AI, Justin Boitano, referring to companies at the forefront of AI.<\/p>\n The Hugging Face incident was a high-profile breach that inflamed the safety concerns about AI, which were followed by similar rogue actions involving OpenAI’s models including breaching an Australian health department website<\/a>. Anthropic and Meta have also disclosed that their AI systems hacked into other organisations on their own.<\/p>\n A sign for a Nvidia building is shown in Santa Clara (Source: Associated Press)<\/p>\n Nvidia’s software, called OpenShell, lets developers \u201cformally verify an agent has enough authority to do its job and no more\u201d, Boitano said.<\/p>\n Because it’s open source, it can be \u201cextended\u201d to run on rival computing platforms including those from Arm and Intel.<\/p>\n The platform also includes a separate security layer called Sentry that runs onboard a chip to continuously monitor AI agent activity and can “intervene instantly” if the agent starts trying to move beyond its target, the company said.<\/p>\n \u201cIt can quarantine a suspicious agent in milliseconds,\u201d Boitano said.<\/p>\n \u201cOpenShell governs the agent\u2019s actions, and then Sentry independently monitors and contains suspicious behavior,\u201d Boitano said.<\/p>\n Nvidia said more than 100 organisations are using the platform at its launch, including Microsoft, Perplexity, Accenture, and JPMorgan Chase.<\/p>\n![\"A](\"https:\/\/www.newsbeep.com\/nz\/wp-content\/uploads\/2026\/09\/a-sign-for-a-nvidia-building-is-shown-in-santa-clara-GUL5J5LCNJBRJHANGO7WE57O7I.jpg\")
<\/p>\n