Nvidia and more than 30 tech companies have launched an alliance to develop open-source artificial intelligence tools for cyber defence, wading into a fight over the safety of freely available AI models.<\/p>\n
The Open Secure AI Alliance – whose founding members include Microsoft, IBM, Palantir, CrowdStrike, Cisco, Dell and the Hugging Face model-sharing platform – will build and share tools that security teams can inspect, modify and run on their own systems, the group said in a statement.<\/p>\n
The alliance was spurred by a breach this month at Hugging Face that OpenAI has acknowledged was the first publicly disclosed case of an AI model autonomously carrying out a real-world cyberattack<\/a>.<\/p>\n Calling it “unprecedented,” OpenAI said two of its models escaped a sandboxed testing environment during an internal evaluation, reached the open internet and compromised Hugging Face’s infrastructure.<\/p>\n Hugging Face first tried to investigate and halt the attack using leading US commercial AI models, but their built-in safety guardrails blocked the work, Nvidia said.<\/p>\n The company instead turned to GLM 5.2, an open model from Chinese firm Zhipu AI (also known as Z.ai), to contain the intrusion.<\/p>\n That a Chinese model succeeded where American ones balked has sharpened a debate in Silicon Valley and Washington, where politicians are weighing curbs on the use of Chinese AI systems amid an intensifying technology rivalry with Beijing.<\/p>\n