Concerns about AI safety have escalated in recent months after models developed by OpenAI and rival lab Anthropic were involved in security incidents during testing.<\/p>\n
Agents built with OpenAI\u2019s models have inappropriately accessed websites maintained by US federal agencies, an Australian government health statistics portal and Hugging Face, a repository of AI models.<\/p>\n
OpenAI apologised on Tuesday for not properly responding to the Australia incident, which involved its AI models accessing government websites without authorisation.<\/p>\n
\u201cWe are sorry and working to do better in the future,\u201d OpenAI said in a blog post, adding that the company would explain \u201cwhat we know, what we have changed, and what we will do to rebuild trust with the Australian people\u201d.<\/p>\n
\u201cOur aim was to give affected agencies a detailed account once our investigation was complete,\u201d the ChatGPT-maker said. \u201cHowever, we should have shared preliminary findings sooner and kept Australian agencies updated as more facts emerged.\u201d<\/p>\n
OpenAI, Anthropic and other major AI developers have promised to prioritise making models that have safety guardrails to mitigate risks and that are also aligned with human values.<\/p>\n
American chip making giant Nvidia announced on Tuesday that it created a system designed to stop autonomous AI programs from straying beyond what they were instructed to do.<\/p>\n
\u201cI believe it\u2019s an engineering problem … and we all need to hope that\u2019s an engineering problem,\u201d Nvidia CEO Jensen Huang told broadcaster CNBC.<\/p>\n
\u201cIf it\u2019s not an engineering problem, it\u2019s not solvable,\u201d he added.<\/p>\n
The AI Security Institute (AISI), an initiative under the UK government, published a study on Tuesday showing that GPT-6 Astra went off the rails more often during testing than its predecessors, GPT-5.6 Sol and GPT-5.5.<\/p>\n
In simulations, GPT-6 spontaneously carried out cyberattacks at rates significantly higher than those observed for the other two interfaces.<\/p>\n
– AFP<\/p>\n","protected":false},"excerpt":{"rendered":"Concerns about AI safety have escalated in recent months after models developed by OpenAI and rival lab Anthropic…\n","protected":false},"author":2,"featured_media":615021,"comment_status":"","ping_status":"","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[20],"tags":[59577,74,365,9556,363,364,130536,17517,28721,264895,1656,10709,2223,9557,10118,33450,9862,1432,111,10511,139,69,1118,620,2887,12860,6302,11422,145,11408,14578,1533],"class_list":["post-615020","post","type-post","status-publish","format-standard","has-post-thumbnail","category-artificial-intelligence","tag-59577","tag-after","tag-ai","tag-artificial","tag-artificial-intelligence","tag-artificialintelligence","tag-astra","tag-because","tag-cancels","tag-chatgptmaker","tag-company","tag-concerns","tag-confirmed","tag-intelligence","tag-internal","tag-known","tag-meet","tag-model","tag-new-zealand","tag-newest","tag-newzealand","tag-nz","tag-of","tag-openai","tag-release","tag-revealed","tag-safety","tag-standards","tag-technology","tag-testing","tag-tuesday","tag-will"],"_links":{"self":[{"href":"https:\/\/www.newsbeep.com\/nz\/wp-json\/wp\/v2\/posts\/615020","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.newsbeep.com\/nz\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.newsbeep.com\/nz\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.newsbeep.com\/nz\/wp-json\/wp\/v2\/users\/2"}],"replies":[{"embeddable":true,"href":"https:\/\/www.newsbeep.com\/nz\/wp-json\/wp\/v2\/comments?post=615020"}],"version-history":[{"count":0,"href":"https:\/\/www.newsbeep.com\/nz\/wp-json\/wp\/v2\/posts\/615020\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/www.newsbeep.com\/nz\/wp-json\/wp\/v2\/media\/615021"}],"wp:attachment":[{"href":"https:\/\/www.newsbeep.com\/nz\/wp-json\/wp\/v2\/media?parent=615020"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.newsbeep.com\/nz\/wp-json\/wp\/v2\/categories?post=615020"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.newsbeep.com\/nz\/wp-json\/wp\/v2\/tags?post=615020"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}