![\"Toby](\"https:\/\/www.newsbeep.com\/au\/wp-content\/uploads\/2026\/07\/8231db99bfb96390c3ee3f0f392d95a22980e50b604e173db92e61ee540f7bdc.png\")
Toby Walsh<\/a>Chief scientist, AI Institute, UNSW<\/p>\nJuly 30, 2026 \u2014 3:30pm<\/p>\n
July 30, 2026 \u2014 3:30pm<\/p>\n
Save<\/p>\n
You have reached your maximum number of saved items.<\/p>\n
Remove items from your saved list<\/a> to add more.<\/p>\n AAA<\/p>\n It\u2019s an ancient fear. It goes back thousands of years. You find it in the story of Prometheus in ancient Greek mythology. And in stories like that of Surtr in Norse mythology. What if our inventions and discoveries get the better of us?<\/p>\n Wind forward to today, and people are starting to fear artificial intelligence going rogue and getting the better of us. OpenAI<\/a>, for example, just published a blog post describing how its latest and most capable AI agents went rogue and hacked into Hugging Face, one of the most popular websites for AI researchers to share resources.<\/p>\n In response, a bill has just been proposed in the US Congress to force AI developers to provide a \u201ckill switch\u201d to shut down any AI that goes AWOL.<\/p>\n Now, there\u2019s plenty to worry about, but not what you or Congress might think. And it\u2019s certainly not what much of the reporting <\/a>would have you think. News articles have talked about an AI that went \u201crogue\u201d, that \u201cescaped\u201d its confinement, and got \u201coutside\u201d. No AI in this case went rogue.<\/p>\n Related Article Indeed, the whole problem was that the AI did exactly and only what it was asked to do. It was asked to solve a cyber challenge, which it did rather too diligently.<\/p>\n And no AI \u201cescaped\u201d and got \u201coutside\u201d. The reality was much more prosaic. The AI was put in a sandbox and given limited web access. So it worked out a \u201chack\u201d to get unlimited web access. The reality is that OpenAI put it in a rather insecure sandbox.<\/p>\n And as far as we know, the AI agent never left OpenAI\u2019s machine. It didn\u2019t escape and get outside. It merely accessed information that it shouldn\u2019t have.<\/p>\n Of course, OpenAI has every incentive to talk up the capabilities of its latest AI. It surely won\u2019t hurt its forthcoming initial public offering on the share market. Or in attracting new customers to its frontier models and away from competitors such as Anthropic<\/a>. And it might also help negotiate some favourable regulation in the ongoing AI race between the US and China.<\/p>\n Related Article Personally, I\u2019m more worried about the AI bubble bursting. We\u2019re still seeing trillions of dollars of capital expenditure on data centres, yet AI is delivering value much slower than this rate of investment supports.<\/p>\n Circular financing deals<\/a> \u2013 such as Nvidia investing in OpenAI, which spends this investment on Nvidia\u2019s chips \u2013 don\u2019t ease my worries. The Australian Bureau of Statistics\u2019 latest figures<\/a> suggest this technology capital expenditure is keeping the national economy afloat, and keeping us from recession. But it can\u2019t continue<\/a>.<\/p>\n The lesson I take from the Hugging Face hack is that the cyber capabilities of the latest AI models are very impressive and very troubling. Rather than reason its way to a solution to the cyber challenge, OpenAI\u2019s agent worked out the answer was hidden on Hugging Face\u2019s website, protected by a password. So it gained access to the internet, found a stolen password and accessed the answer.<\/p>\n OpenAI\u2019s agent could have been turned off easily at any time. Just reach for the power switch on the side of the computer. We don\u2019t need to regulate for kill switches. We already have them on every computer on the planet. But what we don\u2019t have is mechanisms to prevent these AI models falling into the hands of bad actors and being used to do harm.<\/p>\n Editor’s pick And this problem only got harder with China and others producing \u201copen-weight models\u201d like Kimi 3<\/a>, which are free to all. This genie is out of the bottle.<\/p>\n Governments, therefore, should be introducing new regulations. We need, for example, to hold tech companies more liable for their products. If a car manufacturer produces a car that catches fire, we hold it liable. Ford discovered this to its cost in the 1970s with the scandal around the Ford Pinto\u2019s fuel tank<\/a>.<\/p>\n Why, then, aren\u2019t we holding AI companies more accountable for the harms they are causing? The Digital Duty of Care<\/a> under discussion in the Australian parliament is one place to start. This legislation needs to be expedited.<\/p>\n We also need to hold companies more accountable for facilitating the distribution of harmful content. How is it that Google Search can help you download nudify software<\/a>? Or ChatGPT offers advice about self-harm that helps people self-harm<\/a>? These wrongs were entirely predictable and preventable.<\/p>\n Related Article Finally, we can\u2019t depend on the goodwill of companies to report these incidents and regulate themselves. Social media platforms have demonstrated repeatedly that they can\u2019t be trusted to mark their own homework.<\/p>\n When Anthropic decided not to release its latest Fable model<\/a> because of its impressive cyber capabilities, it instead released it to a select group of companies to start identifying and patching their software. All very good and responsible.<\/p>\n This group included several banks. Yes, our bank accounts are in danger of being drained by hackers supercharged by AI. But Anthropic only released the AI model to banks in the United States. No banks in Europe or Australia or Asia were given advance access. How are they supposed to get ahead of the hackers if they\u2019re left in the dark?<\/p>\n We cannot then continue to rely on tech companies doing the right thing. It\u2019s time governments stepped up. I was pleased to hear Prime Minister Anthony Albanese give a major speech on artificial intelligence, saying our government would be more interventionist, and would ensure AI was used for the public good.<\/p>\n It\u2019s time to turn those promises into action.<\/p>\n Toby Walsh is chief scientist of UNSW Sydney\u2019s AI Institute. His is the author of God AI: Boom or Doom? What to expect when the machines outsmart us, to be released on September 1.<\/p>\n If you or anyone you know needs help, call Lifeline on 13 11 14 (see lifeline.org.au<\/a>), Beyond Blue on 1300 22 4636 (see beyondblue.org.au<\/a>) or 1800 RESPECT (1800 737 732).<\/p>\n Get a weekly wrap of views that will challenge, champion and inform your own. Sign up for our Opinion newsletter<\/a>.<\/p>\n Save<\/p>\n You have reached your maximum number of saved items.<\/p>\n Remove items from your saved list<\/a> to add more.<\/p>\n![\"Who\u2019s](\"https:\/\/www.newsbeep.com\/au\/wp-content\/uploads\/2025\/10\/1aaae958f8425e1c1fd5a028ebeaf3f10d7742ff.jpeg\")
Who\u2019s in command, and can laws make AI firms accountable?iStock<\/p>\n![\"Competition](\"https:\/\/www.newsbeep.com\/au\/wp-content\/uploads\/2026\/07\/1785393373_379_f6f6a92964a1bdc69c369f06c4fd4d2e743fc61c.jpeg\")
<\/a><\/p>\n![\"One](\"https:\/\/www.newsbeep.com\/au\/wp-content\/uploads\/2026\/06\/63197eee9e95ebbe1b5ebd8db0123fc76e99bef1.jpeg\")
<\/a><\/p>\n![\"](\"https:\/\/www.newsbeep.com\/au\/wp-content\/uploads\/2026\/07\/1785393375_294_60e0fb5fbc183451ecbed765ba703212f71dbe16.jpeg\")
<\/a><\/p>\n![\"Prime](\"https:\/\/www.newsbeep.com\/au\/wp-content\/uploads\/2026\/07\/1785393376_32_d288259a9b6188f06f76b51f41006c4ee71f5e12.jpeg\")
<\/a><\/p>\n
![\"Toby](\"https:\/\/www.newsbeep.com\/au\/wp-content\/uploads\/2026\/07\/1785393376_808_8231db99bfb96390c3ee3f0f392d95a22980e50b604e173db92e61ee540f7bdc.png\")