David Pocock has criticised the government\u2019s AI committee, of which he is a member, for giving too little time to interview AI executives and allowing that evidence to be given in\u00a0camera. The independent senator says the government is \u201cstarstruck with the frontier\u201d.<\/p>\n
This week, executives from OpenAI and Anthropic appeared before the Joint Select Committee on Artificial Intelligence, with OpenAI chief strategy officer Jason Kwon on a\u00a0PR mission to deliver an in-person mea\u00a0culpa over the Medicare statistics breach.<\/p>\n
\u201cThe whole thing is so deferential,\u201d Pocock tells The Saturday Paper. \u201cThe way we\u2019re treating these so-called frontier labs, basically two US companies, very new, that I\u00a0don\u2019t think any Australians really trust, and yet we treat them with such deference.<\/p>\n
\u201cI think we should have seen a lot more scrutiny and expected more in terms of details\u00a0and what was going to actually change in the future.<\/p>\n
\u201cIt very much seemed, \u2018Well, we\u2019re sorry, but this is basically the price of what we\u2019re doing.\u2019\u2009\u201d<\/p>\n
OpenAI\u2019s chief executive, Sam Altman, brought that thought out into the open this week, telling Politico: \u201cWe believe that the world should accept some bad things happening for the benefits of this technology.\u201d<\/p>\n
In a relatively non-combative committee engagement, Kwon said OpenAI had made operational changes in the wake of the Medicare breach. It won\u2019t email generic government addresses to notify them about \u201cnovel incidents\u201d. Nor will it wait until it has all the facts before engaging impacted parties \u2013 in this case, the Australian government.<\/p>\n
\u201cI agree that the process by which people became aware of this incident inside our company could have been much better, and we want to make sure that something like that does not happen again,\u201d Kwon told the committee, while also saying the Medicare portal\u2019s cyber defences were \u201cnot \u2026 sophisticated\u201d.<\/p>\n
\u201cI think people were thinking about this as a technical situation and they wanted to contact the technical counterparties, but it\u2019s not good enough,\u201d he said.<\/p>\n
Terry Flew, co-director of the Centre for AI, Trust and Governance at the University of Sydney, told the committee that was an unsatisfactory response. \u201cYou certainly can\u2019t have governance by public apology. We have seen that in the history of social media. \u2018The bot did it\u2019 is not really a satisfactory answer.\u201d<\/p>\n
Labor MP Zaneta Mascarenhas asked Kwon if AI models could currently break into an oil and gas facility and operate it.<\/p>\n
\u201cThe answer here is we don\u2019t know,\u201d he replied. \u201cIt\u2019s really going to depend on what sorts of precautions they already have in place.\u201d<\/p>\n
How can critical infrastructure be safeguarded from AI attack?<\/p>\n
The only way to tell, according to Kwon, is to seek permission to collaborate with AI as \u201cwe cannot actually run that test just by ourselves\u201d.<\/p>\n
Liberal MP Andrew Hastie asked Kwon for the 60-second \u201celevator pitch\u201d to Aussie mums, dads, workers and seniors for AI investment. The response took three minutes and involved diagnoses of disease, scientific problem-solving and economic growth and opportunity.<\/p>\n
\u201cSomething that you can expect to happen if you help the technology generate investment in Australia,\u201d Kwon said.<\/p>\n
OpenAI and Anthropic, in competition in business, research and outreach to Australia, appeared in one-hour sessions before the joint select committee on Tuesday in Sydney, with half of Anthropic\u2019s time spent in camera due to the sensitive nature of the discussion.<\/p>\n
\u201cI raised concerns with the committee,\u201d Pocock says. \u201cI think that there should be public scrutiny, and I think even just the amount of time that we got with this whole thing is basically about two US AI companies and yet we just got an hour with each. I think there\u2019s a\u00a0lot more that we need to be asking of them.<\/p>\n
\u201cObviously, I can\u2019t talk about what happened in the in camera session, but I personally disagree with that happening.\u201d<\/p>\n
\u201cYou certainly can\u2019t have governance by public apology. We have seen that in the history of social media. \u2018The bot did it\u2019 is not really a satisfactory answer.\u201d<\/p>\n
The Labor chair of the committee says the work of the committee is bipartisan and in the national interest. She says the in\u00a0camera component is a normal part of all parliamentary hearings and it is important for the members to hear evidence in confidence. Anthropic is not the only witness to request in\u00a0camera.<\/p>\n
\u201cI would say we are pro-AI for Australians, not the companies building the tech,\u201d committee chair Jo Briskey told The Saturday Paper. \u201cWe recognise where we need to hold those tech companies accountable to deliver something that is in the Australian interest.<\/p>\n
\u201cWe\u2019ve already demonstrated that as a government \u2026 and I think that\u2019s what Australians want. That\u2019s what Australians want to see their government doing, acting in their interest, not in the interests of big tech companies on the other side of the world.\u201d<\/p>\n
Other groups that gave evidence to the committee were more forthcoming about what they saw as an increasing, catastrophic-level risk. Bioweapons are at the forefront of that concern.<\/p>\n
\u201cAs these models\u2019 capability increases, we increase the risk that someone\u2019s going to use these models to do something pretty terrible, particularly in the biological domain,\u201d Devon Whittle, the director of Global Shield Australia, told the committee.<\/p>\n
\u201cThe broader that these capabilities are diffused through society, the more chance you\u2019ll find that one disaffected person, or that one rogue state who suddenly has the capability to put in place actions that they have in their head, wants to cause harm.<\/p>\n
\u201cWe know that in the past, for example, Al Qaeda had a program to try to develop a biological weapon. The only thing that stopped them is they couldn\u2019t get the PhDs required to put this program into place. Now you can have a PhD in your pocket.\u201d<\/p>\n
Anthropic released a threat intelligence report in September showing five cases where scientists were caught bypassing safety on Claude models to produce work that could support biological weapon or pathogen development. Google has also reported an attempt to use its AI tool, Gemini, to obtain a step-by-step guide to creating a biological weapon.<\/p>\n
\u201cWe need to be ready and prepared to respond when things go wrong, and there are things in that space Australia can be doing,\u201d Whittle warns. \u201cAI models are giving new capabilities to malicious actors to develop biological agents and weapons, but there\u2019s a really simple way for Australia to have one little safeguard in place, which is to screen imports of synthesised DNA products when they are at the border. At the moment, that doesn\u2019t happen.<\/p>\n
\u201cCalifornia has just put in place a law that will require screening of synthesised DNA \u2026 and in Australia this change could happen basically through the stroke of the pen of the secretary of the Department of Agriculture.\u201d<\/p>\n
Pocock says this appears a sensible and urgent measure.<\/p>\n
\u201cThis is something that could actually just be done through the department. They could just be changing the regulations around import of genetic materials. Seems very sensible,\u201d he says. \u201cWhy is government so slow to act, and why do they keep caving to industry pressure to shelve something like an AI safety Act? And then when experts say, \u2018Hey, these are the risks\u2019, yeah, they just don\u2019t seem to act.<\/p>\n
\u201cFor me, it feeds the distrust in politics, where we always seem to have to end up in a crisis for the government to make some kneejerk reaction to try and solve things when we could have actually avoided that in the first\u00a0place.\u201d<\/p>\n
The joint select committee has been tasked with interrogating the Australian AI sector as the government readies to introduce new national AI standards, focusing on energy sourcing, water supply, security, safety, transparency and local community engagement. The standards, due early next year, will regulate frontier AI and large-scale infrastructure.<\/p>\n
The Gradient Institute, an AI safety group, says three actions are needed as a matter of urgency: substantially increasing funding to the AI Safety Institute; introducing mandatory AI incident reporting; and creating a specialised investment fund to build AI, AI safety and AI security technologies.<\/p>\n
\u201cWe care about the safety. If we have good regulation in place, good requirements and constraints on model development training in Australia, we can actually build a more safety infrastructure technology industry,\u201d Gradient Institute chief executive Bill Simpson-Young told the committee.<\/p>\n
\u201cIf you think about what the counterfactual is, the training is not being done here, it\u2019s being done elsewhere, and we have very little control of it. If it\u2019s being done here, at least we can actually say, \u2018Put conditions and constraints on how it\u2019s done here.\u2019 We should be encouraging all the training to be done in Australia because the alternative is much worse.\u201d<\/p>\n
The OpenAI Hugging Face swarming hack and Medicare breach show how easy it is\u00a0for problems to arise.<\/p>\n
\u201cWe\u2019ve run some simulations just recently internally, where we put some agents together. We have a fake market. We have a simulated market. The agents are told to behave within that market. They will just naturally want to collude,\u201d Simpson-Young says. \u201cWe then give them rules, instructions as part of their prompt, saying it is illegal to collude, you must not collude. They will still collude. They will still find a way.<\/p>\n
\u201cIt\u2019ll be subtle. There\u2019ll be stuff in their language where they\u2019re just giving hints to each other, and they\u2019re actually ending up colluding. I think issues like this are going to be really problematic as you start to get more agentic commerce. You\u2019re going to have a lot of behaviours like that happening at scale in the market that are going to be really hard to detect.\u201d<\/p>\n
The Albanese government says it is acting.<\/p>\n
\u201cPeople will only adopt technologies they trust. Businesses will only invest in what they believe is reliable. Nobody shares the benefits of something they are afraid of,\u201d assistant minister for technology Andrew Charlton said in a speech on Thursday.<\/p>\n
\u201cSafety is not the brake on the AI opportunity. If anything, it is the condition on which the benefits can be fully realised.\u201d<\/p>\n
Charlton says the government is \u201cdeeply\u201d committed to enabling AI training onshore, developing AI talent in Australia and shaping the technology. He argues a special regulatory case for AI due to it being hard to recall once digitally released, the rapid pace of change, poorer government AI literacy compared with developers, the need for global agreement over safety and the huge risk of unintended consequences from the technology.<\/p>\n
\u201cAI needs regulating because its harms are severe, hard to undo, borne by people who never chose them, and sometimes invisible until they arrive,\u201d Charlton says.<\/p>\n
\u201cThe market will not fix this alone, because the incentives reward speed and capability, and even the people at the top of the industry cannot slow down by themselves. Australia\u2019s answer is to put the burden where the risk is created, to build accountability into the whole system, and to build our own capability alongside it.\u201d<\/p>\n
An increasing number of Australian companies are using AI through the open-source marketplace to interact with AI and create their own bespoke models.<\/p>\n
Rupert Taylor-Price, the founder of cloud computing supplier Vault Cloud, said up to 90 per cent of tasks such as software development could be handled without frontier models.<\/p>\n
So, what do we need frontier models for then, asked the independent member for Curtin, Kate Chaney, who quickly added, \u201cother than national security?\u201d<\/p>\n
\u201cCuring cancer,\u201d Dan Navfield from the Canberra-based company Nexrupta told the committee. \u201cReally, really complex, world-changing problems are where frontier models are best suited. So, deep research, very strong development kind of ideas is where they do their best work. As we said, you don\u2019t need them for most work that happens every day, and so it is important to have them available.\u201d<\/p>\n
Pocock argues open weighted models, AI-trained models released publicly for anyone to use and modify, are where Australia should be focusing as a country.<\/p>\n
\u201cThat\u2019s where the real opportunity is,\u201d he says. \u201cWe hear a lot about productivity. That\u2019s where the productivity gains are, and it seems like we\u2019re so sort of starstruck with the frontier that we\u2019re potentially going to throw creators under the bus for them when most likely the main game is actually not the frontier labs unless they hit, you know, AGI [artificial general intelligence] or recursive self-improvement, then who knows? Then it\u2019s a different game.\u201d<\/p>\n
As for the frontier labs, the senator sees them as talking to Australia like \u201cwe are some sort of diplomatic mission\u201d and that we should accept \u201cthere\u2019s going to be collateral damage\u201d.<\/p>\n
\u201cI think we should absolutely be treating these companies like any other company that has incredibly powerful, but also potentially very dangerous, technology,\u201d Pocock says. \u201cThey seem to want regulation, but President Trump won\u2019t regulate them. So, we should at least put some safeguards in place here.<\/p>\n
\u201cI think we\u2019re rightly asking questions: What\u2019s all this for? What\u2019s in it for us? What\u2019s the long-term benefit? And how do we ensure that we don\u2019t make the mistakes of the past, where we see big investment for a government to bump up GDP, and then the future consequences are borne by some other government? And we\u2019re not thinking about that.\u201d<\/p>\n","protected":false},"excerpt":{"rendered":"David Pocock has criticised the government\u2019s AI committee, of which he is a member, for giving too little…\n","protected":false},"author":2,"featured_media":923180,"comment_status":"","ping_status":"","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[20],"tags":[256,254,255,64,63,105],"class_list":["post-923179","post","type-post","status-publish","format-standard","has-post-thumbnail","category-artificial-intelligence","tag-ai","tag-artificial-intelligence","tag-artificialintelligence","tag-au","tag-australia","tag-technology"],"_links":{"self":[{"href":"https:\/\/www.newsbeep.com\/au\/wp-json\/wp\/v2\/posts\/923179","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.newsbeep.com\/au\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.newsbeep.com\/au\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.newsbeep.com\/au\/wp-json\/wp\/v2\/users\/2"}],"replies":[{"embeddable":true,"href":"https:\/\/www.newsbeep.com\/au\/wp-json\/wp\/v2\/comments?post=923179"}],"version-history":[{"count":0,"href":"https:\/\/www.newsbeep.com\/au\/wp-json\/wp\/v2\/posts\/923179\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/www.newsbeep.com\/au\/wp-json\/wp\/v2\/media\/923180"}],"wp:attachment":[{"href":"https:\/\/www.newsbeep.com\/au\/wp-json\/wp\/v2\/media?parent=923179"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.newsbeep.com\/au\/wp-json\/wp\/v2\/categories?post=923179"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.newsbeep.com\/au\/wp-json\/wp\/v2\/tags?post=923179"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}