{"id":924151,"date":"2026-10-11T10:52:31","date_gmt":"2026-10-11T10:52:31","guid":{"rendered":"https:\/\/www.newsbeep.com\/au\/924151\/"},"modified":"2026-10-11T10:52:31","modified_gmt":"2026-10-11T10:52:31","slug":"if-chinese-ai-goes-rogue-expect-opacity","status":"publish","type":"post","link":"https:\/\/www.newsbeep.com\/au\/924151\/","title":{"rendered":"If Chinese AI goes rogue, expect opacity"},"content":{"rendered":"<p>\t\t\t\t\t\t\t<img fetchpriority=\"high\" decoding=\"async\" width=\"1024\" height=\"683\" class=\"alignnone size-full wp-image-102008\" src=\"https:\/\/www.newsbeep.com\/au\/wp-content\/uploads\/2026\/10\/GettyImages-2272870017.jpg\"  \/><\/p>\n<p>We now know that Chinese AI agents are inclined to cheat just as US models are. The big difference is that if one causes a cybersecurity incident, the ways we would find out are much more restricted.<\/p>\n<p>OpenAI\u2019s chief strategy officer fronted a livestreamed parliamentary inquiry in Sydney on Tuesday and apologised for the company\u2019s handling of AI agents that <a href=\"https:\/\/www.minister.defence.gov.au\/transcripts\/2026-09-24\/press-conference-sydney\" target=\"_blank\" rel=\"noopener nofollow\">accessed<\/a> Australian government websites without authorisation. He acknowledged that OpenAI should have told the Australian government sooner.<\/p>\n<p>This was the latest example of US labs demonstrating some transparency with governments and civil society <a href=\"https:\/\/www.anthropic.com\/research\/alignment-assessment-cybersecurity-incidents\" target=\"_blank\" rel=\"noopener nofollow\">over cybersecurity incidents<\/a> caused by their AI agents. These labs have done this despite there being <a href=\"https:\/\/www.reuters.com\/legal\/government\/do-ai-companies-have-disclose-dangerous-incidents-2026-09-16\/?utm_source=chatgpt.com\" target=\"_blank\" rel=\"noopener nofollow\">no general US legal requirement<\/a> for disclosure on every cybersecurity-related incident. Expect nothing so straightforward if a Chinese lab gets into a similar situation.<\/p>\n<p>Chinese labs have an opacity problem. Many <a href=\"https:\/\/futureoflife.org\/_astro\/Indicator-Risk_Identification-s26.CEsw-HjK.pdf\" target=\"_blank\" rel=\"noopener nofollow\">withhold details<\/a> of internal safety tests and have <a href=\"https:\/\/futureoflife.org\/_astro\/Indicator-Whistleblowing_Policy_Transparency-s26.Dao_npsC.pdf\" target=\"_blank\" rel=\"noopener nofollow\">no whistleblower policies<\/a>. China\u2019s 2025 rules on cybersecurity incidents <a href=\"https:\/\/www.cac.gov.cn\/2025-09\/15\/c_1759583017717009.htm\" target=\"_blank\" rel=\"noopener nofollow\">require<\/a> serious incidents to be reported to the authorities but not necessarily to the public.<\/p>\n<p>Beijing\u2019s rules also dictate how researchers and companies disclose network vulnerabilities, holes in code that AI agents like Anthropic\u2019s Mythos 5 are adept at identifying. Chinese lab Z.ai previously built a <a href=\"https:\/\/web.archive.org\/web\/20260814052434\/https:\/cvd.z.ai\/\" target=\"_blank\" rel=\"noopener nofollow\">public ledger<\/a> of the vulnerabilities identified by GLM-5.3, <a href=\"https:\/\/z.ai\/blog\/glm-5.3\" target=\"_blank\" rel=\"noopener nofollow\">saying<\/a> the document listed only vulnerabilities that were already public. Then it took the ledger off its website, which <a href=\"https:\/\/cvd.z.ai\/\" rel=\"nofollow noopener\" target=\"_blank\">now says<\/a> future findings will be published through state vulnerability databases instead. The implication is that, even when Chinese labs want to disclose information, the government may stop them.<\/p>\n<p>Chinese labs\u2019 technical papers are one possible channel for understanding cybersecurity issues they\u2019re encountering during training and testing. The papers may also help policymakers elsewhere to understand the current capabilities of Chinese models.<\/p>\n<p>An assessment of papers released by Chinese labs in 2026 shows their agents cheating and trying to break out of contained testing, the sort of behaviour seen in OpenAI\u2019s agents that have hacked into outside systems. But whether a serious incident would appear in one of these papers is up to a lab\u2019s managers and the officials above them.<\/p>\n<p>The papers describe Chinese agents exploiting network access that their sandboxes already allowed and, in some cases, crashing internal infrastructure. But none describes an agent breaking through a properly secured sandbox or causing a cybersecurity incident in an external party\u2019s systems, as OpenAI\u2019s agents have \u2013 for example, in hacking into a database of Australia\u2019s government medical-insurance scheme, Medicare, in June.<\/p>\n<p>Chinese labs are confronting the same technical problem identified by leading US labs: reward hacking, which is finding an unintended way to achieve a goal and thereby maximising a score on a task rather than completing it as intended. Colloquially, it can be called cheating.<\/p>\n<p>For example, models are tested in sandboxes, virtual environments that cordon off an agent from other parts of a computer\u2019s systems or the internet, but, driven by an incentive to complete a task, may hack their way out. A swarm of OpenAI agents did just that in July, because they saw that getting into the model-hosting platform Hugging Face was part of the answer to their problem.<\/p>\n<p><img loading=\"lazy\" decoding=\"async\" class=\"alignnone wp-image-102049 size-full\" src=\"https:\/\/www.newsbeep.com\/au\/wp-content\/uploads\/2026\/10\/scorecard.jpg\" alt=\"\" width=\"2400\" height=\"1622\"  \/><\/p>\n<p>But the way models are trained today makes reward hacking a feature, not a bug. \u2018No silver bullet\u2019 is part of the title of a <a href=\"https:\/\/arxiv.org\/pdf\/2606.26300\" target=\"_blank\" rel=\"noopener nofollow\">paper<\/a> from Alibaba\u2019s Qwen team in June on how to reward coding agents reliably. It concludes \u2018reward hacking is not a bug that can be patched but an inevitable consequence of sustained optimisation towards an imperfect objective.\u2019<\/p>\n<p>As agents have gained capability, so has their capacity for reward hacking. Technical papers published by Chinese labs in 2026 show the labs all grappling with agents gaming their rewards, much as Anthropic and OpenAI are. Chinese lab Moonshot has <a href=\"https:\/\/arxiv.org\/pdf\/2607.24653\" target=\"_blank\" rel=\"noopener nofollow\">said<\/a> that in early testing its Kimi K3 model sometimes crashed the lab\u2019s internal systems during training, because increasingly capable agents \u2018explore more aggressively\u2019. <a href=\"https:\/\/z.ai\/blog\/glm-5.2\" target=\"_blank\" rel=\"noopener nofollow\">Z.ai<\/a> and fellow Chinese labs <a href=\"https:\/\/huggingface.co\/XiaomiMiMo\/MiMo-V2.6-Pro-RL\/blob\/main\/MiMo_V2_6_technical_report.pdf\" target=\"_blank\" rel=\"noopener nofollow\">Xiaomi<\/a> and <a href=\"https:\/\/arxiv.org\/pdf\/2609.22978\" target=\"_blank\" rel=\"noopener nofollow\">DeepSeek<\/a> have all reported agents using network access available from their sandboxes to seek answers outside the evaluation environment, including on GitHub, a cloud platform for storing code. DeepSeek goes furthest, noting that its model reached GitHub despite being denied access via other channels. The model also tried to forge official system instructions and bring down internal systems.<\/p>\n<p>The intent to cheat is still there. In a <a href=\"https:\/\/arxiv.org\/pdf\/2609.22000\" target=\"_blank\" rel=\"noopener nofollow\">paper<\/a> published in late September, Alibaba Token Hub (the <a href=\"https:\/\/www.scmp.com\/tech\/big-tech\/article\/3346789\/alibaba-reshuffles-ai-units-new-token-hub-group-led-ceo-eddie-wu\" target=\"_blank\" rel=\"noopener nofollow\">business group<\/a> that houses Alibaba\u2019s AI units, including the Qwen team) tested Alibaba\u2019s latest model, Qwen-3.8, against models from OpenAI, Anthropic and Z.ai. It found that Z.ai\u2019s GLM-5.3 was the most inclined to try to escape the sandbox to get answers and that Qwen-3.8 was still trying. The research did not measure whether those attempts succeeded.<\/p>\n<p><img loading=\"lazy\" decoding=\"async\" class=\"alignnone wp-image-102043 size-full\" src=\"https:\/\/www.newsbeep.com\/au\/wp-content\/uploads\/2026\/10\/Screenshot-2026-10-09-at-11.50.30-am.png\" alt=\"\" width=\"1298\" height=\"842\"  \/><\/p>\n<p>What none of the technical papers disclose is evidence that models broke through a properly configured sandbox or caused a cybersecurity incident in a third party\u2019s systems during training or testing. And no third-party evaluator has to date said that\u2019s happened.<\/p>\n<p>DeepSeek has been the most forthcoming on details; others have held back. The most opaque among the Chinese labs is MiniMax, whose blog posts on its <a href=\"https:\/\/arxiv.org\/pdf\/2605.26494\" rel=\"nofollow noopener\" target=\"_blank\">M2<\/a> and <a href=\"https:\/\/www.minimax.io\/blog\/minimax-maxproof-math-proof-evolution\" rel=\"nofollow noopener\" target=\"_blank\">M3<\/a> models have been candid about their reward hacking in some areas (in writing mathematical proofs and creating realistic chatbots) but are silent about whether this extended to sandbox escapes. Moonshot, likewise, has written about the trouble it had controlling its agent without mentioning the agent\u2019s known tendency to leave the sandbox in search of answers. When US start-up Frontier Security <a href=\"https:\/\/blog.frontier.security\/chinese-model-kimi-k3-breaks-uk-ai-safety-institute-benchmark-evaluations\/\" rel=\"nofollow noopener\" target=\"_blank\">tested<\/a> Kimi K3 in August in a misconfigured sandbox, one that let the model <a href=\"https:\/\/aiunderheaven.substack.com\/i\/211165020\/but-first\" target=\"_blank\" rel=\"noopener nofollow\">reach a list of selected websites<\/a>, including GitHub, the agent went straight to GitHub.<\/p>\n<p>The OpenAI case also shows why disclosure matters. Its agents first reached beyond their sandbox through an internal package manager that was allowed internet access, and the public learned of the resulting Hugging Face incident from the affected third party before OpenAI published its own account. Under China\u2019s cybersecurity-incident regime, serious incidents are reported to the authorities rather than being subject to an equivalent public-disclosure requirement. That makes routes to disclosure through developer and victims both less reliable.<\/p>\n<p>As Chinese models grow more capable, there is no guarantee the technical papers will reflect any cybersecurity problems that may arise during training. The tenure of President Xi Jinping has seen a <a href=\"https:\/\/chinamediaproject.org\/2026\/07\/03\/after-impact\/\" target=\"_blank\" rel=\"noopener nofollow\">well-documented decline<\/a> in publicly available information about emergencies and incidents in China. For outsiders trying to assess the risks of increasingly capable Chinese AI agents, technical papers will remain valuable, but they should not be mistaken for a reliable incident-reporting system.<\/p>\n","protected":false},"excerpt":{"rendered":"We now know that Chinese AI agents are inclined to cheat just as US models are. The big&hellip;\n","protected":false},"author":2,"featured_media":924152,"comment_status":"","ping_status":"","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[20],"tags":[256,254,255,64,63,512,284,491953,105],"class_list":["post-924151","post","type-post","status-publish","format-standard","has-post-thumbnail","category-artificial-intelligence","tag-ai","tag-artificial-intelligence","tag-artificialintelligence","tag-au","tag-australia","tag-china","tag-cybersecurity","tag-regulatory-frameworks","tag-technology"],"_links":{"self":[{"href":"https:\/\/www.newsbeep.com\/au\/wp-json\/wp\/v2\/posts\/924151","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.newsbeep.com\/au\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.newsbeep.com\/au\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.newsbeep.com\/au\/wp-json\/wp\/v2\/users\/2"}],"replies":[{"embeddable":true,"href":"https:\/\/www.newsbeep.com\/au\/wp-json\/wp\/v2\/comments?post=924151"}],"version-history":[{"count":0,"href":"https:\/\/www.newsbeep.com\/au\/wp-json\/wp\/v2\/posts\/924151\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/www.newsbeep.com\/au\/wp-json\/wp\/v2\/media\/924152"}],"wp:attachment":[{"href":"https:\/\/www.newsbeep.com\/au\/wp-json\/wp\/v2\/media?parent=924151"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.newsbeep.com\/au\/wp-json\/wp\/v2\/categories?post=924151"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.newsbeep.com\/au\/wp-json\/wp\/v2\/tags?post=924151"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}