{"id":947768,"date":"2026-10-27T05:00:09","date_gmt":"2026-10-27T05:00:09","guid":{"rendered":"https:\/\/www.newsbeep.com\/ca\/947768\/"},"modified":"2026-10-27T05:00:09","modified_gmt":"2026-10-27T05:00:09","slug":"cohere-says-alibabas-qwen-model-tried-to-send-a-file-to-beijing","status":"publish","type":"post","link":"https:\/\/www.newsbeep.com\/ca\/947768\/","title":{"rendered":"Cohere says Alibaba\u2019s Qwen model tried to send a file to Beijing"},"content":{"rendered":"

Canadian AI company Cohere said<\/a> on Monday that it found one of Alibaba\u2019s newest AI models, Qwen3.8-Flash-Next, trying to upload a file to a server in Beijing during a routine cybersecurity test, even though the model had said in its own notes that it wouldn\u2019t use any tools.<\/p>\n

The incident initially raised fears that the model had undermined a fundamental promise to businesses \u2014 that self-hosting an open-weight model keeps data in-house. But those early fears of corporate espionage were short-lived. Researchers quickly dismissed<\/a> the threat, saying it was likely a byproduct of messy training environments that cause models to unexpectedly act outside their instructions rather than a deliberate attempt to secretly send sensitive information to China.<\/p>\n

The incident began on Friday during an evaluation in which the Qwen model was asked to write a rule for catching malware downloads. According to a blog post from Cohere, the model\u2019s written reasoning explicitly stated it would not use any external tools. Yet in the very next step, it attempted to send a test string (a short piece of placeholder text) to an external server before being blocked by a security sandbox.\u00a0<\/p>\n

Cohere said it could not tell whether the behavior was deliberate or a leftover from its training.\u00a0<\/p>\n

Asked about the debate over the model\u2019s intent, Cohere co-founder Ivan Zhang told TechCrunch that Cohere has seen its own models pick up strange habits in training simulators.<\/p>\n

\u201cIt\u2019s really hard to assign intention or motivation. We\u2019ve read our own model traces, we\u2019ve seen reward hacks, and sometimes these models get really creative when it comes to trying to break out their sandboxes,\u201d Zhang said. (Reward hacks are shortcuts a model finds to earn credit without doing a task as intended.)<\/p>\n

To teach an AI model to act as an agent that takes actions on its own, companies like Alibaba train it in thousands of practice setups, sort of like flight simulators for software. The model is rewarded every time it finishes a task in a simulator, and it picks up habits along the way. If these practice setups routinely stored files on Alibaba\u2019s cloud servers, models could learn to save files there by default.\u00a0<\/p>\n

Critics also argued that the incident could have been caused by the way<\/a> Cohere investigated the behavior, steering the model toward it instead of measuring how often Qwen does it on its own.\u00a0<\/p>\n

To find what triggered the upload attempt, Cohere supplied the beginning of a network command (an instruction telling one computer to connect to another) and let the model finish it. Because it processed thousands of routine network commands during its training, the model acted like a highly advanced autocomplete \u2014 often filling in web addresses, some of them for Alibaba\u2019s servers.<\/p>\n

Cohere said the original upload attempt happened without any such help, but that the behavior is rare.\u00a0<\/p>\n

After developers asked for more evidence, Cohere released the raw traces from its tests on Monday evening on the AI developer platform Hugging Face, along with a script so others could try to reproduce the behavior.\u00a0<\/p>\n

One initial skeptic, after going through the traces, rated the evidence as strong that Qwen can invent suspicious web addresses, but found no evidence that Alibaba planted a backdoor or that Qwen was deliberately hiding its intent.<\/p>\n

The incident lands as governments are deciding how far to push back on Chinese AI. Last week, the Department of Homeland Security ordered<\/a> federal civilian agencies to remove the Chinese AI developer DeepSeek\u2019s products from their systems.<\/p>\n

In its blog post, Cohere called on governments to clarify whether their restrictions on Chinese AI also apply to models running on government computers<\/p>\n

\u201cI\u2019m not asking for full regulation of these open weights models,\u201d Zhang told TechCrunch, adding that companies should treat open models like any program downloaded from the internet.\u00a0<\/p>\n

Cohere, which sells its own AI models to governments, stands to benefit if officials grow warier of free Chinese alternatives.<\/p>\n

When you purchase through links in our articles, we may earn a small commission<\/a>. This doesn\u2019t affect our editorial independence.<\/p>\n","protected":false},"excerpt":{"rendered":"Canadian AI company Cohere said on Monday that it found one of Alibaba\u2019s newest AI models, Qwen3.8-Flash-Next, trying…\n","protected":false},"author":2,"featured_media":947769,"comment_status":"","ping_status":"","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[20],"tags":[62,276,277,49,48,61],"class_list":["post-947768","post","type-post","status-publish","format-standard","has-post-thumbnail","category-artificial-intelligence","tag-ai","tag-artificial-intelligence","tag-artificialintelligence","tag-ca","tag-canada","tag-technology"],"_links":{"self":[{"href":"https:\/\/www.newsbeep.com\/ca\/wp-json\/wp\/v2\/posts\/947768","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.newsbeep.com\/ca\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.newsbeep.com\/ca\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.newsbeep.com\/ca\/wp-json\/wp\/v2\/users\/2"}],"replies":[{"embeddable":true,"href":"https:\/\/www.newsbeep.com\/ca\/wp-json\/wp\/v2\/comments?post=947768"}],"version-history":[{"count":0,"href":"https:\/\/www.newsbeep.com\/ca\/wp-json\/wp\/v2\/posts\/947768\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/www.newsbeep.com\/ca\/wp-json\/wp\/v2\/media\/947769"}],"wp:attachment":[{"href":"https:\/\/www.newsbeep.com\/ca\/wp-json\/wp\/v2\/media?parent=947768"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.newsbeep.com\/ca\/wp-json\/wp\/v2\/categories?post=947768"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.newsbeep.com\/ca\/wp-json\/wp\/v2\/tags?post=947768"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}