{"id":453745,"date":"2026-03-02T15:09:09","date_gmt":"2026-03-02T15:09:09","guid":{"rendered":"https:\/\/www.newsbeep.com\/uk\/453745\/"},"modified":"2026-03-02T15:09:09","modified_gmt":"2026-03-02T15:09:09","slug":"the-most-controversial-thing-happening-in-ai-could-unleash-its-darkest-power","status":"publish","type":"post","link":"https:\/\/www.newsbeep.com\/uk\/453745\/","title":{"rendered":"The most controversial thing happening in AI could unleash its darkest power"},"content":{"rendered":"

Distillation might never have been so controversial since Prohibition<\/a>. Once again, society is locked in a complex and moral argument about what should be allowed, how much you can ban, and what is good for us. But this time around it\u2019s not alcohol that\u2019s at stake, but artificial intelligence<\/a>.<\/p>\n

The word, and the metaphor, is a useful one. When making alcoholic drinks, distillation separates off the unwanted water to reduce the liquid to more of what is actually desired. In machine learning, the work is much the same: reducing a model so that it can be smaller and more efficient without necessarily losing much or any of the important part.<\/p>\n

It has been an important technique that helped build many of the AI systems that people use today. But, this week, it has become one of the most important and controversial ideas in the whole of artificial intelligence.<\/p>\n

That happened when Anthropic, which makes Claude, claimed this week that competitors from China were stealing its central technologies<\/a>. It accused them of using the technique to \u201cillicitly extract Claude\u2019s capabilities to improve their own models\u201d. And it said those attacks were \u201cgrowing in intensity and sophistication\u201d, and suggested that if the industry and governments did not act now then it could transform the AI industry.<\/p>\n

At its heart, distillation is a relatively simple process. It involves training smaller AI models with the outputs of larger ones. AI companies do this with their own models: they might initially create a powerful, \u201cfrontier\u201d model, for instance, and then train another more efficient version of that same model. That is useful because LLMs such as those that power ChatGPT or Claude use vast amounts of resources, in terms of chips and energy, and so a more efficient model can produce answers more cheaply and quickly.<\/p>\n

But the same process can be used by rivals to, in effect, take the important parts of other companies models. That was what Anthropic accused its rivals of doing. It said that three Chinese labs had \u201cgenerated over 16 million exchanges with Claude through approximately 24,000 fraudulent accounts\u201d. <\/p>\n

Distillation has already led to some controversy. In the wake of the popularity of DeepSeek last year, for instance, OpenAI suggested that it had used the technique to build its efficient AI models<\/a>. That in turn led to a semi-crisis across the AI industry: the value of US tech stocks dramatically reduced, for instance, as investors feared that technologies such as those in ChatGPT were perhaps not as special, and therefore not as valuable, as they had presumed.<\/p>\n

In its accusations, however, Anthropic took an even more weighty tone. It said that distilled models of this kind \u201clack necessary safeguards, creating significant national security risks\u201d. That could mean, for instance, that anyone distilling its models could do so without the controls that mean that they cannot be used to \u201cfor example, develop bioweapons or carry out malicious cyber activities\u201d.<\/p>\n

\u201cForeign labs that distill American models can then feed these unprotected capabilities into military, intelligence, and surveillance systems\u2014enabling authoritarian governments to deploy frontier AI for offensive cyber operations, disinformation campaigns, and mass surveillance,\u201d it wrote. \u201cIf distilled models are open-sourced, this risk multiplies as these capabilities spread freely beyond any single government’s control.\u201d<\/p>\n

The accusation came at a sensitive time. Anthropic is currently locked in an argument with the US government over whether and how its systems can be used by the US government. It is currently fighting with the US Department of Defence which has demanded that Anthropic allow the government to put Anthropic to \u201cany lawful use\u201d, which the company has suggested would include mass surveillance and autonomous weapons.<\/p>\n

But distillation could make some of that argument moot. If it is to become widespread \u2013\u00a0and Anthropic suggested that it would, if immediate and important steps were not taken \u2013\u00a0then companies might not be in any position to argue about how their technologies can be used anyway.<\/p>\n

Anthropic\u2019s argument about distillation comes laced with some irony. Various commentators pointed out that the creation of such AI models in the first place is done through an analogous process: feeding vast amounts of text into a system so that it can learn how language works, by spotting patterns in the way that words are used. Many of the big AI companies have faced criticism that they have done that in the same \u201cillicit\u201d way that Anthropic accused its competitors of doing, without due respect or renumeration to the original creators of those texts.<\/p>\n

The law and ethics around those processes remains unclear. AI companies are locked in high-profile and high-cost legal battles with rightsholders who have accused them of stealing their work. Those legal cases will set precedents that themselves could make or break both the companies themselves as well as the economic and ethical underpinnings of the technology that they have become so rich by making.<\/p>\n

That, of course, is the thing about information: it wants to be free. Unlike rockets or chips, it can\u2019t easily be subject to export bans or restrictions. And so the argument about distillation all boils down to one about control.<\/p>\n","protected":false},"excerpt":{"rendered":"Distillation might never have been so controversial since Prohibition. Once again, society is locked in a complex and…\n","protected":false},"author":2,"featured_media":453746,"comment_status":"","ping_status":"","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[20],"tags":[554,733,4308,86,56,54,55],"class_list":{"0":"post-453745","1":"post","2":"type-post","3":"status-publish","4":"format-standard","5":"has-post-thumbnail","7":"category-artificial-intelligence","8":"tag-ai","9":"tag-artificial-intelligence","10":"tag-artificialintelligence","11":"tag-technology","12":"tag-uk","13":"tag-united-kingdom","14":"tag-unitedkingdom"},"_links":{"self":[{"href":"https:\/\/www.newsbeep.com\/uk\/wp-json\/wp\/v2\/posts\/453745","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.newsbeep.com\/uk\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.newsbeep.com\/uk\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.newsbeep.com\/uk\/wp-json\/wp\/v2\/users\/2"}],"replies":[{"embeddable":true,"href":"https:\/\/www.newsbeep.com\/uk\/wp-json\/wp\/v2\/comments?post=453745"}],"version-history":[{"count":0,"href":"https:\/\/www.newsbeep.com\/uk\/wp-json\/wp\/v2\/posts\/453745\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/www.newsbeep.com\/uk\/wp-json\/wp\/v2\/media\/453746"}],"wp:attachment":[{"href":"https:\/\/www.newsbeep.com\/uk\/wp-json\/wp\/v2\/media?parent=453745"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.newsbeep.com\/uk\/wp-json\/wp\/v2\/categories?post=453745"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.newsbeep.com\/uk\/wp-json\/wp\/v2\/tags?post=453745"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}