The impressive capabilities of Chinese lab Moonshot\u2019s Kimi K3, the biggest open-weight large language model, has kicked off a debate that conflates two things: the economic possibilities of American AI giants and the future of LLMs as a technology.<\/p>\n
OpenAI\u2019s head of strategic futures, Dean W. Ball, went so far as to argue<\/a> that the US government should find a pretext to create regulatory fear, uncertainty, and distrust around the new models, since open-weight models must necessarily deter capital spending by the frontier labs. <\/p>\n People freaked out<\/a>, with tech luminaries like Yann LeCun<\/a> and Martin Casado<\/a> arguing that open software can accelerate innovation and coexist with proprietary projects. Ball soon retracted<\/a> his claims that a regulatory crackdown was the White House\u2019s \u201cbest strategy\u201d and that open-weight models necessarily slow down advances in the technology.<\/p>\n However, Axios reports<\/a> that the Trump administration is considering banning K3 and other advanced Chinese models at the behest of American frontier labs. Another report<\/a> from Politico said that the Department of Commerce would not take that step anytime soon. <\/p>\n The benefit for major AI companies is clear: Open-weight models, running on independent infrastructure or inside major enterprises, offers cheaper intelligence than Anthropic or OpenAI\u2019s class-leading models. If users increasingly spend more outside the closed labs, that means smaller return on their massive investments in model training.<\/p>\n That view extends far beyond OpenAI. \u201cStrong, frontier-caliber open source models will place a squeeze on the margins and will bring down the prices of the frontier companies,\u201d Braden Hancock, the co-founder of Snorkel AI and a research partner at the Laude Institute, told TechCrunch. \u201cIt will not necessarily mean that the amount of AI usage goes down a little bit. You know, obviously, quite the opposite.\u201d<\/p>\n That\u2019s not a problem for people without shares in Anthropic and OpenAI. AI will still proliferate. So what\u2019s the justification for the government to block Americans from purchasing something in our ostensibly free markets?<\/p>\n Concerns over Chinese models come in several flavors. One is protecting US data from the Chinese government; the US banned the import of modern Chinese EVs over concerns about their data gathering. But experts tend to think that open-weight models run on US servers are unlikely to leak data back to China, although it\u2019s not impossible that such a thing could be done. <\/p>\n Another is that the models may have implicit bias toward the PRC \u2014 but it\u2019s not clear what that might mean for, say, coding tasks.<\/p>\n A third common worry is that Chinese models lack the guardrails that the US government has mandated (through an opaque process<\/a>), which aim to prevent leading US LLMs from being used to exploit closed computer systems or create weapons. However, those same guardrails may make US companies more vulnerable: David Sacks, the venture capitalist and Trump adviser, has been sharing cases<\/a> of US companies turning to Chinese LLMs to close security gaps when US frontier models refuse to do the tasks.<\/p>\n But the most significant motivation for restricting the models is that fear that China will be able to outpace the US if the frontier labs slow down.<\/p>\n Sam Bresnick, a China-focused research fellow at Georgetown\u2019s Center for Security and Emerging Technology, says the growing importance of AI to the US military operations gives the US a reason to support continued investment in AI at the frontier labs. But the whole question, he says, is fraught.<\/p>\n \u201cWhy should the weight of the U.S. government be aimed at protecting these these companies from competitors that are being locked out from the U.S. market based on their origins?\u201d Bresnick asks.<\/p>\n Advocates for open AI say that the frontier companies are creating a false binary between innovation and closed models. <\/p>\n \u201cThe bigger impact of having these open source models come from China is less that they\u2019re sneaking in back doors, and more that they are owning the innovation,\u201d Hancock told TechCrunch. \u201cYou end up with, effectively, an expanded workforce on your model. PyTorch became the industry standard because it was open source, and so the whole community could contribute to it rather than just one company, and it grew and grew, and all the rest of the deep learning libraries kind of died in comparison.\u201d<\/p>\n Hancock and other advocates fear that Chinese LLMs will become the locus of international research. Already, US graduate programs mainly build on open-weight Chinese models, and Hancock says that half of the papers students study are coming from Chinese institutions, with American frontier labs increasingly reticent about sharing their work widely.<\/p>\n \u201cRestricting open models wouldn\u2019t make AI safer,\u201d said Clem Delangue, the CEO of Hugging Face, a platform for open AI collaboration. \u201cIt would simply hide the risks, concentrate power in the hands of a few and make it harder for the next generation of builders, researchers, academia, non-profits, governments to participate in making AI safer and more beneficial for all.\u201d<\/p>\n Bresnick says that the real way to slow China would be to focus more on chip export controls. A better way to preserve US AI leadership would be to stop selling Nvidia H200 processors to China. \u201cThat,\u201d he says, \u201ccould potentially keep us out of this thorny debate about banning open source technologies that huge numbers of US companies want to use.\u201d<\/p>\n Part of the problem is that uncertainty around AI economics. \u201cThe open business model, the proprietary business model \u2014 neither one is figured out. AI companies are struggling to figure out how to make money on their tools, especially as training costs need to go up and up,\u201d Bresnick points out.<\/p>\n The same challenges that play out in the US are also playing out in China, where AI companies are also struggling to generate revenue and access compute power, and the government is seen as encouraging open releases for policy reasons despite the challenge in capitalizing on them.<\/p>\n Some US companies, including Thinking Machines Lab and Nvidia, are trying to make a business around releasing open models. Hancock points out that Nvidia would do better \u201cif there are dozens or hundreds of companies building AI than rather than two or three that are well capitalized enough to make their own chips,\u201d which is one reason behind its investment in Nemotron<\/a>, a collection of open models.<\/p>\n \u201cThe main point is the U.S. would be very well served to have its own very capable, much less expensive open models,\u201d Bresnick said. \u201cIt just clashes with the approach the frontier labs have taken.\u201d<\/p>\n With additional reporting from Rebecca Bellan.<\/p>\n