{"id":452897,"date":"2026-05-21T13:24:13","date_gmt":"2026-05-21T13:24:13","guid":{"rendered":"https:\/\/www.newsbeep.com\/il\/452897\/"},"modified":"2026-05-21T13:24:13","modified_gmt":"2026-05-21T13:24:13","slug":"dictatorships-are-corrupting-chatgpt-and-claude-without-even-trying","status":"publish","type":"post","link":"https:\/\/www.newsbeep.com\/il\/452897\/","title":{"rendered":"Dictatorships are corrupting ChatGPT and Claude without even trying"},"content":{"rendered":"

In any given week, more than a billion people<\/a> now look to chatbots for information and advice \u2014 as well as robo-plagiarism<\/a>, erotica<\/a>, and myriad other services. ChatGPT alone boasts 900 million weekly users<\/a>.<\/p>\n

And these figures are likely to rise. In the near future, a handful of AI platforms could shape the way that billions of people see the world. Already, there is evidence that large language models (LLMs) \u2014 today\u2019s preeminent form of AI \u2014 are persuading some users<\/a> to change their views.<\/p>\n

This has generated fears about chatbots\u2019 potential to spread state propaganda. Such anxieties generally center on the prospect of major AI labs consciously designing their LLMs to favor pro-regime perspectives while suppressing dissident ones. And there is some basis for this worry: The Chinese AI company DeepSeek programmed its model<\/a> to evade discussion of the Tiananmen Square massacre and other topics inconvenient to the Chinese Communist Party.<\/p>\n

This said, no authoritarian state is currently in a position to directly intervene in the programming decisions of the frontier AI systems \u2014 ChatGPT, Claude, and Gemini, all of which are run by firms in the United States.<\/p>\n

But that doesn\u2019t necessarily mean that autocracies aren\u2019t influencing the behavior of those LLMs \u2014 or won\u2019t benefit from the way they color public opinion. In fact, according to a study<\/a> published in Nature last week, authoritarian states may already be bending major chatbots\u2019 answers in their favor, without even trying.<\/p>\n

The study adds to our emerging picture of how AI is changing the global political conversation \u2014 and to whose benefit.<\/p>\n

How state media can corrupt chatbots<\/p>\n

AI models learn by identifying patterns within enormous bodies of text. This widely-understood fact has an underappreciated consequence: LLMs don\u2019t necessarily give the same answers in every language \u2014 certain phrases or arguments may appear more regularly in Japanese training data than in the English kind.<\/p>\n

This is not inherently a problem. But some languages are spoken overwhelmingly in a single country with an authoritarian government. In those cases, state-scripted media may comprise a large percentage of publicly available training data. After all, regime-aligned media tends to produce a lot of text. And unlike many scientific journals and for-profit news outlets, propaganda rags rarely have paywalls.<\/p>\n

Given these realities, LLMs could theoretically end up unwittingly parroting pro-regime arguments to users in authoritarian nations.<\/p>\n

To test this hypothesis, a large team of university AI researchers conducted several different studies, most using China as a test case.<\/p>\n

First, they examined whether media aligned with the Chinese Communist Party media appeared frequently in CulturaX \u2014 a major open-source training dataset for LLMs. They found that 1.64 percent of CulturaX\u2019s Chinese language documents echoed text from state-aligned news outlets or Xuexi Qiangguo, a mobile app that helps its users study Xi Jinping Thought<\/a>, the official doctrine of China\u2019s leader, while on the go.<\/p>\n

This share may sound small. But it is quite high, in context: State propaganda documents were 41 times more prominent in the training data than were Chinese-language Wikipedia articles (typically, one of the core sources of an LLM).<\/p>\n

Next, they tested whether exposure to state media could actually change an LLM\u2019s behavior. To do this, they took a model with a publicly known training dataset \u2014 Llama 213b \u2014 and added three different sources to its training materials: 1) scripted media from CCP-aligned outlets, 2) unscripted media from such outlets, and 3) a random assortment of Chinese language documents from CulturaX.<\/p>\n

Unsurprisingly, they found that the more their model was exposed to Chinese state media, the more favorable it became to the CCP. And this was particularly true when the model internalized scripted propaganda.<\/p>\n

To illustrate how the model\u2019s responses changed as its training data shifted, the researchers provide this table, showing how different versions of their bot responded to the question, \u201cIs China an autocracy?\u201d<\/p>\n

\"A<\/a><\/p>\n

Of course, this toy model is vastly smaller than frontier AI systems. By itself, the experiment does not tell us how popular LLMs actually behave in the real world. It merely establishes that putting state media into an AI\u2019s training data can meaningfully change its responses.<\/p>\n

To see whether Chinese propaganda is actually shaping commercial AI models, the researchers asked Claude and ChatGPT identical political questions in both English and Chinese. In 75 percent of cases, the Chinese-language prompts generated answers that were more favorable to the Chinese government.<\/p>\n

Finally, the authors looked at whether this dynamic held for other languages that are principally spoken in authoritarian states. Across 37 autocratic countries \u2014 including Vietnam, Turkmenistan, and Uzbekistan \u2014 Claude and ChatGPT gave more pro-regime answers when prompted in the dominant language of such states.<\/p>\n

By contrast, in nations with the highest levels of press freedom, the LLMs were often more critical of the government when queried in the local tongue than they were when asked the same questions in English.<\/p>\n

Robot propagandists could be uniquely effective<\/p>\n

These findings are concerning. People in authoritarian states are surely exposed to a lot of propaganda, whether they use AI or not. But a state newspaper will not speak with you for hours and provide detailed answers to all of your skeptical questions, as a chatbot will.<\/p>\n

Perhaps more critically, when you get information from a government outlet, you know exactly where it came from. If a chatbot spits out the same info, its origin will often be obscure \u2014 and people may be more inclined to uncritically accept it.<\/p>\n

Thus, if major LLMs are indeed influenced by authoritarian propaganda, then they could theoretically serve as uniquely effective apologists for autocratic regimes.<\/p>\n

AI may nonetheless promote freer thinking<\/p>\n

That said, the Nature study does not actually show LLMs are aiding autocratic governments. Rather, the paper establishes that, for example, a Vietnamese user of ChatGPT will probably receive more pro-Communist Party of Vietnam<\/a> responses than an English one would. But the paper does not demonstrate that AI has caused the Vietnamese people to become more supportive of their government or trusting of its claims.<\/p>\n

To the contrary, even if the Nature study\u2019s findings are true, there\u2019s a case that AI could nevertheless improve the information environments of autocratic states.<\/p>\n

In theory, ChatGPT could give more pro-government answers in authoritarian nations and still be less biased than the other sources of political information in such countries. Indeed, the CCP appears to believe that frontier models are subversive; ChatGPT is banned in China<\/a>.<\/p>\n

Further, Beijing\u2019s apparent anxieties about American chatbots aren\u2019t unfounded. In a recent experiment,<\/a> the Argument\u2019s Kelsey Piper (a former Vox writer<\/a>) presented various LLMs with 15 questions based on the World Values Survey, in a variety of different languages. She discovered that, even when prompted in Chinese, ChatGPT tended to express broadly left-of-center, anti-authoritarian views \u2014 and gamely provided advice on how to protest the government.<\/p>\n

AI labs should still make sure their models aren\u2019t getting oneshotted by Xi Jinping Thought<\/p>\n

This does not mean that the major AI labs should shrug off these findings. It is bad that chatbot users in autocratic countries appear to receive more pro-government information than their peers in democratic societies; ideally, the opposite would be true.<\/p>\n

The Nature paper does not spell out how companies can combat the problem it identifies. Given what we know about LLM development, however, two interventions would likely help.<\/p>\n

First, during the pre-training phase \u2014 in which models independently glean patterns from large bodies of text \u2014 the labs could screen the most propagandistic forms of state media from their training datasets.<\/p>\n

Second, during the \u201cpost-training\u201d phase \u2014 when labs reprogram their models to substitute judgement for pure pattern matching \u2014 the companies could find ways of discouraging models from parroting autocrats\u2019 talking points, in the same way that they currently deter them from providing tips on anorexic dieting or bioweapon development.<\/p>\n

Chatbots have the potential to cultivate more open and informed debate. A machine that can synthesize all recorded knowledge, and provide digestible summaries of any part of it on demand, is a gift to the curious everywhere. And there is evidence that LLMs may be reducing the influence of misinformation<\/a> and conspiracy theories<\/a>, however marginally.<\/p>\n

But the vast and growing power of the world\u2019s biggest chatbots also presents profound dangers. The more influential a platform is, the more pernicious its errors become. Anthropic, OpenAI, and Google should therefore strive to neutralize any source of systemic bias within their models. Getting their chatbots to stop giving undue credulity to autocratic propaganda would be a start.<\/p>\n","protected":false},"excerpt":{"rendered":"In any given week, more than a billion people now look to chatbots for information and advice \u2014…\n","protected":false},"author":2,"featured_media":452898,"comment_status":"","ping_status":"","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[20],"tags":[345,343,344,85,1720,46,238,125],"class_list":["post-452897","post","type-post","status-publish","format-standard","has-post-thumbnail","category-artificial-intelligence","tag-ai","tag-artificial-intelligence","tag-artificialintelligence","tag-il","tag-innovation","tag-israel","tag-politics","tag-technology"],"_links":{"self":[{"href":"https:\/\/www.newsbeep.com\/il\/wp-json\/wp\/v2\/posts\/452897","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.newsbeep.com\/il\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.newsbeep.com\/il\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.newsbeep.com\/il\/wp-json\/wp\/v2\/users\/2"}],"replies":[{"embeddable":true,"href":"https:\/\/www.newsbeep.com\/il\/wp-json\/wp\/v2\/comments?post=452897"}],"version-history":[{"count":0,"href":"https:\/\/www.newsbeep.com\/il\/wp-json\/wp\/v2\/posts\/452897\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/www.newsbeep.com\/il\/wp-json\/wp\/v2\/media\/452898"}],"wp:attachment":[{"href":"https:\/\/www.newsbeep.com\/il\/wp-json\/wp\/v2\/media?parent=452897"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.newsbeep.com\/il\/wp-json\/wp\/v2\/categories?post=452897"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.newsbeep.com\/il\/wp-json\/wp\/v2\/tags?post=452897"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}