Many of the largest and most widely established state-sponsored online propaganda campaigns have embraced using artificial intelligence, a new report finds \u2014 and they\u2019re often bad at it.<\/p>\n
The report, by the social media analytics company Graphika, analyzed nine ongoing online influence operations \u2014 including ones it says are affiliated with China\u2019s and Russia\u2019s governments \u2014 and found that each has, like much of social media, increasingly adopted generative AI to make images, videos, text and translations.<\/p>\n
The researchers found that sponsors of propaganda campaigns have come to rely on AI for core functions like making content and creating influencer personas on social media, streamlining some campaigns. But the researchers say that content is low quality and gets little engagement. <\/p>\n
The findings run counter to what many researchers had anticipated with the growing sophistication of generative AI \u2014 artificial intelligence that mimics human speech, writing and images in pictures and videos. The technology has rapidly become more advanced in recent years, and some experts warned<\/a> that propagandists working on behalf of authoritarian countries would embrace high-quality, convincing synthetic content designed to deceive even the most discerning people in democratic societies.<\/p>\n Resoundingly, though, the Graphika researchers found that the AI content created by those established campaigns is low-quality \u201cslop,\u201d ranging from unconvincing synthetic news reporters in YouTube videos to clunky translations or fake news websites that accidentally include AI prompts in headlines.<\/p>\n \u201cInfluence operations have been systematically integrating AI tools, and a lot of it is low-quality, cheap AI slop,\u201d said Dina Sadek, a senior analyst at Graphika and co-author of the report. As was the case before such campaigns started routinely using AI, the vast majority of their posts<\/a> on Western social media sites receive little to no attention, she said.<\/p>\n Online influence campaigns aimed at swaying American politics and pushing divisive messages go back at least a decade, when the Russia-based Internet Research Agency<\/a> created scores of Facebook and Twitter accounts and tried to influence the 2016 presidential election.<\/p>\n As in some other fields, like cybersecurity<\/a> and programming<\/a>, the rise of AI hasn\u2019t revolutionized the field of online propaganda, but it has made it easier to automate some tasks, Sadek said.<\/p>\n \u201cIt might be low-quality content, but it\u2019s very scalable on a mass scale. They\u2019re able to just sit there, maybe one individual pressing buttons there, to create all this content,\u201d she said.<\/p>\n Examples cited in the report include \u201cDoppelganger,\u201d an operation the Justice Department has tied to the Kremlin<\/a>, which researchers say used AI to create unconvincing fake news websites, and \u201cSpamoflauge,\u201d which the Justice Department has tied to China<\/a> and which creates fake AI news influencers to spread divisive but unconvincing videos on social media sites like X and YouTube. The report cited several operations that used low-quality deepfake audio.<\/p>\n One example posted deepfakes of celebrities like Oprah Winfrey and former President Barack Obama, appearing to comment on India\u2019s rise in global politics. But the report says the videos came off as unconvincing and didn\u2019t get much traction.<\/p>\n