False AI ‘fact-checks’ stir online chaos after Kirk assassination

Grok also falsely claimed that a Utah-based registered Democrat named Michael Mallinson had been identified as the shooter, wrongly attributing the information to major news outlets such as CNN and the New York Times.

Mallinson, in reality a 77-year-old retired Canadian banker living in Toronto, said he was “shocked” by thousands of social media posts that labelled him the culprit.

Breaking news events often spark a frantic search for new information on social media, frequently leading to false conclusions that chatbots then regurgitate, contributing to further online chaos.

The tide of misinformation comes after a volatile environment in the United States following Kirk’s assassination, with many right-wing influencers from Trump’s Make America Great Again (Maga) political base calling for violence and “retribution” against the left.

The motives of the gunman involved in the shooting – who remains at large – are unknown.

Meanwhile, some conspiracy theorists have baselessly claimed that the video showing Kirk being shot was AI-generated, asserting that the entire incident was staged.

The assertion underscores how the rise of cheap and widely available AI tools has given misinformation peddlers a handy incentive to cast doubt about the authenticity of real content – a tactic researchers have dubbed as the “liar’s dividend”.

“We have analysed several of the videos [of Kirk’s shooting] circulating online and find no evidence of manipulation or tampering,” said Hany Farid, the co-founder of GetReal Security and a professor at the University of California, Berkeley.

Farid also reported seeing some AI-generated videos.

“This is an example of how fake content can muddy the waters and in turn cast doubt on legitimate content,” he said.

The falsehoods underline how facts are increasingly under assault in a misinformation-filled internet landscape, an issue exacerbated by public distrust of institutions and traditional media.

It has exposed an urgent need for stronger AI detection tools, experts say, as major tech platforms have largely weakened safeguards by reducing investment in human fact-checking.

Researchers say chatbots have previously made errors verifying information related to other crises such as the Israel-Hamas war in the Middle East, the recent India-Pakistan conflict, and anti-immigration protests in Los Angeles.

A recent audit by NewsGuard found that 10 leading AI chatbots repeated false information on controversial news topics at nearly double the rate compared to one year ago.

“A key factor behind the increased fail rate is the growing propensity for chatbots to answer all inquiries, as opposed to refusing to answer certain prompts,” NewsGuard said in a report last week.

“The Large Language Models (LLMs) now pull from real-time web searches – sometimes deliberately seeded by vast networks of malign actors.”

-Agence France-Presse