Citing credible media sources such as CNN, Grok separately misidentified an image of Ahmed as that of an Israeli hostage held by the Palestinian militant group Hamas for more than 700 days.
When asked about another scene from the attack, Grok incorrectly claimed it was footage from tropical “cyclone Alfred”, which generated heavy weather across the Australian coast earlier this year.
Only after another user pressed the chatbot to re-evaluate its answer did Grok backpedal and acknowledge the footage was from the Bondi Beach shooting.
When reached for comment by AFP, Grok-developer xAI responded only with an auto generated reply: “Legacy Media Lies”.
‘Crisis actor’
The misinformation underscores what researchers say is the unreliability of AI chatbots as a fact-checking tool.
Internet users are increasingly turning to chatbots to verify images in real time, but the tools often fail, raising questions about their visual debunking capabilities.
In the aftermath of the Sydney attack, online users circulated an authentic image of one of the survivors, falsely claiming he was a “crisis actor”, disinformation watchdog NewsGuard reported.
Crisis actor is a derogatory label used by conspiracy theorists to allege that someone is deceiving the public – feigning injuries or death – while posing as a victim of a tragic event.
Online users questioned the authenticity of a photo of the survivor with blood on his face, sharing a response from Grok that falsely labelled the image as “staged” or “fake”.
NewsGuard also reported that some users circulated an AI image – created with Google’s Nano Banana Pro model – depicting red paint being applied on the survivor’s face to pass off as blood, seemingly to bolster the false claim that he was a crisis actor.
Researchers say AI models can be useful to professional fact-checkers, helping to quickly geolocate images and spot visual clues to establish authenticity.
But they caution that they cannot replace the work of trained human fact-checkers.
In polarised societies, however, professional fact-checkers often face criticism from conservatives of liberal bias, a charge they reject.
AFP currently works in 26 languages with Meta’s fact-checking programme, including in Asia, Latin America, and the European Union.
-Agence France-Presse