“ALBANESE LOSES IT AS BARNABY JOYCE TEARS INTO HIM OVER NEW HATE SPEECH LAWS — LABOR’S CENSORSHIP AGENDA EXPOSED!”

“Pauline Hanson and Lee Hanson unveil never-seen duet — a song connecting them across time.”

“SHOCKING NEWS FROM AUSTRALIA: BILLIONAIRE GINA RINEHART FULLY SPONSORS THE EDUCATION OF THE CHILD PRODIGY WHO SAVED HIS FAMILY.”

What do all of these stories have in common? None are real.

A facebook post with a splitscreen image of Barnaby Joyce and Anthony Albanese. A graphic overlay says FAKE NEWS A fake news story involving One Nation’s Barnaby Joyce and Prime Minister Barnaby Joyce.(Supplied)A woman with red hair and a woman with blonde hair smiling and embracing around a microphone This AI-generated image of Pauline and Lee Hanson appeared on a fake news post on Facebook.A facebook fake news post featuring Gina Rinehart and Austin Appelbee A fake news story about mining billionaire Gina Rinehart.(Supplied)

They’re part of a trove of Facebook posts created by overseas-based accounts that ABC NEWS Verify has examined in detail.

The posts use a mix of AI-generated and genuine images combined with compelling but completely fake stories.

They’ve attracted hundreds of thousands of likes, comments and shares — many from very real Australian voters who appear to believe the fake news they are being served.

So you can understand how the accounts are using Australian politics to manipulate users, we’ve downloaded all the images from one week of posts from 14 of these accounts.

NOTE: The images in this mosaic are a mix of human and artificially generated. When we show you an image up close, we’ll tell you if it’s AI-generated, but other AI images are not labelled.

A large mosaic of images. A mosaic containing a raft of fake news images, some AI-generated.(ABC NEWS Verify)

There are 370 images in this mosaic, taken from the week beginning February 7 and ending February 14.

One Nation leader Pauline Hanson is the main focus of the accounts.

A black and white headshot of a woman with cropped hair sits in an orange circle graphic.A large mosaic of images, half of them are orange. Senator Hanson appears in over half of the images.(ABC NEWS Verify)

She appears in 191, or just over half, of the week’s posts.

Let’s take a look at some of her adventures.

Senator Hanson often appears engaging in acts of altruism.

A large mosaic of images. An AI-generated image of Senator Hanson donating money to Austin Appelbee.(ABC NEWS Verify)

Here she is in an AI-generated image giving an oversized novelty cheque to Austin Appelbee, the boy whose swimming heroism captivated the nation.

It has been shared 275 times, with more than 11,000 reactions.

Later in the week, a different account claimed Senator Hanson was battling cancer in another AI-generated image.

A large mosaic of images. Fake news scammers depicted Senator Hanson as sick.(ABC NEWS Verify)

Anger is a very common theme. Senator Hanson is often shown raging against other politicians and public figures.

She is portrayed positively as a crusader, while her opponents are overwhelmingly cast negatively.

Here she is with independent senator Fatima Payman, who the post erroneously labelled as a member of the Greens. These images appear to be genuine photographs, which have been stitched together.

Pauline Hanson split screen with Fatima Payman Senator Hanson is often pitted against other politicians.(ABC NEWS Verify)

And here she is with Prime Minister Anthony Albanese, who is a frequent target of the senator.

Pauline Hanson split screen with Anthony Albanese Prime Minister Anthony Albanese is a common opponent for Pauline Hanson.(ABC NEWS Verify)

Speaking of the prime minister, he’s the second-most featured personality in the week we looked at.

Anthony Albanese appears in 93 posts.

A black and white headshot of a man wearing glasses. His face sits within a red graphic circle.A large mosaic. Most squares are blacked out but about a quarter are red. Prime Minister Anthony Albanese appears in 93 of the images.(ABC NEWS Verify)

In 45 of those posts, he’s pitted against Senator Hanson in some way. None are supportive of Labor.

A large mosaic. Most squares are blacked out but 45 are red. Prime Minister Anthony Albanese appears with Pauline Hanson in 45 images.(ABC NEWS Verify)

The posts are often presented as “breaking news” or “live” to create a sense of urgency.

Pauline Hanson and Anthony Albanese split screen. Text says "Pauline Hanson wins!" Senator Hanson is often portrayed as the victor, while Mr Albanese is cast in a negative light.(ABC NEWS Verify)

Mr Albanese is frequently painted in a negative light and portrayed as the loser of these battles.

The third-most common public figure might surprise you.

It’s Peta Credlin, the former chief of staff to former Liberal prime minister Tony Abbott, who is now a presenter and commentator on Sky News.

A black and white headshot of a woman with long hair. Her face sits in a blue graphic circle.

Credlin appears in the week’s dataset 63 times.

A large image mosaic. 63 of the squares are blue. Peta Credlin appears in 63 of the posts.(ABC NEWS Verify)

She has also been depicted as sick.

Peta Credlin lies in bed holding a sign that says "I'm battling cancer. Pray for me" AI has been used to make fake news about Peta Credlin being sick.(ABC NEWS Verify)

As well as in fake acts of philanthropy.

Peta Credlin holds two babies in the top image. In the bottom image they are grown blonde women She has also been pictured in fake acts of philanthropy.(ABC NEWS Verify)

And of course, in angry conflict with the prime minister.

Peta Credlin and Anthony Albanese shout at eachother on a news set. AI was used to generate this image of the prime minister and Credlin fighting.(ABC NEWS Verify)

ABC NEWS Verify examined 20 overseas Facebook pages, mostly administered from Vietnam, using these tactics to enrage and engage Australian Facebook users.

Anne Kruger, a University of Queensland expert in countering false information on social media, told ABC NEWS Verify the algorithms serving content to users on social media were currently geared towards anger.

She’d like to see the social media giants do better.

“I think we have design engineers that can do more when it comes to flagging what is the quality information and leading people to that,” she said.

“Why is it so easy to be led to the bottom feeders when it comes to content and those that are making money out of it? Can we please make it easier for people to actually find quality information?”

Queensland University of Technology disinformation researcher Timothy Graham said there were likely many more similar accounts beyond what ABC NEWS Verify examined out there.

“I would wager that this is the tip of the iceberg,” he said.

A fake news story involving Peta Credlin and philanthropist George Soros.(Supplied)A facebook post with two politicians shouting at each other. In the foreground, comments supportive of Pauline Hanson Pauline Hanson and Penny Wong.(Supplied)

Many commenters, who appeared to be genuine Australian accounts, seemed to believe the fake news they were being served.

A unique mystery

On the surface, a Facebook account with the name Trần Tân paints a picture of a life of muted affluence in Vietnam.

Photos posted to the account show a man shopping and sitting in an opulent hotel foyer.

A man stares out at the city lights at night from within a restaurant. Dining.(Supplied)A man sits in a hotel lobby. Lounging.(Supplied)Facebook photo Shopping.(Supplied)

The account is involved with running a page ABC NEWS Verify examined, called Unique Mystery.

It appears to be generating fake news for money.

Each post includes a link to a story on a fake news website, where users are served ads.

It’s the same model for the vast majority of accounts that ABC NEWS Verify examined.

Most of the accounts have at least one admin based in Vietnam listed in their transparency information. Some have admins in Sri Lanka, the Philippines and the United States.

Two accounts, Down Under Daily and Strength in Principle, were only established in January and immediately began pumping out Australian fake news.

Others have been around for longer — some years — and had previously been creating fake news that targeted other countries. ABC NEWS Verify has been unable to connect any of the other fake news accounts to their administrators.

In January, the Trần Tân account also established a Facebook group called Team Pauline Hanson.

The group has grown rapidly and many of its followers appear to be to real Australians.

On February 19, it had around 3,000 members. It is now close to 50,000.

ABC NEWS Verify sent questions to the Trần Tân account but did not receive a response.

How did we connect the Trần Tân account to Unique Mystery?

AI slop meets Australian politics

AI slop refers to artificially generated content that is shallow in nature and created with the express purpose of driving engagement.

The pages examined by ABC NEWS Verify have been using it to great effect. But they haven’t been using it just to target Australia.

Pauline Hanson wears a red jacket and hands a large cheque worth $50k to a man with a Carl nametag An AI-generated image of Pauline Hanson handing a cheque to a man named Carl.(Supplied)

Here’s an AI-generated image of Senator Hanson supposedly giving a cheque to her high-school janitor (misspelled as “junction”) Carl.

But this fake story is not new.

Dolly Parton has blonde hair and wears a sparkle dress has arm around an older man blue shirt with a novelty cheque An AI image of American singer Dolly Parton giving a cheque to a high school janitor.(Supplied)

Here’s Carl receiving a cheque from singer Dolly Parton

Kurt Russell with his arm around a janitor wearing a blue shirt. He holds a large novelty cheque An AI-generated image of Kurt Russell giving an oversized cheque to a high school janitor.(Supplied)

… actor Kurt Russell …

Novak Djokovic wears all denim has hand around an older man in a blue shirt with a novelty cheque An AI-generated image of tennis player Novak Djokovic giving a cheque to a high-school janitor.(Supplied)

And tennis star Novak Djokovic, who appears to have made out the cheque to himself.

Using Facebook’s search function, ABC NEWS Verify found many instances of recycled fake news ideas.

Journalist Waleed Aly has been placed multiple times in conflict with Senator Hanson, Peta Credlin and even singer Barbra Streisand

Bizarrely, they appear to have used a London news set as a backdrop.

Three box split image with a man and a woman arguing. London is visible in the background AI-generated Peter Credlin and Waleed Aly arguing on a British TV set.(Supplied)Three box split image with a man and a woman arguing. London is visible in the background AI-generated Pauline Hanson and Waleed Aly arguing on a British TV set.(Supplied)Three box split image with a man and a woman arguing. London is visible in the background AI-generated Barbara Streisand and Waleed Aly arguing on a British TV set.(Supplied)

Dr Graham said this could be a sign of pages working together.

“I do think there is clear indicators of coordinated, inauthentic behaviour … the template of the content reuse is probably the biggest signal giveaway.”

Do you know more?Email Michael Workman at workman00@protonmail.com or Matt Martino at mattmartino@protonmail.comIf you require more secure communication, please choose an option on the confidential tips pageStoking fear without celebrity

One page, named Inside Australia, posted an AI-generated video of a woman, speaking in an Australian accent, railing against immigration.

It appears to have used a similar prompt in this near-identical video of a woman railing against immigration in a British accent, against a backdrop of British flags and posted by a page called UK Diaries.

Loading…

Inside Australia is one of two pages ABC NEWS Verify examined that does not link to an external website in its posts.

Dr Graham said that the goal for these pages was likely different, pointing to Meta’s revenue sharing program, which pays creators for engagement.

“I would be very surprised if those AI personas are not monetised,” he said.

Meta did not respond to questions about whether any of the pages were being paid as part of its creator program.

Fake news, real impacts

ABC NEWS Verify contacted some of the Australian personalities featured to ask how they felt about being the subject of fake news.

Senator Hanson and Peta Credlin both said they had been contacted by members of the public enquiring about their welfare.

“These posts falsely claiming that myself and members of my family are suffering serious health issues (or in the case of my elderly Mum, have died) have been personally upsetting particularly for Mum,” Credlin told ABC NEWS Verify.

A photo of a woman in a wedding dress with a woman wearing a blue dress and pearls. On the right the blue dress woman is sick On the left, a genuine image of Peta Credlin and her mother. On the right, two AI-generated images.(Supplied)

“I am staggered that so many people have seen these posts and assumed that they are factful … I am not on Facebook but many of my mother’s connections are, and she’s been devastated by what has been published.”

A spokesman for One Nation called on the social media giants to do more.

“Platforms are clearly not scrutinising the establishment of online accounts to the best of their ability, nor are they acting fast enough to suspend or take down accounts of those reported for suspicious behaviour,” he said.

“If social media companies won’t act voluntarily to safeguard Australians from the onslaught of AI scams and malicious fake posts, it may require further legislative intervention.”

Senator Payman accused the Labor government of a “lack of political will and leadership … to address this stream of disinformation and misinformation head-on”.

“Either we get serious about standards to stop AI being weaponised in politics without guardrails, or we let the loudest outrage merchants set the tone.”

ABC NEWS Verify sent questions to Prime Minister Anthony Albanese and Minister for Communications Annika Wells about whether the government had plans to address this issue.

A spokeswoman for the Department of Infrastructure provided a statement that did not respond directly and instead pointed towards fact-checking and media literacy initiatives that the government had funded.

Some pages down, but plenty more remain

After ABC NEWS Verify contacted Meta, it took down most — but not all — of the pages we highlighted for violating its inauthentic behaviour policies.

Meta said it was constantly enforcing against inauthentic behaviour using a combination of manual enforcement and automated systems, telling ABC NEWS Verify in a statement that it was still “investigating the content” for any violations of Meta policy.

As those investigations by Meta continue, ABC NEWS Verify has identified even more fake political news accounts since the company was made aware of this story.

Senator Payman said Meta should do more.

“If platforms like Meta can detect copyrighted music in seconds, they can certainly detect coordinated AI-generated smear pages. The question is whether they want to when there is no imperative to?”

CreditsResearch and reporting: Michael WorkmanResearch, reporting, design and digital production: Matt MartinoFact-checking and editing: Lucy CarterDesign: Devi MallalHow did we connect the Trần Tân account to Unique Mystery?

The Facebook group Team Pauline Hanson was established in January this year. Trần Tân is listed as the account that established the group.

Unique Mystery was listed first as the administrator of the page.

The Trần Tân account was also listed as an administrator, alongside another account named Quang Trương and two other profiles that appear to be dummy accounts.

The two dummy accounts post fake news content that links to the same fake news website that Unique Mystery links to in its posts.

Trần Tân, Quang Trương and one of the dummy profiles are listed as administrators on three other fake news pages, which all target the US, including one called Team Melania Trump.