{"id":172380,"date":"2025-12-03T06:26:07","date_gmt":"2025-12-03T06:26:07","guid":{"rendered":"https:\/\/www.newsbeep.com\/ie\/172380\/"},"modified":"2025-12-03T06:26:07","modified_gmt":"2025-12-03T06:26:07","slug":"anti-immigrant-material-among-ai-generated-content-getting-billions-of-views-on-tiktok-artificial-intelligence-ai","status":"publish","type":"post","link":"https:\/\/www.newsbeep.com\/ie\/172380\/","title":{"rendered":"Anti-immigrant material among AI-generated content getting billions of views on TikTok | Artificial intelligence (AI)"},"content":{"rendered":"

Hundreds of accounts on TikTok<\/a> are garnering billions of views by pumping out AI-generated content, including anti-immigrant and sexualised material, according to a report.<\/p>\n

Researchers said they had uncovered 354 AI-focused accounts pushing 43,000 posts made with generative AI tools and accumulating 4.5bn views over a month-long period.<\/p>\n

According to AI Forensics, a Paris-based non-profit, some of these accounts attempt to game TikTok\u2019s algorithm \u2013 which decides what content users see \u2013 by posting large amounts of content in the hope that it goes viral.<\/p>\n

One posted up to 70 times a day or at the same time of day, an indication of an automated account, and most of the accounts were launched at the beginning of the year.<\/p>\n

Last month TikTok revealed there were at least 1.3bn AI-generated posts on the platform. More than 100m pieces of content are uploaded to the platform every day, indicating that labelled AI material is a small part of TikTok\u2019s catalogue. TikTok is also giving users the option of reducing the amount of AI content they see<\/a>.<\/p>\n

Of the accounts that posted content most frequently, half focused on content related to the female body. \u201cThese AI women are always stereotypically attractive, with sexualised attire or cleavage,\u201d the report said.<\/p>\n

AI Forensics found the accounts did not label half of the content they posted and less than 2% carried the TikTok label for AI content \u2013 which the nonprofit warned could increase the material\u2019s deceptive potential. Researchers added that the accounts sometimes escape TikTok\u2019s moderation for months, despite posting content barred by its terms of service.<\/p>\n

Dozens of the accounts revealed in the study have subsequently been deleted, researchers said, indicating that some had been taken down by moderators.<\/p>\n

Some of the content took the form of fake broadcast news segments with anti-immigrant narratives<\/a> and material sexualising female bodies, including girls that appeared to be underage. The female body category accounted for half of the top 10 most active accounts, said AI Forensics, while some of the fake news pieces featured known broadcasting brands such as Sky News and ABC.<\/p>\n

Some of the posts have been taken down by TikTok after they were referred to the platform by the Guardian.<\/p>\n

TikTok said the report\u2019s claims were \u201cunsubstantiated\u201d and the researchers had singled it out for an issue that was affecting multiple platforms. In August the Guardian revealed that nearly one in 10 of the fastest growing YouTube channels globally were showing only AI-generated content<\/a>.<\/p>\n

\u201cOn TikTok, we remove harmful AIGC [artificial intelligence-generated content], block hundreds of millions of bot accounts from being created, invest in industry-leading AI-labelling technologies and empower people with tools and education to control how they experience this content on our platform,\u201d a TikTok spokesperson said.<\/p>\n

An example of AI \u2018slop\u2019, content that is nonsensical and designed to clutter social media feeds. Photograph: TikTok<\/p>\n

The most popular accounts highlighted by AI Forensics in terms of views had posted \u201cslop\u201d, the term for AI-made content that is nonsensical, bizarre and designed to clutter up people\u2019s social media feeds \u2013 such as animals competing in an Olympic diving contest<\/a> or talking babies<\/a>. The researchers acknowledged that some of the slop content was \u201centertaining\u201d and \u201ccute\u201d.<\/p>\n

skip past newsletter promotion<\/a><\/p>\n

A weekly dive in to how technology is shaping our lives<\/p>\n

Privacy Notice: Newsletters may contain information about charities, online ads, and content funded by outside parties. If you do not have an account, we will create a guest account for you on theguardian.com<\/a> to send you this newsletter. You can complete full registration at any time. For more information about how we use your data see our Privacy Policy<\/a>. We use Google reCaptcha to protect our website and the Google Privacy Policy<\/a> and Terms of Service<\/a> apply.<\/p>\n

TikTok guidelines prohibit using AI to depict fake authoritative sources, the likeness of under-18s or the likeness of adults who are not public figures.<\/p>\n

\u201cThis investigation of [automated accounts] shows how AI content is now integrated into platforms and a larger virality ecosystem,\u201d the researchers said.<\/p>\n

\u201cThe blurring line between authentic human and synthetic AI-generated content on the platform is signalling a new turn towards more AI-generated content on users\u2019 feeds.\u201d<\/p>\n

The researchers analysed data from mid-August to mid-September. Some of the content attempts to make money from users, including pushing health supplements via fake influencers, promoting tools that help make viral AI content and seeking sponsorships for posts.<\/p>\n

AI Forensics, which has also highlighted the prevalence of AI content on Instagram, said it welcomed TikTok\u2019s decision to let users limit the amount of AI content they see, but that labelling had to improve.<\/p>\n

\u201cGiven the structural and non-negligible amount of failure to identify such content, we remain sceptical regarding the success of this feature,\u201d they said.<\/p>\n

The researchers added that TikTok should consider creating an AI-only feature on the app in order to separate AI-made content from human-created posts. \u201cPlatforms must go beyond weak or optional \u2018AI content\u2019 labels and consider segregating generative content from human-created material, or finding a fair system that enforces systematic and visible labelling of AI content,\u201d they said.<\/p>\n