{"id":679604,"date":"2026-05-18T23:35:09","date_gmt":"2026-05-18T23:35:09","guid":{"rendered":"https:\/\/www.newsbeep.com\/au\/679604\/"},"modified":"2026-05-18T23:35:09","modified_gmt":"2026-05-18T23:35:09","slug":"a-key-science-publishing-platform-is-cracking-down-on-ai-slop","status":"publish","type":"post","link":"https:\/\/www.newsbeep.com\/au\/679604\/","title":{"rendered":"A key science publishing platform is cracking down on AI slop"},"content":{"rendered":"

The pre-print website arXiv has announced<\/a> that researchers who put their names to papers which included errors clearly generated by artificial intelligence (AI) will face a year-long ban and ongoing restrictions.<\/p>\n

The move is a response to a growing influx of AI-generated papers<\/a> faced by scholarly journals as well as sites such as arXiv, which serve as unofficial platforms for research publication ahead of peer review.<\/p>\n

However, not everyone agrees that arXiv\u2019s response to the problem is appropriate \u2013 and the solution to the flood of AI slop research may involve more AI, not less.<\/p>\n

The rise of bot-assisted writing<\/p>\n

AI-generated text is on the rise everywhere. A study released last week<\/a> suggests half of new articles published online are now \u201cprimarily AI-generated\u201d.<\/p>\n

Science is not immune to this trend. Last month, the journal Organization Science published a study<\/a> of how the rise of AI has affected submissions and peer reviews since the release of ChatGPT in 2022. Reporting a dramatic rise in submitted papers and a drop in quality, the authors conclude that \u201cthe current state of AI tools, amplified by existing publish-or-perish incentives, appears to be pushing the system toward an equilibrium of more rather than better research\u201d.<\/p>\n

A common problem in AI-generated research writing is hallucinated citations<\/a>: references to other research that does not exist.<\/p>\n

The traditional safeguard against poor quality in scholarly publishing is peer review<\/a>: another expert in the subject at hand reads the research paper and interrogates the work behind it before it can be published. <\/p>\n

However, the peer review system was already struggling<\/a> before AI. Pressured researchers often have little time or incentive to do the unpaid work of peer review.<\/p>\n

And on arXiv, which publishes preprints \u2013 articles which have most often not been peer-reviewed \u2013 even this system is not available. Last year, flooded with AI-generated submissions, the site stopped accepting<\/a> certain types of article.<\/p>\n

A study published in January<\/a> (itself a preprint) estimated around 1 in 8 papers in biomedical science now contain AI-generated text.<\/p>\n

Most researchers would agree that AI-generated text is not a problem in itself. The problem is the lower-quality work that AI can make easy to produce.<\/p>\n

Does the punishment fit the crime?<\/p>\n

The ArXiv announcement doesn\u2019t come out against AI use, but rather says <\/p>\n

If a submission contains incontrovertible evidence that the authors did not check the results of LLM generation, this means we can\u2019t trust anything in the paper.<\/p>\n

This may be true as far as it goes. But the penalty \u2013 a year-long ban for all authors listed on a paper \u2013 may be out of keeping with current research practices.<\/p>\n

In the past, research was often carried out by people working alone or in groups of two or three. In these circumstances, it seems reasonable to expect each author to take responsibility for the whole.<\/p>\n

But research is now more collaborative than ever before. Many papers have four or five authors, and in a growing number of extreme cases<\/a> papers may be credited to groups of hundreds of scientists working together<\/a>, each working on their own speciality and trusting their colleagues to be doing the same.<\/p>\n

In a case where one author of dozens or hundreds included an AI-hallucinated reference in their part of the paper, banning the lot seems harsh.<\/p>\n

And there are no equivalent sanctions for publishing other problematic material. There\u2019s no ban for pushing fringe or discredited theories, or using poor quality evidence and illogical arguments, for example.<\/p>\n

Can AI help fight slop?<\/p>\n

The rise of AI produces problems for publishers and quality assurance. And the idea of some kind of sanctions for reckless use of AI, such as included hallucinated references, is a good one.<\/p>\n

But ArXiv\u2019s particular choice seems drastic. If the goal is to improve peer review and quality assurance, AI systems themselves can play a role. <\/p>\n

Modern AI systems are quite capable of taking a list of references and checking everything on it<\/a> is a real paper available on the internet. Any references flagged as suspect can then be checked by a human.<\/p>\n

AI can even be useful for carrying out quick sense-checks of things like a paper\u2019s statistical analysis.<\/p>\n

Perhaps this is the way forward, rather than harsh sanctions for relatively minor AI-related infractions.<\/p>\n","protected":false},"excerpt":{"rendered":"The pre-print website arXiv has announced that researchers who put their names to papers which included errors clearly…\n","protected":false},"author":2,"featured_media":679605,"comment_status":"","ping_status":"","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[20],"tags":[256,254,255,64,63,105],"class_list":["post-679604","post","type-post","status-publish","format-standard","has-post-thumbnail","category-artificial-intelligence","tag-ai","tag-artificial-intelligence","tag-artificialintelligence","tag-au","tag-australia","tag-technology"],"_links":{"self":[{"href":"https:\/\/www.newsbeep.com\/au\/wp-json\/wp\/v2\/posts\/679604","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.newsbeep.com\/au\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.newsbeep.com\/au\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.newsbeep.com\/au\/wp-json\/wp\/v2\/users\/2"}],"replies":[{"embeddable":true,"href":"https:\/\/www.newsbeep.com\/au\/wp-json\/wp\/v2\/comments?post=679604"}],"version-history":[{"count":0,"href":"https:\/\/www.newsbeep.com\/au\/wp-json\/wp\/v2\/posts\/679604\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/www.newsbeep.com\/au\/wp-json\/wp\/v2\/media\/679605"}],"wp:attachment":[{"href":"https:\/\/www.newsbeep.com\/au\/wp-json\/wp\/v2\/media?parent=679604"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.newsbeep.com\/au\/wp-json\/wp\/v2\/categories?post=679604"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.newsbeep.com\/au\/wp-json\/wp\/v2\/tags?post=679604"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}