{"id":571484,"date":"2026-08-17T07:38:21","date_gmt":"2026-08-17T07:38:21","guid":{"rendered":"https:\/\/www.newsbeep.com\/nz\/571484\/"},"modified":"2026-08-17T07:38:21","modified_gmt":"2026-08-17T07:38:21","slug":"report-supporting-australias-teen-social-media-ban-appears-to-contain-ai-hallucinations-senate-hears-social-media-ban","status":"publish","type":"post","link":"https:\/\/www.newsbeep.com\/nz\/571484\/","title":{"rendered":"Report supporting Australia\u2019s teen social media ban appears to contain AI hallucinations, Senate hears | Social media ban"},"content":{"rendered":"

The authors of a report testing the technology underpinning Australia\u2019s social media ban have conceded ChatGPT<\/a> was used in editing, but denied a number of citation errors in the report were due to AI hallucinations.<\/p>\n

The $3.48m age assurance technology trial<\/a>, run by the UK-based Age Check Certification Scheme (ACCS) last year, tested various types of technology that could be used by social media platforms as part of Australia\u2019s under-16 social media ban.<\/p>\n

The communications minister, Anika Wells, heralded the report as showing \u201cmany effective options\u201d for checking people\u2019s ages, and it paved the way for the ban to come into effect in December last year.<\/p>\n

Most of the report is based on tests the authors did of the various age-verification technologies currently available, but one chapter covers \u201cemerging technologies\u201d and cites a number of journal papers about potential new ways to check ages.<\/p>\n

An ongoing Senate inquiry seeking to further strengthen the social media ban law received a submission highlighting at least two citation errors in the report. The \u201ccitations \u2026 appear to be AI hallucinated, rather than being based on real sources,\u201d it said.<\/p>\n

When asked about the allegation by Guardian Australia this month, a spokesperson for ACCS initially denied the use of AI in the report, but later conceded that AI had been used to rewrite paragraphs more succinctly.<\/p>\n

\u201cWe did not use AI in the generation of the report or the cited materials \u2026 Each one of them were checked as genuine links and reports and that they were relevant to the specific issue being cited,\u201d they said.<\/p>\n

However, Guardian Australia\u2019s own analysis of the report identified six references in the same section that contained errors.<\/p>\n

The errors include: Digital Object Identifiers (DOIs \u2013 unique combinations of letters and numbers which are associated with specific academic articles) that link to papers that do not exist; DOIs that point to incorrect papers; author name, journal and publication year combinations that do not match any known references; and DOI links to papers that did not say what the report suggested they said.<\/p>\n

Sign up for the Breaking News Australia email<\/a><\/p>\n

The spokesperson later provided clarifications and new references to the research ACCS had relied on, but this response too contained errors.<\/p>\n

A list of journal articles intended to correct those in the report included years, authors and journal titles not matching the original citations in the report.<\/p>\n

One article ACCS cited was apparently accessed in March 2025. However, one of the lead authors of this study confirmed to the Guardian that their article was not publicly accessible until it was published in June 2025. They also confirmed that the person originally cited by ACCS as the paper\u2019s lead author, \u201cJamil\u201d, had never been on the paper, and that the ACCS report had summarised their paper incorrectly.<\/p>\n

The ACCS spokesperson provided further clarification regarding another reference that could not be found in the journal cited \u2013 \u201cWeber et al. 2011\u201d \u2013 by saying it was cited in a study by Monash University, which they provided to the Guardian. However there was no reference attributed to Weber in the Monash paper ACCS sent.<\/p>\n

The spokesperson only conceded AI had been used after the Guardian identified four links in part E and part K of the report that contained metadata identifying that the source of the link was ChatGPT.<\/p>\n

They maintained that by including the metadata of ChatGPT in the links the organisation had disclosed its use, and given the links were correct, they did not see that as a problem.<\/p>\n

They said AI had been used to rewrite some paragraphs more succinctly, but was not used for originating research or for the generation of the report.<\/p>\n

\u201cAll of the links were checked and verified and, whilst I apologise if there is an inadvertent error, this was all done by human verification.\u201d<\/p>\n

skip past newsletter promotion<\/a>Free newsletter | When needed<\/p>\n

Sign up to Breaking News Australia<\/p>\n

Get the most important news as it breaks<\/p>\n

\"\"<\/p>\n

The federal government has previously taken a dim view of contractors using AI in reports to government. Deloitte last year refunded part of its $440,000 contract<\/a> with the government after errors were identified, and the consultant firm admitted to using AI.<\/p>\n

Questions to Wells\u2019 office were redirected to her department.<\/p>\n

\u201cThe department is examining the concerns raised below and will engage with ACCS as appropriate,\u201d a spokesperson for the department said last Friday.<\/p>\n

In a hearing for the Senate inquiry on Friday, department officials said they met with ACCS, who claimed that the errors were due to links breaking that had previously worked. The officials have not independently verified this, stating it would be \u201cvery difficult\u201d to go back and check.<\/p>\n

They said it was a \u201chandful of errors\u201d in 26 pages of citations for a 1,000-page report.<\/p>\n

\u201c[ACCS] assured us that the links were all checked at the time that the document was published, and they all worked then,\u201d the department\u2019s first assistant secretary, Sarah Vandenbroek, said. \u201cSo, something may have changed in the interim. [They] did also assure us that while some of the links may have been broken, though the source documents do still exist, they are still valid.\u201d<\/p>\n

Prof Christian Downie, from the school of regulation and global governance at the Australian National University, who has previously examined submissions to government that contained AI hallucinations<\/a>, said if reports or submissions to government are found to have false citations in them \u2013 AI or otherwise \u2013 it could lead to bad decisions, and \u201cerode public confidence and trust\u201d in institutions.<\/p>\n

\u201cOne would assume the government is already thinking about this, and that is going to have to require contractual arrangements and presumably penalties to discourage this type of behaviour,\u201d he said.<\/p>\n

Fatima Payman, an independent senator, said: \u201cThe saga of last year\u2019s Deloitte AI slop report should have marked the end of slack referencing in reports by government contractors.\u201d<\/p>\n

\u201cThe government must demand an apology and refund from the contractor behind the report,\u201d she said.<\/p>\n","protected":false},"excerpt":{"rendered":"The authors of a report testing the technology underpinning Australia\u2019s social media ban have conceded ChatGPT was used…\n","protected":false},"author":2,"featured_media":571485,"comment_status":"","ping_status":"","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[20],"tags":[365,363,364,111,139,69,145],"class_list":["post-571484","post","type-post","status-publish","format-standard","has-post-thumbnail","category-artificial-intelligence","tag-ai","tag-artificial-intelligence","tag-artificialintelligence","tag-new-zealand","tag-newzealand","tag-nz","tag-technology"],"_links":{"self":[{"href":"https:\/\/www.newsbeep.com\/nz\/wp-json\/wp\/v2\/posts\/571484","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.newsbeep.com\/nz\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.newsbeep.com\/nz\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.newsbeep.com\/nz\/wp-json\/wp\/v2\/users\/2"}],"replies":[{"embeddable":true,"href":"https:\/\/www.newsbeep.com\/nz\/wp-json\/wp\/v2\/comments?post=571484"}],"version-history":[{"count":0,"href":"https:\/\/www.newsbeep.com\/nz\/wp-json\/wp\/v2\/posts\/571484\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/www.newsbeep.com\/nz\/wp-json\/wp\/v2\/media\/571485"}],"wp:attachment":[{"href":"https:\/\/www.newsbeep.com\/nz\/wp-json\/wp\/v2\/media?parent=571484"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.newsbeep.com\/nz\/wp-json\/wp\/v2\/categories?post=571484"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.newsbeep.com\/nz\/wp-json\/wp\/v2\/tags?post=571484"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}