Sign up: AU Breaking News email<\/a><\/p>\n The subsequent report found widespread issues, including a lack of \u201ctraceability\u201d between the rules of the framework and the legislation behind it, as well as \u201csystem defects\u201d. It said an IT system was \u201cdriven by punitive assumptions of participant non-compliance\u201d.<\/p>\n It was first published on 4 July. It was re-uploaded to the DEWR website on Friday, after the Australian Financial Review<\/a> in August reported that multiple errors had been found, including nonexistent references and citations.<\/p>\n University of Sydney academic, Dr Christopher Rudge, who first highlighted the errors, said the report contained \u201challucinations\u201d where AI models may fill in gaps, misinterpret data, or try to guess answers.<\/p>\n \u201cInstead of just substituting one hallucinated fake reference for a new \u2018real\u2019 reference, they\u2019ve substituted the fake hallucinated references and in the new version, there\u2019s like five, six or seven or eight in their place,\u201d he said.<\/p>\n \u201cSo what that suggests is that the original claim made in the body of the report wasn\u2019t based on any one particular evidentiary source.\u201d<\/p>\n The updated review noted a \u201csmall number of corrections to references and footnotes\u201d, but the department has said there have been no changes to the review\u2019s recommendations.<\/p>\n \u201cDeloitte conducted the independent assurance review and has confirmed some footnotes and references were incorrect,\u201d a spokesperson for the department said.<\/p>\n \u201cThe substance of the independent review is retained, and there are no changes to the recommendations.\u201d<\/p>\n In the updated version of the report, Deloitte added reference to the use of generative AI in its appendix. It states that a part of the report \u201cincluded the use of a generative artificial intelligence (AI) large language model (Azure OpenAI GPT \u2013 4o) based tool chain licensed by DEWR and hosted on DEWR\u2019s Azure tenancy.\u201d<\/p>\n Deloitte did not state that artificial intelligence was the reason behind the errors in its original report. It also stood by the original findings of the review.<\/p>\n \u201cThe updates made in no way impact or affect the substantive content, findings and recommendations in the report,\u201d it stated in the amended version.<\/p>\n A spokesperson for Deloitte said \u201cthe matter has been resolved directly with the client\u201d.<\/p>\n skip past newsletter promotion<\/a><\/p>\n Sign up to Breaking News Australia<\/p>\n Get the most important news as it breaks<\/p>\n Privacy Notice: Newsletters may contain information about charities, online ads, and content funded by outside parties. If you do not have an account, we will create a guest account for you on theguardian.com<\/a> to send you this newsletter. You can complete full registration at any time. For more information about how we use your data see our Privacy Policy<\/a>. We use Google reCaptcha to protect our website and the Google Privacy Policy<\/a> and Terms of Service<\/a> apply.<\/p>\n after newsletter promotion<\/p>\n Rudge said that, despite his criticism, he hesitates to say the whole report should be \u201cregarded as illegitimate\u201d, because the conclusions concur with other widespread evidence.<\/p>\n Labor senator Deborah O\u2019Neill, who was on a senate inquiry into the integrity of consulting firms, said it looked like \u201cAI is being left to do the heavy lifting\u201d.<\/p>\n \u201cDeloitte has a human intelligence problem. This would be laughable if it wasn\u2019t so lamentable. A partial refund looks like a partial apology for substandard work,\u201d she said.<\/p>\n \u201cAnyone looking to contract these firms should be asking exactly who is doing the work they are paying for, and having that expertise and no AI use verified.<\/p>\n \u201cPerhaps instead of a big consulting firm, procurers would be better off signing up for a ChatGPT subscription.\u201d<\/p>\n The AFR found several incorrect references<\/a> in the original report, including nonexistent reports by professors at the University of Sydney and the Lund University in Sweden.<\/p>\n The paper also reported a made up reference to a court decision in a robodebt<\/a> case, Deanna Amato v Commonwealth. Deloitte wrote in it\u2019s final report that the update \u201camend[ed] the summary of the Amato proceeding which contained errors\u201d.<\/p>\n Quick GuideContact us about this storyShow The best public interest journalism relies on first-hand accounts from people in the know.<\/p>\n If you have something to share on this subject, you can contact us confidentially using the following methods.<\/p>\n Secure Messaging in the Guardian app<\/p>\n The Guardian app has a tool to send tips about stories. Messages are end to end encrypted and concealed within the routine activity that every Guardian mobile app performs. This prevents an observer from knowing that you are communicating with us at all, let alone what is being said.<\/p>\n If you don’t already have the Guardian app, download it (iOS<\/a>\/Android<\/a>) and go to the menu. Select \u2018Secure Messaging\u2019. <\/p>\n SecureDrop, instant messengers, email, telephone and post<\/p>\n If you can safely use the Tor network without being observed or monitored, you can send messages and documents to the Guardian via our SecureDrop platform<\/a>.<\/p>\n![\"\"](\"https:\/\/www.newsbeep.com\/il\/wp-content\/uploads\/2025\/10\/1759738747_77_4000.jpg\")
<\/p>\n