The Australian Taxation Office is actively trialling large multimodal AI models to help audit taxpayer-submitted documents as part of a broader push to \u201cindustrialise\u201d AI across the agency by 2030.<\/p>\n
<\/p>\n
The technology builds on the ATO\u2019s existing use of open source AI, which for the past five years has been used to automatically read, classify and summarise supporting documents during audits.<\/p>\n
But now, the office is preparing to extend those capabilities to non-text formats, including images, using emerging multimodal systems, according to ATO assistant commissioner for data science Ying Yang.<\/p>\n
Speaking at the AI Innovation Showcase in Canberra, she said: \u201cWhy large multimodal instead of large language? The documents are not always in plain language.<\/p>\n
“It can be images as well, so the team is right now playing with large multimodal models to see whether it will increase the performance of the document understanding.\u201d<\/p>\n
The ATO first piloted its document understanding tool in 2021 to help case officers sift through work-related expense claims after a taxpayer is selected for audit.<\/p>\n
These cases are then verified by an ATO case worker, who will handle around 25 audits per year with an average of 147 pages of documents to assess.<\/p>\n
The tool became fully operational in May 2024 [pdf]<\/a> and works by extracting and prioritising key information from documents, breaking them down and then ranking them by their relevance to the client labels that are being identified.<\/p>\n According to ATO assistant commissioner Julia Webb, who also spoke at the AI Innovation Showcase, the tool was developed using an \u201centerprise learning loop\u201d, a process of continuous human feedback to improve the AI\u2019s performance.<\/p>\n \u201cThe machine is constantly learning and understanding why something might help,\u201d Webb said.<\/p>\n “When a case worker directly requests to access the document, then they’re able to provide feedback again, or whether it’s relevant or whether it’s not.\u201d<\/p>\n After completing the document review, case officers can then review the summaries of allowed claims to compare them with the original claims.<\/p>\n These details inform an audit finalisation letter that is then issued to the taxpayer.<\/p>\n \u201cAfter that, a case officer completes what we call an intelligence survey on the audit,\u201d Webb said.<\/p>\n \u201c[Details] include a client\u2019s behaviour, the audit\u2019s outcome, any unique claims made and any audit decisions.<\/p>\n \u201cThe intelligence is used to feed in and inform the machine learning function, providing insights into behavioural observations to continually evaluate and improve our selection of tactics as well.\u201d<\/p>\n Before reaching the audit stage, the ATO already makes extensive use of AI to assess the likelihood that work-related expense claims may be non-compliant, flagging potential issues before a return is selected for manual review.<\/p>\n \u201cWe have models running… to have a quick browse of their numbers and call out if there are any abnormal numbers and give [the taxpayer] a friendly nudge,\u201d Yang said.<\/p>\n Examples of this, she said, include if someone\u2019s claim is higher than average for people in \u201csimilar circumstances\u201d<\/p>\n \u201cOnce we receive the tax return, we have risk models running in the background to call out inputs or claims that are deemed high risk at least by machines at first,” she said.<\/p>\n However, Yang added, it\u2019s only after a claim is reviewed by a case officer that a taxpayer is asked to provide supporting documentation.<\/p>\n “Impactful and scalable\u201d<\/p>\n The document understanding tool and learning loop form part of the ATO\u2019s five \u201cvery high value\u201d enterprise use cases in its AI strategy, which was first outlined in 2022.<\/p>\n At the centre of this is a goal that by 2030, \u201cthe ATO is a leader in industrialising ethical, impactful and scalable AI solutions\u201d, Yang said.<\/p>\n As part of this, the ATO intends to use AI for \u201cclient profiling\u201d, which Yang described as creating an \u201cintegrated single source of truth for each of our clients.\u201d<\/p>\n Currently, she said, different teams within the ATO use their own models to determine a person\u2019s risk profile.<\/p>\n \u201cHow do we consolidate all these different perspectives of risk for a client so that everyone coming to the picture will have a consolidated understanding [of them]?\u201d she said.<\/p>\n \u201cThat’s the current focus of this enterprise use case.<\/p>\n Another key use case, meanwhile, is known as \u201cfraud disruption\u201d, which Yang described as being a \u201cvery high priority\u201d for the government.<\/p>\n While she didn\u2019t provide details, the reference comes in the wake of revelations that more than $550 million in fraudulent claims<\/a> were made over the two previous financial years by exploiting loopholes in the government\u2019s digital identity systems.<\/p>\n The last use case is for helping ATO workers understand different laws and precedents using AI.<\/p>\n \u201cThe AI can start to understand how those decisions were made,\u201d Yang added.<\/p>\n Yang noted that the ATO\u2019s strategy deliberately omitted any mention of specific technologies or AI services, although as of June 2024, it had eight publicly available generative AI technologies approved for use.<\/p>\n