{"id":866417,"date":"2026-08-24T07:17:09","date_gmt":"2026-08-24T07:17:09","guid":{"rendered":"https:\/\/www.newsbeep.com\/au\/866417\/"},"modified":"2026-08-24T07:17:09","modified_gmt":"2026-08-24T07:17:09","slug":"ai-costs-are-rising-for-australian-businesses-even-as-tokens-get-cheaper","status":"publish","type":"post","link":"https:\/\/www.newsbeep.com\/au\/866417\/","title":{"rendered":"AI costs are rising for Australian businesses even as tokens get cheaper"},"content":{"rendered":"<p class=\"paragraph_paragraph___QITb\">Australian businesses paying to use AI are weighing up what value they are getting from the disruptive technology.<\/p>\n<p class=\"paragraph_paragraph___QITb\">&#8220;It&#8217;s actually only really a relatively new thing that we have started to speak about,&#8221; Anna Volkova, the head of people and culture at HR software company HiBob, told ABC News.<\/p>\n<p class=\"paragraph_paragraph___QITb\">The platform has seen wins from using artificial intelligence, but it has been difficult to judge that against the mounting cost.<\/p>\n<p class=\"paragraph_paragraph___QITb\">With AI capabilities changing so quickly, Ms Volkova said the business can &#8220;never catch up&#8221; with the need to redesign how it works to get the most out of it.<\/p>\n<p class=\"paragraph_paragraph___QITb\">This has made it hard to work out precisely if the money is being spent effectively.<\/p>\n<p class=\"paragraph_paragraph___QITb\">&#8220;We&#8217;ll probably start to see impact to our bottom line in maybe two or three years, and I think most businesses are in that boat.&#8221;<\/p>\n<p><img decoding=\"async\" alt=\"A graphic of an AI chip\" class=\"Image_image__5tFYM ContentImage_image__DQ_cq\"  src=\"https:\/\/www.newsbeep.com\/au\/wp-content\/uploads\/2026\/08\/51aa70299d77b8020dbc8ed3fc49616c.jpeg\" loading=\"lazy\" data-component=\"Image\" data-lazy=\"true\"\/><\/p>\n<p class=\"Typography_base__sj2RP FigureCaption_text__zDxQ5 Typography_sizeMobile12__w_FPC Typography_lineHeightMobile20___U7Vr Typography_regular__WeIG6 Typography_colourInherit__dfnUx\" data-component=\"Typography\">Despite the cost of AI tokens tumbling, businesses are spending more than ever. (ABC News graphic)<\/p>\n<p class=\"paragraph_paragraph___QITb\">Jeremy Pell, whose firm Elastic helps companies to manage the cost of AI, agreed with that estimate.<\/p>\n<p class=\"paragraph_paragraph___QITb\">&#8220;We&#8217;re in a really interesting time at the moment,&#8221; he said.<\/p>\n<p>&#8220;Businesses are forced to pay this additional investment into AI, but they haven&#8217;t yet reaped the &#8216;bottom-line&#8217; benefits of the cost savings yet.&#8221;<img decoding=\"async\" alt=\"Jeremy Pell Elastic\" class=\"Image_image__5tFYM ContentImage_image__DQ_cq\"  src=\"https:\/\/www.newsbeep.com\/au\/wp-content\/uploads\/2026\/08\/56514484f9fc675f91936ad5e8c6059d.jpeg\" loading=\"lazy\" data-component=\"Image\" data-lazy=\"true\"\/><\/p>\n<p class=\"Typography_base__sj2RP FigureCaption_text__zDxQ5 Typography_sizeMobile12__w_FPC Typography_lineHeightMobile20___U7Vr Typography_regular__WeIG6 Typography_colourInherit__dfnUx\" data-component=\"Typography\">Jeremy Pell says companies have not yet reaped the bottom-line benefits. (ABC News: Berge Breiland)<\/p>\n<p class=\"paragraph_paragraph___QITb\">Last week, Assistant Minister for Technology and the Digital Economy Andrew Charlton described the value flowing out of Australia via AI as a &#8220;distant sucking sound&#8221;.<\/p>\n<p class=\"paragraph_paragraph___QITb\">In <a class=\"Link_link__5eL5m ScreenReaderOnly_srLinkHint__OysWz Link_showVisited__C1Fea Link_showFocus__ALyv2\" href=\"https:\/\/www.minister.industry.gov.au\/charlton\/media\/anu-crawford-school-public-policy-annual-lecture\" data-component=\"Link\" rel=\"nofollow noopener\" target=\"_blank\">a speech<\/a> at the ANU Crawford School of Public Policy, he said Australians were already spending $5-8 billion each year on artificial intelligence.<\/p>\n<p>&#8220;With the overwhelming majority of those payments flowing offshore, in effect, we are creating a new import bill. An import bill for intelligence.&#8221;<\/p>\n<p class=\"paragraph_paragraph___QITb\">That is just the start, with the government estimating local spending on AI could &#8220;plausibly&#8221; reach $20 billion to $40 billion annually within a decade.<\/p>\n<p>Tokens adding up to billions<\/p>\n<p class=\"paragraph_paragraph___QITb\">Even a few years ago, AI was not a line item companies had in annual budgets.<\/p>\n<p class=\"paragraph_paragraph___QITb\">Now, in the <a class=\"Link_link__kR0xA Link_link__5eL5m ScreenReaderOnly_srLinkHint__OysWz Link_showVisited__C1Fea Link_showFocus__ALyv2\" href=\"https:\/\/www.abc.net.au\/news\/2026-08-05\/miners-set-to-post-solid-results-amid-low-consumer-sentiment\/106993966\" data-component=\"Link\" data-uri=\"coremedia:\/\/article\/106993966\" rel=\"nofollow noopener\" target=\"_blank\">current reporting season for ASX-listed companies<\/a>, you can measure it in billions.<\/p>\n<p class=\"paragraph_paragraph___QITb\">The technology spend at Australia&#8217;s biggest bank, the Commonwealth Bank, increased from $2.3 billion in the 2025 financial year to $2.4 billion in this most recent financial year. It lists savings too.<\/p>\n<p class=\"paragraph_paragraph___QITb\">&#8220;Measured gross benefits from AI use cases, including reinvested capacity, were [around] $200 million in FY26,&#8221; its results presentation noted.<\/p>\n<p>&#8220;Gross benefits from AI use cases are expected to double in FY27, and to exceed investment.&#8221;<\/p>\n<p class=\"paragraph_paragraph___QITb\">On Wall Street, investors are asking whether the billions invested by US tech giants in AI will ever be justified by returns, creating concern about an AI-fuelled stock market bubble.<\/p>\n<p class=\"paragraph_paragraph___QITb\">Stu Scotis, AI leader for consulting firm Deloitte, said the equation of how to spend an IT budget is getting tougher.<\/p>\n<p><img decoding=\"async\" alt=\"Stu Scotis Deloitte\" class=\"Image_image__5tFYM ContentImage_image__DQ_cq\"  src=\"https:\/\/www.newsbeep.com\/au\/wp-content\/uploads\/2026\/08\/0d80d11a457ecc6c2028c5837d9d5546.jpeg\" loading=\"lazy\" data-component=\"Image\" data-lazy=\"true\"\/><\/p>\n<p class=\"Typography_base__sj2RP FigureCaption_text__zDxQ5 Typography_sizeMobile12__w_FPC Typography_lineHeightMobile20___U7Vr Typography_regular__WeIG6 Typography_colourInherit__dfnUx\" data-component=\"Typography\">Stu Scotis says there are more uses of AI for increasingly complex tasks.<\/p>\n<p>\u00a0 (ABC News: Patrick Rocca)<\/p>\n<p class=\"paragraph_paragraph___QITb\">Clients are weighing up long-term information technology costs \u2014 like storage and refreshing laptops \u2014 with a new, runaway expense.<\/p>\n<p class=\"paragraph_paragraph___QITb\">&#8220;What we used to plan for as a static activity is now somewhat variable,&#8221; he said.<\/p>\n<p class=\"paragraph_paragraph___QITb\">Mr Scotis said current conversations are around &#8220;tokens&#8221;: <a class=\"Link_link__5eL5m ScreenReaderOnly_srLinkHint__OysWz Link_showVisited__C1Fea Link_showFocus__ALyv2\" href=\"https:\/\/blogs.nvidia.com\/blog\/ai-tokens-explained\/\" data-component=\"Link\" rel=\"nofollow noopener\" target=\"_blank\">units of data processed by AI<\/a>, or essentially the amount of grunt used to compute tasks.<\/p>\n<p class=\"paragraph_paragraph___QITb\">Complex requests use more tokens, simple ones fewer.<\/p>\n<p class=\"paragraph_paragraph___QITb\">The cost of tokens has plummeted in recent years, with increased competition, more efficient chips and more supply.<\/p>\n<p class=\"paragraph_paragraph___QITb\">An unprecedented amount of data centre construction has increased the computing power available in the world.<\/p>\n<p class=\"paragraph_paragraph___QITb\">Adding in more energy-efficient microchips, increased competition and the technology improving how much it can compute per token, it is now cheaper than ever.<\/p>\n<p class=\"paragraph_paragraph___QITb\">As the below <a class=\"Link_link__5eL5m ScreenReaderOnly_srLinkHint__OysWz Link_showVisited__C1Fea Link_showFocus__ALyv2\" href=\"https:\/\/epoch.ai\/data-insights\/llm-inference-price-trends\" data-component=\"Link\" rel=\"nofollow noopener\" target=\"_blank\">chart from research institute Epoch shows<\/a>, the cost of the most powerful models has fallen the fastest.<\/p>\n<p class=\"paragraph_paragraph___QITb\">Epoch used the &#8220;Massive Multitask Language Understanding&#8221; benchmark to rank AI large language models.<\/p>\n<p class=\"paragraph_paragraph___QITb\">The price for large language models GPT-4 Turbo level or better (the most powerful, shown by the blue line) fell from $US15 ($20.90) for one million tokens in November 2023, to 17.5 US cents (24.4 cents) per million in February last year.<\/p>\n<p><img decoding=\"async\" alt=\"A chart showing fall in cost of AI tokens\" class=\"Image_image__5tFYM ContentImage_image__DQ_cq\"  src=\"https:\/\/www.newsbeep.com\/au\/wp-content\/uploads\/2026\/08\/760ef4c658d760ef3c7d3b4407a9027f.png\" loading=\"lazy\" data-component=\"Image\" data-lazy=\"true\"\/><\/p>\n<p class=\"Typography_base__sj2RP FigureCaption_text__zDxQ5 Typography_sizeMobile12__w_FPC Typography_lineHeightMobile20___U7Vr Typography_regular__WeIG6 Typography_colourInherit__dfnUx\" data-component=\"Typography\">Research institute Epoch found the cost of the most high-powered tokens has fallen the fastest. (Supplied: Epoch)<\/p>\n<p class=\"paragraph_paragraph___QITb\">Despite this trend, what companies are spending on AI is rising.<\/p>\n<p class=\"paragraph_paragraph___QITb\">That is because firms are finding new tasks for AI to take on, leading to increasingly difficult computations, requiring more tokens per request.<\/p>\n<p>AI not necessarily cheaper than workers<\/p>\n<p class=\"paragraph_paragraph___QITb\">Mr Scotis put it another way: Human workers are paid in dollars, digital workers \u2014 or AI models \u2014 are paid in tokens.<\/p>\n<p class=\"paragraph_paragraph___QITb\">&#8220;You want to get value for the digital workers and their output,&#8221; he explained.<\/p>\n<p class=\"paragraph_paragraph___QITb\">That means companies investing in AI need to examine the &#8220;value, outcome or growth&#8221; that comes from the tasks they complete, just as companies evaluate the work of human employees.<\/p>\n<p><a href=\"https:\/\/www.abc.net.au\/news\/2026-07-21\/prepare-for-stock-market-pain-china-ai-boom-tech\/106937282\" data-component=\"FullBleedLink\" class=\"RelatedCard_link__rsgR9 FullBleedLink_root__lTw_U interactive_focusContext__yRhc_ interactive_defaults__AKxUU FullBleedLink_showVisited__g3Xvz\" rel=\"nofollow noopener\" target=\"_blank\">China throws spanner into tech boom<\/a><\/p>\n<p class=\"Typography_base__sj2RP RelatedCard_synopsis__cFwMW Typography_sizeMobile14__u7TGe Typography_lineHeightMobile20___U7Vr Typography_regular__WeIG6 Typography_colourInherit__dfnUx\" data-component=\"Typography\">Elon Musk&#8217;s latest venture sent global stock markets to dizzying heights, but its performance since does not augur well for the company or the future of the AI boom.<\/p>\n<p>&#8220;You start to get pretty clear, measurable outcomes that mean your investment in AI dollars or AI tokens actually pay a return.&#8221;<\/p>\n<p class=\"paragraph_paragraph___QITb\">He said the human workers should not be too worried about being replaced.<\/p>\n<p class=\"paragraph_paragraph___QITb\">&#8220;The cost of a digital worker doesn&#8217;t necessarily mean it&#8217;s cheaper than a human,&#8221; he said.<\/p>\n<p class=\"paragraph_paragraph___QITb\">&#8220;The complexity of the task, the length of time which a digital worker runs can, in some instances, be more expensive than a person.&#8221;<\/p>\n<p class=\"paragraph_paragraph___QITb\">Mr Scotis said firms needed to make a judgement &#8220;as to where you want to invest that type of work in your organisation, and does it make sense to do so&#8221;.<\/p>\n<p class=\"paragraph_paragraph___QITb\">It is a question being weighed in boardrooms right now.<\/p>\n<p>How do companies pay for AI?<\/p>\n<p class=\"paragraph_paragraph___QITb\">There are multiple ways that companies pay for artificial intelligence.<\/p>\n<p class=\"paragraph_paragraph___QITb\">Some use &#8220;seats&#8221;, paying per employee that accesses the technology.<\/p>\n<p class=\"paragraph_paragraph___QITb\">This model is often used with platforms like Microsoft&#8217;s Copilot, where AI abilities can be unlocked in existing programs, like writing documents in Word or juggling numbers in Excel spreadsheets.<\/p>\n<p class=\"paragraph_paragraph___QITb\">The most common way to pay is by tokens.<\/p>\n<p class=\"paragraph_paragraph___QITb\">The frequency with which employees are using AI models and the amount of tokens used in the queries is a new and increasing cost for businesses \u2014 which many of them will not have been paying for in even last financial year&#8217;s report.<\/p>\n<p class=\"paragraph_paragraph___QITb\">&#8220;That&#8217;s the cost metric these businesses are grappling with,&#8221; said Elastic&#8217;s Jeremy Pell.<\/p>\n<p>Different model, different prices<\/p>\n<p class=\"paragraph_paragraph___QITb\">Another variable is that some of the cutting-edge or &#8220;frontier&#8221; AI models use more tokens.<\/p>\n<p class=\"paragraph_paragraph___QITb\">That has led to companies using different models for different tasks, to avoid paying top dollar for tasks a more basic model can handle.<\/p>\n<p><img decoding=\"async\" alt=\"a purple light illuminates a thick web of computer cables in a dark room\" class=\"Image_image__5tFYM ContentImage_image__DQ_cq\"  src=\"https:\/\/www.newsbeep.com\/au\/wp-content\/uploads\/2026\/08\/e72905da972197776a6a374a5933c754.jpeg\" loading=\"lazy\" data-component=\"Image\" data-lazy=\"true\"\/><\/p>\n<p class=\"Typography_base__sj2RP FigureCaption_text__zDxQ5 Typography_sizeMobile12__w_FPC Typography_lineHeightMobile20___U7Vr Typography_regular__WeIG6 Typography_colourInherit__dfnUx\" data-component=\"Typography\">AI spending by major US firms is raising alam bells for some investors. (ABC News: John Gunn)<\/p>\n<p class=\"paragraph_paragraph___QITb\">Some firms have also become more deliberate about the use of AI, sometimes capping the amount of tokens employees can use in a certain time frame.<\/p>\n<p>&#8220;Businesses can no longer do AI for AI&#8217;s sake,&#8221;  Mr Pell said.<\/p>\n<p class=\"paragraph_paragraph___QITb\">&#8220;It&#8217;s a matter of making sure that you are driving the business forward and these initiatives are driven and tied to the business&#8217;s return on investment \u2026 It&#8217;s working out which bits are useful.&#8221;<\/p>\n<p>&#8216;Scattergun&#8217; AI approach<\/p>\n<p class=\"paragraph_paragraph___QITb\">AI expert Jon Whittle has warned the &#8220;scattergun&#8221; approach business has taken to using AI means the cost calculations are becoming more difficult, even as the price of tokens falls.<\/p>\n<p class=\"paragraph_paragraph___QITb\">&#8220;I don&#8217;t think companies are being very strategic right now about their AI use cases,&#8221; he told The Business.<\/p>\n<p class=\"paragraph_paragraph___QITb\">&#8220;They&#8217;re just trying to find any place where they can use it, and that&#8217;s why they&#8217;re having costs increase so much.&#8221;<\/p>\n<p><img decoding=\"async\" alt=\"Jon Whittle\" class=\"Image_image__5tFYM ContentImage_image__DQ_cq\"  src=\"https:\/\/www.newsbeep.com\/au\/wp-content\/uploads\/2026\/08\/52ee9bb26c212ef031a5d03f93d009a5.jpeg\" loading=\"lazy\" data-component=\"Image\" data-lazy=\"true\"\/><\/p>\n<p class=\"Typography_base__sj2RP FigureCaption_text__zDxQ5 Typography_sizeMobile12__w_FPC Typography_lineHeightMobile20___U7Vr Typography_regular__WeIG6 Typography_colourInherit__dfnUx\" data-component=\"Typography\">Jon Whittle says the cost of tokens has come down dramatically. (ABC News: Simon Winter)<\/p>\n<p class=\"paragraph_paragraph___QITb\">Professor Whittle, a former technical lead at NASA, director of CSIRO&#8217;s AI capability and founder of Australia&#8217;s National AI Centre, said a particular issue was that AI itself did a poor job at estimating the amount of tokens required.<\/p>\n<p class=\"paragraph_paragraph___QITb\">Research has shown estimates can differ &#8220;by a factor of 30&#8221; running the same request on the same technology.<\/p>\n<p>&#8220;I think that&#8217;s the number one thing keeping [chief financial officers] up at night right now,&#8221;  Professor Whittle said.<\/p>\n<p class=\"paragraph_paragraph___QITb\">&#8220;It turns out that even the AI itself is not very good at predicting the cost that a particular AI task will take.&#8221;<\/p>\n<p>Speed increases as AI crunches data faster<\/p>\n<p class=\"paragraph_paragraph___QITb\">From her Sydney office, Anna Volkova says the major advantage her firm currently gets from AI is speed.<\/p>\n<p><img decoding=\"async\" alt=\"Anna Volkova 2 Hibob\" class=\"Image_image__5tFYM ContentImage_image__DQ_cq\"  src=\"https:\/\/www.newsbeep.com\/au\/wp-content\/uploads\/2026\/08\/a8ea92866f0113ceb028a8945906f62a.jpeg\" loading=\"lazy\" data-component=\"Image\" data-lazy=\"true\"\/><\/p>\n<p class=\"Typography_base__sj2RP FigureCaption_text__zDxQ5 Typography_sizeMobile12__w_FPC Typography_lineHeightMobile20___U7Vr Typography_regular__WeIG6 Typography_colourInherit__dfnUx\" data-component=\"Typography\">Anna Volkova says decisions around AI are essentially choices to spend in the hope it will be worth it. (ABC News: Daniel Irvine)<\/p>\n<p class=\"paragraph_paragraph___QITb\">By connecting artificial intelligence to the software tools the company already uses, staff have been able to do more, at greater pace.<\/p>\n<p class=\"paragraph_paragraph___QITb\">But the bill is mounting.<\/p>\n<p><a href=\"https:\/\/www.abc.net.au\/listen\/programs\/abc-business-daily\" data-component=\"FullBleedLink\" class=\"RelatedCard_link__rsgR9 FullBleedLink_root__lTw_U interactive_focusContext__yRhc_ interactive_defaults__AKxUU FullBleedLink_showVisited__g3Xvz\" rel=\"nofollow noopener\" target=\"_blank\">ABC Business Daily<\/a><\/p>\n<p class=\"Typography_base__sj2RP RelatedCard_synopsis__cFwMW Typography_sizeMobile14__u7TGe Typography_lineHeightMobile20___U7Vr Typography_regular__WeIG6 Typography_colourInherit__dfnUx\" data-component=\"Typography\">The podcast that helps you unpack the latest business and finance news.<\/p>\n<p class=\"paragraph_paragraph___QITb\">She said, eventually, the business would likely need to evaluate usage &#8220;by need&#8221;, not &#8220;limiting responsible experimentation&#8221; but looking for uses that maximise what staff get out of using AI as a tool.<\/p>\n<p class=\"paragraph_paragraph___QITb\">&#8220;I think the things that we&#8217;re looking for in terms of really seeing the return for our people \u2026 is it making their work better, easier?&#8221; she asks.<\/p>\n<p>&#8220;Is it helping our leaders make decisions faster?&#8221;<\/p>\n<p class=\"paragraph_paragraph___QITb\">It turns out the questions business leaders are asking about AI are very human.<\/p>\n<p class=\"paragraph_paragraph___QITb\">Watch <a class=\"Link_link__5eL5m ScreenReaderOnly_srLinkHint__OysWz Link_showVisited__C1Fea Link_showFocus__ALyv2\" href=\"https:\/\/iview.abc.net.au\/show\/business\" data-component=\"Link\" rel=\"nofollow noopener\" target=\"_blank\">The Business<\/a>, Mondays to Thursdays 8:44pm on ABC News Channel, after the Late News on ABC TV, and anytime on <a class=\"Link_link__5eL5m ScreenReaderOnly_srLinkHint__OysWz Link_showVisited__C1Fea Link_showFocus__ALyv2\" href=\"https:\/\/iview.abc.net.au\/show\/business\" data-component=\"Link\" rel=\"nofollow noopener\" target=\"_blank\">ABC iview<\/a><\/p>\n","protected":false},"excerpt":{"rendered":"Australian businesses paying to use AI are weighing up what value they are getting from the disruptive technology.&hellip;\n","protected":false},"author":2,"featured_media":836409,"comment_status":"","ping_status":"","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[5],"tags":[256,254,107028,64,63,99,80244,117376,5474,5939,174451],"class_list":["post-866417","post","type-post","status-publish","format-standard","has-post-thumbnail","category-business","tag-ai","tag-artificial-intelligence","tag-artificial-intelligence-research","tag-au","tag-australia","tag-business","tag-business-investment","tag-capex","tag-investment","tag-spending","tag-tokens"],"_links":{"self":[{"href":"https:\/\/www.newsbeep.com\/au\/wp-json\/wp\/v2\/posts\/866417","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.newsbeep.com\/au\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.newsbeep.com\/au\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.newsbeep.com\/au\/wp-json\/wp\/v2\/users\/2"}],"replies":[{"embeddable":true,"href":"https:\/\/www.newsbeep.com\/au\/wp-json\/wp\/v2\/comments?post=866417"}],"version-history":[{"count":0,"href":"https:\/\/www.newsbeep.com\/au\/wp-json\/wp\/v2\/posts\/866417\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/www.newsbeep.com\/au\/wp-json\/wp\/v2\/media\/836409"}],"wp:attachment":[{"href":"https:\/\/www.newsbeep.com\/au\/wp-json\/wp\/v2\/media?parent=866417"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.newsbeep.com\/au\/wp-json\/wp\/v2\/categories?post=866417"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.newsbeep.com\/au\/wp-json\/wp\/v2\/tags?post=866417"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}