In a 1987 article in the Times Book Review, Robert Solow, a Nobel-winning economist at M.I.T., commented, \u201cYou can see the computer age everywhere but in the productivity statistics.\u201d Despite massive increases in computing power and the rising popularity of personal computers, government figures showed that over-all output per worker, a key determinant of wages and living standards, had stagnated for more than a decade. The \u201cproductivity paradox,\u201d as it came to be known, persisted into the nineteen-nineties and beyond, generating a huge and inconclusive body of literature. Some economists blamed mismanagement of the new technology; others argued that computers paled in economic importance compared to older inventions such as the steam engine and electricity; still others blamed measurement errors in the data and argued that once these were corrected the paradox disappeared.<\/p>\n
Nearly forty years after Solow\u2019s article, and almost three years since OpenAI released its ChatGPT chatbot, we may be facing a new economic paradox, this one involving generative artificial intelligence. According to a recent survey carried out by economists at Stanford, Clemson, and the World Bank, in June and July of this year, almost half of all workers\u201445.6 per cent, to be precise\u2014were using A.I. tools. And yet, a new study, from a team of researchers associated with M.I.T.\u2019s Media Lab, reports, \u201cDespite $30 – $40 billion in enterprise investment into GenAI, this report uncovers a surprising result in that 95% of organizations are getting zero return.\u201d<\/p>\n
The study\u2019s authors examined more than three hundred public A.I. initiatives and announcements, and interviewed more than fifty company executives. They defined a successful A.I. investment as one that had been deployed beyond the pilot phase and had generated some measurable financial return or marked gain in productivity after six months. \u201cJust 5% integrated AI pilots are extracting millions in value, while the vast majority remain stuck with no measurable P&L\u201d\u2014profit-and-loss\u2014\u201cimpact,\u201d they wrote.<\/p>\n
The survey interviews elicited a range of responses, some of which were highly skeptical. \u201cThe hype on LinkedIn says everything has changed, but in our operations, nothing fundamental has shifted,\u201d the chief operating officer at a midsize manufacturing firm told researchers. \u201cWe\u2019re processing some contracts faster, but that\u2019s all that has changed.\u201d Another respondent commented, \u201cWe\u2019ve seen dozens of demos this year. Maybe one or two are genuinely useful. The rest are wrappers or science projects.\u201d<\/p>\n
To be sure, the report points out that some firms have made successful A.I. investments. For example, it highlights efficiencies created by customized tools aimed at back-office operations, noting, \u201cThese early results suggest that learning-capable systems, when targeted at specific processes, can deliver real value, even without major organizational restructure.\u201d The survey also cites some firms reporting \u201cimproved customer retention and sales conversion through automated outreach and intelligent follow-up systems,\u201d which suggests that A.I. systems could be useful for marketing.<\/p>\n
But the idea that many companies are struggling to achieve substantial returns jibed with another recent survey, by Akkodis, a multinational consulting firm. After contacting more than two thousand business executives, the firm found that the percentage of C.E.O.s who are \u201cvery confident\u201d in their firm\u2019s A.I.-implementation strategies has fallen from eighty-two per cent in 2024 to forty-nine per cent this year. Confidence had also fallen among corporate chief technology officers, although not by as much. These developments \u201cmay reflect disappointing outcomes from previous attempts at digital or AI initiatives, delays or failures in implementation as well as concerns around scalability,\u201d the Akkodis survey said.<\/p>\n
Last week, media accounts of the M.I.T. Media Lab study coincided with a fall in highly valued stocks associated with A.I., including Nvidia, Meta, and Palantir. Correlation isn\u2019t causation, of course, and recent comments by Sam Altman, the chief executive of OpenAI, may have played a bigger role in the sell-off, which was surely inevitable at some point, given recent price increases. At a dinner with reporters, Altman said valuations were \u201cinsane\u201d and used the term \u201cbubble\u201d three times in fifteen seconds, CNBC reported.<\/p>\n
Still, the M.I.T. study garnered a lot of attention, and after the initial raft of news stories about the research, a report emerged that the Media Lab, which has ties to many technology companies, was quietly restricting access to it. Messages that I left with the organization\u2019s communications office and two of the report\u2019s authors went unreturned.<\/p>\n
Although the report is more nuanced than some news coverage made out, it certainly raises questions about the grand economic narrative that has underpinned the tech boom since November, 2022, when OpenAI released ChatGPT. The short version of this narrative is that the economy-wide diffusion of generative A.I. would be bad for workers, particularly knowledge workers, but great for companies, and their shareholders, because it would generate a big leap in productivity and, by extension, profits.<\/p>\n
One possible reason this doesn\u2019t seem to have happened yet recalls the suggestion that management failures were constraining the productivity benefits of computers in the nineteen-eighties and early nineties. The Media Lab study found that some of the most successful A.I. investments were made by startups that use highly customized tools in narrow areas of workflow processes. On the other side of the \u201cGenAI Divide,\u201d the study pointed to less successful startups that were \u201ceither building generic tools or trying to develop capabilities internally.\u201d More generally, the report said the divisions between success and failure \u201cdoes not seem to be driven by model quality or regulation, but seems to be determined by approach.\u201d<\/p>\n
Conceivably, the novelty and complexity of generative A.I. may be holding some companies back. A recent study, by the consultancy firm Gartner, found that fewer than half of C.E.O.s are confident that their chief information officers are \u201cAI-savvy.\u201d But there is another possible explanation for the disappointing record highlighted in the Media Lab report: for many established businesses, generative A.I., at least in its current incarnation, simply isn\u2019t all it\u2019s been cracked up to be. \u201cIt\u2019s excellent for brainstorming and first drafts, but it doesn\u2019t retain knowledge of client preferences or learn from previous edits,\u201d one respondent to the Media Lab survey said. \u201cIt repeats the same mistakes and requires extensive context input for each session. For high-stakes work, I need a system that accumulates knowledge and improves over time.\u201d<\/p>\n
Of course, there are plenty of people who find A.I. useful, and there is academic evidence to back this up: in 2023, two economists at M.I.T. found that exposure to ChatGPT enabled participants in a randomized trial to complete \u201cprofessional writing tasks\u201d more quickly and improved the quality of their writing. The same year, other research teams identified productivity-enhancing outcomes for computer programmers who used Github\u2019s Copilot, and for customer-support agents who were given access to proprietary A.I. tools. The Media Lab researchers found that many workers are using their personal tools, such as GPT or Claude, at their jobs; the report refers to this phenomenon as the \u201cshadow AI economy,\u201d and comments that \u201cit often delivers better ROI\u201d than employer initiatives. But the question remains, and it\u2019s one that senior corporate executives will surely be asking more frequently: Why haven\u2019t more firms seen these types of benefits feeding through to the bottom line?<\/p>\n
Part of the problem may be that generative A.I., remarkable as it is, has limited application in many parts of the economy. Taken together, leisure and hospitality, retail, construction, real estate, and the care sector\u2014child-minding and looking after people who are old or infirm\u2014employ about fifty million Americans, but they don\u2019t look like immediate candidates for an A.I. transformation.<\/p>\n
Another important thing to note is that adoption of A.I. throughout the economy could well be a lengthy process. In Silicon Valley, people like to move fast and break things. But economic history tells us that even the most transformative technologies, which economists refer to as general-purpose technologies, can\u2019t be exploited to maximum effect until infrastructure, skills, and products that can complement them are developed. And this can be a long process. The Scottish inventor James Watt invented his cylindrical steam engine in 1769. Thirty years later, most cotton factories in Great Britain were still powered by water wheels, partly because it was difficult to transport coal for use in steam engines. That didn\u2019t change until the development of steam-powered railways in the early nineteenth century. Electricity also spread slowly and didn\u2019t immediately lead to an economy-wide spurt in productivity growth. As Solow noted, the development of computers followed the same pattern. (From 1996 to 2003, economy-wide productivity growth finally increased, which many economists attributed to the delayed effect of information technology. Subsequently, however, it fell back.)<\/p>\n","protected":false},"excerpt":{"rendered":"In a 1987 article in the Times Book Review, Robert Solow, a Nobel-winning economist at M.I.T., commented, \u201cYou…\n","protected":false},"author":2,"featured_media":97795,"comment_status":"","ping_status":"","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[20],"tags":[256,254,51780,255,64,63,17864,71740,105],"class_list":["post-97794","post","type-post","status-publish","format-standard","has-post-thumbnail","category-artificial-intelligence","tag-ai","tag-artificial-intelligence","tag-artificial-intelligence-a-i","tag-artificialintelligence","tag-au","tag-australia","tag-automation","tag-economic-development","tag-technology"],"_links":{"self":[{"href":"https:\/\/www.newsbeep.com\/au\/wp-json\/wp\/v2\/posts\/97794","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.newsbeep.com\/au\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.newsbeep.com\/au\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.newsbeep.com\/au\/wp-json\/wp\/v2\/users\/2"}],"replies":[{"embeddable":true,"href":"https:\/\/www.newsbeep.com\/au\/wp-json\/wp\/v2\/comments?post=97794"}],"version-history":[{"count":0,"href":"https:\/\/www.newsbeep.com\/au\/wp-json\/wp\/v2\/posts\/97794\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/www.newsbeep.com\/au\/wp-json\/wp\/v2\/media\/97795"}],"wp:attachment":[{"href":"https:\/\/www.newsbeep.com\/au\/wp-json\/wp\/v2\/media?parent=97794"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.newsbeep.com\/au\/wp-json\/wp\/v2\/categories?post=97794"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.newsbeep.com\/au\/wp-json\/wp\/v2\/tags?post=97794"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}