Summary: A new study utilizes Koopman operator learning to prove that certain complex, chaotic systems have fundamental predictability limits that cannot be overcome by infinite training data. By designing adversarial systems to map where machine learning models collapse, the team explained the mathematical root causes of LLM hallucinations, while introducing a highly efficient algorithm with built-in error bounds that successfully mapped hidden Arctic sea ice patterns using a standard laptop.<\/p>\n
Key FactsThe Infinite Data Myth Overthrown: The research demonstrates that the common tech-industry philosophy of \u201cmore data equals guaranteed learning\u201d is mathematically incorrect. Certain highly complex or chaotic problems feature layered patterns that are hidden or impossible to neatly separate, meaning the absolute best an algorithm can score is a coin-flip ($50\/50$), rendering the problem mathematically unsolvable regardless of dataset size.Why Chatbots Hallucinate: The mathematical instabilities that break long-term physical prediction explain why large language models (LLMs) like ChatGPT or Claude confidently invent false information over time. In highly sensitive systems, minute variations in the starting prompt trigger compounding errors that send the model down wildly separate pathways, preserving short-term coherence while entirely losing contact with reality.The Two Pillars of Machine Learning Failure: Dr. Matthew Colbrook\u2019s team identified two specific structural reasons why AI modeling naturally breaks down when interacting with complex environments:Data Insufficiency Verification Failure: The machine learning algorithm possesses no internal mathematical mechanism to determine when it has ingested enough training samples to output a stable, provably certain prediction.Hidden Pattern Obfuscation: Critical tracking coordinates within the dynamic architecture remain mathematically hidden or deeply tangled, making them impossible for standard neural nets to differentiate.The Chaos Frequency Problem: When an AI analyzes a chaotic system (where tiny changes in starting parameters yield massive divergence), the Koopman operator produces a continuous spread of overlapping frequencies rather than clean, isolated tracking variables. This explains why short-term forecasts remain accurate, while long-term system projections systematically collapse.The Provably Reliable Algorithm: To solve this structural vulnerability, the researchers engineered a novel, mathematically rigorous algorithm featuring built-in, immutable error bounds. This toolkit gives researchers a real-time certainty meter, verifying exactly when an AI\u2019s output can be trusted without requiring multi-million-dollar supercomputers.The Laptop vs. Supercomputer Benchmark: When stress-tested against 40 years of Arctic climate records, the team\u2019s custom algorithm identified long-lost structural decay patterns in the ice sheets. It consistently outperformed the world\u2019s leading commercial AI systems while running entirely on a basic, consumer-grade standard laptop at a fraction of the computational cost.<\/p>\n
Source: University of Cambridge<\/p>\n
When can we trust the results we get from AI, and when is learning impossible? Researchers have shown that there are some problems that even the most powerful AI can reliably solve, no matter how much data it\u2019s given.<\/p>\n
The researchers, from the University of Cambridge and the University of California Santa Barbara, designed \u2018adversarial\u2019 mathematical systems designed to fool any AI algorithm. Like ethical hackers stress-testing the security of a network, these adversarial systems were designed to map out exactly where and why AI prediction breaks down.<\/p>\n
Many real-world systems \u2013 like those in oceans, the human brain, or robotics \u2013 are too complex to describe neatly with equations, so researchers often learn how they behave by using machine learning. But these AI methods don\u2019t always work well, returning unreliable results or poor predictions.<\/p>\n
Sometimes, however, providing reliable solutions is fundamentally impossible, even with infinite data. The adversarial systems developed by the researchers may help developers and users of AI systems know whether they\u2019re working on a solvable or unsolvable problem, build methods that work, and avoid wasting time, effort or AI tokens when a problem is beyond the bounds of possibility.<\/p>\n
Their results, reported in the journal\u00a0Nature Communications, could also help explain why popular AI chatbots like ChatGPT or Claude can be accurate in the short term, but can drift or hallucinate over time.<\/p>\n
\u201cWe\u2019re probing the boundaries of what you can and can\u2019t do with AI,\u201d said lead author Dr Matthew Colbrook, from Cambridge\u2019s Department of Applied Mathematics and Theoretical Physics. \u201cIt\u2019s so important to understand what problems can\u2019t be solved with these methods, because otherwise you end up wasting a lot of time and money.\u201d<\/p>\n
Colbrook and his co-authors used an approach called Koopman operator learning, which turns complicated nonlinear behaviour into a linear form that\u2019s easier to analyse.<\/p>\n
\u201cWhat we were doing with these \u2018adversaries\u2019 was trying to figure out the types of systems that are hard or impossible to predict, and the types of systems that could be adapted to return reliable results,\u201d said Colbrook.<\/p>\n
The researchers identified two main reasons why machine learning breaks down when analysing complex systems: either the algorithm can\u2019t tell when it\u2019s seen enough data to return a reliable result, or patterns in the system can be hidden or hard to distinguish.<\/p>\n
\u201cIn a lot of AI research, a common assumption is that if we just collect more data, learning will eventually work,\u201d said Colbrook. \u201cBut we found this is often wrong. Learning is often layered, and requires multiple steps in the right order to work.\u201d<\/p>\n
When a system is chaotic \u2014 meaning tiny differences in starting conditions lead to wildly different trajectories, like a choose your own adventure story \u2014 the Koopman operator often ends up with a\u00a0continuous\u00a0spread of frequencies rather than clean, distinct modes. Short-term prediction was accurate, but long-term prediction became fundamentally unreliable, because the sensitivity to initial conditions compounds over time.<\/p>\n
The same mathematical instability that defeats prediction algorithms may also explain why AI chatbots confidently fabricate facts: small changes in a question can send the chatbot down an entirely different path, one that looks plausible word-by-word but loses its grip on reality over longer outputs.<\/p>\n
The researchers developed a way to classify these problems based on how many steps are needed to solve them. Where the data is not sufficiently layered or in the right order, the best an algorithm can do \u2013 even with infinite data \u2013 is 50\/50, essentially classifying the problem as unsolvable. \u00a0<\/p>\n
The team also produced a new, provably reliable and highly efficient algorithm with built-in error bounds: essentially giving AI researchers a way to know when they\u2019re able to trust the answer, at a fraction of the cost of most supercomputers.<\/p>\n
The researchers tested their approach on over 40 years of Arctic sea ice data. Using their algorithm they found hidden patterns in how the ice is declining, and were able to outperform current leading AI models at a fraction of the cost, on a standard laptop.<\/p>\n
\u201cWe\u2019re at the stage now where there have been a lot of flashy examples and success stories in AI, but it\u2019s vital that we also ask how certain the models are, and how we know whether they\u2019re certain,\u201d said Colbrook. \u201cOtherwise, we\u2019re building on very shaky foundations.\u201d<\/p>\n
Key Questions Answered:Q: What is a \u201cKoopman operator,\u201d and how did the researchers use it to find the limits of artificial intelligence?<\/p>\n
A: Imagine trying to predict the path of smoke rising from a campfire. The smoke twists, loops, and breaks apart in a highly complicated, non-linear way that is nearly impossible to track with basic equations. A Koopman operator is a mathematical technique that takes this messy, non-linear behavior and maps it into an alternative, abstract landscape where the movement acts like a straight, linear line. By converting complex systems into this linear form, Dr. Matthew Colbrook\u2019s team could stress-test the math, creating \u201cadversarial networks\u201d to pinpoint exactly where the equations break down and become impossible for an AI to solve.<\/p>\n
Q: How does this mathematical study explain why AI chatbots like ChatGPT confidently lie or hallucinate?<\/p>\n
A: Chatbots process text much like a chaotic weather system processes atmosphere, word by word, the path depends entirely on the starting point. When a system is chaotic, tiny shifts in the initial input send the path down wildly different trajectories. In a chatbot, changing a single letter or word in a long prompt can cause the AI to veer off its factual path. Word-by-word, the response sounds completely plausible, but over a long output, the compounding sensitivity to that minor initial change causes the model to drift away from reality, resulting in a hallucination.<\/p>\n
Q: If more data can\u2019t fix these unsolvable problems, what should AI developers do instead?<\/p>\n
A: The tech sector needs to stop blindly throwing massive computing power and uncurated datasets at complex problems. Instead, developers can use the Cambridge-UCSB team\u2019s new algorithm, which features built-in error bounds. Think of it like a built-in dashboard gauge that tells you exactly how certain an AI model is about its output. By using this method, scientists can immediately distinguish whether a complex problem is solvable or fundamentally impossible, saving millions of dollars, cutting out wasted supercomputing time, and highlighting hidden patterns using basic, affordable laptops.<\/p>\n
Editorial Notes:This article was edited by a Neuroscience News editor.Journal paper reviewed in full.Additional context added by our staff.About this AI research news<\/p>\n
Author:\u00a0Sarah Collins<\/a>
Source:\u00a0University of Cambridge<\/a>
Contact:\u00a0Sarah Collins \u2013 University of Cambridge
Image:\u00a0The image is credited to Neuroscience News<\/p>\n