{"id":112074,"date":"2025-08-26T20:11:07","date_gmt":"2025-08-26T20:11:07","guid":{"rendered":"https:\/\/www.newsbeep.com\/us\/112074\/"},"modified":"2025-08-26T20:11:07","modified_gmt":"2025-08-26T20:11:07","slug":"the-fragile-mind-of-artificial-intelligence","status":"publish","type":"post","link":"https:\/\/www.newsbeep.com\/us\/112074\/","title":{"rendered":"The Fragile “Mind” of Artificial Intelligence"},"content":{"rendered":"

The controversial author Nassim Taleb<\/a> has written about the interesting idea of \u201cantifragility<\/a>.” It’s the property of systems that don\u2019t just survive stress<\/a> but grow stronger from it. Given my recent curiosity about AI\u2019s anti-intelligence<\/a>, I thought this connection was worth a closer look. And a couple of recent academic papers sharpened my focus.<\/p>\n

But let\u2019s start with antifragility. Muscles are antifragile, and so are bones. Human reasoning, too, often grows when tested by change itself, even in the context of a surprise. It’s this push and pull of uncertainty that, in the final analysis, helps define us.<\/p>\n

So, here’s the point: Artificial intelligence<\/a>, by contrast, is often anything but antifragile. Its brilliance shines in the context of structure, but the moment reality shows up and a question is reworded, or a distraction is introduced, that brilliance fades. What emerges is brittle pseudo-cognition<\/a>. It’s the appearance of intelligence<\/a> that collapses under the slightest perturbation.<\/p>\n

Two recent studies capture this fragility with unsettling clarity. One involves a small shift in multiple-choice exams. The other, a harmless piece of cat trivia. Each in its own way reveals how far machine \u201cminds\u201d are from the antifragility that defines human thought.<\/p>\n

The NOTA Collapse<\/p>\n

The first study, published in JAMA Network Open<\/a>, looked at whether large language models genuinely reason or merely recognize patterns. The researchers sampled questions from a standard benchmark for medical board exams. In the original version, each question had one correct answer. In the modified version, the correct choice was removed and replaced with \u201cNone of the other answers\u201d (NOTA). A clinician reviewed every substitution to confirm that all the visible options were indeed wrong, leaving NOTA as the only correct answer.<\/p>\n

For us humans, this is often trivial. You check each option, find them incorrect, and select NOTA. In fact, this kind of structure is designed precisely to test deeper reasoning on exams. But for the LLMs, the simple substitution was devastating, and the accuracy was cut nearly in half.<\/p>\n

I think that this collapse reveals something essential. On clean benchmarks, models often perform impressively and create the clickbait and sound bites of brilliance. But what they are doing is not reasoning through medical knowledge\u2014it is pattern-matching between familiar question forms and familiar answer tokens. Remove the shortcut, and the platform disappears. Instead of adapting, the model grasps at one of the distractors, failing to see that none of them fit.<\/p>\n

This isn\u2019t how humans operate. We expect a certain degree of trickiness, and we adapt to reframing a problem. This adaptability is antifragility. The machine\u2019s brittleness is something else entirely.<\/p>\n

The CatAttack Effect<\/p>\n

If the NOTA study exposed weakness in abstraction, the CatAttack experiment<\/a> highlights weakness in focus. In this case, researchers showed that inserting irrelevant statements\u2014like \u201cDid you know cats sleep most of their lives?\u201d\u2014into a math problem could double or triple error rates.<\/p>\n

Humans would ignore the trivia. We might even smile at it and then return to the calculation without missing a step. But the models treated the fluff as meaningful. The cat fact didn\u2019t disappear into the background; it distorted the process. What is noise to us became signal to the machine.<\/p>\n

Once again, the contrast is stark. Human cognition has filters built for noise. We thrive in a messy environment. Distraction is the baseline of real life, and our minds adapt accordingly. The machine\u2019s \u201cmind\u201d does the opposite: It is derailed by irrelevance.<\/p>\n

Anti-Intelligence Revealed<\/p>\n

Taken together, these failures are more than technical curiosities. They reveal what I call anti-intelligence. Not stupidity. Not ignorance. But an inversion of reasoning itself.<\/p>\n

Humans gain strength from variability, and we grow sharper, more creative, more resilient<\/a>. LLMs lose strength under unexpected change, and they become less accurate. Their failures are systematic, not random. They collapse precisely where intelligence should become stronger.<\/p>\n

This is the essence of the brittle pseudo-cognition we often see in AI and LLMs. It shines under order yet falters in disorder. It mimics the appearance of intelligence but inverts the very properties that make cognition real.<\/p>\n

The Hidden Risk<\/p>\n

The danger lies in how invisible this fragility can be. When a model gets an answer right, it projects confidence<\/a> and fluency. And when it fails, it often fails with the same confidence. And it’s that techno-confidence, hiding behind “cognitive theater,” that worries me.<\/p>\n

In medicine, the stakes are obvious. Any clinician will tell you that patients don\u2019t present in tidy, test-friendly ways. Their symptoms are ambiguous, their stories and lives are messy, and their physiology unpredictable. These are precisely the conditions under which human clinicians grow sharper and machines stumble. The same is true in law, education<\/a>, and science. The real world is noisy, and it’s antifragile territory.<\/p>\n

Artificial Intelligence Essential Reads<\/p>\n

The Order to Disorder<\/p>\n

The lesson of NOTA and CatAttack is simple, yet deceptively so. Swap in \u201cNone of the other answers,\u201d toss a cat fact into a prompt, and watch the machine falter. But the simplicity is the point, and it doesn\u2019t take much to expose the hollowness.<\/p>\n

It’s fair to say that real intelligence grows in the presence of disorder. That\u2019s why humans thrive under pressure and why we so often discover our strength in difficulty. Artificial intelligence, in contrast, reveals itself as fragile\u2014persuasive when the world is neat, brittle when the world is real.<\/p>\n

That’s not progress toward intelligence, at least not in a human sense.<\/p>\n","protected":false},"excerpt":{"rendered":"The controversial author Nassim Taleb has written about the interesting idea of \u201cantifragility.” It’s the property of systems…\n","protected":false},"author":2,"featured_media":112075,"comment_status":"","ping_status":"","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[45],"tags":[182,181,507,74],"class_list":{"0":"post-112074","1":"post","2":"type-post","3":"status-publish","4":"format-standard","5":"has-post-thumbnail","7":"category-artificial-intelligence","8":"tag-ai","9":"tag-artificial-intelligence","10":"tag-artificialintelligence","11":"tag-technology"},"_links":{"self":[{"href":"https:\/\/www.newsbeep.com\/us\/wp-json\/wp\/v2\/posts\/112074","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.newsbeep.com\/us\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.newsbeep.com\/us\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.newsbeep.com\/us\/wp-json\/wp\/v2\/users\/2"}],"replies":[{"embeddable":true,"href":"https:\/\/www.newsbeep.com\/us\/wp-json\/wp\/v2\/comments?post=112074"}],"version-history":[{"count":0,"href":"https:\/\/www.newsbeep.com\/us\/wp-json\/wp\/v2\/posts\/112074\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/www.newsbeep.com\/us\/wp-json\/wp\/v2\/media\/112075"}],"wp:attachment":[{"href":"https:\/\/www.newsbeep.com\/us\/wp-json\/wp\/v2\/media?parent=112074"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.newsbeep.com\/us\/wp-json\/wp\/v2\/categories?post=112074"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.newsbeep.com\/us\/wp-json\/wp\/v2\/tags?post=112074"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}