{"id":374902,"date":"2026-04-11T18:56:09","date_gmt":"2026-04-11T18:56:09","guid":{"rendered":"https:\/\/www.newsbeep.com\/nz\/374902\/"},"modified":"2026-04-11T18:56:09","modified_gmt":"2026-04-11T18:56:09","slug":"the-biggest-advance-in-ai-since-the-llm","status":"publish","type":"post","link":"https:\/\/www.newsbeep.com\/nz\/374902\/","title":{"rendered":"The biggest advance in AI since the LLM"},"content":{"rendered":"<p><a target=\"_blank\" href=\"https:\/\/substackcdn.com\/image\/fetch\/$s_!-P9Y!,f_auto,q_auto:good,fl_progressive:steep\/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F63f64a11-5698-410a-af12-a8c88597d566_784x1168.jpeg\" data-component-name=\"Image2ToDOM\" rel=\"nofollow noopener\" class=\"image-link image2 is-viewable-img can-restack\"><img decoding=\"async\" src=\"https:\/\/www.newsbeep.com\/nz\/wp-content\/uploads\/2026\/04\/https:\/\/substack-post-media.s3.amazonaws.com\/public\/images\/63f64a11-5698-410a-af12-a8c88597d566_784x.jpeg\" width=\"784\" height=\"1168\" data-attrs=\"{&quot;src&quot;:&quot;https:\/\/substack-post-media.s3.amazonaws.com\/public\/images\/63f64a11-5698-410a-af12-a8c88597d566_784x1168.jpeg&quot;,&quot;srcNoWatermark&quot;:null,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:1168,&quot;width&quot;:784,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:363605,&quot;alt&quot;:null,&quot;title&quot;:null,&quot;type&quot;:&quot;image\/jpeg&quot;,&quot;href&quot;:null,&quot;belowTheFold&quot;:false,&quot;topImage&quot;:true,&quot;internalRedirect&quot;:&quot;https:\/\/garymarcus.substack.com\/i\/193895488?img=https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F63f64a11-5698-410a-af12-a8c88597d566_784x1168.jpeg&quot;,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}\" alt=\"\"   fetchpriority=\"high\" class=\"sizing-normal\"\/><\/a>Even Grok knows that neurosymbolic hybrid power is the future<\/p>\n<p><a href=\"https:\/\/claude.com\/product\/claude-code\" rel=\"nofollow noopener\" target=\"_blank\">Claude Code<\/a>, an impressive and possibly game-changing \u201ccoding agent\u201d for programmers to write code faster is the single biggest advance in AI since the LLM.<\/p>\n<p>And the thing is, Claude Code is NOT a pure LLM. And it\u2019s not pure deep learning. Not even close. <\/p>\n<p>That changes everything. <\/p>\n<p><a href=\"https:\/\/arstechnica.com\/ai\/2026\/03\/entire-claude-code-cli-source-code-leaks-thanks-to-exposed-map-file\/\" rel=\"nofollow noopener\" target=\"_blank\">The source code leak<\/a> proves it. Tucked away at its center is <a href=\"https:\/\/techtrenches.dev\/p\/the-snake-that-ate-itself-what-claude\" rel=\"nofollow noopener\" target=\"_blank\">a 3,167 line kernel called <\/a><a href=\"https:\/\/techtrenches.dev\/p\/the-snake-that-ate-itself-what-claude\" rel=\"nofollow noopener\" target=\"_blank\">print.ts<\/a>.<\/p>\n<p>print.ts is a pattern matching. And pattern matching is supposed to be the *strength* of LLMs. <\/p>\n<p>But Anthropic figured out that if you really need to get your patterns right, you can\u2019t trust a pure LLM. They are too probabilistic. And too erratic.<\/p>\n<p>Instead, the way Anthropic built that kernel is straight out of classical symbolic AI.  For example, it\u2019s in large part a big IF-THEN conditional, with 486 branch points and 12 levels of nesting \u2014 all inside a deterministic, symbolic loop that the real godfathers of AI, people like John McCarthy and Marvin Minsky and Herb Simon, would have instantly recognized.<\/p>\n<p>Putting things differently, Anthropic, when push came to shove, went exactly where I have said for 25 years that the field needed to go: to Neurosymbolic AI. <\/p>\n<p>That\u2019s right, the biggest advance since the LLM is <a href=\"https:\/\/ojs.aaai.org\/index.php\/AAAI\/article\/view\/42130\" rel=\"nofollow noopener\" target=\"_blank\">neurosymbolic<\/a>. AlphaFold, AlphaEvolve, AlphaProof, and AlphaGeometry are all neurosymbolic, too; <a href=\"https:\/\/open.substack.com\/pub\/garymarcus\/p\/how-o3-and-grok-4-accidentally-vindicated?r=8tdk6&amp;utm_medium=ios\" rel=\"nofollow noopener\" target=\"_blank\">so is Code Interpreter; when you are calling code, you are asking symbolic AI to do an important part of the work<\/a>.<\/p>\n<p>Claude Code isn\u2019t better because of scaling. It\u2019s better because it is <a href=\"https:\/\/ojs.aaai.org\/index.php\/AAAI\/article\/view\/42130\" rel=\"nofollow noopener\" target=\"_blank\">neurosymbolic<\/a>. Anthropic accepted the importance of using classical AI techniques alongside neural networks \u2014 precisely <a href=\"https:\/\/mitpress.mit.edu\/9780262632683\/the-algebraic-mind\/\" rel=\"nofollow noopener\" target=\"_blank\">the marriage I have spent my career advocating<\/a>. <\/p>\n<p>It\u2019s both massive vindication for me personally (see <a href=\"https:\/\/montrealai.github.io\/aidebate\/\" rel=\"nofollow noopener\" target=\"_blank\">my 2019 debate with Yoshua Bengio<\/a> for context, or my 2001 book, <a href=\"https:\/\/mitpress.mit.edu\/9780262632683\/the-algebraic-mind\/\" rel=\"nofollow noopener\" target=\"_blank\">The Algebraic Mind<\/a>), and for <a href=\"https:\/\/nesy-ai.org\/\" rel=\"nofollow noopener\" target=\"_blank\">the hundreds of other researchers who have stood by neurosymbolic AI<\/a> even when prominent people like Geoff Hinton <a href=\"https:\/\/x.com\/tabithagold\/status\/1071189769499996161?s=61\" rel=\"nofollow\">wrongly disparaged us<\/a> for years. <\/p>\n<p>Still, Claude Code ain\u2019t perfect, or even close.<\/p>\n<p>What we really need to do to get trustworthy AI rather than the current unpredictable \u201cjagged\u201d mess, is to go in the knowledge-, reasoning-, and world-model driven direction I laid out in 2020, in an article called <a href=\"https:\/\/arxiv.org\/abs\/2002.06177\" rel=\"nofollow noopener\" target=\"_blank\">The Next Decade in AI<\/a>, in which neurosymbolic AI is just the *starting point* in a longer journey.<\/p>\n<p>Read <a href=\"https:\/\/arxiv.org\/abs\/2002.06177\" rel=\"nofollow noopener\" target=\"_blank\">that article<\/a> if you want to know what else we need to do next. The first part has already come to pass. In time, other three will, too.<\/p>\n<p>Meanwhile, the implications for the allocation of capital are pretty massive: smartly adding in bits of symbolic AI can do a lot more than scaling alone, and even Anthropic has now discovered (though they haven\u2019t acknowledged publicly) scaling is no longer the essence of innovation. <\/p>\n<p>The paradigm has changed.<\/p>\n<p>P.s. for a good <a href=\"https:\/\/ojs.aaai.org\/index.php\/AAAI\/article\/view\/42130\" rel=\"nofollow noopener\" target=\"_blank\">recent review<\/a> of neurosymbolic AI, read <a href=\"https:\/\/ojs.aaai.org\/index.php\/AAAI\/article\/view\/42130\" rel=\"nofollow noopener\" target=\"_blank\">this<\/a>: <\/p>\n<p><a target=\"_blank\" href=\"https:\/\/substackcdn.com\/image\/fetch\/$s_!4QN-!,f_auto,q_auto:good,fl_progressive:steep\/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F7a6005de-1f87-4551-a114-e5777a7a89cf_2142x1382.png\" data-component-name=\"Image2ToDOM\" rel=\"nofollow noopener\" class=\"image-link image2 is-viewable-img can-restack\"><img decoding=\"async\" src=\"https:\/\/www.newsbeep.com\/nz\/wp-content\/uploads\/2026\/04\/https:\/\/substack-post-media.s3.amazonaws.com\/public\/images\/7a6005de-1f87-4551-a114-e5777a7a89cf_2142.jpeg\" width=\"1456\" height=\"939\" data-attrs=\"{&quot;src&quot;:&quot;https:\/\/substack-post-media.s3.amazonaws.com\/public\/images\/7a6005de-1f87-4551-a114-e5777a7a89cf_2142x1382.png&quot;,&quot;srcNoWatermark&quot;:null,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:939,&quot;width&quot;:1456,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:403866,&quot;alt&quot;:&quot;&quot;,&quot;title&quot;:null,&quot;type&quot;:&quot;image\/png&quot;,&quot;href&quot;:null,&quot;belowTheFold&quot;:true,&quot;topImage&quot;:false,&quot;internalRedirect&quot;:&quot;https:\/\/garymarcus.substack.com\/i\/193895488?img=https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Ffb47f6bb-ffef-4fbb-9928-4facbdea2fb6_2349x1382.png&quot;,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}\" alt=\"\" title=\"\"   loading=\"lazy\" class=\"sizing-normal\"\/><\/a><\/p>\n","protected":false},"excerpt":{"rendered":"Even Grok knows that neurosymbolic hybrid power is the future Claude Code, an impressive and possibly game-changing \u201ccoding&hellip;\n","protected":false},"author":2,"featured_media":374903,"comment_status":"","ping_status":"","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[20],"tags":[365,363,364,111,139,69,145],"class_list":{"0":"post-374902","1":"post","2":"type-post","3":"status-publish","4":"format-standard","5":"has-post-thumbnail","7":"category-artificial-intelligence","8":"tag-ai","9":"tag-artificial-intelligence","10":"tag-artificialintelligence","11":"tag-new-zealand","12":"tag-newzealand","13":"tag-nz","14":"tag-technology"},"_links":{"self":[{"href":"https:\/\/www.newsbeep.com\/nz\/wp-json\/wp\/v2\/posts\/374902","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.newsbeep.com\/nz\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.newsbeep.com\/nz\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.newsbeep.com\/nz\/wp-json\/wp\/v2\/users\/2"}],"replies":[{"embeddable":true,"href":"https:\/\/www.newsbeep.com\/nz\/wp-json\/wp\/v2\/comments?post=374902"}],"version-history":[{"count":0,"href":"https:\/\/www.newsbeep.com\/nz\/wp-json\/wp\/v2\/posts\/374902\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/www.newsbeep.com\/nz\/wp-json\/wp\/v2\/media\/374903"}],"wp:attachment":[{"href":"https:\/\/www.newsbeep.com\/nz\/wp-json\/wp\/v2\/media?parent=374902"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.newsbeep.com\/nz\/wp-json\/wp\/v2\/categories?post=374902"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.newsbeep.com\/nz\/wp-json\/wp\/v2\/tags?post=374902"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}