{"id":279574,"date":"2026-02-12T00:34:10","date_gmt":"2026-02-12T00:34:10","guid":{"rendered":"https:\/\/www.newsbeep.com\/nz\/279574\/"},"modified":"2026-02-12T00:34:10","modified_gmt":"2026-02-12T00:34:10","slug":"about-that-matt-shumer-post-that-has-nearly-50-million-views","status":"publish","type":"post","link":"https:\/\/www.newsbeep.com\/nz\/279574\/","title":{"rendered":"About that Matt Shumer post that has nearly 50 million views"},"content":{"rendered":"

\"\"<\/a>Something Big is Happening, or so a lot of people want to believe<\/p>\n

All morning people have been asking me about a blog post by Matt Shumer<\/a> that has gone viral, with nearly 50 million views on X. <\/p>\n

It\u2019s a masterpiece of hype, written in the style of the old direct marketing campaigns, with bold-faced call outs like \u201cI know this is real because it happened to me first\u201d and \u201cI am no longer needed for the actual technical work of my job\u201d. It\u2019s chock full of singularity vibes:<\/p>\n

\"\"<\/a><\/p>\n

As I told a journalist who asked me about the post, I wouldn\u2019t take it so seriously:<\/p>\n

Shumer\u2019s blog post is weaponized hype that tells people want they want to hear, but stumbles on the facts, especially with respect to reliability. He gives no actual data to support this claim that the latest coding systems can write whole complex apps without making errors. Similarly, when he describes how AI\u2019s are doing longer and longer tasks on METR\u2019s famous task-time benchmark, he neglects to say the criterion on that benchmark is 50% correct, not 100%, and that the benchmark is only about coding and not tasks in general. No AI system can reliably do every five-hour long task humans can do without error, or even close, but you wouldn\u2019t know that reading Shumer\u2019s blog, which largely ignores all the hallucination and boneheaded errors that are so common in every day experience. And of course Shumer didn\u2019t cite the new Caltech\/Stanford article that reviews a wide range of reasoning errors in so-called reasoning models<\/a> [or the Apple reasoning paper or the ASU mirage paper, etc]. The picture he sells just isn\u2019t realistic, however much people might wish it were true. I should add that Shumer is the guy who was once famous for apparently exaggerated claims about a big model of his that didn\u2019t replicate and that many people saw a fraud<\/a>; he likes to sell big. But that doesn\u2019t mean we should take him seriously.<\/p>\n

In hindsight, I should have made five other points, too:<\/p>\n

Shumer made no reference to a different METR study showed that coders sometimes imagine big productivity gains where they actually <\/a>lost <\/a>productivity<\/a>. (Even though he selectively mentioned their other well-known study).<\/p>\n

He also didn\u2019t acknowledge that other user\u2019s experience is certainly not \u201cit\u2019s usually perfect.\u201d Take the often AI-optimistic Kelsey Piper who reported a few weeks back that Claude Code was sometimes perfect, and other times maddening<\/a>. (Example: \u201cSometimes, Claude is absolutely the worst coworker you\u2019ve ever had. At one point, it deleted every single one of the phoneme files of each English sound pronounced [that she was working with in her app] absolutely correctly, which I had personally emailed an English teacher to secure permission to use, and replaced them with AI-generated sounds which were all subtly wrong.\u201d) Shumer glosses over that kind of experience. <\/p>\n

\"\"<\/a><\/p>\n

LLMs write code wicked fast, but some coders are starting to report burnout<\/a>, and only relatively modest gains relative to that burnout, as a new story from Connie Loizos at Tech Crunch illustrates<\/a><\/p>\n

\"\"<\/a><\/p>\n

To his credit, Shumer is actually correct that something has changed recently. You really can let things rip more in the most recent systems. But he misses something subtle but essential, captured well by a friend who very skilled in the art of coding pointed out to me. After reading a draft of this essay, he texted me <\/p>\n

\u201c[Shumer\u2019s blog is representing my experience as well\u2026 Something happened a couple of months ago where you can truly give it a description and let it go and – sometimes! – will come out with the right answer. \u2026 Sometimes\u2026 [But] Ultimately, I think this makes it more dangerous \u2026. Generally, the closer these systems are to appearing right, the more dangerous they become because people become increasingly at ease just trusting them [when the shouldn\u2019t]\u201d. <\/p>\n

The security of the autogenerated code is very much in question, as for example this article last week noted<\/a> (precisely as this substack has long warned<\/a>):<\/p>\n

\"\"<\/a><\/p>\n

The kicker, though, might be the accidental self-own at the end.<\/p>\n

\"\"<\/a><\/p>\n

Quoting another friend, \u201cWhy did [Shumer] need these guys to review the drafts, why didn\u2019t he have the AI do it? Heck, why didn\u2019t he have the AI write his little missive to begin with?\u201d Hmm\u2026<\/p>\n

The bottom line is this: LLMs are certainly coding more, but it\u2019s not clear that the code they are creating is secure or trustworthy. Shumer\u2019s presentation is completely one-sided, omitting lots of concerns that have been widely expressed here and elsewhere. <\/p>\n

A lot of people may have taken his post seriously, but they shouldn\u2019t have.<\/p>\n","protected":false},"excerpt":{"rendered":"Something Big is Happening, or so a lot of people want to believe All morning people have been…\n","protected":false},"author":2,"featured_media":279575,"comment_status":"","ping_status":"","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[20],"tags":[365,363,364,111,139,69,145],"class_list":{"0":"post-279574","1":"post","2":"type-post","3":"status-publish","4":"format-standard","5":"has-post-thumbnail","7":"category-artificial-intelligence","8":"tag-ai","9":"tag-artificial-intelligence","10":"tag-artificialintelligence","11":"tag-new-zealand","12":"tag-newzealand","13":"tag-nz","14":"tag-technology"},"_links":{"self":[{"href":"https:\/\/www.newsbeep.com\/nz\/wp-json\/wp\/v2\/posts\/279574","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.newsbeep.com\/nz\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.newsbeep.com\/nz\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.newsbeep.com\/nz\/wp-json\/wp\/v2\/users\/2"}],"replies":[{"embeddable":true,"href":"https:\/\/www.newsbeep.com\/nz\/wp-json\/wp\/v2\/comments?post=279574"}],"version-history":[{"count":0,"href":"https:\/\/www.newsbeep.com\/nz\/wp-json\/wp\/v2\/posts\/279574\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/www.newsbeep.com\/nz\/wp-json\/wp\/v2\/media\/279575"}],"wp:attachment":[{"href":"https:\/\/www.newsbeep.com\/nz\/wp-json\/wp\/v2\/media?parent=279574"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.newsbeep.com\/nz\/wp-json\/wp\/v2\/categories?post=279574"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.newsbeep.com\/nz\/wp-json\/wp\/v2\/tags?post=279574"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}