{"id":165261,"date":"2025-12-03T01:54:12","date_gmt":"2025-12-03T01:54:12","guid":{"rendered":"https:\/\/www.newsbeep.com\/nz\/165261\/"},"modified":"2025-12-03T01:54:12","modified_gmt":"2025-12-03T01:54:12","slug":"neural-dispatch-stressful-times-for-nvidias-world-view-and-ai-refuses-to-take-responsibility-ht-tech","status":"publish","type":"post","link":"https:\/\/www.newsbeep.com\/nz\/165261\/","title":{"rendered":"Neural Dispatch: Stressful times for Nvidia\u2019s world view, and AI refuses to take responsibility \n(HT Tech)"},"content":{"rendered":"\n<p>Cognitive warmup. RAM prices are going up, and this will not be pretty. Mark my words. The fact that a 96GB DDR5 RAM costs as much as $900 (around \u20b989,000) means it is more expensive than an entire Sony PlayStation 5 (that\u2019s around \u20b954,990). These are memory prices that haven\u2019t doubled, but tripled over the past few months. The main culprit? AI\u2019s insatiable appetite for memory. Data centres and cloud providers are buying up massive amounts of high-bandwidth memory for AI servers. Consumer RAM business naturally takes a backseat \u2014 that means your next smartphone, desktop, laptop, even your next tablet or gaming console, will get a bit more expensive. And I\u2019m not overstating the scenario. There is another element at play. The transition from DDR4 to DDR5 (the first DDR5 products began arriving in 2022) did add complexity, and initial production of newer nodes understandably had lower yields, constraining supply during this crossover period between 2021 and 2023. Memory brands including Micron, Crucial, Patriot, and Corsair were playing inventory catch-up. Unfortunately, relief isn\u2019t coming soon. I don\u2019t foresee meaningful price drops before mid-2026 at the earliest. In the meantime, tech companies will inevitably pass on these costs to customers. Not that it means you should rush to buy a new phone or laptop, even if you don\u2019t need one.<\/p>\n<p>     <img decoding=\"async\" src=\"https:\/\/www.newsbeep.com\/nz\/wp-content\/uploads\/2025\/12\/Algorithm_-_Google_Ironwood_TPU_1764707787306_1764707816762.png\" alt=\"Google which has till now largely rented out custom TPUs is offering to sell them for the first time\" title=\"Google which has till now largely rented out custom TPUs is offering to sell them for the first time\"\/>   Google which has till now largely rented out custom TPUs is offering to sell them for the first time    Last time on Neural Dispatch: <a rel=\"nofollow noopener\" href=\"https:\/\/httechnology.substack.com\/p\/neural-dispatch-the-ai-maths-is-broken?triedRedirect=true\" target=\"_blank\" class=\"backlink\" data-vars-page-type=\"story\" data-vars-link-type=\"Manual\" data-vars-anchor-text=\"The AI maths is broken, and a bubble that many pretend to not see, is deflating\">The AI maths is broken, and a bubble that many pretend to not see, is deflating<\/a>ALGORITHM<\/p>\n<p>This week, we talk about stressful times for Nvidia, also because Google\u2019s found a big leap for its TPU business that directly hurts Nvidia\u2019s GPU sales, and its a case of never say never as OpenAI admits that advertisements within ChatGPT may more be a case of when and not if.<\/p>\n<p>   Google TPU vs Nvidia GPU: Who\u2019s winning!<\/p>\n<p>\u201cCompetitors can price their chips at $0 and Nvidia products will still be a better option,\u201d CEO Jensen Huang said, not too recently. That didn\u2019t age well at all, did it? Meta is now buying (not immediately, staggered) what will be billions of dollars worth of Google TPUs, or Tensor Processing Units. Two important things to note here. First, Google which has till now largely rented out custom TPUs is offering to sell them for the first time. Secondly, despite Nvidia\u2019s insistence to the contrary, TPUs as application-specific integrated circuit (ASIC) will be a better and more cost effective fit in specific AI frameworks. This news hit the Nvidia stock price, quite hard. So much so, Nvidia posted a rather grudging congratulatory note (after all, everyone\u2019s got to still show they\u2019re friends, because AI\u2019s sake\u2026) whilst claiming that \u201cNvidia is a generation ahead of the industry \u2014 its the only platform that runs every AI model and does it everywhere computing is done.\u201d Great.<\/p>\n<p>What\u2019s the difference between a GPU that Nvidia wants to sell for AI tasks, versus a TPU that Google champions? A GPU is a specialised processor originally designed for manipulating computer graphics. Their parallel structure makes them ideal for algorithms that process large blocks of data commonly found in AI workloads. A TPU is an ASIC designed for neural networks with specialised features, such as the matrix multiply unit (MXU) and proprietary interconnect topology that make them ideal for accelerating AI training and inference. All of Google AI services run off TPUs. Right now, Google has three iterations available for customers \u2014 the Cloud TPU v5e that\u2019s ideal for medium-to-large-scale training and inference workloads, the Cloud TPU v5p which is a powerful TPU for building large, complex foundational models, as well as the Trillium, a sixth generation TPU which pushed the standards for energy efficiency and peak compute performance per chip for training and inference. Next in line is the Ironwood TPU, which Google says is their \u201cmost powerful and efficient TPU yet, for large scale training and inference.\u201d<\/p>\n<p>One thing is clear. Suddenly, the \u2018Nvidia or nothing\u2019 worldview seems less absolute. Is Nvidia still the gold standard? Perhaps, but we\u2019ll let the market forces decide that. But the armour isn\u2019t shining anymore.<\/p>\n<p> Nvidia says they aren\u2019t like Enron<\/p>\n<p>I mean I don\u2019t know everything, but I\u2019d say that if you have to say \u201cwe are not like Enron,\u201d you\u2019re already on the back foot. Isn\u2019t it? Nvidia\u2019s attempts to silence ballooning speculation, over revenue recognition, accounting methodology, and the realistic lifespan of GPUs, are sounding increasingly like a company that is on the back foot. In a note to Wall Street analysts in response to the definitive puncturing of the AI bubble over the past few months (panic is setting in, because circular funding gas been found out) and also American investor and hedge fund manager Michael Burry made a rather blunt post X after Nvidia\u2019s <a rel=\"nofollow noopener\" href=\"https:\/\/httechnology.substack.com\/p\/neural-dispatch-the-ai-maths-is-broken?triedRedirect=true\" target=\"_blank\" class=\"backlink\" data-vars-page-type=\"story\" data-vars-link-type=\"Manual\" data-vars-anchor-text=\"earnings release\">earnings release<\/a>. He had pointed out the practice of Nvidia\u2019s customers now using six-year depreciation schedules instead of the standard practice of two or three years. Burry had argued about the maths of that practice. Nevertheless, Nvidia in the note says \u201cNvidia does not resemble historical accounting frauds because Nvidia\u2019s underlying business is economically sound, our reporting is complete and transparent, and we care about our reputation for integrity. Unlike Enron, Nvidia does not use Special Purpose Entities to hide debt and inflate revenue.\u201d Great, then. The fact that investor forums, analysts, and a few very loud short-sellers even managed to find shades enough for that comparison, is telling. Every over-performing tech giant eventually learns \u2014 gravity isn\u2019t a rumour; it\u2019s a schedule.<\/p>\n<p> From \u201cnever doing ads\u201d to, this\u2026<\/p>\n<p>It was inevitable, wasn\u2019t it? The world\u2019s most powerful conversational product seems to be tip-toeing toward the world\u2019s oldest monetisation model \u2014 advertising. Some things never change, no matter how technology changes. OpenAI\u2019s Sam Altman has hinted that ads are \u201csomething we\u2019ll try\u201d. Don\u2019t get sidetracked by this, because in OpenAI-speak, this translates to \u201ca pilot is already running somewhere, we just haven\u2019t told you.\u201d I\u2019d estimate this means three things. First, AI search is about to look even more like traditional search. Secondly, \u201cobjective answers\u201d may slowly become \u201csponsored objectivity. And third, any dreams of an ad-free, neutral, reasoning-first AI assistant may be headed for a retirement home. The silver lining? If done with transparency, ads might subsidise cheaper tiers, in particular the India-focused education initiatives, without degrading the totality of the product. But the internet has heard that promise before. And some of us will only believe what we see.<\/p>\n<p> Do check out my other newsletter, Wired Wisdom: <a class=\"backlink\" target=\"_blank\" href=\"https:\/\/www.hindustantimes.com\/ht-newsletter\/htwiredwisdom27112025.html\" data-vars-page-type=\"story\" data-vars-link-type=\"Manual\" data-vars-anchor-text=\"Decoding home air purifiers, SaveSage\u2019s AI saves you money, and Toyota\u2019s tem museum\" rel=\"nofollow noopener\">Decoding home air purifiers, SaveSage\u2019s AI saves you money, and Toyota\u2019s tem museum<\/a>THINKING   <img decoding=\"async\" src=\"https:\/\/www.newsbeep.com\/nz\/wp-content\/uploads\/2025\/12\/quoteText.png\" alt=\"\"\/>  <\/p>\n<p>\u201cWe will respectfully make our case in a way that is cognizant of the complexity and nuances of situations involving real people and real lives\u2026 Because we are a defendant in this case, we are required to respond to the specific and serious allegations in the lawsuit.\u201d \u2014 OpenAI\u2019s response to a lawsuit, and denying liability in teen suicide.<\/p>\n<p>While this may just be another corporate statement crafted by a legal team to safeguard the larger business interests (as far as that is possible), it does signal an uncomfortable inflection point. One where AI systems have become emotionally accessible enough that people confide in them the way they do in humans \u2014 but they are still engineered to behave like tools. No boundaries. No limits. No balance. I am reminded of that time when Meta CEO Mark Zuckerberg was given an absolute earful by the U.S. Senate Judiciary Committee hearing on online child safety and exploitation (this was on January 31, 2024), and was forced to apologise to parents of children who were harmed by interactions on social media. Technology never had the societal filters for conversations with children. This at a time when public expectation mismatch is widening. Users increasingly (and absolutely incorrectly, I must add) treat ChatGPT like a thinking, empathic entity. It isn\u2019t, and no AI is or will ever be. Regulators still classify it as software, and rightly so. It is a tool and will always be that \u2014 tools cannot be human, humans must find the right use for tools. Now is the time when courts must interpret a technology whose influence is human-like, yet whose accountability is legally non-human. This response is an example of that.<\/p>\n<p>A Reality Check: This lawsuit I\u2019m referring to, is the manifestation of that cognitive dissonance. And it won\u2019t be the last. As AI becomes more agentic, and supposedly more personalised, it finds itself more deeply embedded in mental-health-adjacent interactions, the boundary between influence and responsibility blurrier still.<\/p>\n<p>OpenAI\u2019s defence, that the company cannot be held liable for all user outcomes, is institutionally predictable. No AI firm can survive if held responsible for every emotional, psychological, or behavioural consequence triggered by a model\u2019s output. But morality doesn\u2019t take instructions from legal disclaimers. And the truth is this \u2014 AI companies have spent years marketing these systems as empathetic, conversational, human-like companions. You can\u2019t sell \u201cintelligence,\u201d \u201creasoning,\u201d and \u201cconnection\u201d on Monday and then argue \u201cwe\u2019re just a tool\u201d on Wednesday afternoon, without raising eyebrows and lawsuits. The stakes aren\u2019t just about what happened in this tragic case. They\u2019re about who carries the burden when AI steps into human emotional territory. The user? The developer? The regulator? Or the emerging grey zone of shared responsibility no one is quite ready to define?<\/p>\n<p>The AI era\u2019s legal phase has officially begun, and the industry may now begin to (and very uncomfortably so, I might add) discover that being \u201ctransformational\u201d also means being answerable.<\/p>\n","protected":false},"excerpt":{"rendered":"Cognitive warmup. RAM prices are going up, and this will not be pretty. Mark my words. The fact&hellip;\n","protected":false},"author":2,"featured_media":165262,"comment_status":"","ping_status":"","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[6],"tags":[108046,108047,761,108048,111,139,108045,69,620,145],"class_list":["post-165261","post","type-post","status-publish","format-standard","has-post-thumbnail","category-technology","tag-ai-developments","tag-ddr5","tag-laptop","tag-new-phone","tag-new-zealand","tag-newzealand","tag-nvidias-world-view","tag-nz","tag-openai","tag-technology"],"_links":{"self":[{"href":"https:\/\/www.newsbeep.com\/nz\/wp-json\/wp\/v2\/posts\/165261","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.newsbeep.com\/nz\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.newsbeep.com\/nz\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.newsbeep.com\/nz\/wp-json\/wp\/v2\/users\/2"}],"replies":[{"embeddable":true,"href":"https:\/\/www.newsbeep.com\/nz\/wp-json\/wp\/v2\/comments?post=165261"}],"version-history":[{"count":0,"href":"https:\/\/www.newsbeep.com\/nz\/wp-json\/wp\/v2\/posts\/165261\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/www.newsbeep.com\/nz\/wp-json\/wp\/v2\/media\/165262"}],"wp:attachment":[{"href":"https:\/\/www.newsbeep.com\/nz\/wp-json\/wp\/v2\/media?parent=165261"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.newsbeep.com\/nz\/wp-json\/wp\/v2\/categories?post=165261"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.newsbeep.com\/nz\/wp-json\/wp\/v2\/tags?post=165261"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}