Today, Nvidia\u2019s revenues are dominated by hardware sales. But when the AI bubble inevitably pops, the GPU giant will become the single most important software company in the world.<\/p>\n
Since ChatGPT kicked off the AI arms race in late 2022, Nvidia has shipped millions of GPUs predominantly for use in AI training and inference.<\/p>\n
That\u2019s a lot of chips that are going to be left idle when the music stops and the finance bros come to the sickening realization that using a fast-depreciating asset as collateral for multi-billion dollar loans wasn\u2019t such a great idea after all.<\/p>\n
However, anyone suggesting those GPUs will be rendered worthless when the dust settles is naive.<\/p>\n
GPUs may be synonymous with AI by this point, but they\u2019re much more versatile than that. As a reminder, GPU stands for graphics processing unit. These chips were originally designed to speed up video game rendering, which, by the late \u201890s, was quickly becoming too computationally intensive for the single-threaded CPUs of the time.<\/p>\n
As it turns out, the same thing that made GPUs great at pushing pixels also made them particularly well suited for other parallel workloads \u2014 you know, like simulating the physics of a hydrogen bomb going critical. Many of Nvidia\u2019s most powerful accelerators \u2014 chips like the H200 or GB300 \u2014 have long since ditched the graphics pipeline to make room for more vector and matrix math accelerators required in HPC and AI.<\/p>\n
If an app can be parallelized, there\u2019s a good chance it\u2019ll benefit from GPU acceleration \u2014 if you have the software to do it. This is why there are so few GPU companies. A GPU needs to be broadly programmable; an AI ASIC only needs to do inference or training well.<\/p>\n
CUDA-X many reasons to buy a GPU<\/p>\n
Since introducing CUDA, its low level GPU programming environment and API interface, in 2007, Nvidia has built hundreds of software libraries, frameworks, and micro-services to accelerate any and every workload it can think to.<\/p>\n
The libraries, collectively marketed under the CUDA-X banner<\/a>, cover everything from computational fluid dynamics and electronic design automation to drug discovery, computational lithography, material design, and even quantum computing. The company also has frameworks for visualizing digital twins and robotics.<\/p>\n For now, AI has turned out to be the most lucrative of these, but when the hype train runs out of steam, there\u2019s still plenty that can be done with the hardware.<\/p>\n For example, Nvidia built cuDF and integrated it into the popular RAPIDS data science and analytics framework to accelerate SQL databases or Pandas, attaining a 150x speed up<\/a> in the process. It\u2019s no wonder database giant Oracle is so keen on Nvidia\u2019s hardware. Any compute it can\u2019t rent out to OpenAI for a profit, it can use to accelerate its database and analytics platforms.<\/p>\n Nvidia doesn\u2019t offer a complete solution, and that\u2019s by design. Some of its libraries are open sourced, while others are made available as more comprehensive frameworks and micro-services. These form the building blocks by which software developers can use to accelerate their workloads, with a growing number of them being tied back to revenue-generating licensing schemes<\/a>.<\/p>\n The only problem: up to this point, these benefits required buying or leasing a pricy GPU and then integrating these frameworks into your code base or waiting for an independent software vendor (ISV) to do it for you.<\/p>\n But when the bubble bursts and pricing on GPUs drops through the floor, anyone that can find a use for these stranded assets stands to make a fortune. Nvidia has already built the software necessary to do it \u2014 the ISVs just need to integrate and sell it.<\/p>\n In this context, Nvidia\u2019s steady transition from building low-level software libraries aimed at developers to selling enterprise-focused micro-services starts to make a lot of sense. The lower the barrier to adoption, the easier it is to sell hardware and the subscriptions that go with it.<\/p>\n It appears that Nvidia may even open this software stack to a broader ecosystem of hardware vendors. GPUzilla has begun transitioning to a disaggregated architecture that breaks up workloads and offloads them to third-party silicon.<\/p>\n This week, Nvidia completed<\/a> a $5 billion investment in Intel. The x86 giant is currently developing a prefill accelerator to speed up prompt processing for large language model inference. Meanwhile, Nvidia signed<\/a> a deal last week to aqui-hire rival chip vendor Groq that it \u2014 though it remains to be seen how the GPU slinger intends to integrate the company\u2019s tech long term.<\/p>\n In addition to its home-grown software platforms, Nvidia has made several strategic software acquisitions over the past few years, acquiring Run:AI<\/a>\u2019s Kubernetes-based GPU orchestration and Deci AI<\/a>\u2019s model optimization platforms in 2024. Earlier this month, Nvidia added<\/a> SchedMD\u2019s Slurm workload management platform, which is widely deployed across AMD, Nvidia, and Intel-based clusters for HPC and AI workloads, ensuring a profit even if you don\u2019t buy its hardware.<\/p>\n GenAI is here to stay<\/p>\n To be clear, generative AI as we know it today isn\u2019t going away. The cash that\u2019s fueled AI development over the past three years may evaporate, but the underlying technology, imperfect as it is, is still valuable enough that enterprises will keep using it.<\/p>\n Rather than chasing the mirage that is artificial general intelligence, applications of the tech will be far more mundane.<\/p>\n In fact, many of Nvidia\u2019s more comprehensive micro-services make extensive use of domain-specific AI models for things like weather forecasting or physics simulation.<\/p>\n When the dot-com bubble burst, people didn\u2019t stop building web services or buying switches and routers. This time around, people aren\u2019t going to stop consuming AI services either. They\u2019ll just be one of several reasons to buy GPUs. \u00ae<\/p>\n","protected":false},"excerpt":{"rendered":"Today, Nvidia\u2019s revenues are dominated by hardware sales. But when the AI bubble inevitably pops, the GPU giant…\n","protected":false},"author":2,"featured_media":218311,"comment_status":"","ping_status":"","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[20],"tags":[220,218,219,61,60,80],"class_list":["post-218310","post","type-post","status-publish","format-standard","has-post-thumbnail","category-artificial-intelligence","tag-ai","tag-artificial-intelligence","tag-artificialintelligence","tag-ie","tag-ireland","tag-technology"],"_links":{"self":[{"href":"https:\/\/www.newsbeep.com\/ie\/wp-json\/wp\/v2\/posts\/218310","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.newsbeep.com\/ie\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.newsbeep.com\/ie\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.newsbeep.com\/ie\/wp-json\/wp\/v2\/users\/2"}],"replies":[{"embeddable":true,"href":"https:\/\/www.newsbeep.com\/ie\/wp-json\/wp\/v2\/comments?post=218310"}],"version-history":[{"count":0,"href":"https:\/\/www.newsbeep.com\/ie\/wp-json\/wp\/v2\/posts\/218310\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/www.newsbeep.com\/ie\/wp-json\/wp\/v2\/media\/218311"}],"wp:attachment":[{"href":"https:\/\/www.newsbeep.com\/ie\/wp-json\/wp\/v2\/media?parent=218310"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.newsbeep.com\/ie\/wp-json\/wp\/v2\/categories?post=218310"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.newsbeep.com\/ie\/wp-json\/wp\/v2\/tags?post=218310"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}