Every year the artificial intelligence industry gathers at Nvidia Corp.\u2019s GPU Technology Conference expecting to see faster graphics processing units, bigger models and the next wave of AI software innovation.<\/p>\n
And yes, that will all be there.<\/p>\n
But if you\u2019ve been watching the conversations we\u2019ve been having on theCUBE over the past few years, you know the real story isn\u2019t just happening on stage \u2014 it\u2019s happening under the hood.<\/p>\n
What\u2019s unfolding right now is the largest infrastructure buildout the tech industry has seen since the birth of the cloud. But unlike the cloud era, which was largely a software revolution, the AI era is rapidly becoming something else entirely.<\/p>\n
It\u2019s becoming industrial.<\/p>\n
The companies racing to lead this new era aren\u2019t just writing code. They\u2019re securing power, booking semiconductor capacity, locking in memory supply and deploying massive clusters designed to produce intelligence at scale.<\/p>\n
We call this system the AI factory.<\/p>\n
And as we head into GTC, the deeper narrative isn\u2019t just about the next GPU architecture. It\u2019s about a global infrastructure race \u2014 a trillion-dollar supply chain trench war \u2014 to build the factories that will manufacture intelligence for the next decade.<\/p>\n
What\u2019s even more interesting is that this factory is no longer confined to hyperscale data centers. It\u2019s beginning to extend outward into what we call the hyperconverged edge, where AI moves closer to where data is created and decisions are made.<\/p>\n
That shift \u2014 from centralized AI to a distributed network of intelligence factories \u2014 may ultimately define the next phase of the industry.<\/p>\n
The AI factory: Manufacturing intelligence<\/p>\n
Over the past few years we\u2019ve been describing a shift in how computing infrastructure is designed.<\/p>\n
Traditional data centers stored data and ran applications.<\/p>\n
AI infrastructure does something fundamentally different: It manufactures intelligence. An AI factory is a vertically integrated system designed to convert raw inputs \u2014 power, silicon, memory and data \u2014 into outputs such as AI models, inference services, automation and reasoning systems.<\/p>\n
Companies leading this transformation include Nvidia, Amazon.com Inc., Microsoft Corp., Google LLC, Meta Platforms Inc., among others.\u00a0 Collectively, these firms are investing hundreds of billions of dollars in AI infrastructure. Some of our reported estimates suggest the next phase of this cycle could approach $1 trillion in capital investment.<\/p>\n
GTC will showcase the latest pieces of this architecture \u2014 but the most important story lies deeper in the supply chain.<\/p>\n
The GPU appreciation paradox<\/p>\n
One of the strangest economic dynamics in this cycle is what I call the GPU appreciation paradox. In traditional technology markets, hardware depreciates rapidly.<\/p>\n
But in the AI era, the opposite appears to be happening. Take the widely deployed Nvidia H100 GPU. Instead of losing economic value over time, the productivity of these chips is increasing as the models they serve become more powerful.<\/p>\n
As frontier models improve, the value generated by the compute serving those models rises. This is why some AI labs are locking in multiyear GPU contracts at roughly $2.40 per hour, well above estimated build costs.<\/p>\n
AI compute have become the most constrained resource in the digital economy. And that\u2019s turning GPUs into something closer to productive capital assets than traditional information technoogy hardware.<\/p>\n
The hidden constraint: memory<\/p>\n
GPUs may get the headlines at GTC, but the real bottleneck in the AI factory could be memory.<\/p>\n
Modern AI systems rely heavily on long-context reasoning, meaning models can process huge sequences of text, code and multimodal data.\u00a0That capability requires massive amounts of high-bandwidth memory or HBM.<\/p>\n
HBM is physically expensive:<\/p>\n
It consumes three to four times more wafer area than standard dynamic random-access memory or DRAM.
\nIt requires advanced packaging techniques.
\nIt competes directly with consumer electronics supply chains.<\/p>\n
Our data suggest that by 2026, as much as 30% of hyperscaler capital expenditures could go toward memory alone (drumroll: Wait for all the price increases for systems).<\/p>\n
This shift is already reshaping semiconductor allocation across the industry, with memory supply increasingly prioritized for AI infrastructure.<\/p>\n
The lithography ceiling<\/p>\n
To understand the ultimate limit of AI scaling, you have to go even further upstream.<\/p>\n
The real gatekeeper in the semiconductor ecosystem is ASML Holding NV, the Dutch manufacturer of extreme ultraviolet lithography machines. These tools are required to produce the most advanced chips.<\/p>\n
Each machine costs more than $350 million, contains hundreds of thousands of components, and relies on a supply chain of thousands of specialized suppliers.\u00a0 More importantly, production is limited. ASML can manufacture roughly 70 to 100 extreme ultraviolet tools per year through the end of the decade.<\/p>\n
That output effectively caps how quickly the world can expand advanced semiconductor production. You can innovate software at exponential speed. But you cannot easily scale the industrial manufacturing systems that produce the silicon.<\/p>\n
Power: The pay-to-play constraint<\/p>\n
Another key input to the AI factory is energy. Frontier AI clusters now require enormous amounts of electricity \u2014 often measured in gigawatts. Yet power isn\u2019t necessarily a hard scaling limit.<\/p>\n
It\u2019s a cost problem.\u00a0To bypass grid constraints and multi-year permitting timelines, hyperscalers and AI labs are increasingly deploying behind-the-meter power systems. These include natural gas turbines, modular microgrids, fuel cells and factory-built data center modules.<\/p>\n
Even if energy costs increase, the economics still favor early deployment because the marginal value of frontier AI models is so high.\u00a0In the AI race, speed often matters more than efficiency.<\/p>\n
The rise of the hyperconverged edge<\/p>\n
While the hyperscale AI factory is grabbing headlines, another important shift is happening further out in the infrastructure stack. The AI factory is expanding to the edge.<\/p>\n
Enterprises are increasingly deploying localized AI systems to support real-time decision-making in environments such as: factories, hospitals, retail stores, logistics centers and smart cities.\u00a0These environments require low latency, data sovereignty and continuous operation even when cloud connectivity is limited.<\/p>\n
This is where the hyperconverged edge enters the picture. Hyperconverged edge platforms collapse networking, compute, storage, security and AI inference into unified edge infrastructure.<\/p>\n
Instead of isolated devices, organizations deploy distributed mini AI factories capable of running localized inference and synchronizing with centralized AI clusters. In this architecture, hyperscale AI factories train models, while hyperconverged edge systems operate those models in the real world.<\/p>\n
This distributed model of intelligence production will likely be a major theme emerging from GTC discussions.<\/p>\n
AI sovereignty and the geopolitical dimension<\/p>\n
The AI infrastructure race is also becoming deeply geopolitical.<\/p>\n
Governments around the world increasingly see AI capability as a matter of national sovereignty. Control over AI infrastructure means control over economic competitiveness, industrial automation, defense systems and national innovation capacity\u00a0<\/p>\n
The United States currently leads in several key areas, including AI software ecosystems and access to advanced manufacturing through partners such as Taiwan Semiconductor Manufacturing Co. But other regions are moving quickly.<\/p>\n
China is pursuing full-stack vertical integration through companies such as Huawei, investing heavily in domestic chip design, memory production and sovereign AI infrastructure. Europe and Middle Eastern nations are also investing in sovereign compute capacity to ensure they are not dependent on foreign cloud providers.<\/p>\n
In many ways, AI factories are becoming the strategic infrastructure of the digital age, similar to energy grids or telecommunications networks.<\/p>\n
From software industry to industrial infrastructure<\/p>\n
Perhaps the biggest misconception about the AI boom is how it is categorized. Many investors still treat AI companies as traditional software firms.<\/p>\n
But the companies leading the AI Factory buildout increasingly resemble heavy industrial operators. They are deploying gigawatt-scale data centers, global semiconductor supply chains, massive capital investment programs and vertically integrated infrastructure stacks<\/p>\n
This is not just another software cycle.\u00a0It\u2019s the emergence of industrial-scale intelligence production.<\/p>\n
What to watch at GTC<\/p>\n
As we head into another Nvidia GTC, it\u2019s easy to get caught up in the product announcements like the next GPU, the next model, the next software framework.<\/p>\n
But the bigger story unfolding beneath the surface is about infrastructure power.<\/p>\n
The companies that win the next four to five years in AI won\u2019t simply be the ones with the best algorithms. They\u2019ll be the ones that secured the supply chain early:\u00a0The ones that are locked in the lithography capacity. The ones that booked the memory wafers. The ones that built the power plants. The ones that extended their AI factories all the way out to the edge.<\/p>\n
Because the future of AI is no longer just about training bigger models.\u00a0It\u2019s about building the global system that runs them.<\/p>\n
The AI factory is quickly becoming the industrial backbone of the digital economy \u2014 a distributed network of hyperscale clusters and hyperconverged edge infrastructure that together produce and operate intelligence.<\/p>\n
And if the last decade belonged to the cloud, the next decade will belong to the companies that build and control these factories.\u00a0That\u2019s the story I\u2019ll be watching closely this week at GTC.<\/p>\n
Because the race to build the AI factory is only just getting started.<\/p>\n
Image: theCUBE<\/p>\n
Support our mission to keep content open and free by engaging with theCUBE community. Join theCUBE\u2019s Alumni Trust Network, where technology leaders connect, share intelligence and create opportunities.<\/p>\n
15M+ viewers of theCUBE videos, powering conversations across AI, cloud, cybersecurity and more
\n11.4k+ theCUBE alumni \u2014 Connect with more than 11,400 tech and business leaders shaping the future through a unique trusted-based network.<\/p>\n
About SiliconANGLE Media<\/p>\n
SiliconANGLE Media is a recognized leader in digital media innovation, uniting breakthrough technology, strategic insights and real-time audience engagement. As the parent company of SiliconANGLE<\/a>, theCUBE Network<\/a>, theCUBE Research<\/a>, CUBE365<\/a>, theCUBE AI<\/a> and theCUBE SuperStudios \u2014 with flagship locations in Silicon Valley and the New York Stock Exchange \u2014 SiliconANGLE Media operates at the intersection of media, technology and AI.<\/p>\n Founded by tech visionaries John Furrier and Dave Vellante, SiliconANGLE Media has built a dynamic ecosystem of industry-leading digital media brands that reach 15+ million elite tech professionals. Our new proprietary theCUBE AI Video Cloud is breaking ground in audience interaction, leveraging theCUBEai.com neural network to help technology companies make data-driven decisions and stay at the forefront of industry conversations.<\/p>\n","protected":false},"excerpt":{"rendered":"Every year the artificial intelligence industry gathers at Nvidia Corp.\u2019s GPU Technology Conference expecting to see faster graphics…\n","protected":false},"author":2,"featured_media":524781,"comment_status":"","ping_status":"","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[45],"tags":[182,181,507,236412,236411,15091,74],"class_list":["post-524780","post","type-post","status-publish","format-standard","has-post-thumbnail","category-artificial-intelligence","tag-ai","tag-artificial-intelligence","tag-artificialintelligence","tag-gtc-preview-inside-the-ai-factory-the-1t-infrastructure-war-under-the-hood-of-the-ai-economy","tag-john-furrier","tag-siliconangle","tag-technology"],"_links":{"self":[{"href":"https:\/\/www.newsbeep.com\/us\/wp-json\/wp\/v2\/posts\/524780","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.newsbeep.com\/us\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.newsbeep.com\/us\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.newsbeep.com\/us\/wp-json\/wp\/v2\/users\/2"}],"replies":[{"embeddable":true,"href":"https:\/\/www.newsbeep.com\/us\/wp-json\/wp\/v2\/comments?post=524780"}],"version-history":[{"count":0,"href":"https:\/\/www.newsbeep.com\/us\/wp-json\/wp\/v2\/posts\/524780\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/www.newsbeep.com\/us\/wp-json\/wp\/v2\/media\/524781"}],"wp:attachment":[{"href":"https:\/\/www.newsbeep.com\/us\/wp-json\/wp\/v2\/media?parent=524780"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.newsbeep.com\/us\/wp-json\/wp\/v2\/categories?post=524780"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.newsbeep.com\/us\/wp-json\/wp\/v2\/tags?post=524780"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}