Global adoption of artificial intelligence has reshaped many landscapes over the past few years, including the competitive dynamics of the technology industry itself.<\/p>\n
There was a time when the best semiconductor or cloud services model could dictate much of the market. That era has given way to a new paradigm in which the integration of silicon, software, networking and the developer ecosystem matters most. As theCUBE Research team recently noted<\/a>, the basis of competition has shifted from individual components to complete platforms.<\/p>\n This shift will ultimately drive the economics of AI, with the AI factory occupying the center of enterprise infrastructure. What separates the winners from the losers will be their ability to deliver customer value from AI investments.<\/p>\n \u201cWe\u2019re branching and diverging in a pretty active way,\u201d said Ilya Tabakh<\/a> (pictured), vice president of innovation at TensorWave Inc. \u201cAs folks introduce these new concepts of deep thinking or agentic or things that change the GPU to CPU balance, a lot of it is what are you trying to do? We can talk about tokens, but ultimately people are interested in value creation. At the end of the day, [if] I put a watt or a dollar or whatever in, am I getting the thing that I expected out? This is a new chapter there.\u201d<\/p>\n Tabakh spoke with theCUBE Research\u2019s Dave Vellante<\/a> for the \u201cBeyond The GPU: The Full-Stack Fight for Enterprise AI\u201d<\/a> exclusive interview series with theCUBE, SiliconANGLE Media\u2019s livestreaming studio. Executives from Supermicro, AMD, Vast Data, TensorWave and Crusoe discussed the growing importance of storage, networking and open ecosystems, and what it takes to build the next generation of enterprise AI infrastructure. (* Disclosure below.)<\/p>\n Open-source artificial intelligence platform<\/p>\n Realizing value requires a framework that can integrate various tools and technologies for AI training and inference. To provide that support, TensorWave has introduced ScalarLM<\/a>, a fully open-source AI platform for training, fine-tuning and serving large language models. ScalarLM operates on a GPU-agnostic architecture, supporting both AMD and Nvidia processors without requiring code changes.<\/p>\n \u201cWe\u2019ve done quite a bit of work in helping folks think through how to reduce time to value,\u201d Tabakh told theCUBE. \u201c[ScalarLM] combines inference and training and the whole idea is to get around this conversation of, \u2018Hey, let\u2019s build a data center and connect it to the IT network.\u2019 It\u2019s more on focusing on, \u2018Can I tune and train an application, a model to my specific use case?\u2019 By minimizing that time to value, organizations are able to wrap their heads around what it is going to take and baseline their workload.\u201d<\/p>\n TensorWave\u2019s embrace of an open-source AI platform highlights how technology companies are working to provide customers with a broader range of options. The different architectures developing around AI require an open ecosystem, according to Linda Yang<\/a>, director of AI product management at Super Micro Computer Inc.<\/p>\n \u201cWhen I think about open ecosystem or open architecture, it\u2019s where you have the playground that allows different architectures, different software stacks that can run freely as well as most effectively on that playground,\u201d Yang said. \u201cLook at our partner customers \u2026 we work closely together to define what we mean by open ecosystem. We are working closely with each other, we help each other define what\u2019s best for our common customer together.\u201d<\/p>\n The ability to design open systems has also shaped Crusoe\u2019s approach as it seeks to build<\/a> sustainable AI infrastructure. Umair Piracha<\/a>, senior director of supply chain and strategic sourcing for Crusoe Cloud at Crusoe Inc., views flexibility and freedom of choice as key ingredients in the next wave of industry-specific AI value.<\/p>\n \u201cThe goal isn\u2019t to standardize on one piece of technology,\u201d Piracha said. \u201cThe goal is to standardize on outcomes while maintaining the freedom of choice. System design is open. The reason we are with AMD is because of the open architecture. And the systems with Supermicro, which really helps us, they are upgradeable. We can swap things out; we can swap compute out.\u201d<\/p>\n Building a neocloud ecosystem<\/p>\n The flexibility described by Piracha has been a key element in the rise of neoclouds<\/a>, specialized AI-first cloud providers focused on delivering the computing power needed for the next generation of applications and workloads. In addition to gaining access to GPUs, enterprises must also consider CPUs, accelerators, storage, cooling, networking and software portability.<\/p>\n A neocloud ecosystem featuring AMD, Supermicro, Crusoe and TensorWave is working to bring those pieces together within an integrated framework. For AMD, this involves designing architectures that support the needs of neoclouds and their users.<\/p>\n \u201cIf you take a look at the transition that we\u2019re making, our current architecture class, state-of-the-art is our MI355X GPUs, and we have eight of those that are tightly connected in a pod,\u201d said Ted Marena<\/a>, director of market development, GPU AI data center OEM\/ODMs at AMD. \u201cAs we move to our next generation, MI455X, we\u2019re scaling that up to where you have 72 GPUs now, tightly interconnected. So, the scale-up and scale-out network significantly increased to allow communication to happen more quickly and to deliver the answers and the responses in a more timely manner. It\u2019s more profitable for the neoclouds and for the customers.\u201d<\/p>\n The rise of neoclouds has also given enterprise customers an alternative to the services provided by legacy hyperscalers. This is a byproduct of denser infrastructure, in which interconnected GPUs represent a different model, according to TensorWave\u2019s Tabakh.<\/p>\n \u201cHyperscalers have a lot of applications, they have software, they have different types of loads, and they\u2019re very good generalists,\u201d Tabakh said. \u201cThe neocloud and a dense AI data center are a new type of ask. The basic physics of this is that you need more GPUs, more closely connected. Being a generalist doesn\u2019t serve you well because you have an existing fleet. You have a pretty wide mix of expertise, and many of those things are not applicable in this high density, more industrial type setting.\u201d<\/p>\n Eliminating storage bottlenecks<\/p>\n The introduction of new technologies can also create new bottlenecks. AI accelerators can deliver value only when they receive data at an effective speed, placing more pressure on networks and the system input-output path.<\/p>\n A combination<\/a> of AMD\u2019s EPYC processor, Supermicro\u2019s H14 server and Vast Data\u2019s AI Operating System is designed to provide a balanced and efficient framework for storage in the AI era.<\/p>\n \u201cStorage is this unique workload in the world of computer science because it has to balance directionally from pulling data, reading data off of a collection of solid state drives but also pushing it out over the wire,\u201d said John Mao<\/a>, VP of global business development at Vast Data Inc. \u201cYou see this constant back and forth. You squeeze the balloon on the SSD side, then it\u2019s the network that becomes swollen and bottlenecked. You do the other side with the network, and then the SSDs become the bottleneck. It\u2019s a constant balancing act that we see, which makes this all fun.\u201d<\/p>\n To avoid bursting that balloon, the three companies have focused on enabling CPUs to orchestrate the flow of data to GPUs. This work has involved new generations<\/a> of AMD CPUs that leverage PCIe architecture to improve bandwidth, according to Penny Tseng<\/a>, who helps lead product marketing development at AMD.<\/p>\n \u201cAround the November timeframe, AMD is launching in the market the first PCIe Gen 6 CPU from x86,\u201d Tseng told theCUBE. \u201cThat can help the GPU access the right data. The CPU gives extra memory bandwidth that moves data faster compared with generation to generation. The AMD CPU can keep on increasing performance, giving double bandwidth to catch up with what the GPU needed.\u201d<\/p>\n AMD\u2019s work in the CPU market has become more urgent with the rise of agentic AI<\/a>. As enterprises increasingly deploy agents to perform autonomous tasks, they need the right data infrastructure to support those workloads.<\/p>\n \u201cWith more agentic AI happening now, it\u2019s proved that SSD is much needed for this data ingestion, data tier platforms,\u201d explained Ben Lee<\/a>, director of solution management at Supermicro. \u201cBut then because you have fast SSD, that\u2019s why you definitely need a high-speed CPU. The CPU can really not just be the bridge for all of these PCIe lanes for the SSD, but also for the NIC card, and also provide sufficient computational powers to deal with this workload. We try to work very closely with AMD and also Vast to tackle this problem.\u201d<\/p>\n New processor for agentic AI<\/p>\n As trusted enterprise systems of record converge with AI-driven applications and agents, it becomes even more critical for the various elements of AI infrastructure to work together.<\/p>\n In May, AMD announced<\/a> that its next-generation EPYC processor, codenamed \u201cVenice,\u201d was ramping up production in Taiwan. AMD is working to integrate Venice into the Supermicro server family while providing broader rack-scale infrastructure and improvements in performance and efficiency.<\/p>\n \u201cVenice itself, the way I would describe it is it\u2019s the highest performance solution that is going to be on the market on the x86 side,\u201d said Derek Dicker<\/a>, corporate VP of the Enterprise Business Group at AMD. \u201cGeneration over generation, we\u2019ll see a 70% performance increase in the product itself. We\u2019re featuring PCIe Gen 6 time-to-market with an ecosystem that we\u2019re building wrapped around it, again in partnership with Supermicro.\u201d<\/p>\n For Supermicro, the launch of Venice<\/a> provides several ways to enhance its server product line with the new EPYC processor. These include integration with Supermicro\u2019s slim rackmount computer chassis<\/a>, known in the industry as a \u201cpizza box,\u201d as well as denser computing systems, according to Vik Malyala<\/a>, chief business officer of Supermicro.<\/p>\n \u201cWhen we started looking at Venice, one of the things that we started looking at was what are the environments that it is going to be deployed in besides the traditional way,\u201d Malyala told theCUBE. \u201cFor example, we have our standard 1U, 2U pizza boxes with a single or dual socket. Then we extended that into a dense compute, like FlexTwin, which is liquid cooled platforms. Then we have integrated switch into that for those who wanted to have a dense compute, but in a, let\u2019s say, smaller form factor like a SuperBlade. And the product lines extends, one after the other.\u201d<\/p>\n Here\u2019s the\u00a0\u201cBeyond The GPU: The Full-Stack Fight for Enterprise AI\u201d<\/a> exclusive video series playlist:<\/p>\n (* Disclosure: TheCUBE is a paid media partner for the \u201cBeyond the GPU: The Full-Stack Fight for Enterprise AI\u201d video series. Neither Supermicro, the sponsor of theCUBE\u2019s event coverage, nor other sponsors have editorial control over content on theCUBE or SiliconANGLE.)<\/p>\n Photo: SiliconANGLE<\/p>\n Support our mission to keep content open and free by engaging with theCUBE community. Join theCUBE\u2019s Alumni Trust Network, where technology leaders connect, share intelligence and create opportunities.<\/p>\n 15M+ viewers of theCUBE videos, powering conversations across AI, cloud, cybersecurity and more About SiliconANGLE Media<\/p>\n SiliconANGLE Media is a recognized leader in digital media innovation, uniting breakthrough technology, strategic insights and real-time audience engagement. As the parent company of SiliconANGLE<\/a>, theCUBE Network<\/a>, theCUBE Research<\/a>, CUBE365<\/a>, theCUBE AI<\/a> and theCUBE SuperStudios \u2014 with flagship locations in Silicon Valley and the New York Stock Exchange \u2014 SiliconANGLE Media operates at the intersection of media, technology and AI.<\/p>\n Founded by tech visionaries John Furrier and Dave Vellante, SiliconANGLE Media has built a dynamic ecosystem of industry-leading digital media brands that reach 15+ million elite tech professionals. Our new proprietary theCUBE AI Video Cloud is breaking ground in audience interaction, leveraging theCUBEai.com neural network to help technology companies make data-driven decisions and stay at the forefront of industry conversations.<\/p>\n","protected":false},"excerpt":{"rendered":"Global adoption of artificial intelligence has reshaped many landscapes over the past few years, including the competitive dynamics…\n","protected":false},"author":2,"featured_media":564959,"comment_status":"","ping_status":"","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[6],"tags":[61,60,80],"class_list":["post-564958","post","type-post","status-publish","format-standard","has-post-thumbnail","category-technology","tag-ie","tag-ireland","tag-technology"],"_links":{"self":[{"href":"https:\/\/www.newsbeep.com\/ie\/wp-json\/wp\/v2\/posts\/564958","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.newsbeep.com\/ie\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.newsbeep.com\/ie\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.newsbeep.com\/ie\/wp-json\/wp\/v2\/users\/2"}],"replies":[{"embeddable":true,"href":"https:\/\/www.newsbeep.com\/ie\/wp-json\/wp\/v2\/comments?post=564958"}],"version-history":[{"count":0,"href":"https:\/\/www.newsbeep.com\/ie\/wp-json\/wp\/v2\/posts\/564958\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/www.newsbeep.com\/ie\/wp-json\/wp\/v2\/media\/564959"}],"wp:attachment":[{"href":"https:\/\/www.newsbeep.com\/ie\/wp-json\/wp\/v2\/media?parent=564958"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.newsbeep.com\/ie\/wp-json\/wp\/v2\/categories?post=564958"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.newsbeep.com\/ie\/wp-json\/wp\/v2\/tags?post=564958"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}
\n11.4k+ theCUBE alumni \u2014 Connect with more than 11,400 tech and business leaders shaping the future through a unique trusted-based network.<\/p>\n