{"id":144570,"date":"2025-09-15T09:01:09","date_gmt":"2025-09-15T09:01:09","guid":{"rendered":"https:\/\/www.newsbeep.com\/au\/144570\/"},"modified":"2025-09-15T09:01:09","modified_gmt":"2025-09-15T09:01:09","slug":"what-is-rack-scale-computing","status":"publish","type":"post","link":"https:\/\/www.newsbeep.com\/au\/144570\/","title":{"rendered":"What Is Rack-Scale Computing?"},"content":{"rendered":"

For decades, servers have been the fundamental building block of data centers. Deploying a workload requires enough servers to support that workload. Infrastructure monitoring, power management<\/a>, and so on also largely occur at the server level.<\/p>\n

In the AI era, server-scale approaches to data centers are becoming increasingly inadequate. A better strategy, arguably, is rack-scale computing \u2013 an idea that is not all that new, but that has perhaps finally come into its moment.<\/p>\n

What Is Rack-Scale Computing?<\/p>\n

Rack-scale computing is the practice of provisioning hardware inside data centers using server racks rather than individual servers as the main unit of IT infrastructure.<\/p>\n

In other words, when you embrace rack-scale computing, your main goal is to ensure you have enough racks \u2013 and the optimum combination of compute, memory, storage, and networking hardware within each rack \u2013 to support a given workload.<\/p>\n

This is different from traditional infrastructure strategies, which center around individual servers. Most data center administrators are accustomed to thinking in terms of how many servers are assigned to workloads, not how many racks are provisioned for them, which is why it\u2019s common to size Kubernetes environments<\/a> based on how many nodes they include, for example, or use total servers as a proxy for total data center capacity.<\/p>\n

Related:Rack-Scale Revolution: AI Drives New Era of Data Center Architecture<\/a><\/p>\n

Under a rack-scale approach, a data center\u2019s total number of servers ceases to be the focus. Instead, the key factor for driving infrastructure success becomes the total number of racks and the configuration of each rack.<\/p>\n

\"Data<\/p>\n

Rack-scale computing finds its moment in the AI era, where 1 MW racks deliver the integrated performance traditional server-centric approaches cannot match.<\/p>\n

The Benefits of Going Rack-Scale<\/p>\n

At first glance, rack-scale computing might seem like an unconventional approach to data center infrastructure management. After all, the total number of servers that can fit inside a single rack can vary widely depending on rack size<\/a>. If the computing capacity of a rack is so variable, why would you treat racks as the fundamental building block of data centers?<\/p>\n

Part of the answer is that servers, too, are not actually a very consistent way of measuring infrastructure capacity because the computing power of servers can vary widely.<\/p>\n

The more compelling reason for embracing rack-scale computing is that it enables a more flexible approach to data center infrastructure management. Specifically, rack-centric infrastructure allows businesses to:<\/p>\n

Meet the needs of large-scale workloads. Modern workloads often require multiple servers \u2013 and hence benefit from having an entire rack assigned to them.<\/p>\n

Build more resilient infrastructures. Individual servers are prone to failure, but it\u2019s rare for an entire rack to go down. Therefore, when you use racks as your building block, your workloads are inherently more reliable.<\/p>\n

Optimize infrastructure configurations. Focusing on rack design and components makes it easier to outfit each rack with hardware optimized for a given workload. For example, if a workload generates an especially high amount of network traffic, it can be supported with a rack that includes a high-end switch \u2013 or even multiple switches.<\/p>\n

Related:SmartNICs: The Unsung Heroes of Modern Data Center Scalability<\/a><\/p>\n

A Solution Whose Time Has Finally Come<\/p>\n

Interestingly, the concept of rack-scale computing has been around for more than a decade. Microsoft was promoting<\/a> it in 2013, and vendors like Intel were seizing upon it<\/a> years ago as part of composable infrastructure strategies.<\/p>\n

At the time, rack-scale computing never really caught on fully. The data center industry did not shift to a model wherein racks became the fundamental building blocks of infrastructure.<\/p>\n

But the need to support modern AI has catalyzed renewed interest in rack-scale infrastructure strategies. For example, speaking at Data Center World 2025, analyst Jeremie Eliahou Ontiveros pointed to rack-scale architectures<\/a> as part of the solution to provisioning AI workloads with sufficient infrastructure.<\/p>\n

Related:What Are TPUs? A Guide to Tensor Processing Units<\/a><\/p>\n

This approach is particularly well-suited to AI workloads. Not only do AI workloads require massive amounts of compute, memory, and (in many cases) storage resources, they also work a lot better when the infrastructure they run on is optimized at the hardware level. Rack-scale computing can help to meet both goals.<\/p>\n

For example, 1 MW racks \u2013 which can accommodate much higher server capacities than traditional racks \u2013 can help ensure that AI workloads have the resources they need to operate. At the same time, rack architectures that optimize the movement of data between individual servers within a rack, while also helping to balance heat dissipation, help to avoid processing bottlenecks and optimize workload performance.<\/p>\n

Individual server provisioning cannot achieve comparable optimization since it would be more challenging to integrate those servers optimally.<\/p>\n

The Future of Rack-Scale Computing<\/p>\n

To be sure, rack-scale computing has drawbacks. Chief among these is that when racks become the primary units, they may limit scalability because it will be challenging to provision more servers than a single rack can handle. However, this concern diminishes if data centers shift toward higher-capacity racks \u2013 such as, again, those capable of accommodating up to 1 MW worth of hardware.<\/p>\n

Thus, as racks modernize, expect data center architectures to modernize with them as businesses pivot toward rack-scale approaches. Individual servers will remain important because not every workload requires its own dedicated rack. But the most critical \u2013 and expensive \u2013 workloads are likely to operate at rack scale.<\/p>\n","protected":false},"excerpt":{"rendered":"For decades, servers have been the fundamental building block of data centers. Deploying a workload requires enough servers…\n","protected":false},"author":2,"featured_media":144571,"comment_status":"","ping_status":"","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[21],"tags":[64,63,257,105],"class_list":{"0":"post-144570","1":"post","2":"type-post","3":"status-publish","4":"format-standard","5":"has-post-thumbnail","7":"category-computing","8":"tag-au","9":"tag-australia","10":"tag-computing","11":"tag-technology"},"_links":{"self":[{"href":"https:\/\/www.newsbeep.com\/au\/wp-json\/wp\/v2\/posts\/144570","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.newsbeep.com\/au\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.newsbeep.com\/au\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.newsbeep.com\/au\/wp-json\/wp\/v2\/users\/2"}],"replies":[{"embeddable":true,"href":"https:\/\/www.newsbeep.com\/au\/wp-json\/wp\/v2\/comments?post=144570"}],"version-history":[{"count":0,"href":"https:\/\/www.newsbeep.com\/au\/wp-json\/wp\/v2\/posts\/144570\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/www.newsbeep.com\/au\/wp-json\/wp\/v2\/media\/144571"}],"wp:attachment":[{"href":"https:\/\/www.newsbeep.com\/au\/wp-json\/wp\/v2\/media?parent=144570"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.newsbeep.com\/au\/wp-json\/wp\/v2\/categories?post=144570"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.newsbeep.com\/au\/wp-json\/wp\/v2\/tags?post=144570"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}