News Summary:<\/p>\n
\n\tNVIDIA BlueField-4 powers NVIDIA Inference Context Memory Storage Platform, a new kind of AI-native storage infrastructure designed for gigascale inference, to accelerate and scale agentic AI.
\n\tThe new storage processor platform is built for long-context-processing agentic AI systems with lightning-fast long- and short-term memory.
\n\tInference Context Memory Storage Platform extends AI agents\u2019 long-term memory and enables high-bandwidth sharing of context across clusters of rack-scale AI systems \u2014 boosting tokens per seconds and power efficiency by up to 5x.
\n\tEnabled by NVIDIA Spectrum-X Ethernet, extended context memory for multi-turn AI agents improves responsiveness, increases throughput per GPU and supports efficient scaling of agentic inference.
\n\t\u00a0
<\/p>\n
CES\u2014NVIDIA today announced that the NVIDIA BlueField\u00ae-4 data processor, part of the full-stack NVIDIA BlueField<\/a> platform, powers NVIDIA Inference Context Memory Storage Platform, a new class of AI-native storage infrastructure for the next frontier of AI.<\/p>\n As AI models scale to trillions of parameters and multistep reasoning, they generate vast amounts of context data \u2014 represented by a key-value (KV) cache, critical for accuracy, user experience and continuity.<\/p>\n A KV cache cannot be stored on GPUs long term, as this would create a bottleneck for real-time inference in multi-agent systems. AI-native applications require a new kind of scalable infrastructure to store and share this data.<\/p>\n NVIDIA Inference Context Memory Storage Platform provides the infrastructure for context memory by extending GPU memory capacity, enabling high-speed sharing across nodes, boosting tokens per seconds by up to 5x and delivering up to 5x greater power efficiency compared with traditional storage.<\/p>\n \u201cAI is revolutionizing the entire computing stack \u2014 and now, storage,\u201d said Jensen Huang, founder and CEO of NVIDIA. \u201cAI is no longer about one-shot chatbots but intelligent collaborators that understand the physical world, reason over long horizons, stay grounded in facts, use tools to do real work, and retain both short- and long-term memory. With BlueField-4, NVIDIA and our software and hardware partners are reinventing the storage stack for the next frontier of AI.\u201d<\/p>\n NVIDIA Inference Context Memory Storage Platform boosts KV cache capacity and accelerates the sharing of context across clusters of rack-scale AI systems, while persistent context for multi-turn AI agents improves responsiveness, increases AI factory throughput and supports efficient scaling of long-context, multi-agent inference.<\/p>\n Key capabilities of the NVIDIA BlueField-4-powered platform include:<\/p>\n
Storage innovators including AIC, Cloudian, DDN<\/a>, Dell Technologies, HPE, Hitachi Vantara, IBM, Nutanix<\/a>, Pure Storage, Supermicro, VAST Data and WEKA<\/a> are among the first building next-generation AI storage platforms with BlueField-4, which will be available in the second half of 2026.<\/p>\n
\n\tNVIDIA Rubin<\/a> cluster-level KV cache capacity, delivering the scale and efficiency required for long-context, multi-turn agentic inference.
\n\tUp to 5x greater power efficiency than traditional storage.
\n\tSmart, accelerated sharing of KV cache across AI nodes, enabled by the NVIDIA DOCA\u2122 framework and tightly integrated with the NVIDIA NIXL library and NVIDIA Dynamo software to maximize tokens per second, reduce time to first token and improve multi-turn responsiveness.
\n\tHardware-accelerated KV cache placement managed by NVIDIA BlueField-4 eliminates metadata overhead, reduces data movement and ensures secure, isolated access from the GPU nodes.
\n\tEfficient data sharing and retrieval enabled by NVIDIA Spectrum-X\u2122 Ethernet<\/a> serves as the high-performance network fabric for RDMA-based access to AI-native KV cache.
<\/p>\n