Groq 3 LPX Extends the Vera Rubin Platform, Delivering Ultrafast Token Generation for the Next Generation of Agentic AI, With Nebius the First to Adopt<\/p>\n
News Summary:<\/p>\n
\n\tIn Artificial Analysis benchmarking, Groq 3 LPX showcased world-class speed for agentic coding and other latency-sensitive workloads.
\n\tNVIDIA Groq 3 LPX extends the inference performance of NVIDIA Vera Rubin NVL72 systems by dramatically increasing token generation rates.
\n\tNebius is the first AI cloud to adopt NVIDIA Groq 3 LPX.
<\/p>\n
Hot Chips\u2014NVIDIA today announced that NVIDIA Groq 3 LPX<\/a>, the interactive AI inference accelerator, is now in full production. An extension of the NVIDIA Vera Rubin platform, Groq 3 LPX delivers a major boost in AI inference by enabling ultrafast token generation for highly responsive agentic systems.<\/p>\n Agentic systems can generate massive volumes of tokens across hundreds or thousands of inference steps, making faster token generation critical for agents to reason, act and complete complex tasks in real time.<\/p>\n Vera Rubin NVL72 systems provide the most versatile training and inference platform for every AI factory. NVIDIA Groq 3 LPX extends the inference performance of Vera Rubin NVL72 by dramatically increasing the rate of token generation, providing premium user experiences for context-heavy workloads so agents can act at extreme speeds.<\/p>\n NVIDIA Groq 3 LPX is pushing the frontier of AI inference. It delivered a record 3,400 output tokens per second in Artificial Analysis benchmarking running Gemma 4 31B, an open source agentic model, with a 100,000-token context critical for agentic systems \u2014 the fastest performance ever recorded for the model.<\/p>\n Groq 3 LPX enables agentic tasks such as coding in minutes versus hours, providing 4x faster responsiveness for agents and latency-sensitive workloads than the nearest alternative platform.<\/p>\n \u201cInference is the growth engine of AI. NVIDIA Grace Blackwell and NVL72 revolutionized large language model inference with an unprecedented leap in performance and efficiency,\u201d said Jensen Huang, founder and CEO of NVIDIA. \u201cVera Rubin extends that vision with workload-optimized AI factory configurations designed for the era of agentic AI, advancing the performance frontier with LPX for ultrafast token generation. This transforms how intelligence is produced, delivering another giant leap in AI throughput, efficiency and responsiveness, just as demand for AI computation is accelerating worldwide.\u201d<\/p>\n Groq 3 LPX \u2014 The Interactive AI Inference Accelerator NVIDIA Groq 3 LPX is purpose-built to extend Vera Rubin\u2019s interactivity \u2014 the rate at which tokens are generated for an individual user, determining how quickly an agent can complete each step of its work.<\/p>\n Faster generation gives agents more time to inspect files, write and test code, call tools, verify results and iterate while maintaining a responsive user experience.<\/p>\n AI Cloud Momentum for Groq 3 LPX Nebius<\/a>, a leading AI cloud, plans to bring NVIDIA Groq 3 LPX to Nebius Token Factory<\/a>, its production inference platform, giving developers access to extreme token generation speed for highly responsive agentic AI applications.<\/p>\n \u201cGeneration is the phase of inference that determines how responsive an AI system actually is, and that\u2019s exactly what NVIDIA Groq 3 LPX is built to accelerate,\u201d said Danila Shtan, chief technology officer of Nebius. \u201cAs the first AI cloud bringing it to production via Nebius Token Factory, we\u2019re making sure every step of an agent\u2019s loop feels instant \u2014 through the same API developers are already using, with no migration to a new stack.\u201d<\/p>\n
\nAgentic AI creates two distinct computing challenges: efficiently processing enormous amounts of context and generating tokens with extremely low latency.<\/p>\n
\nAI clouds are becoming the engines of the AI economy, giving enterprises and developers access to advanced infrastructure for training, reasoning and inference at scale. For providers serving latency-sensitive, high-volume inference workloads, NVIDIA Groq 3 LPX provides a path to deploy differentiated compute in proven rack-scale systems.<\/p>\n