{"id":185076,"date":"2025-12-15T16:43:09","date_gmt":"2025-12-15T16:43:09","guid":{"rendered":"https:\/\/www.newsbeep.com\/nz\/185076\/"},"modified":"2025-12-15T16:43:09","modified_gmt":"2025-12-15T16:43:09","slug":"inside-nvidia-nemotron-3-techniques-tools-and-data-that-make-it-efficient-and-accurate","status":"publish","type":"post","link":"https:\/\/www.newsbeep.com\/nz\/185076\/","title":{"rendered":"Inside NVIDIA Nemotron 3: Techniques, Tools, and Data That Make It Efficient and Accurate"},"content":{"rendered":"

Agentic AI<\/a> systems increasingly rely on collections of cooperating agents\u2014retrievers, planners, tool executors, verifiers\u2014working together across large contexts and long time spans. These systems demand models that deliver fast throughput, strong reasoning<\/a> accuracy, and persistent coherence over large inputs. They also require a level of openness that allows developers to customize, extend, and deploy models wherever they operate.<\/p>\n

The NVIDIA Nemotron 3 family of open models (Nano, Super, Ultra), datasets, and techniques were designed to build specialized agentic AI for this new era.<\/p>\n

It introduces a hybrid Mamba-Transformer mixture-of-experts (MoE<\/a>) architecture, reinforcement learning (RL<\/a>) across interactive environments, and a native 1M-token context window that enables high-throughput, long-horizon reasoning for multi-agent<\/a> applications.<\/p>\n

What\u2019s new in Nemotron 3<\/a><\/p>\n

Nemotron 3 introduces several innovations that directly address the needs of agentic systems:<\/p>\n

A hybrid Mamba-Transformer MoE backbone for superior test-time efficiency and long-range reasoning.<\/p>\n

Multi-environment reinforcement learning designed around real-world agentic tasks.<\/p>\n

A 1M-token context length supporting deep multi-document reasoning and long-running agent memory.<\/p>\n

An open, transparent training pipeline, including data, weights, and recipes.<\/p>\n

Immediate availability of Nemotron 3 Nano with ready-to-use cookbooks. Super and Ultra to follow.<\/p>\n

Simple prompt example<\/a><\/p>\n

Video 1. A video of a table seating logical puzzle running on Nemotron 3 Nano.<\/p>\n

Key technologies for Nemotron 3 models<\/a><\/p>\n

Hybrid Mamba-Transformer MoE<\/a><\/p>\n

Nemotron 3 integrates three architectures into a single backbone:\u00a0<\/p>\n

Mamba layers for efficient sequence modeling,\u00a0<\/p>\n

Transformer layers for precision reasoning, and\u00a0<\/p>\n

MoE routing for scalable compute efficiency.\u00a0<\/p>\n

Mamba excels at tracking long-range dependencies with minimal memory overhead, enabling sustained performance even when processing hundreds of thousands of tokens<\/a>. Transformer layers complement this with detailed attention mechanisms that capture structural and logical relationships required for tasks such as code manipulation, math reasoning, or complex planning.<\/p>\n

The MoE component amplifies effective parameter count without incurring the cost of dense computation. Only a subset of experts is activated for each token, reducing latency and improving throughput. This architecture is particularly well-suited to agent clusters where many lightweight agents must operate concurrently\u2014each generating plans, inspecting context, or executing tool-based workflows.<\/p>\n

\"LayerFigure 1. Nemotron 3 hybrid architecture. The model interleaves Mamba-2 and MoE layers with only a few self-attention layers, maximizing inference throughput while maintaining state-of-the-art accuracy.<\/p>\n

Multi-environment reinforcement learning (RL) training<\/a><\/p>\n

To align Nemotron 3 with real agentic behavior, the model is post-trained using reinforcement learning across many environments in NeMo Gym<\/a>, an open-source library for building and scaling RL environments. These environments evaluate the model\u2019s ability to perform sequences of actions\u2013\u2013going beyond just single-turn responses\u2013\u2013such as generating correct tool calls, writing functional code, or producing multi-part plans that satisfy verifiable criteria.<\/p>\n

This trajectory-based reinforcement produces a model that behaves reliably under multi-step workflows, reduces reasoning drift, and handles the kinds of structured operations common in agentic pipelines. Because NeMo Gym is open, developers can reuse, extend, or even create their own environments when customizing models for domain-specific tasks<\/a>.<\/p>\n

These environments and RL datasets<\/a> are being made available, alongside NeMo Gym, for those interested in using the environments to train their own models.<\/p>\n

\"TheFigure 2. Nemotron 3 Nano delivers the highest throughput efficiency using the hybrid MoE architecture and leading accuracy with advanced Reinforcement Learning using NeMo Gym<\/p>\n

1M token context length<\/a><\/p>\n

Nemotron 3\u2019s 1M-token context enables sustained reasoning across large codebases, long documents, extended conversations, and aggregated retrieved content. Instead of relying on fragmented chunking heuristics, agents can keep entire evidence sets, history buffers, and multi-stage plans in a single context window.<\/p>\n

This long context window is enabled by Nemotron 3\u2019s hybrid Mamba-Transformer architecture, which processes extremely large sequences efficiently. MoE routing also keeps the per-token compute lower, making these large sequences practical at time of inference.<\/p>\n

For enterprise-scale retrieval-augmented generation<\/a>, compliance analysis, multi-hour agent sessions, or monolithic repository understanding, the 1M-token window significantly improves factual grounding and reduces context fragmentation.<\/p>\n

Key technologies coming in Nemotron 3 Super and Ultra<\/a><\/p>\n

Latent MoE<\/a><\/p>\n

Nemotron 3 Super and Ultra introduce latent MoE, where experts operate on a shared latent representation before outputs are projected back to token space. This approach allows the model to call on 4x more experts at the same inference cost, enabling better specialization around subtle semantic structures, domain abstractions, or multi-hop reasoning patterns.<\/p>\n

\"Side-by-sideFigure 3. Standard MoE vs. latent MoE architectures. In latent MoE, tokens are projected into a smaller latent dimension for expert routing and computation, reducing communication costs while enabling more experts and higher accuracy per byte.<\/p>\n

Multi-token prediction (MTP)<\/a><\/p>\n

MTP enables the model to predict several future tokens in a single forward pass, significantly increasing throughput for long reasoning sequences and structured outputs. For planning, trajectory generation, extended chain-of-thought<\/a>, or code generation, MTP reduces latency and improves agent responsiveness.<\/p>\n

NVFP4 training<\/a><\/p>\n

Super and Ultra are pretrained in\u00a0 NVFP4, NVIDIA\u2019s 4-bit floating-point format that offers best-in-class cost-accuracy for training and inference. An updated NVFP4 recipe was designed for Nemotron 3 to ensure accurate and stable pretraining on our 25T token pretraining dataset. The majority of floating-point multiply-accumulate operations during pretraining are in NVFP4.\u00a0<\/p>\n

Ongoing commitment to open models<\/a><\/p>\n

Nemotron 3 reinforces NVIDIA\u2019s commitment to transparency and developer empowerment. The model weights are openly released under the NVIDIA Open Model License. NVIDIA\u2019s synthetic pretraining corpus\u2013\u2013nearly 10 trillion tokens\u2013\u2013can be inspected or repurposed. Developers also have access to detailed training and post-training recipes within the Nemotron GitHub<\/a> repository, enabling complete reproducibility and customization.<\/p>\n

Nemotron 3 Nano is available now, forming the foundation for high-throughput, long-context agentic systems. Super and Ultra, coming in the first half of 2026, will extend this foundation with higher reasoning depth and efficiency-minded architectural enhancements.<\/p>\n

Nemotron 3 Nano: available now<\/a><\/p>\n

Available today is our first model in the series: Nemotron 3 Nano. This 30B total 3B active parameter model is specifically designed for DGX Spark, H100, and B200 GPUs, allowing you to build with the most efficient model in our Nemotron 3 family.<\/p>\n

If you want to learn more about the technical details of Nemotron 3 Nano, you can find a detailed Hugging Face blog<\/a>, or you can read the technical report available here<\/a>.<\/p>\n

This model delivers highest throughput efficiency, achieves leading score on Artificial Analysis Intelligence Index<\/a>, and preserves the Artificial Analysis Openness Index score that NVIDIA Nemotron Nano V2 achieved. That showcases its effectiveness for multi-agent tasks while remaining transparent and customizable.<\/p>\n

\"BarFigure 5. On the Artificial Analysis Intelligence Index v3.0, Nemotron 3 Nano achieves leading accuracy (52) among similarly-sized models.<\/p>\n

Developers can start using Nemotron 3 Nano today across multiple deployment and development workflows:<\/p>\n

Launch the model with NVIDIA cookbooks<\/a><\/p>\n

We\u2019re providing ready-to-use cookbooks for several major inference engines:<\/p>\n

vLLM Cookbook<\/a> \u2013 Deploy Nemotron 3 Nano with high-throughput continuous batching and streaming.<\/p>\n

SGLang Cookbook<\/a>\u2013 Run fast, lightweight inference optimized for multi-agent tool-calling workloads.<\/p>\n

TRT-LLM Cookbook<\/a>\u2013 Deploy fully optimized TensorRT-LLM engines for low-latency, production-grade environments.<\/p>\n

Each cookbook includes configuration templates, performance tips, and reference scripts so you can get Nemotron 3 Nano running within minutes.<\/p>\n

In addition, get started today with Nemotron on any NVIDIA GPU \u2013 from GeForce RTX desktops and laptops to RTX Pro workstations, to DGX Spark \u2013 using top frameworks and tools such as Llama.cpp<\/a>, LM Studio<\/a> and Unsloth<\/a>.<\/p>\n

Build with Nemotron open training datasets<\/a><\/p>\n

NVIDIA is also releasing the open datasets used throughout the model\u2019s development, providing unprecedented transparency into how high-performance, trustworthy models are built.<\/p>\n

New dataset highlights include:<\/p>\n

Nemotron-pretraining<\/a> \u2013 A new 3-trillion-token dataset with richer coverage of code, math, and reasoning, enhanced through synthetic augmentation and annotation pipelines.<\/p>\n

Nemotron-post-training 3.0<\/a> \u2013 An 13-million-sample corpus for supervised fine-tuning and reinforcement learning that powers Nemotron 3 Nano\u2019s alignment and reasoning.<\/p>\n

Nemotron-RL datasets<\/a> \u2013 A curated collection of RL datasets and environments for tool-use, planning, and multi-step reasoning.<\/p>\n

Nemotron agentic safety dataset<\/a> \u2013 A collection of nearly 11-thousand AI agent workflow traces designed to help researchers evaluate and mitigate emerging safety and security risks in agentic systems.<\/p>\n

Paired with NVIDIA NeMo Gym<\/a>, RL<\/a>, Data Designer<\/a>, and Evaluator<\/a> open libraries, these open datasets enable developers to train, enhance, and evaluate their own Nemotron models.<\/p>\n

Explore the Nemotron GitHub: pre-training & RL recipes<\/a><\/p>\n

NVIDIA maintains an open Nemotron GitHub<\/a> repository that includes:<\/p>\n

Pre-training recipes (already available) showing how Nemotron 3 Nano was trained<\/p>\n

RL alignment recipes for multi-environment optimization<\/p>\n

Data-processing pipelines, tokenizer configuration, and long-context setup<\/p>\n

Future updates will include additional post-training and fine-tuning recipes<\/p>\n

If you want to train your own Nemotron, extend Nano, or produce a domain-specialized variant, the GitHub repository provides the documentation, configurations, and tooling to reproduce key steps end-to-end.<\/p>\n

This openness completes the story: You can run the model, deploy the model, inspect how the model was built, and even train your own\u2014all using NVIDIA open resources.<\/p>\n

Nemotron 3 Nano is available now. Start building long-context, high-throughput agentic systems today using NVIDIA open models, open tools, open data, and open training infrastructure<\/a>.<\/p>\n

Join the Nemotron Model Reasoning Challenge<\/a><\/p>\n

Accelerating open research is a core priority for the Nemotron team. With that in mind, we\u2019re excited to announce a new community competition focused on improving Nemotron\u2019s reasoning performance using Nemotron\u2019s open models and datasets.<\/p>\n

Register here<\/a> to be the first to know when details are released.<\/p>\n

And stay up-to-date on NVIDIA Nemotron<\/a> by subscribing to NVIDIA news<\/a> and following NVIDIA AI on LinkedIn<\/a>, X<\/a>, Discord<\/a>, and YouTube<\/a>.<\/p>\n","protected":false},"excerpt":{"rendered":"Agentic AI systems increasingly rely on collections of cooperating agents\u2014retrievers, planners, tool executors, verifiers\u2014working together across large contexts…\n","protected":false},"author":2,"featured_media":185077,"comment_status":"","ping_status":"","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[20],"tags":[365,363,364,111,139,69,145],"class_list":["post-185076","post","type-post","status-publish","format-standard","has-post-thumbnail","category-artificial-intelligence","tag-ai","tag-artificial-intelligence","tag-artificialintelligence","tag-new-zealand","tag-newzealand","tag-nz","tag-technology"],"_links":{"self":[{"href":"https:\/\/www.newsbeep.com\/nz\/wp-json\/wp\/v2\/posts\/185076","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.newsbeep.com\/nz\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.newsbeep.com\/nz\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.newsbeep.com\/nz\/wp-json\/wp\/v2\/users\/2"}],"replies":[{"embeddable":true,"href":"https:\/\/www.newsbeep.com\/nz\/wp-json\/wp\/v2\/comments?post=185076"}],"version-history":[{"count":0,"href":"https:\/\/www.newsbeep.com\/nz\/wp-json\/wp\/v2\/posts\/185076\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/www.newsbeep.com\/nz\/wp-json\/wp\/v2\/media\/185077"}],"wp:attachment":[{"href":"https:\/\/www.newsbeep.com\/nz\/wp-json\/wp\/v2\/media?parent=185076"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.newsbeep.com\/nz\/wp-json\/wp\/v2\/categories?post=185076"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.newsbeep.com\/nz\/wp-json\/wp\/v2\/tags?post=185076"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}