nvidia/NVIDIA-Nemotron-Labs-3-Puzzle-75B-A9B-BF16 · Hugging Face
This covers a coding tool or code-capability update — useful for developers assessing workflow changes and reusable value.
NVIDIA's Nemotron-Labs-3-Puzzle-75B-A9B is a deployment-optimized large
Nemotron-Labs-3-Puzzle-75B-A9B is a deployment-optimized large language model developed by NVIDIA, derived from Nemotron-3-Super-120B-A12B. The model is produced using Iterative Puzzle, a post-training compression framework, with the goal of significantly improving inference efficiency for interactive, reasoning-heavy, and long-context workloads while preserving strong downstream accuracy.
The model employs a hybrid MoE architecture with interleaved Mamba, MoE, and Attention layers. Like Nemotron-3-Super, it supports Multi-Token Prediction (MTP) for faster text generation. Compared to its parent, Puzzle-75B-A9B reduces the model from 120.7B total / 12.8B active parameters to 75.3B total / 9.3B active parameters.
See the tech report for full training and compression details: Nemotron-Labs-3-Puzzle-75B-A9B: Compressing Hybrid MoE LLMs .
- Achieves approximately 2× higher server throughput on a single 8×B200 node at matched user-throughput constraints,
- Maintains strong accuracy across reasoning, coding, multilingual, long-context, and agentic benchmarks.
We're excited to introduce Nemotron-Labs-Audex-30B-A3B , a unified audio-text LLM built on Nemotron-Cascade-2-30B-A3B , a strong text-only MoE LLM with 30B MoE model with 3B activated parameters. Audex-30B-A3B extends the vocabulary for discrete audio tokens used for speech and general audio outputs, as well as an audio encoder for speech and general audio inputs. Audex-30B-A3B delivers strong abilities on audio tasks (audio understanding, speech recognition and translation, text-to-speech, audio generation, and speech-to-speech generation) while preserving very compelling reasoning, alignment, knowledge, long-context, and agentic capabilities of its text-only LLM backbone with marginal or no regression. Audex-30B-A3B operates in both thinking and instruct (non-thinking) modes.
- Audex-30B-A3B follows the ChatML template and supports both thinking and instruct (non-thinking) modes. Reasoning content is enclosed within and tags. To activate the instruct (non-thinking) mode, we prepend to the beginning of the assistant’s response.
- Audex-30B-A3B has different recommended inference setups per audio-related task as described below.