NVIDIA quietly released a 550B open model built for long-running AI agents (1M context, runs locally via Ollama)
Saw this making the rounds and figured it's worth a post since it hasn't gotten much coverage outside NVIDIA's own blog.
NVIDIA released Nemotron 3 Ultra on June 4. It's a 550B parameter MoE model (55B active per token), open weights, released alongside training data and recipes.
A few things that stood out to me:
- 1M token context window, so you can throw an entire codebase or hours of transcript at it in one go
- NVIDIA claims up to ~6x higher inference throughput vs other open models in its class (Kimi K2.6, GLM-5.1, Qwen-3.5), though take vendor benchmarks with the usual grain of salt
- It's specifically tuned for agentic workflows — multi-step coding, tool use, long research chains — rather than optimized for single-turn chatbot benchmarks
- You can run it locally through Ollama if you've got the hardware for it (fair warning: full BF16 weights need something like 8x H100s, this isn't a laptop model)
Worth noting this isn't really a "Claude Code killer" the way some clickbait framing has suggested — it's a base model, not an agent harness, so it's more of a building block than a direct product comparison.
Independent numbers from Artificial Analysis put it at the top of the Intelligence Index for US open-weight models specifically, though Kimi K2.6 still leads on raw benchmarks overall if you're not tied to NVIDIA hardware.
Anyone here tested it yet? Curious how it actually performs on real agent tasks vs the benchmark numbers.