Nemotron on danilchenko.devhttps://www.danilchenko.dev/tags/nemotron/Recent content in Nemotron on danilchenko.devHugoen-usFri, 17 Jul 2026 08:25:00 +0000Nemotron 3: How a Mamba-Transformer Hybrid Runs 1M Tokenshttps://www.danilchenko.dev/posts/nemotron-3-mamba/Fri, 17 Jul 2026 08:25:00 +0000https://www.danilchenko.dev/posts/nemotron-3-mamba/Nemotron 3 swaps most attention layers for Mamba-2 and MoE to reach 1M-token context at 3.3x throughput. Here is how the hybrid architecture actually works.