It’s an MoE with ~3B active params and a 30B n-gram lookup table offloaded to RAM for fast 256k context on a 24GB GPU. Reminds me of Gemma 4’s PLE trick.
Initial analysis suggest it wont be replacing my Qwen 3.6 27b.
I'm stuck doing this exhausting two-model dance: Claude writes the actual plan, then I hand it to Gemini 3.1 Pro because Google has hallucinationmaxxed their LLM. It's fine 7/10 times. The other 30%? Ignores explicit instructions, invents functions that don't exist, randomly touches code I never mentioned, goes in an endless loop of forcing an impossible thing to work.
Google, just give us Opus 5 and Sonnet 5 already.