u/real-bahman

https://preview.redd.it/49i6lspukdbh1.png?width=1794&format=png&auto=webp&s=13901d454561cadb3b8e10e8257668ddff8bddcb

I've been running my Hermes agent with Gemma 4 26b a4b q4 qat on my AMD 7900 XTX gpu,
with 15GB size, it leave plenty of room for 200k context length, with Vulkan I get ~150-120 tps, which is faster than ROCm ~100 - 75 tps