Is this real ? Qwen3.6:27b with 128k context fit in 24Gb VRAM ?
▲ 202 r/Qwen_AI+2 crossposts

Is this real ? Qwen3.6:27b with 128k context fit in 24Gb VRAM ?

https://preview.redd.it/yw41s1jikefh1.png?width=1942&format=png&auto=webp&s=3a180ae6443c1db9f7b0ce621533a4b2aa553921

Hi,
I've been running Ollama on my Unraid server since the llama2 era. I use to be able to run qwen3.5 and then 3.6 27b with 32k context, barely but it was fitting. The other day I notice that the VRAM usage was WAY lower than I remembered.

So I kept increasing the context window, hitting 128k at 83% VRAM usage ! How ? Can I go further ?

I'm using the model in opencode right now and the token count goes up to 131072 before the awnser automatically stop (an issue I had before, but at 32k used) all this without using the system RAM and keeping a healthy 30 tok/s (sys ram would be 4 tok/s).

I'm using OLLAMA_FLASH_ATTENTION=1 and OLLAMA_KV_CACHE_TYPE=q4_0 as well.

Is this just an hallucination ?

edit : qwen3.6 Q4, or Q5 with 96K context works too!

reddit.com
u/4sch3 — 25 days ago
▲ 1 r/prius

Gen 3 Prius 350.000 km loosing coolant, head gasket ?

Hi there,

I'm the (so far) happy owner of a 2012 gen 3 Prius. Since a few day I've had the engine producing knocking sound at start-up. It last for 5s, then normal sound. The knocking start again after the engine is shut-off for a few minutes like driving a bit in EV or shutting off the car... Again and again.

The coolant level is low. And no Matter how much I fill the tank, it goes down. Also when I open the coolant tank, I hear air succion. By memory opening this didn't have any noise due to pressure difference.

I'm I due for a head gasket replacement?

Can I still use the car if I top-off coolant regularly until I get the gasket replacement?

Not a financial good time for me, I really need to use my car to work...

reddit.com
u/4sch3 — 3 months ago