u/auto_m8

I just upgraded my ram from 32gb to 96gb in effort to run qwen 3.8 flash next.

Previously I ran qwen 3.8 27b with ninfer which I was pleased with but I only had 32gb ram.

Now with 96gb RAM to pair with my 5090 32gb VRAM I would like to explore the next step up and alternative.

I saw something about strata working well with lower VRAM gpus and lots of vram, not sure if there is a different alternative for my before setup or its similar / the same.

I also wonder what kind of inference stats I can hope for with qwen 3.8 flash next, pp, decode.

Additionally if there are other MOE models I can Playa round with this setup even if its not the go to qwen.

Thanks for your time and replies in advance :)