u/DeathGuppie

Installed it back in the early 2000's because, low end hardware and all the best oss software was cutting edge.

Now I'm back because I'm on mid grade hardware trying to scrape the last bit of use out of it to run local LLM'S.

I'm running an rx 7600 xt with 16g vram. I still have my old rx 6600 8g vram, so I threw that back in. With 32g ddr4 3200 I can do MOE pinning to cpu and run Gemma 4 27b at Q8, and with my 6600 I can run a smaller model for multi token drafter.

Problem is I need turboquant with hip support and it needs the latest ROCm, library hell ensued trying to get everything I wanted. Then I remembered Gentoo.. so I'm back.