u/Gloomy_Letterhead395

Hey, just wondering if there are forks or exact gguf versions that give fastest prompt processing and token gen speeds for AMD gpu?
Looking to run q8 or q6
Vram 96gb
W7900 + w7800 both 48gb
With bandwidth mismatch, tensor paralleling amd equivalent not working

I am building a local token machine
W7900 and w7800 variant have both same 48gb
But a price difference of 1000$
Has anyone used them multiple of these
How is the performance which one works for local lmstudio

Is it a good shift or possible issue with ubuntu