Is the RX6800 worth it for Local inference over my 3070 + 3060 build ?
Hello, I would like to get some insight if anybody has used an RX6800 local ai build, currently I have an rtx 3070 and RTX 3060 12gb, I was thinking about the following possibilites after the only 3090 deal in my local market is gone:
1- adding another 3060 12gb and ditch the 3070 ?
2- selling both cards and getting 2xRX6800 for the 32GB VRAM total
3- getting something else like a 3080 ti or an Nvidia 12gb card
The idea for my build that I am now too limited in terms of context size for Qwen3.6 27b as I can't exceed ~32k tokens context size. I am also thinking about image and video gen possibilities in the future, but that is not my main goal for the local build, it is mainly text gen.
With my 3070+3060 build, I am getting 16-20 tps and a 300-500tps during pp, it could be enough for chat and some agentic work, but slow for code gen.
there is actually no RTX 3090 in my local market, and the budget is limited, that is why I thought about the RX6800 since it has 512.0 GB/s bandwidth and 16GB VRAM.
I would appreciate your advice.
Thank you