
▲ 18 r/ROCm
Ninfer but for R9700s
This project has existed for running Qwen-3.8 on 5090 NVidia GPUs with numbers exceeding the efficiency of using the 5090 on llama.cpp compiled for Cuda. I wondered if there were equivalent gains to be made for the R9700 GPUs as well given that they're comparatively affordable and what would incentivize someone to work on such an effort.
u/olivercroomes — 1 day ago