u/bkvargyas

https://preview.redd.it/jscehbtobvuh1.png?width=3200&format=png&auto=webp&s=d9838c72274f451f2141ccfcd24ca45fd9810953

For those of you wanting to stay with stock ROCM10 and vLLM, this set of custom kernels i've been working on for weeks plug right into vLLM and improve RDNA4 performace significantly.

https://github.com/bkvargyas/r9700-stack

I've tested 2 and 4 card configs. I've mainly been bulding for Qwen Flash Next and 27B, but this kernel will work with others.

https://preview.redd.it/9klr64i22esh1.png?width=1714&format=png&auto=webp&s=31e7f996fcef367fea9e7c74e2fb2d8535b7da11

Working on my fastest impelemntation of QFN/27B TP4 card setup. What is amazing, is that I'm getting this on Circa PCIe 3 hardware. The other piece, is this is using stock vLLM .30 and ROCM10. 225W power cap on each card. https://github.com/bkvargyas/r9700-stack