How do i proper do int8 quantization for model like Anima on Rdna2 cards?
I have 6700xt, 32gb ram, from what i found online, int8 quantization should help improving speed by 30% but after setting up fast int8 triton backend, i found that the speed practically didn't change, it was 4.65s/it in fp16 and 4.53s/it int8 at 832x1216. Did i do something wrong or it was rdna2 limitation?
Comfyui var i use cache none, pinned memory disabled, pytorch cross attention