[INFO] Native ops: float8_e5m2, float8_e4m3fn, int8_tensorwise , emulated ops: mxfp8, nvfp4
[INFO] model weight dtype torch.float8_e4m3fn, manual cast: torch.float16
Has anyone managed to solve this problem for the AMD R9700 GPU in ComfyUI on Linux?
[INFO] Native ops: float8_e5m2, float8_e4m3fn, int8_tensorwise , emulated ops: mxfp8, nvfp4
[INFO] model weight dtype torch.float8_e4m3fn, manual cast: torch.float16
Has anyone managed to solve this problem for the AMD R9700 GPU in ComfyUI on Linux?
https://github.com/Comfy-Org/ComfyUI/issues/11519
Is there anyone here who has successfully run FP8 Wan 2.2 on an R9700 GPU? By "successfully," I mean achieving the correct VRAM usage and speed, without ComfyUI automatically converting the model weights to FP16 and increasing VRAM consumption. If so, please share the VRAM usage for FP8 on this GPU at 1280x720x81. I’m starting to wonder if it actually works on this card at the moment.
Is there anyone with an R9700 who could send me a link to a good YouTube installation tutorial that works for them on this card and includes all the acceleration features like Flash Attention, Sage Attention, etc. for Comfy UI? I assume it's Linux? I've always used Windows and I'm not very familiar with Linux. On Windows, Comfy UI overloads my GPU's VRAM even at 1280x720x81 frames, and it's a complete disaster.
I have Docker installed on Windows, but I don't know how to use it. I don't have time to learn it, and it's generally getting on my nerves, so it would probably be quicker if I burned one drive separately on Linux for this GPU. I need a quick and simple tutorial so I can easily reproduce the steps without having to learn it.
Is it normal that WAN 2.2/Bernini in FP8 can barely fit 81 frames at 720x1280 on an AMD Radeon R9700 with 32GB of VRAM? ComfyUi. Model has near 15GB but in first KSampler Comfy allocate 36GB in VRAM. When Dynamic VRAM is enable it is "only" 31GB... Something's probably wrong, or is this happening to you too? I used to run 57GB models on the RTX 2080ti, but even the small ones in FP8 take up the entire card, and the larger models don't work at all. Does AMD have any issues with VRAM allocation in Comfy?
Is it normal that WAN 2.2/Bernini in FP8 can barely fit 81 frames at 720x1280 on an AMD Radeon R9700 with 32GB of VRAM? ComfyUi. Something's probably wrong, or is this happening to you too? I used to run 57GB models on the RTX 2080ti, but even the small ones in FP8 take up the entire card, and the larger models don't work at all. Does AMD have any issues with VRAM allocation in Comfy?
Hello, is it normal that after each message lmstudio unloading model from VRAM?
Help, is it normal that Lmstudio unloading model from VRAM after each chat message?
Hi, what are your TG t/s speeds in LM Studio under Vulkan, using an R9700 + Nvidia? I'm referring to the combination and what are your speeds on various setups, e.g., an R9700 with a 4090, 5090, 5070ti, 4080, etc. I have a setup with an R9700 + 2080ti, and when I fully load the two GPUs, say with a 39-40GB model like the Gemma 4 UD Q8 XL and a little context, this setup runs at about 12 t/s. If I swap the 2080Ti for, say, a 5070TI, would the speed increase and it would perform like a Radeon R9700 with Gemma on full, i.e., about 18 t/s with only 48GB of VRAM? Has anyone tested such combinations? I couldn't get MTP to work in LM Studio for Gemma 4, so these speeds are for the regular Unsloth model.