u/nasone32

▲ 33 r/ROCm

MiniMax H3 on AMD ROCm/HIP + Multi-GPU tips (2x 7900 XTX)

I finally got MiniMax H3 working really well on AMD, including multi-GPU, so I thought I'd share a few things that saved me a lot of trial and error.

For reference, my setup is 2x AMD Radeon RX 7900 XTX, 24 GB VRAM each. Some settings below, especially the multi-GPU VRAM allocation, are specific to my hardware.

I also uploaded the workflow + notes on Civitai here:

https://civitai.com/models/2857584/minimax-h3-amd-hip-and-multigpu-tips?modelVersionId=3227624

ComfyUI ROCm build

I'm using the build from patientx-cfz:

https://github.com/patientx-cfz/comfyui-rocm

It works extremely well for me and has been stable/error-free. Just follow the installation instructions on GitHub.

After installing, make sure to update everything using the included batch files:

comfyui-rocm-updater.bat
rocm-pytorch-package-updater.bat

Then edit comfyui-rocm.bat, find:

set PARAMS=

and add:

--use-sage-attention

at the end.

MiniMax H3 models

I recommend using the Q8_0 GGUF models.

The INT8 versions also work and are roughly as fast as Q8, but in my testing they require a lot more VRAM with no noticeable quality benefit.

I'm using the Unsloth versions:

https://huggingface.co/unsloth/MiniMax-H3-GGUF/tree/main

Specifically:

minimax_h3_fl2va_pruned-Q8_0.gguf
minimax_h3_ref2va_pruned-Q8_0.gguf

If you only have one 24 GB GPU, I'd suggest starting with Q5_0 instead. If you have 32GB maybe try Q6 or Q8.

Important: NVFP4 CLIP works on AMD

Download the recommended CLIP:

qwen3vl_32b_minimax_h3_nvfp4_awq

This was probably the biggest source of confusion for me.

I'm familiar with NVFP4 from the LLM world, so because it's associated with NVIDIA hardware I automatically assumed it wouldn't work on AMD.

I tried several GGUF CLIP models and only managed to make them work properly for T2V. For the other workflows, no luck.

Turns out that assumption was wrong:

You do NOT need a GGUF CLIP. The recommended NVFP4 model works on AMD in this setup, the included comfy-kitchen module handles it transparently.

Multi-GPU

Install these two custom nodes through ComfyUI Manager:

comfyui-multigpu
ComfyUI-GGUF

After installing comfyui-multigpu, use:

UnetLoaderGGUFDisTorch2MultiGpu

as the GGUF loader.

On my 2x 7900 XTX 24 GB setup, I use:

virtual_vram_gb = 20

20 GB is specific to my setup, so don't blindly copy that value if your GPUs have a different amount of VRAM... With my two 7900 XTXs, the second GPU essentially works as a very fast cache/offload device for the primary GPU doing the computation. The 20 means 20Gb of the second card are used as cache for the first card.

Turbo LoRAs

You can of course add LoRAs on top. The H3 LoRA ecosystem is moving quickly, but these were among the first Turbo LoRAs:

https://huggingface.co/lightx2v/Minimax-h3-Turbo/tree/main

They let you use around 4 or 8 steps instead of the default 20, depending on the LoRA/workflow. Actually the 4 step works best with 5/6 steps, soemtimes 4 steps is a bit rough on fast movements.

Again, I've uploaded the workflow I'm using here:

https://civitai.com/models/2857584/minimax-h3-amd-hip-and-multigpu-tips?modelVersionId=3227624

Hopefully this saves some AMD users a few hours of experimenting. :)

times: the workflow linked above took 2min 13sec for 4 steps, it's a 5 second video 0.4 megapixels. Also I NEVER got an OOM this has been extremely reliable for me.

reddit.com
u/nasone32 — 6 days ago
▲ 333 r/ROCm+1 crossposts

Got Qwen3-27B MTP running on AMD 7900 XTX at ~75 tok/s using llama.cpp

I noticed a few people are trying to run Qwen3-27B MTP on AMD GPUs and running into VRAM/OOM issues, so I wanted to share what worked for me.

I’m running it on a 7900 XTX and I’m getting around 75 tokens/s, which I’m very happy with.

The quant I used is this one:

https://huggingface.co/froggeric/Qwen3.6-27B-MTP-GGUF

in the Q4_K_XL Edit: Q4 K M flavour; I used the llama.cpp branch indicated in that repo.

My setup:

  • Windows 10
  • AMD Radeon 7900 XTX
  • Latest AMD drivers
  • Latest Vulkan SDK
  • VS Code 2026
  • Built llama.cpp from source
  • Launched the model immediately after compiling

Nothing fancy on the system side.

The important part seems to be using the right GGUF quant and the correct llama.cpp branch linked by the model author. With this setup I was able to run the model without the immediate OOM problems that others were seeing.

For reference, someone in the Qwen subreddit mentioned that they could barely get a 27B Q3 running on headless Debian with 32k context and Q4_0 KV cache, and that it would often OOM on the first message. On my Windows + Vulkan setup, this quant worked much better.

I also used ChatGPT to help me through the compile/setup steps; here’s the chat link:

https://chatgpt.com/share/69fd7345-b24-8396-8e54-d769d0e615d

sorry the chat is in Italian and I don't have the time to write a proper post right now, but maybe this is enough to get some people through. I also didn't try max context maybe I will try this evening, i'm sure 56k is doable with q8/q8 but I think close to 100k should be achievable with some tinkering. cheers

EDIT: i know this is called r/ROCm and I used vulkan instead, lol, but I think this was the most appropriate place to post this due to the userbase of this sub.

u/nasone32 — 1 month ago