u/devtools-dude

I have zero experience with water cooling other than installing AIOs. I read a recent AI cooling thread where a user was trying to cool four RTX 6000 GPUs and a lot of valid questions were asked, but it didn't give me understanding if it was possible to reasonably cool things and reduce fan noise.

My build:

https://pcpartpicker.com/b/3B4scf

The current problem I'm experiencing is the bottom workstation GPU exhausts to the top GPU, which makes the top GPU work harder, and that GPU exhausts heat to the CPU AIO line, which makes the CPU unnecessarily hot.

I have tried things like adding fans to the top GPU and it does help a little, along with reducing the power output of the GPUs to keep it in a 70-80C range and adjusting fan curves, but the entire system still has to work and thus sounds like a jet engine; the Threadripper Pro ends up roasting to 90C during LLM inference despite low CPU utilization.

From what I've read, even using a 420mm radiator may not be enough to dissipate 1200W and you'd have to do a MORA setup.

The machine runs on a 240V / 30A circuit and is in a room that's AC cooled to 22C / 73F. It lives in my home in the bay area.

I'm not really sure where to start and I understand there's risks involved with dismantling the GPUs to be waterblocked.

One "simple" option I've seen is the AIO Bykski B-FRD-RTXPRO6000-WS-360 which has a dual GPU watercooling option, but from my understanding a 320mm radiator will be useless against the 1200W total output.

Another option I'm considering is moving the 3rd GPU (RTX 5080) to an external oculink dock and reposition the two GPUs to be more spread out and away from the CPU for better airflow.

Last option would be to find someone to trade the workstation cards for max-q cards instead.

I did try to search for guides on how to start but I'm not finding anything definitive - I'm seeing setups that involve multiple pumps, radiators, individual routing blocks, and am not sure of what I really need.

Overall, I'd like to reduce GPU temps and also reduce fan noise if possible.

If you think this is too complex of a problem for someone without experience to solve, is there someone in the bay area that offers services to perform this work?

I'm using the MiniMax-M3-GGUF UD-IQ3_XXS model loaded via Unsloth Studio using the defaults, and have been trying to use the model via the Unsloth API server with harnesses like claude code, hermes, and opencode.

In all the harnesses, they seem to have issues with the thought / tool calling output; in opencode, I get the following:

"Failed to parse input at pos 92: <]minimax[>[<tool_call>\n]<]minimax[>[<invoke name=\"read\">]<]minimax[>[<filePath>/home/theo/projects/pwrstat-ui/package.json]<]minimax[>[</filePath>]<]minimax[>[</invoke>\n]<]minimax[>[</tool_call>"

I have checked the issues on GitHub for some of the harnesses and it's hard to tell if the issue I'm seeing is exactly some results I'm finding around MiniMax / M3 usage in the respective harness.

I thought maybe I need to use a specific template, but from what I've read M3 has a native template...

Anyone been successful in using this model from Unsloth Studio with an external harness?

Edit: I seem to also be having issues in Unsloth Studio as well. Looks like any kind of tool call / thought just fails for it.