u/Easy_Werewolf7903

I have a blackwell card so I've tried both fp16 and 8 bit quantized unsloth versions. I am using vscode with open code extension. For some reason I constantly need to prompt "continue" or "proceed" in the terminal for Qwen to keep going. Does anyone know why? Current context size is 256k, I set the card to use about 95gb of VRAM.

I need to run two GPUs, one gpu will connect to the native 2v-2x6 connection, the other GPU will run with an adapter. The two GPUs are rtx 4090 (450W) and rtx 6000 pro max q (300W). rtx 4090 will use the native 2v-2x6 since will use more power draw. My pro max q will use the nzxt adapter.

Here is the cable:

Product listing says NZXT COMPATIBILITY: Guaranteed for use with all NZXT C-Series Gold ATX 2.X PSUs (PA-xG1BB)

https://www.amazon.com/NZXT-12VHPWR-Adapter-Cable-Compatible/dp/B0CBBF1ZL1

Here is the PSU cable compatibility chart:

https://support.nzxt.com/hc/en-us/articles/23511925676059-NZXT-PSU-Cable-Compatibility

While both the cable and my PSU are in Group 1, I am not sure how atx number changes the equation? Will the cable also work for NZXT 3.1 PSU? Whats the differences between atx 2.0, 3.0 and 3.1?

Got an expensive graphics card, so I decided to upgrade the same psu to ATX 3.1 for the extra protection.

Anyways, I am short on pcie cables. Can I reused the old c1200 pcie cable in my new c1200 PSU? Are they compatible? It is the same psu but atx is different.

Does anyone know?

I have a RTX 6000 and a RTX 4090 I was wondering if anyone can recommend me a bigger case with good air flow for multi GPU setup? My current case is the fractal design North midtower.

The rtx 4090 windforce OC is the biggest issue. It is about 3 inches tall.

I tried to deshroud the card to fix into my current case. While it works the airflow is not that good.

https://imgur.com/a/Nciqyse

Any help is appreciated 👍

I have a RTX 6000 pro Max Q and a RTX 4090 windforce OC. I had to deshroud the 4090 card to make it fit. At this point I realized this is too janky and it is time for a bigger case. Any case recommendations for multi GPU setup?