Just thinking ahead since I am going through this with my mac studio now. With mac studios I can turn in my old unit for a new one and Apple gives you a good deal on the hardware. But how will that work with our rtx pro 6000s? There doesn't seem to be a safe and easy option like Apple. So would that mean we'll have to sell on ebay ourselves? I don't feel great about selling something so expensive on Facebook marketplace or ebay where they can charge back on me. So what are we supposed to do when vera Ruben rtx pro 6000 comes out and we want to upgrade?

Is anyone running dual RTX 6000 Pro's on a Lenovo P620 (WRX80) platform? Hoping you might be able to confirm some BIOS settings. For instance, I needed to disable resizeable BAR to get it to POST. Was wondering if there's anything else you figured out that you wish you knew when getting this config going? TIA

I've been looking at ways to reduce power consumption on my RTX Pro 6000 GPUs. First some stats:

SGLang, Qwen 3.8 27B, BF16, prefill = 32k prompt (cold), decode = 1024 tokens on a cached context of 105k.

Prefill

Power (W)	Speed (tok/s)	Change (%)
600	5426	-
450	4298	-21
350	3446	-37
300	2949	-46
250	2456	-55
200	1968	-64

Prefill draws whatever power it is allowed, and its speed is roughly proportional to power. Capping prefill saves little energy; it only makes prefill slower. Running prefill at 600 W costs about 8% more energy per token and halves the time.

Decode

Power (W)	Speed (tok/s)	Change (%)
600	66.8	-
450	66.7	0
350	65.2	-2
300	61.9	-7
250	51.3	-23
200	36.8	-45

Decode at 600 W draws only about 475 W. It does not use the full limit, so any cap between 450 W and 600 W changes nothing for decode.

The knee is at about 300–350 W. Down to 350 W, decode loses approx 3% speed while using approx 25% less energy per token than at 600 W. At 300 W it loses approx 8% and uses 30% less energy.

250 W costs a lot of speed for almost no further saving. Decode drops approx 23% against 600 W, but energy per token is only about 1% better than at 300 W. At 200 W, energy per token gets worse again.

Summary

The optimal strategy seems to be: use 600W for prefill, 300W for decode.

I've installed a daemon that monitors SGLang log files, and switches the power cap depending if SGLang is in Prefill or Decode. I'm monitoring this on real-world workloads now.

Is anybody else doing this? I haven't seen this strategy mentioned before.

I need to pick a motherboard for my 4x rtx pro 6000 and I'd like to hear which motherboard you picked and why?