▲ 4 r/mlops
I built a tool to calculate the "Interconnect Tax" (40% efficiency loss) in GPU Clouds.
I’ve spent 30 years in hardware operations and NPI at places like HPE. I built the GPU Compute Index because I noticed everyone was buying GPUs based on 'sticker price' while ignoring the physics of interconnects.
If you're training large models (70B+) on standard 100GbE Ethernet, you're likely paying a 40% hidden tax because your GPUs are sitting idle waiting for gradients. I put this calculator online for free so the community can run real TCO models.
There's also a 36-month 'Build vs. Rent' logic included. Hope this helps some of you save on your cloud bills.
u/Ornery_Cattle7896 — 7 days ago