PCIE bandwidth needed to be a desirable multiple GPU host - will PCIe 3.0 x16 work well for 4-8 GPUs? What about PCIe 3.0 x8?
I want 4-8 GPUs per rig hosted (5070 Ti, 5080 and maybe RTX Pro 4000) and pretty much all the surface research I can find says that PCIe bandwidth doesn't matter. I am not convinced however...
Dual Xeon MOBO under consideration for these rigs has six PCIe 3.0 x16 slots - is that a mistake? PCIE 3.0 x8 seems to be the floor and you see some weird configurations listed on console like PCIe 4.0 x4 but I am not sure if these are getting rented.
I don't want these rigs sitting idle so marketability is a key driver of any design decision. Obviously 8 cards would require bifurcation of a few x16 slots to x8/x8. Does anyone know if vast.ai would "see" this as a x16/x16/x16/x16/x8/x8/x8/x8 configuration or will just report PCIe 3.0 x16?
Would fewer PCIe 4.0 or 5.0 slots be better? The budget won't allow for anything more than a MOBO with one or two such slots.
Thanks!