Does PCIe 4.0 vs 5.0 actually matter for self-hosted AI workloads?
Hey guys, I’m currently building a setup for self-hosted AI (image generation, maybe some LLM inference later), and I’m trying to figure out whether PCIe 5.0 actually makes a difference compared to PCIe 4.0.
I already have a GPU that supports PCIe 5.0, so now I’m wondering if it’s actually worth pairing it with a PCIe 5.0 motherboard, or if PCIe 4.0 is still more than enough.
From what I understand, most GPUs today don’t fully saturate PCIe 4.0 yet, but I’m not sure if that changes for AI workloads—especially things like:
Stable Diffusion / image generation at scale
Running multiple models
High batch sizes or heavy data transfer between CPU and GPU
So my questions:
- Does PCIe bandwidth actually impact performance in real-world self-hosted AI use?
- In what scenarios would PCIe 5.0 give noticeable benefits over PCIe 4.0?
- Is it worth going full PCIe 5.0, or am I fine sticking with PCIe 4.0 even with a PCIe 5.0 GPU?