u/OddManufacturer2701

10K GPU to run AI locally.

Hello everyone, I need an upgrade from an nvidia A10 running on a SR650 7x06. I have:
- 2× Intel Xeon Silver 42
- 4× 64GB DDR4 @ 3200 MHz

My company has a 10keuros budget and I really don't know much about server hardware. The models (llm, reranker, embedding) I will run will depend on the GPU purchase.

I have 2x750W PSU that I will also have to upgrade.

reddit.com
u/OddManufacturer2701 — 3 days ago