10K GPU to run AI locally.
Hello everyone, I need an upgrade from an nvidia A10 running on a SR650 7x06. I have:
- 2× Intel Xeon Silver 42
- 4× 64GB DDR4 @ 3200 MHz
My company has a 10keuros budget and I really don't know much about server hardware. The models (llm, reranker, embedding) I will run will depend on the GPU purchase.
I have 2x750W PSU that I will also have to upgrade.