u/Dangerous_Feature_50

Hey all, quick question.

I’m building a PC mainly for local AI (LLMs via Ollama / LM Studio). I’m considering a used RTX 3090 (24GB) for around €800–900.

From what I understand, VRAM is the main bottleneck, and 24GB still seems to hit a sweet spot for running ~13B–32B models locally.

Am I on the right track? Or would it be smarter to go with a newer gen GPU (40/50 series) with less VRAM?

Max budget ~€1k. I’ve also read NVIDIA is still the safer choice vs AMD for AI.

Plan long term is to expand to a second 3090.

Appreciate any insights 🙏