u/HyenaUpbeat

Leftover parts build. Help

Hey everyone, I've put together a low budget, on board rig using leftover parts (AMD processor, 32GB DDR5 5600MHz RAM). I'm aiming to build a dedicated system for automated research, data processing, and administrative tasks. I know it will be slow!

My goal is to run a custom UI 24/7 to manage multiple models for background tasks. This involves tasks like drafting emails, pulling data for templates, and scraping web content. I'm planning to leverage Codex and Claude for heavy lifting as I know I can’t hand over the coding to the smaller models . The system has 16TB of HDD storage and 2.5TB of SSD for frequently accessed datasets and models. Not sure if I can put the storage to good use for anything.

Where I need help!
Not sure what models to run! It’s currently a windows setup.
I was thinking Linux for OS and having one model be a router and another to do the heavy lifting.
I tried a Gemma model but found it was only good at chatting and other models I’ve used seem to have better tool calling but I was hoping for some input as I know the 32gb of ram is an awkward spot but I only bought a motherboard and case for it right now everything else is already on hand.

Thanks!

reddit.com
u/HyenaUpbeat — 1 day ago
▲ 3 r/AiForSmallBusiness+1 crossposts

What is the real ceiling for 32gb vram

Right now I don’t care about speed or power as I plan to run my system nonstop off solar panels/battery I have. But realistically how many models can I run off of 32gb? I was planning one router/harness model and one larger one to handle email drafts, docs , etc for me. Any suggestions? This is the list I have so far. hermes3:8bdeepseek-r1-16k:latestphi4-mini-long:latestqwen3-vl-long:latestgemma4-long:latestqwen3:14bqwen3:8bphi4-mini:latestqwen2.5-coder:7bdeepseek-r1:14bnomic-embed-text:latestgemma4:e4bqwen3-vl:8bqwen3:1.7b

reddit.com
u/HyenaUpbeat — 1 day ago