Is Apple the most affordable way to self-host?
Been banging my head trying to find a functional Hermes Agent-capable LLM that runs on my M4 Mac Mini. Seems like the solution space is narrow, and most of them are slow responding. Hard to get over 15 t/s on that hardware.
Looking to upgrade my self-hosted llama.cpp runner. Is the M4 Max Mac Studio capable enough? Is there a better, more affordable option? Is 64GB RAM enough?
u/PutridWerewolf4449 — 6 days ago