u/Hot-Chocolate-8620

MacBook m5 pro, 24gb ram

Hey guys, I’m pretty new to running LLMs locally.

I’ve found that my biggest limitation is the 24 GB of RAM on my machine, so I’m wondering: based on your experience, what’s the best model I can reliably run on a Mac with that amount of memory?

reddit.com
u/Hot-Chocolate-8620 — 3 days ago