u/Kirkslovechild

Question about on device LLMs

Hi team. I recently just dropped back into the MBP world after tapping out on the last gen intel series a while back.

while sticking to a budget i was able to upsell myself from the base model air (au$1800) to the base model pro ($2000 discounted from 2700)

while lurking i see many posts talking about using the larger ram models for LLMs, besides keeping your interactions private. what has drawn you to using a local llm vs a typical cloud free or subscription?

the only quick example i have is plugging into xcode and the local llms can only give advice, where codex can actually go in and change your code. making the local some what less useful.

thanks team. super chuffed to be here 😁

reddit.com
u/Kirkslovechild — 15 days ago