I'm a little (or a lot) privacy conscious and intend to not use the app if I buy the Buzz.
If disconnecting the modem is as easy as pulling a fuse I will do that too.
What would I miss out on in this case? All the usual suspects like using the app to start the car, etc... coming from a "dumb" car I won't miss any of those things.
My 32GB unified memory setup runs both, though 27B even with MTP is something like 7-10 tok/sec. Usable but not real time by any means. (~18 tok/sec with 35B-A3B)
Would it be worth using 27B to plan long horizon tasks, put together the PLAN.md, and have 35B-A4B iterate over it quickly? I can't load both models together, so I'd swap once the plan is set.
Right now I'm using the latter exclusively but am wondering whether the differences in intelligence are as pronounced as some here say.
Wondering how much model quantization matters here. Daily driver on my 32gb unified memory setup is the qwen model outputting ~15 tokens a second.
Heard good things about the 12B Gemma 4 model so interested in trying it against my codebase. Given its size I can very comfortably fit the Q8 in. Hell, I could probably run it at BF16 lol