u/No_Willingness_2249

Has anyone found any good settings to use Gemma 4 models served through oMLX with coding harnesses like Pi?

For me none of the Gemma 4 models seem to be able to make tool calls in this harness - I suspect it’s due to the differing tool call format used in Gemma models.

Has anyone figured out how to make this work in oMLX + Pi or OpenCode?

Update: they do seem capable of making tool calls if you explicitly ask for it. For example if you ask it to build an html game it’ll just print out the code in the chat but then if you ask it to write it to a file with the ‘write’ tool then it will. A bit annoying as Qwen models just do it.