u/SimpleRain173

Currently I am running oMLX on my M3 Max, with the model Qwen3.6-27B-4bit.
Here is my setting

https://preview.redd.it/ug7l5i6e96bh1.png?width=1538&format=png&auto=webp&s=cd6013fdd705d551cb038506b79300b54776b2e1

https://preview.redd.it/iy9che4i96bh1.png?width=1524&format=png&auto=webp&s=668f94f5ecf20104d5d969c3f78858234f22f141

https://preview.redd.it/q5qwgbel96bh1.png?width=1448&format=png&auto=webp&s=35f9dc1e88b03ea2b7bb40f13f2dc91d250550a7

https://preview.redd.it/io2p2zeq96bh1.png?width=1456&format=png&auto=webp&s=3c7415989adc042daf51823f7f823f97dc382b6a

https://preview.redd.it/fal1ahus96bh1.png?width=1470&format=png&auto=webp&s=ed866123bd2a4d72b0264cdf784913c0808c157f

https://preview.redd.it/i3py54yv96bh1.png?width=1446&format=png&auto=webp&s=a0eab2c196954b57caa7b2e5eb6795f9ebd90dd9

The output only around 7-10tokens.
Can you guys give me more suggestion to improve the output? Thank you a lot