u/FleetingMemories

▲ 7 r/oMLX+1 crossposts

Creating New oQ Quantization in oMLX

Hi! I'm sorry if this is a dumb question but I'm new to oMLX and have been doing some of my own experimenting and research. I've been experimenting with the Qwen3.6-27B-oQ4-mtp model that Jundot has on huggingface, but I wanted to compare that to an oQ3 model. There isn't one available that I could find so I wanted to try making my own quantization of it in oMLX. Where can I find a full precision Qwen3.6-27B in mlx format that I could use as the source model? I was only able to find the unsloth BF16 model in gguf format. Thank you!

reddit.com
u/FleetingMemories — 2 days ago