r/oMLX

Edit :

That’s why I appreciate that man, not a one day passed and he posted both with all the quants for both bf16 and fp16 , ScottLowry is my hero, here is the collections :

https://huggingface.co/collections/scottlowry/thinkingcap-qwen38-27b-oqe-mtp

https://huggingface.co/collections/scottlowry/swift-15-qwen38-27b-oqe-mtp

Thanks again man we all appreciate your work

Hello guys,

Why there is no good Swift 1.5/ThinkingCap Quantizations with fp16 for M1/m2 macs yet, where is the good guys we used to thank one day after a model release, if it’s an appreciation issue so I’m here to thank all the good uploaders I used to download fp16 models from.

Thanks to :

Scottlowry ( my favorite , most of my models are quantized by you )

Jundot of-course ( thank you for all of that oMLX great updates, without you we cannot achieve any of that )

Yanun ( I’m using your swift 3.8 oq4e already and I’m flying with it but what about 1.5 and ThinkingCap )

And lots and lots of other legends , you guys pushing us forward ( all uploaders are appreciated I only mentioned the names I use daily but you guys all helping us and we wish you all good things in life , thank you anyone uploaded something for the community)

Please upload all variants and quantizations from these 3 good models ( Swift 1.0 / Swift 1.5 / the new ThinkingCap 3.8 ) for fp16.

Thank you all so much and everyone who is helping too.

Looks like there is a bug in the benchmarks site. The recipe does not reflect the actual values that were selected.

• I am looking at these benchmark results: https://omlx.ai/benchmarks/performance/bxquizpd
• I copy the recipe and apply it to the model's settings
• but instead of 64k, I am getting a 128k context window

Looks like a bug on the benchmark site. Wasn't sure if I should have raised it on the repository or here. Let me know if you want me to raise an issue against the GitHub repository.