Ornith-1.5-35B-A3B-MLX-8bit on Apple M5 Max — 92.6 tok/s — llm-bench.io
Good speed, decent quality for some usecases.
u/DerTomsn — 8 hours ago
Qwen3.8-27B-4bit on Apple M5 Max — 30.5 tok/s — llm-bench.io
Good, but thinking budget needs to be set on oMLX, otherwise it buuuurns tokens.
u/DerTomsn — 1 day ago
qwen3.8:latest on AMD Radeon RX 7900 XTX — 41.5 tok/s — llm-bench.io
Decent, but can't keep up with the hype.
Faster than qwen3.6:27b and muse-glimmer (if thinking is off!).
u/DerTomsn — 1 day ago
▲ 10 r/LocalLLM
NVIDIA-Nemotron-3.5-Lightning-30B-A3B-8bit on Apple M5 Max — 110.1 tok/s — llm-bench.io
llm-bench.iou/DerTomsn — 7 days ago