we benchmark models nobody actually runs

qwen3.8 27B has seriously impressive benchmarks on its model card, but that's for the unquantised version. Almost everyone here will run one quant or another.

Are there good benchmarks for how those quants perform?

Kl divergence is only a rough proxy for how the distribution over tokens is preserved, but that doesn't necessarily tell you about task performance. Kl divergence could be lower due to stylistic changes, for example, that don't affect coding.

This is also a general problem beyond Qwen.

reddit.com
u/AuspiciousApple — 2 months ago
🔥 Hot ▲ 6.4k r/mongolia+1 crossposts

TIL the abundance of Thai restaurants worldwide is partly the result of a Thai government campaign to spread the country’s cuisine and influence. Since 2002, the Global Thai Program provides people with training, grants, and standardized restaurant models

foodandwine.com
u/AuspiciousApple — 2 months ago

The Great Ace attorney chronicles was amazing. Why hasn't there been a sequel in almost a decade? Was it not commercially successful?

Loved the characters and the writing. Pacing was a bit slow at times, but otherwise it's my favorite game in the series.

In an age, where many other games have absurd budgets attached to them, I can't imagine that a game like this is particularly expensive to make. Why don't they make more ace attorney games?

reddit.com
u/AuspiciousApple — 3 months ago
▲ 423 r/MetalsOnReddit+1 crossposts

Ancient Rome had several embassies from countries in India, which I was surprised to learn about. How long would they have travelled? Would the ambassadors have expected to go home one day? Why were they sent to such a far place? Where they hoping to increase trade?

reddit.com
u/AuspiciousApple — 3 months ago

What is this sub even about? Most people here seem to order and inject random peptides from semi-dodgy sellers or just take arbitrary selections of supplements. Where is the science, the nuance, etc.?

There might be exceptions and those I would be most interested in, but the expected value of ordering something from a seller that is not properly regulated and audited and injecting it must be highly negative.

There's a reason why the real pharma industry is heavily regulated

reddit.com
u/AuspiciousApple — 5 months ago