
▲ 7 r/OpenSourceAI
Great deep dive into running Qwen 2.8 locally by Simon Willison
simonwillison.netu/JeffyPros — 2 days ago

Petere J Liu (https://x.com/peterjliu/status/2081864678586925152) mentions their use of hybrid linear / full attention as well as getting rid of positional encoding (with NoPE https://arxiv.org/abs/2510.2669)
What else stands out?