Qwen 3.6 Dense vs MoE
Day two working on my local LLM setup. I kept using Qwen 3.6 MoE for testing and development of the VS Code Copilot integration. I had it implement a space invaders in HTML/JS. I got pretty far along with MoE alone until I wanted to fix the asymmetry of the player ship sprite and it just could not work this out even though this is pretty basic math and pattern.
Out of frustration I got the Dense 27b model up and running and sure enough it fixed it on first try. Though Dense it running a lot slower than MoE on my RTX Pro 6000.