qwen 3.8 27B vs enterpise
local models are great until you realize you'd rather use the machine to play games instead of running long and heavy context workflows.
super annoying, so I set out to experiment with harnesses that can solve these types of problems that closely resemble real world engineering problems.
you can't beat enterprise, but you can get close with a 90% or so saving if you choose the right harness.
Harrison Kinsley recently posted something similar on his channel. highly recommend you check it out.
here are some highlights;
- experiment cost: total marginal cost 60c of electricity for the qwen 3.8 27B. about 9–$11 for the same token traffic on enterprise.
- about 90–95% inference cost reduction for frontier-adjacent output.
- swapping only the agent harness context window (131K → 32K context, managed tool output) completed the task 4x faster with 3x fewer tokens with the same model, same GPU.
thoughts?