u/RollRogersRoll

I’ve been testing a few inference providers for coding agents and I’m trying to figure out how much the speed difference actually matters in practice. With normal chat I don’t care much once the response is reasonably quick. Coding agents are different though. The agent might make a bunch of calls while it reads files, makes edits, runs tests and then goes back for another pass, so even small delays can start adding up.

Has anyone compared the same coding model across different providers while keeping the harness and task the same? I’m trying to figure out whether faster inference actually makes the whole agent run noticeably quicker, or if you hit a point where the tools, tests or harness become the bottleneck.