I think multi-agent collaboration is mostly a false premise right now
I have been looking at what kinds of agent ideas show up in interviews and reading more about how agents actually work. One topic I keep running into is multi-agent collaboration.
My current view is that the premise is still ahead of the underlying technology. An agent depends on a language model, and language models still hallucinate, forget context, lose capability under pressure, and occasionally make surprisingly weak decisions. Putting several agents on top of those failure modes can amplify them, especially when the agents use different models and have to hand work across a boundary.
The common designs I see are a shared workspace with restricted read/write access, plus a reviewer agent and some kind of circuit breaker. Those controls make sense, but they also look very similar to managing concurrent workers. The uncomfortable part is that the final safety check still depends on another agent.
The costs are obvious. Token usage multiplies, agents can lose track of ownership, and the orchestration becomes rigid and format-heavy. That last point feels the most damaging to me. We are supposed to be using the flexibility of an intelligent model, then we wrap it in so many fixed handoff formats that the system spends its time managing the workflow instead of solving the problem.
I am not sure a large amount of orchestration is the best answer. Maybe the better direction is to let the model decide when another agent is actually needed, with fewer predefined roles. ZenMux can serve as the API gateway when those calls need to cross model or provider boundaries, but the gateway does not solve the coordination problem itself.
So my current summary is that multi-agent systems are still more about exploring what might be possible, with a fair amount of demo value, than reliable production practice. The path to a useful deployment seems much harder than the diagrams suggest.
Do you have a real multi-agent workflow in production? Did it actually meet expectations, or did you eventually simplify it back to one agent and a few tools?