
Not every self-improving LLM system changes the LLM
Recent recursive-agent papers contain a useful definition problem: identifying exactly what is doing the improving.
The AQuA architecture keeps the underlying language model and evaluator fixed. Evaluated evidence accumulates in a local research state and changes which proposals come next. Its two research systems are separate as well, with no shared agents, memories, candidate spaces, outputs, or research state.
This is a systems-level feedback mechanism, not a claim that the model updates its own weights. Calling both mechanisms “self-improvement” may be reasonable, but they imply very different evaluation standards.
Is retained evidence enough to call a fixed-model process self-improving, or should that term require a change to the model or evaluator?