
The AI Negotiation Loop: AI in Contract Negotiation
Four frontier AI models were given a SaaS agreement to negotiate, turn by turn, on contract states prepared by practising attorneys.
Where the counterparty's edit should have been accepted, they passed 80 to 99 per cent of the criteria.
Where it should have been rejected, 6 to 50 per cent.
One model, in one scenario, accepted 98 per cent of what it should have accepted and rejected 6.6 per cent of what it should have rejected.
That is RedlineBench, published in June and scored against rubrics written by practitioners. Two details say more than the aggregate: attorneys change about 100 characters per edit, models 320 to 520, and the models did worst in the opening turn, where you have to decide for yourself what is worth fighting for.
The numbers confirm something visible in contract practice for a long time, without a name.
I have called this the AI negotiation loop and broken it into four mechanisms: revision churn, agreement substitution, the borrowed ruler and mandate drift. On top of them sits what the benchmark measured, the refusal deficit: a model finds yes easier than no, so it does not oscillate around an equilibrium, it slides.
Churn is change without improvement. The tool was built to produce something when asked, and leaving a clause alone is not something it produces. So it rewrites the sentence where you would have swapped a word, and every rewritten sentence is a new doorway for the other side, who can now say "you changed it, so we are reopening it". The tell is simple: if you cannot justify an edit in one sentence by reference to what the client actually wants, it is churn, however intelligent it sounds.
Agreement substitution is older than the technology. Negotiation researchers have known for a decade that solo negotiators sign deals that should never be signed, while teams more often notice that no deal is the better outcome. The tool is the solo negotiator in its purest form. Nobody at the table tells it that walking away counts as a result, and nothing in its training rewards it for recognising a negative bargaining zone. Closing feels like success to it in exactly the way closing feels like success to a tired associate at eleven at night.
The borrowed ruler is the one that costs clients money without anyone noticing. Vendor opens at a cap of one year's fees, purchaser opens at nine, the assistant suggests five as a reasonable landing. Five is reasonable only on the ruler the other side supplied. The questions that actually decide a cap, exposure, insurance, price, what the client does if there is no deal, never entered the arithmetic. Models anchor on the first number the way people do, and in one study they anchored on a mood: an agent that performed desperation improved its payoff by a fifth. Whoever supplies the ruler owns the midpoint, and in a redline the other side supplies it every time they send a draft.
Mandate drift is what happens when every round answers the previous round instead of the client's instructions. After enough turns the document answers only to itself. If you delegate a redline to a tool, the prompt is the mandate, and a prompt that says "review this and find a reasonable solution" is a mandate to drift.
Why the slide runs in one direction has, I think, little to do with the model having a personality. In one round you ask it to find the risks, so it proposes interventions. In the next you ask it to find a compromise, so it proposes concessions. Alternate those two instructions a few times without a fixed mandate in between and the tool spends round nine repairing the risks it introduced in round seven and reopening the point it closed in round five. No preference for the middle is required. Two alternating tendencies and no memory will do it.
Asking it to "review once more" does not help, and the self-correction research explains why: without new facts, another pass adds another reason to change things, including things that were already right. The most expensive edit in any negotiation is the one to a clause that was fine, because it reopens what was closed and teaches the other side that nothing is ever settled.