Sequential LLM releases can skew bargaining outcomes, study finds

A benchmark study using GLEE, an independently collected dataset of 587K strategic decisions by 13 large language models across 1,320 matched bargaining, negotiation, and persuasion configurations, examined what happens when new model releases are treated as an expansion of the strategies available to negotiating parties. Across more than 50,000 release comparisons, many new releases moved the payoffs of the two sides in opposite directions, so one party gained while the other lost. The authors identify a 'Poisoned Apple effect': a newly released model that no agent actually adopts in equilibrium can still shift payoffs asymmetrically and alter the regulator's optimal market design, and they estimate this accounts for up to roughly three in ten of the opposing payoff shifts observed, with technology restrictions amplifying it. The work is a benchmark-based simulation rather than an analysis of real production deployment logs, which the authors note are scarce, proprietary, and lack the counterfactuals needed for this kind of study.

rss · arXiv cs.AI · Aug 18, 04:00

「Background」 Regulators and market designers generally assume that better or newer AI models are neutral or beneficial additions to a market, since participants can simply choose not to adopt them. Game theory has shown in constructed examples that expanding the set of available strategies can harm equilibrium outcomes even without full adoption, but this had not been tested at scale against real model behavior in bargaining-like settings.

「Who should care」 This is most relevant to organisations or regulators overseeing AI agents used in bargaining, negotiation, pricing, or persuasion, especially in markets subject to oversight where sequential, independent model releases are common. Exposure depends on whether a deployment's market design assumes model updates are payoff-neutral for all participants; the effect was demonstrated only in the GLEE benchmark's simulated configurations across 13 LLMs, not in production negotiation logs, so field prevalence is not established.

「Mitigation」 No fix is proposed since this is a structural governance finding rather than a software defect; the paper's implication is that regulators and market designers should account for the payoff effects of newer model releases, including unadopted ones, when setting market rules, and should treat technology restrictions with caution since they can amplify the effect.

Tags: #multi-agent systems, #LLM negotiation, #benchmark evaluation, #AI governance, #market manipulation risk