Negative Externality Coordination
Multi-Agent SecurityDescription
Multiple agents, optimising individual goals, coordinate (explicitly or implicitly) to produce collectively harmful outcomes. Emergent collusive behaviour arising from individual incentive structures rather than explicit programming.
Competing pricing agents tacitly maintain artificially high prices by observing each other's pricing strategies.
The 'lost in the middle' phenomenon — where LLMs fail to use information positioned in the middle of long contexts — has been rigorously documented in controlled research settings. Silent truncation or deprioritisation in production agentic pipelines has not yet been attributed as the confirmed root cause of a reported production incident.
Primary mitigations
- Individual goal monitoring
- cross-agent coordination anomaly detection
- diversity-of-objective design
- colluding agent pattern detection.
Detection signals
Collusive Coordination Index; cross-agent outcome correlation.