Search the Atlas

Search risks, controls, and glossary terms

HighAgenticSwarm AttacksRealized

Coordinated Multi-Agent Harm

Multi-Agent Security

Description

Many agents acting together amplify harmful capacity beyond what individual agents can achieve. Coordinated attacks that overwhelm defences, manipulate markets, or flood communication channels at scale.

Example scenario

1,000 compromised agents simultaneously manipulate product reviews across e-commerce platforms.

Real-world evidenceRealized

Multiple high-profile confirmed production incidents document AI hallucinations causing direct harm in high-stakes outputs, including a court-sanctioned case where fabricated legal citations were submitted, and a consumer tribunal holding an airline liable for chatbot-generated false policy information.

Primary mitigations

  • Agent fleet monitoring
  • collective action anomaly detection
  • inter-agent coordination limiting
  • rate limits at population level.

Detection signals

Collective Action Amplification Score; coordinated action detection across agent fleet.

Mitigating controls

4
Dual coverage

Related risks in Multi-Agent Security