Search the Atlas

Search risks, controls, and glossary terms

HighAgenticSwarm Attacks●Realized

Coordinated Multi-Agent Harm

Multi-Agent Security

Description

Many agents acting together amplify harmful capacity beyond what individual agents can achieve. Coordinated attacks that overwhelm defences, manipulate markets, or flood communication channels at scale.

Example scenario

1,000 compromised agents simultaneously manipulate product reviews across e-commerce platforms.

Real-world evidence●Realized

Multiple high-profile confirmed production incidents document AI hallucinations causing direct harm in high-stakes outputs, including a court-sanctioned case where fabricated legal citations were submitted, and a consumer tribunal holding an airline liable for chatbot-generated false policy information.

Primary mitigations

  • Agent fleet monitoring
  • collective action anomaly detection
  • inter-agent coordination limiting
  • rate limits at population level.

Detection signals

Collective Action Amplification Score; coordinated action detection across agent fleet.

Mitigating controls

4
Dual coverage

Related risks in Multi-Agent Security