Search the Atlas

Search risks, controls, and glossary terms

MediumAgenticSocial Engineering at ScaleDemonstrated

Coordinated AI-Driven Manipulation

Multi-Agent Security

Description

Agents coordinate large-scale personalised persuasion campaigns across millions of users simultaneously. Far exceeds the reach of human social engineering; machine speed at human scale.

Example scenario

Political campaign deploys agent fleet to generate personalised disinformation targeting swing voters across 50 platforms.

Real-world evidenceDemonstrated

Research on multi-step reasoning frameworks (ReAct, chain-of-thought, tool-use agents) has shown that early-step errors compound in downstream steps, with small initial mistakes producing large final errors. Production-scale agentic deployments with documented cascading failures have not been formally reported.

Primary mitigations

  • Agent-generated content detection
  • influence operation monitoring
  • coordinated inauthentic behaviour detection systems.

Detection signals

Coordinated Manipulation Score; per-agent persuasion reach; cross-agent message correlation.

Mitigating controls

4
Dual coverage

Related risks in Multi-Agent Security