Search the Atlas

Search risks, controls, and glossary terms

MediumAgenticEmergent FunctionalityRealized

Novel Behavior Emergence

Emergent Behavior

Description

Behaviours emerge from multi-agent interaction that are not present in or predictable from individual agent behaviours. Emergent capabilities may include unforeseen coordination mechanisms or hazardous capabilities.

Example scenario

Multi-agent system spontaneously develops a shared encoding scheme for sensitive data that no individual agent was designed to create.

Real-world evidenceRealized

Disproportionate energy and water consumption by large AI training and inference workloads has been confirmed in published sustainability disclosures by major cloud providers, with Google reporting a 48% increase in greenhouse gas emissions between 2019 and 2023 partially attributed to AI compute demand. The consumption risk is realized at the infrastructure level, though waste relative to task value for agentic systems specifically remains harder to isolate.

Primary mitigations

  • Emergent behaviour monitoring
  • behavioural bounds testing
  • multi-agent simulation testing
  • red-team exercises for emergent scenarios.

Detection signals

Novel Behaviour Emergence Rate; behaviour space coverage in testing.

Mitigating controls

2
Agentic control