Novel Behavior Emergence
Emergent BehaviorDescription
Behaviours emerge from multi-agent interaction that are not present in or predictable from individual agent behaviours. Emergent capabilities may include unforeseen coordination mechanisms or hazardous capabilities.
Multi-agent system spontaneously develops a shared encoding scheme for sensitive data that no individual agent was designed to create.
Disproportionate energy and water consumption by large AI training and inference workloads has been confirmed in published sustainability disclosures by major cloud providers, with Google reporting a 48% increase in greenhouse gas emissions between 2019 and 2023 partially attributed to AI compute demand. The consumption risk is realized at the infrastructure level, though waste relative to task value for agentic systems specifically remains harder to isolate.
Primary mitigations
- Emergent behaviour monitoring
- behavioural bounds testing
- multi-agent simulation testing
- red-team exercises for emergent scenarios.
Detection signals
Novel Behaviour Emergence Rate; behaviour space coverage in testing.