Search the Atlas

Search risks, controls, and glossary terms

MediumAgenticLong-Term Bias AccumulationRealized

Persistent Bias Drift

Memory & Knowledge Governance

Description

Agent bias accumulates through persistent memory. Biases encoded in memory compound over time; especially problematic in agents that learn from interactions and write back to memory stores.

Example scenario

HR agent's memory accumulates screening patterns that systematically disadvantage candidates from certain universities over time.

Real-world evidenceRealized

Differential model accuracy across demographic groups has been confirmed in multiple production deployments, including commercial facial recognition systems and automated hiring tools. Regulatory investigations and academic audits have documented measurable performance gaps along race and gender lines in live systems.

Primary mitigations

  • Regular bias audits on memory contents
  • bias detection in memory writes
  • memory content diversity monitoring
  • periodic memory sanitisation.

Detection signals

Persistent Bias Drift Score; bias magnitude over time; demographic parity metrics in agent decisions.

Mitigating controls

3
Dual coverage

Related risks in Memory & Knowledge Governance