Search the Atlas

Search risks, controls, and glossary terms

HighLanguage DisparityRealized

Disparate quality across languages/dialects

Fairness & Bias

Description

Markedly worse accuracy/safety in regional languages and dialects excludes or harms non-English-dominant customers.

Example scenario

The assistant handles English well but mis-advises customers in a regional language, an inclusion/SEBI concern.

Real-world evidenceRealized

Amazon's internal AI-based recruiting tool, trained on historical hiring data, learned to penalise resumes from women — a confirmed production incident where historical bias was amplified by the model. The system was used for candidate ranking before being scrapped in 2017.

Primary mitigations

  • Multilingual evaluation
  • language-specific guardrails
  • fallback to human for low-resource languages
  • localisation testing.

Detection signals

Per-language accuracy/safety dashboards; complaint analysis by language.

Mitigating controls

7
Non-agentic controls

Related risks in Fairness & Bias