Search the Atlas

Search risks, controls, and glossary terms

MediumProxy DiscriminationDemonstrated

Proxy / indirect discrimination via prompt features

Fairness & Bias

Description

Seemingly neutral input features (pincode, language, name) act as proxies for protected attributes, producing indirect discrimination.

Example scenario

Pincode used in a prompt becomes a proxy for caste/religion, skewing eligibility language.

Real-world evidenceDemonstrated

The Gender Shades study empirically demonstrated that intersectional groups (e.g., darker-skinned women) suffered compounded error rates far exceeding single-axis assessments in commercial computer vision systems. BFSI-specific production incidents isolating intersectional blind spots as the documented cause have not been confirmed.

Primary mitigations

  • Proxy-feature analysis
  • fairness-through-awareness testing
  • feature governance
  • redaction of high-proxy inputs.

Detection signals

Proxy-correlation analysis; disparate-impact testing on neutral features.

Mitigating controls

7
Non-agentic controls

Related risks in Fairness & Bias