Search the Atlas

Search risks, controls, and glossary terms

Non-AgenticEthical Governance

Non-Maleficence

Explanation

Non-maleficence checks the ethical 'do no harm' principle directly: across the automated recommendations an AI system makes, what fraction avoid causing a harmful outcome to a customer or third party — for example a recommendation that pushes an unsuitable product, denies someone unfairly, or exposes them to financial detriment. It matters because in BFSI automated advice and decisions touch people's livelihoods, and a system that is accurate on average can still inflict concentrated harm that regulators and ethics frameworks expect institutions to actively measure and minimize. It is measured by the Harm Avoidance Score, computed as Harm Avoidance = 1 - (Count(Harmful Outcomes) / Count(Total Decisions)) for automated recommendations: one minus the proportion of decisions that led to a harmful outcome. Implement it by defining what counts as a harmful outcome with risk and compliance, instrumenting recommendation logs so each decision can later be classified as harmful or not (via complaints, redress cases, outcome reviews, or human adjudication), and aggregating the score with the supporting case evidence over RAG and Summarization and Chat flows. The threshold is a Harm Avoidance Score of 0.995, meaning fewer than 0.5% harmful outcomes; falling below it is a breach that triggers investigation into the harmful cases and remediation before the system continues issuing recommendations.

Metric calculation

Harm Avoidance = 1 – (Count (Harmful Outcomes) / Count (Total Decisions)) For automated recommendations

Risks mitigated

28
ZYR-PS-001High
Agent-Actuated Physical Damage
Physical & Scientific Risk
ZYR-PS-004Low
Research Integrity Corruption
Physical & Scientific Risk
ZYR-PS-005High
CBRN Capability Facilitation
Physical & Scientific Risk
ZYR-SE-001High
Human Oversight Erosion
Societal & Economic Risk
ZYR-SE-002High
Labour Market Disruption
Societal & Economic Risk
ZYR-SE-003Medium
Compute-Driven Carbon Footprint
Societal & Economic Risk
ZYR-SE-004High
AI-Enabled Authority Centralisation
Societal & Economic Risk
ZYR-SE-005High
AI-Generated Information Manipulation
Societal & Economic Risk
ZYR-SE-006Medium
Approval-Optimised Dishonesty
Societal & Economic Risk
ZNR-FB-001High
Discriminatory output
Fairness & Bias
ZNR-FB-002High
Representational harm & stereotyping
Fairness & Bias
ZNR-FB-003Medium
Output homogenization / monoculture
Fairness & Bias
ZNR-FB-004High
Disparate quality across languages/dialects
Fairness & Bias
ZNR-FB-005Medium
Proxy / indirect discrimination via prompt features
Fairness & Bias
ZNR-FB-006Medium
Sycophancy & preference bias
Fairness & Bias
ZNR-CS-001Medium
Toxic / hateful / harassing output
Content Safety & Integrity
ZNR-CS-002Low
Violent or self-harm content
Content Safety & Integrity
ZNR-CS-003Low
CBRN / dangerous capability uplift
Content Safety & Integrity
ZNR-CS-004Low
CSAM / NCII / obscene content
Content Safety & Integrity
ZNR-CS-005High
Misinformation / disinformation generation
Content Safety & Integrity
ZNR-CS-006Medium
IP / copyright infringement
Content Safety & Integrity
ZNR-CS-007Medium
Defamation / reputational harm
Content Safety & Integrity
ZNR-CS-008Critical
Unlicensed / unsuitable advice
Content Safety & Integrity
ZNR-SE-001High
Over-reliance / automation bias
Societal & Economic
ZNR-SE-002Medium
Workforce displacement
Societal & Economic
ZNR-SE-003Medium
Environmental / compute & energy cost
Societal & Economic
ZNR-SE-004Medium
Erosion of human skill / deskilling
Societal & Economic
ZNR-SE-005Medium
Accessibility & digital-divide exclusion
Societal & Economic