Search the Atlas

Search risks, controls, and glossary terms

HighSupply ChainDemonstrated

Supply-chain compromise (model/fine-tune/library)

Security & Robustness

Description

Compromised base models, fine-tunes, datasets, or libraries introduce hidden malicious behaviour.

Example scenario

A popular open model on a hub contains a backdoor; the bank adopts it without verification.

Real-world evidenceDemonstrated

BadNets (2017) and a large body of neural-trojan literature demonstrate trigger-based backdoor activation in computer vision and NLP models under controlled conditions. There is no publicly confirmed production deployment where a backdoor trigger was activated against a real financial AI system.

Primary mitigations

  • Model SBOM
  • signed/verified models
  • vendor attestations
  • dependency scanning
  • sandboxed evaluation before adoption.

Detection signals

Model integrity verification; dependency vulnerability scans; provenance checks.

Mitigating controls

7
Non-agentic controls

Related risks in Security & Robustness