Search the Atlas

Search risks, controls, and glossary terms

HighProvenanceDemonstrated

Training-data provenance & licensing gaps

Data & Input Integrity

Description

Unknown or unlicensed provenance of training data creates legal exposure and prevents defensible governance of what the model learned.

Example scenario

The bank cannot evidence the licensing basis of a third-party model's training data during a regulatory audit.

Real-world evidenceDemonstrated

Robo-advisors have drawn SEC and FINRA scrutiny for suitability failures and inadequate risk profiling, and AI chatbots such as Air Canada's were found in court to have made false policy commitments leading to financial loss. However, a documented mass-harm production incident where an LLM-based adviser systematically mis-sold regulated products at scale has not yet been publicly confirmed.

Primary mitigations

  • Data lineage records
  • licence/consent registers
  • provenance attestations from model vendors
  • SBOM-style data bills of materials.

Detection signals

Provenance-coverage metric; licence-audit exceptions; missing-lineage flags.

Mitigating controls

5
Non-agentic controls

Related risks in Data & Input Integrity