Search the Atlas

Search risks, controls, and glossary terms

HighAgenticData Exfiltration via ToolsRealized

Sensitive Payload Leakage

Tool & Affordance Risk

Description

Agent leaks sensitive data through tool invocations, API calls, or external service interactions. Intentional or unintentional transmission of confidential data through legitimate-appearing tool interfaces.

Example scenario

Agent includes full customer PII in API call parameters to an analytics service that logs all requests.

Real-world evidenceRealized

Confirmed production cases exist where users interacted with AI systems without any disclosure of their non-human nature, and courts have held companies accountable for the harm caused. Regulatory bodies including the FTC have cited undisclosed AI interactions as a deceptive practice in active enforcement actions.

Primary mitigations

  • Data sensitivity classification
  • egress monitoring on tool calls
  • PII detection in outbound payloads
  • data minimisation in tool parameters.

Detection signals

Sensitive Payload Leakage Rate; PII detection in tool-call parameters.

Mitigating controls

4
Dual coverage

Related risks in Tool & Affordance Risk