Search the Atlas

Search risks, controls, and glossary terms

MediumResource ExhaustionRealized

Unbounded consumption / denial-of-wallet

Security & Robustness

Description

Uncontrolled or adversarial usage drives runaway inference cost or service denial.

Example scenario

An attacker scripts expensive long-context queries, spiking the bank's inference bill and degrading service.

Real-world evidenceRealized

The PyTorch torchtriton supply-chain attack (December 2022) introduced malicious code via a PyPI dependency used in AI pipelines, affecting real developer environments. Separately, researchers and security firms documented malicious model files uploaded to Hugging Face Hub in 2023–2024 that executed arbitrary code on load, constituting confirmed production supply-chain compromises in AI infrastructure.

Primary mitigations

  • Rate/quota limits
  • token budgets
  • cost alerts
  • abuse detection
  • autoscaling guards.

Detection signals

Cost-spike alerts; per-user usage monitoring; abuse-pattern detection.

Mitigating controls

9
Non-agentic controls

Related risks in Security & Robustness