HighFabricated Sources◐Demonstrated
Fabricated citations & references
Model Accuracy & ReliabilityDescription
The model invents plausible-looking citations, document IDs, or regulatory references that do not exist.
Example scenario
A compliance summary cites a fabricated SEBI circular number that staff act upon.
Real-world evidence◐Demonstrated
LLM arithmetic and numerical reasoning failures are extensively documented across published benchmarks (GSM8K, MATH dataset evaluations) and red-team studies, showing consistent errors in multi-step financial arithmetic. However, a publicly confirmed production incident where an AI financial calculation error caused documented monetary loss has not been independently verified at scale.
Tested by FinProof
Document hallucination
Benchmarked by FinProof Primary mitigations
- Citation verification against the source store
- link-resolution checks
- cite-only-retrieved policy
- reject ungrounded references.
Detection signals
Citation-resolution rate; broken/invalid-reference detection; source-existence checks.
Mitigating controls
13 Non-agentic controls
ZYC-ACCU-001Non-Agentic
Lexical Similarity
Accuracy
ZYC-XAI-001Non-Agentic
Field Justification
Explainability (XAI)
ZYC-ROB-001Non-Agentic
Out-of-Distribution Detection
Robustness
ZYC-XAI-005Non-Agentic
Source Citation
Explainability (XAI)
ZYC-TRANS-006Non-Agentic
Retrieval Provenance
Transparency
ZYC-ROB-011Non-Agentic
Abstention
Robustness
ZYC-ACCU-003Non-Agentic
Lexical Similarity
Accuracy
ZYC-TRANS-004Non-Agentic
Source Traceability
Transparency
ZYC-ACCU-005Non-Agentic
Factuality
Accuracy
ZYC-ACCU-006Non-Agentic
Factuality
Accuracy
ZYC-ACCU-013Non-Agentic
Retrieval Quality
Accuracy
ZYC-ACCU-015Non-Agentic
Accuracy
Accuracy
ZYC-ROB-010Non-Agentic
Retrieval Stability
Robustness