ISACA Chennai Chapter · AI Security · BFSI AI Governance · Workshop Recap
ISACA Chennai 2026: What 60 Risk Officers and Auditors Learned in the AI Guardrails Lab
Zytra ran Workshop 2 (ASSURE) at the ISACA Chennai Conference 2026 — a hands-on AI Guardrails Lab designed for CISOs, model risk officers, and auditors working in BFSI. Here's what the room discovered about prompt injection, RBI compliance gaps, and what it actually takes to build a guardrail that holds in production.
📍
ISACA Chennai Conference 2026 · Workshop 2: ASSURE — AI Guardrails Lab · Chennai, Tamil Nadu
Most AI governance conversations in BFSI stay at the policy level: frameworks, controls, audit checklists. The ASSURE workshop at ISACA Chennai 2026 started from the opposite end. Every participant saw a live prompt injection attack on a banking chatbot, ran an adversarial prompt against a loan document extraction pipeline, and had to explain, in front of the room, why the guardrail they designed didn't catch it.
The point wasn't to be adversarial. It was to build the intuition that risk officers and auditors need when they're reviewing AI deployments: what does a guardrail that actually works look like, and how do you tell the difference between a system that is genuinely protected and one that looks protected on paper?
Who Was in the Room
CISOs
Banking & NBFC
Model Risk Officers
HFCs & PSU Banks
IT Auditors
BFSI
Compliance Officers
Private Banks
AI/ML Engineers
BFSI Technology
Risk Committee Members
Regional Banks
Most attendees were not AI engineers. The majority were risk and audit professionals who are now responsible for overseeing AI systems they didn't build — a function that RBI's AI/ML Circular has made explicit and mandatory.
The Workshop Structure: Four Modules
01
Threat landscape: what attacks look like in BFSI AI
Live demonstration of five attack categories against a simulated BFSI chatbot: prompt injection, indirect injection via RAG retrieval, PII exfiltration, jailbreak attempts targeting financial advice constraints, and system prompt extraction. The point: these aren't theoretical attacks. They work on production-like systems today, and they look different from traditional cybersecurity threats — detection requires BFSI-specific classifiers, not generic content filters.
02
Guardrail design: the three levers that actually matter
Participants worked in groups to design guardrails for a loan document extraction pipeline. The three design levers — coverage (what fraction of the risk surface does the guardrail cover?), false-positive rate (how often does it block legitimate requests?), and latency (can it run in-line without degrading UX?) — turned out to be tighter constraints than most participants expected. A guardrail with 95% coverage at 0.5% FPR at 11.6ms is a very different engineering problem from one that simply blocks "bad-looking" inputs.
03
RBI compliance mapping: what the circular actually requires
Walk-through of RBI's AI/ML Circular (January 2025) and draft eMRM framework (June 2026), focused on what AI security controls are needed to satisfy the specific obligations. The gap most participants hadn't seen before: RBI requires evidence that controls functioned — not just that controls were designed. A guardrail architecture document satisfies the design obligation. A tamper-evident audit log of guardrail events, hash-chained and exportable, satisfies the evidence obligation.
04
Red-team exercise: break your own guardrail
Each group attempted to bypass the guardrail they designed in Module 2. The exercise was intentionally humbling: most guardrails that looked solid in design had at least one bypass route that their designers hadn't anticipated. The goal wasn't to prove that guardrails can be defeated — it was to show what adversarial testing before deployment looks like, and why external red-teaming against a BFSI benchmark (like FinProof) produces more reliable results than internal testing against the team's own assumptions.
Key Takeaways From the Room
- Most BFSI AI deployments have monitoring but not guardrails — they detect problems after the fact, not prevent them at inference time. Monitoring satisfies logging requirements; guardrails satisfy control requirements.
- The false-positive rate is a governance problem, not just an engineering problem. A guardrail that fires on 10% of legitimate transactions creates regulatory risk (discrimination, service denial) that may exceed the risk it was designed to reduce. The 0.5% FPR bar exists for a reason.
- RAG pipelines are a specific attack surface most teams hadn't evaluated. Indirect prompt injection — where malicious instructions are embedded in documents that the RAG retriever returns — bypasses most input-side guardrails entirely. Output-side classification is the only reliable defense.
- Vendor AI is your risk, not the vendor's. Every participant who managed a vendor-supplied AI system was responsible for its compliance under RBI's framework. Vendor attestations and SOC 2 reports do not satisfy independent validation requirements.
- Audit evidence is not the same as audit documentation. A policy document and an architecture diagram are documentation. A hash-chained log of every guardrail event, with the specific classification, the input hash, and the timestamp, is evidence. Regulators are starting to ask for the latter.
"The room shifted in Module 3. When we mapped the eMRM requirements to specific evidence types, people realized they had the documentation but not the evidence. That's a gap most participants hadn't articulated before the workshop, but they're now responsible for closing it."
— Workshop facilitator, Zytra TechnologiesThe Benchmark Question
One of the most common questions from auditors and risk officers: how do you evaluate whether a BFSI AI guardrail is actually good? Not: does it have a policy document? Not: has it passed internal testing? But: how do you know the coverage and false-positive rate claims are accurate?
The honest answer from most vendors is: you don't, unless you run it against an independent benchmark. The FinProof benchmark — Zytra's open BFSI AI safety evaluation suite — exists to address this gap. FinProof tests guardrails against 13 adversarial attack categories drawn from BFSI-specific threat data, with reproducible test methodology that any organization can run. The leaderboard publishes results for any system submitted for evaluation.
For auditors reviewing AI guardrail claims: FinProof results are a more reliable signal than vendor-provided test reports. Independent benchmark performance is harder to inflate than internal testing results.
What Participants Left With
Every participant received a copy of the ASSURE framework — a four-question checklist for evaluating any BFSI AI deployment from a security and governance standpoint:
- Coverage: Does this deployment have a guardrail that covers its full risk surface — including RAG retrieval outputs and agentic tool calls — or only direct user inputs?
- Evidence: Is there a tamper-evident audit log of guardrail events that can be exported for RBI examination, or only internal monitoring dashboards?
- FPR: What is the documented false-positive rate, and has it been validated against BFSI-relevant legitimate traffic (not just adversarial test sets)?
- Red-teaming: Has the guardrail been red-teamed against BFSI-specific adversarial prompts, either internally or via an independent benchmark?
These four questions fit on a single page in an audit workpaper. They also map directly to the control evidence requirements in RBI's eMRM framework. A BFSI AI deployment that can answer all four with documented evidence is in a substantially better position than one that can only point to vendor documentation.
About ISACA Chennai Chapter
ISACA Chennai Chapter connects IT audit, risk, and security professionals in Tamil Nadu and the surrounding region. The Chapter's annual conference brings together practitioners from banking, financial services, insurance, and technology — with a focus on practical, exam-relevant content for CISA, CISM, CRISC, and CGEIT certification holders. For more information about ISACA Chennai events and membership: ISACA Chennai Chapter.
Zytra is available to facilitate ASSURE workshops for ISACA chapters, banking associations, and regulatory training programs across India. If your organization is interested in hosting a BFSI AI guardrails lab, contact us.
Related
Further reading
Platform
Aval — AI Safety Guardrails for Banking
22 BFSI threat categories, 0.5% FPR, 11.6ms. Purpose-built for regulated deployments.
BenchmarkFinProof — BFSI AI Safety Benchmark
Open benchmark for BFSI AI guardrail evaluation. Leaderboard, methodology, reproducible results.
India ComplianceRBI, SEBI & DPDP Compliance
Clause-mapped to RBI eMRM, SEBI Algo-AI Guidelines, and DPDP Act 2023.
Red-teamingBFSI AI Red-Teaming
Adversarial evaluation against FinProof benchmark. B-01 through B-13 attack categories.