THE STUDIO / LIVE FIRE 03
FACILITATOR
Live Fire · Scored Drill · On the Record
THE STUDIO/LIVE FIRE 03/COMPANION TO MODULE 03 — THE RECORD

THE RECON-
STRUCTION

The examiner has arrived. The analyst left last spring, the chats were purged on schedule, and the memos cannot speak for themselves. Five claims stand before you with whatever survived around them. Find the claim the record can no longer carry — and once, defend the record that holds.

FORMAT  SCORED DRILL / RECORD FORENSICS
AUDIENCE  FIRST LINE, AUDIT, MODEL RISK, COMPLIANCE
DOCTRINE  ONLY THE RECORD SPEAKS
RUNTIME  ~25 MIN

Press → or swipe to begin. The record starts when you do.

SCENE 01/THE BRIEFING

Memory is not a record.
Eighteen months from now, nothing else speaks.

Each examination shows a memo's key claims beside an inventory of what actually survives — extracts, registries, worksheets, retention schedules. Exactly one claim per examination cannot be reproduced from the surviving record: the evidence was purged, was never captured, contradicts itself, or lived on a channel that preserved nothing. Find it. And in Examination Five, be ready to attest a record that holds.

“The work happened. The record didn't survive. Regulators priced that difference at more than two billion dollars.”Module 03 — The Record · on the off-channel communications sweep
RULE 01 — THE GAP

One irreproducible claim per examination. The other claims trace cleanly to surviving artifacts. One attempt.

RULE 02 — THE STANDARD

Reproducible means: an independent party, today, could re-derive the claim from preserved artifacts. “The analyst remembers” is not an artifact.

RULE — THE WAGER

Before lodging, stake your conviction. MEASURED: +1 right, 0 wrong. HIGH CONVICTION: +2 right, −1 wrong. The call is the skill; calibration is the discipline.

RULE — THE CHAIN

Every selection, stake, and call is timestamped and hash-chained in your browser — the append-only invariant used for agent audit trails. Your run is itself evidence.

Facilitator Note

Group format: read the claims aloud, then the record inventory. Vote on the irreproducible claim, then on the stake. The best debates start when someone says “but we know that's what happened” — that sentence is the whole reason Module 03 exists. Budget five minutes per examination.

SCENE 02/EXAMINATION ONE
ON THE CLOCK 00:00

The Vanished Chat

THE FILE — Credit memo CM-1187, approved fourteen months ago, now under thematic review. The examiner asks you to reproduce each key claim from the surviving record. One of them can no longer be carried. Find it.
MEMO CM-1187 · KEY CLAIMS vs SURVIVING RECORDT + 14 MONTHS
Record inventory — what survivesEXT-1142 archived, SHA-256 logged · CR-7 v2024.2 in registry · CC-24-011 minutes in workflow · AI assistant transcripts: retention policy 90 days — session of 14 Jan PURGED on schedule · no prompt, output, or model identifier preserved
CONVICTION —
Trace each claim to an artifact. One trace ends in air.
Facilitator Key — Examination One

Gap: Claim 3. The session was real and is gone. The repair is procedural: AI-assisted analysis that feeds a decision gets exported to the evidence store at creation, inside the memo's retention class, not the chat tool's.

Discussion: what is your chat tool's retention period, what is your credit file's, and which claims in last quarter's memos currently live in the gap between them?

SCENE 03/EXAMINATION TWO
ON THE CLOCK 00:00

The Version Ghost

THE FILE — A pricing exception memo cites a model score as its central justification. The examiner asks the simplest question in model risk: which model produced this number? One claim cannot survive the registry. Find it.
MEMO PX-0442 · KEY CLAIMS vs SURVIVING RECORDT + 18 MONTHS
Record inventory — what survivesModel registry snapshot for the memo week: SCORE-X v2.2 in production · claimed v2.3 hotfix: no deployment log entry, no validation sign-off on file · score output itself not archived — no input vector, no run ID · registry note: v2.3 entered production SIX WEEKS AFTER the memo date
CONVICTION —
The registry has a longer memory than the memo.
Facilitator Key — Examination Two

Gap: Claim 1. The registry outlived the memo and contradicts it. Repair: score outputs written to the evidence store with version, run ID, and input hash, at scoring time.

Discussion: pick any model-derived number in a live memo and ask the room to name its version and run ID from the record. Time how long it takes. That duration is your exam finding.

SCENE 04/EXAMINATION THREE
ON THE CLOCK 00:00

The Untraceable Delta

THE FILE — A provisions memo carries a headline figure of €4.1M. The surviving worksheet computes €3.8M. The examiner wants the missing €300,000 to explain itself. One claim has no lineage. Find it.
MEMO PRV-0906 · KEY CLAIMS vs SURVIVING RECORDT + 12 MONTHS
Record inventory — what survivesReconciliation report archived · WS-88 archived: base = €3.8M · committee minutes: approve €4.1M · the €0.3M “management adjustments per Finance”: referenced email thread NOT preserved (mailbox re-provisioned on leaver process) · no adjustment memo, no calculation, no named approver of the delta
CONVICTION —
A committee can approve a number. It cannot manufacture its lineage.
Facilitator Key — Examination Three

Gap: Claim 2 (the €0.3M delta). Base reproducible, approval reproducible, bridge gone. Repair: a one-page adjustment memo per overlay — basis, quantum, approver — filed in the same retention class as the provision.

Discussion: overlays are where auditors camp for a reason. Ask the room: how many adjusted figures in your last close have a standalone artifact for the adjustment?

SCENE 05/EXAMINATION FOUR
ON THE CLOCK 00:00

The Off-Channel Approval

THE FILE — A credit exception memo states its approval plainly. The examiner asks to see it. One claim lived on a channel that preserved nothing. Find it.
MEMO CX-2210 · KEY CLAIMS vs SURVIVING RECORDT + 16 MONTHS
Record inventory — what survivesWorkflow CW-8841: request logged, formal sign-off field EMPTY — status “pending” to this day · communications policy COM-2: business communications on approved, preserved channels only · WhatsApp: personal device, nothing captured, MD since departed · industry context: US regulators have levied over $2B for exactly this pattern
CONVICTION —
The workflow field is still pending. Sixteen months later.
Facilitator Key — Examination Four

Gap: Claim 4. The sweep that produced $2B+ in fines was about precisely this: real business, unpreserved channel. Repair is cultural and mechanical — approvals land in the workflow or they don't count, and everyone knows it.

Discussion: ask the room, honestly, where the last urgent approval in their business actually happened — and whether it would survive this examination.

SCENE 06/EXAMINATION FIVE
ON THE CLOCK 00:00

The Intact File

THE FILE — Internal audit has sampled an AI-assisted valuation memo and drafted a finding: “AI-assisted work is inherently unauditable; the reliance on model output cannot be evidenced.” The record inventory is below. Examine it. Then lodge what the evidence supports.
MEMO VAL-1150 · KEY CLAIMS vs SURVIVING RECORDT + 15 MONTHS
Record inventory — what survivesEvery claim maps to a preserved, independently accessible artifact · the AI session was archived at creation into the memo's retention class, not the chat tool's · chain verification of the evidence store: VALID · an independent reviewer re-derived the central estimate from archived inputs last week: matched to the euro
CONVICTION —
An examiner who cannot clear a good record cannot fault a bad one.
Facilitator Key — Examination Five

Finding: ATTEST REPRODUCIBLE. This file is the target state: AI work archived at creation, versions pinned, deltas documented, approvals on channel. The drill ends by showing the room what passing looks like.

Discussion: gap analysis, live — which of the five artifact disciplines shown here does your team already do, and which of today's four failure classes is currently sitting in your files?

SCENE 07/THE SCORE
0 / 5
PENDING
CONVICTION BOOK: 0 / 10  ·  —

Complete the five scenarios to receive your rating.

SCENE 08/THE DOCTRINE

Build work that explains itself.

Five examinations, five artifact disciplines. Carry these forward:

01

Retention clocks are evidence clocks. AI sessions that feed decisions get archived at creation, in the decision's retention class — the purge runs on schedule, the examiner doesn't.

02

Pin the version or lose the provenance. Model ID, version, run reference, input hash — or the number is an orphan in eighteen months.

03

Every delta needs lineage. Overlays are legitimate; undocumented overlays are findings. Each adjustment carries its own basis, quantum, and approver.

04

Approvals live on preserved channels or not at all. The industry paid $2B+ to learn that the work happening is not the same as the record surviving.

05

Attest the record that holds. Reproducibility is provable. An evidence culture that can only convict teaches people to stop keeping evidence.

When the examiner arrives, the chat will be gone, the analyst will have moved on, and the memo cannot speak for itself. Build the file that speaks. Run this drill with your first line and your auditors in the same room — they will disagree about Examination Five, and that disagreement is the training.

NEXT DRILL → LF-04 THE BURN← LF-02 THE OVERRIDETHE SYSTEM

THE STUDIO — LIVE FIRE 03 · COMPANION TO MODULE 03: THE RECORD

TitleGUIDED NARRATION
Copied