AI for Insurance Professionals
Capable · M6 · lesson 6 of 28 · queued
Preview — browse every lesson free. Enroll to mark lessons complete, open partner links and save your progress. Login & enroll →
Build a Verification Checklist for Every AI-Touched Insurance Artifact
📖
now learning

Build a Verification Checklist for Every AI-Touched Insurance Artifact

15 min

Every AI-touched insurance artifact carries the same structural risk: the output reads professional, the format conforms, and the underwriter / adjuster / producer / actuary signs without catching the missed endorsement, the fabricated case law, the wrong sublimit, or the protected-class proxy that slipped through. The verification checklist is the discipline that catches the failure mode before the artifact leaves the file. NAIC Model Bulletin §4 expects governance over AI-assisted underwriting and claims decisions; Colorado Reg 10-1-1 expects algorithm inventory; NY DFS Circular Letter 2024-7 expects proxy testing; FCRA §615 and ERISA §503 expect specific notice content; HIPAA expects PHI-environment boundaries. The verification checklist operationalizes each expectation as a per-artifact discipline that the human-on-record signs personally. This lesson walks the per-artifact verification checklists for ten core insurance artifacts - submission summary, FNOL, ROR, EUO outline, SIU referral, adverse determination, rate-filing memo, broker comparison, treaty cession, MGA bordereau - and ends each checklist with the file-note line, the prompt-log archive location, and the model-version stamp the human signs against. The lesson closes with a worked verification of an AI-produced Reservation-of-Rights letter that missed an ordinance-or-law endorsement - the specific failure mode the checklist prevents.

The Checklist as Operational Discipline

The checklist serves three purposes: (1) it catches errors before they enter the file or leave the carrier; (2) it documents human review for NAIC §4 personal-review attestation; (3) it produces a chain-of-custody record that survives examination, litigation, and rating-agency review. Each checklist closes with three documentation lines that aggregate to per-artifact governance:

File-note line. Single sentence appended to the carrier or agency file note documenting the AI assistance, the human review, and the artifact's status. Example: "AI-assisted via prompt underwriter_v3.2 (Claude 3.5 Sonnet 2026-05); verified per checklist v2.1 by [underwriter name] [date]; no defects identified; artifact released."

Prompt-log archive location. Specific path or system reference where the full prompt input, model output, and verification record are preserved. Example: "Archive: PromptLog v2.1 archive ID 2026-05-28-UW-12847; retention 7 years per carrier records-management policy."

Model-version stamp. Specific model version that generated the output. Example: "Model: claude-3.5-sonnet-2026-05; prompt registry version underwriter_v3.2; schema version policycenter_submission_v3.2."

The three lines together produce the audit-credible record. Without them, AI-assisted artifacts are operational but not audit-defensible; with them, artifacts survive examination and litigation. The carrier or agency maintains the prompt-log archive under records-management retention; mature operations integrate the archive with the policy administration system or claim system as linked records.

Checklist 1: Submission Summary

Producer-side or underwriter-side artifact integrating ACORD application data, supplemental questionnaires, SOV, loss runs into structured summary. Verification:

(1) Named insured cross-check - name in summary matches application; FEIN matches; entity type matches; address matches; (2) Classification triad - NAICS code valid and matches operations; SIC code matches; ISO General Liability Class Code matches operations; (3) Exposure base - revenue figure from application; employee count matches; payroll matches workers comp ACORD 130 if applicable; (4) Locations - count matches SOV; each location's address verified; building value matches SOV; BPP matches SOV; construction class matches application; year built matches SOV; sprinkler/alarm status matches SOV; (5) Loss runs - 5-year totals match underlying loss-run report; individual claim entries match underlying detail; closed/open status matches; (6) Appetite reference - citation to carrier's filed appetite guide section is current version; (7) Treaty considerations - single-risk limits referenced match treaty; (8) Forbidden outputs absent - no race/ethnicity/protected-class references; no fabricated form numbers; no fabricated regulatory citations.

File-note line: "Submission summary AI-assisted via prompt [version]; verified per submission-summary checklist v[X] by [name] [date]; no defects." Prompt-log archive: "[Archive path]." Model-version stamp: "[Model version]; prompt v[X]; schema v[X]."

Checklist 2: FNOL Summary

Adjuster-side artifact integrating loss notice, recorded statement, policy data into structured first-touch plan. Verification:

(1) Claim number assigned and matches carrier system; (2) Loss type characterization aligns with policy coverage scope; (3) Vehicle/property identification matches loss notice and policy; (4) Coverage form citation includes form number and edition (CA 00 01 11 20, HO 00 03 05 11, CP 00 10 10 12 as applicable); (5) Endorsement citations include form number and edition (CP 04 05 06 13 Ordinance or Law if present); (6) Policy effective/expiration dates match declarations page; (7) Coverage flags enumerated reflect actual policy provisions (not fabricated); (8) Reserves recommendation ranges within carrier-defined methodology; (9) Contact plan per-party with SLA timing aligned with claim handling manual; (10) Subrogation potential assessment supported by evidence; (11) Renewal-cycle awareness if applicable; (12) Forbidden outputs absent - no medical content disclosed beyond authorization scope; no protected-class proxies; no fabricated form numbers.

File-note line: "FNOL summary AI-assisted via prompt adjuster_v[X]; verified per FNOL checklist v[X] by [adjuster name] [date]; no defects." Prompt-log archive: "[Archive path]." Model-version stamp: "[Model version]; prompt v[X]; schema v[X]; HIPAA environment Azure OpenAI BAA confirmed."

Checklist 3: Reservation-of-Rights Letter

Adjuster-side artifact preserving carrier rights during coverage investigation. Verification:

(1) Letterhead and claim ID complete; (2) Coverage form and endorsement enumeration cites form number AND edition for each (CP 00 10 10 12, CP 04 05 06 13, CP 11 32 10 13, CP 14 12 06 07 - all relevant endorsements); (3) Investigation-status statement accurate without prejudging outcome; (4) Specific reservations anchored to policy sections with quoted language where critical; (5) Specific rights reserved enumerated rather than blanket reservation; (6) Full-policy-in-effect statement present; (7) Cooperation language consistent with carrier filed template; (8) Document-request list specific and reasonable; (9) No-waiver close present with explicit waiver-prevention language; (10) State-specific ROR requirements verified (some states require specific language); (11) Underwriter intent on coverage analysis honored (no prejudging); (12) Forbidden outputs absent - no fabricated case law; no fabricated form numbers; no coverage conclusions beyond reservation framing.

File-note line: "ROR letter AI-assisted via prompt adjuster_v[X]; verified per ROR checklist v[X] by [adjuster name] [date]; reviewed by claim manager [name] [date]; no defects." Prompt-log archive: "[Archive path]." Model-version stamp: "[Model version]; prompt v[X]; carrier ROR template v[X]."

Checklist 4: Examination-Under-Oath Outline

Claim-investigation artifact preparing structured EUO topics and document requests. Verification:

(1) Insured identification and claim ID complete; (2) Coverage form citation with edition; (3) EUO topic blocks cover claim-specific facts comprehensively; (4) Topic sequence supports investigation strategy; (5) Document request list aligned with EUO topic scope; (6) State-specific EUO requirements satisfied; (7) Carrier-counsel-coordination noted if material; (8) Outline drafted without prejudging EUO outcome; (9) Forbidden outputs absent - no fabricated regulatory citations; no protected-class probing topics; no probing beyond claim scope.

File-note line: "EUO outline AI-assisted via prompt adjuster_v[X]; verified per EUO checklist v[X] by [adjuster name] [date]; reviewed by carrier counsel [name] [date]; no defects." Prompt-log archive: "[Archive path]." Model-version stamp: "[Model version]; prompt v[X]."

Checklist 5: SIU Referral Memo

Special Investigations Unit referral identifying fraud patterns. Verification:

(1) Claim ID and insured ID complete; (2) Pattern-recognition evidence documented with specifics; (3) NAIC §4 reason codes referenced; (4) Evidence-based observations vs. unsupported speculation distinguished; (5) Prior-loss-history pattern documented if applicable; (6) Network-analysis findings if applicable (Shift Technology / ISO ClaimSearch outputs); (7) Recommended SIU action specific (full investigation / surveillance / database research / case closure); (8) Forbidden outputs absent - no race/ethnicity-based suspicion; no unverified accusations; no fabricated patterns.

File-note line: "SIU referral AI-assisted via prompt adjuster_v[X]; verified per SIU checklist v[X] by [adjuster name] [date]; SIU manager review [name] [date]; no defects." Prompt-log archive: "[Archive path]." Model-version stamp: "[Model version]; prompt v[X]."

Checklist 6: Adverse Determination Notice (ERISA §503 or FCRA §615)

Critical communication on benefit denial or adverse underwriting action. Verification:

(1) Insured/claimant identification accurate; (2) Adverse-action statement specific (decline / rate-up / counteroffer / claim denial); (3) Plan provision or policy provision citations accurate and quoted; (4) Specific reasons with evidence references - not vague boilerplate; (5) Additional information description if applicable; (6) Internal review procedure with 180-day window (ERISA) or appeal process; (7) Decision timeline with 45-day initial + 30-day extension (ERISA initial), 45-day appeal + 45-day extension; (8) Document-access rights statement; (9) Civil-action rights under ERISA §502(a) referenced for ERISA-governed plans; (10) FCRA §615 CRA identifications if FCRA applies (LexisNexis, MIB, Milliman IntelliScript, etc.) with addresses and 60-day rights; (11) No medical-information disclosure beyond authorization scope; (12) Forbidden outputs absent - no race/ethnicity references; no fabricated regulatory citations; no waiver language.

File-note line: "Adverse determination notice AI-assisted via prompt [adjuster/underwriter]_v[X]; verified per checklist v[X] by [name] [date]; reviewed by [claim manager / medical director / CCO as applicable] [date]; no defects." Prompt-log archive: "[Archive path]." Model-version stamp: "[Model version]; prompt v[X]; filed-template v[X]; HIPAA-bounded if PHI scope."

Checklist 7: Rate-Filing Memorandum (SERFF)

Actuarial artifact supporting state SERFF rate filing. Verification:

(1) SERFF tracking number and filing type accurate; (2) Effective date proposed and timely per state rules; (3) Data section - three-year experience period; carrier-specific data; ASOP 23 data-quality compliance attested; (4) Methodology section - GLM/GBM/equivalent with link function; cross-validation; out-of-sample lift; ASOP 56 modeling discipline applied; (5) Variable selection - each variable's actuarial justification documented; BISG proxy testing per NY DFS Circular Letter 2024-7; correlation thresholds documented; (6) Bias-testing exhibit - BISG-estimated demographic outcome rates; statistical significance with confidence intervals; per-variable contribution analysis; no material disparate outcomes outside actuarial variation; (7) Class plan rationale if applicable; (8) Effective date justification per state filing timing rules; (9) ASOP 41 communications and ASOP 56 modeling compliance assertions; (10) Pricing actuary signature and chief actuary concurrence; (11) Forbidden outputs absent - no fabricated bias-test results; no regulatory predictions; no fabricated industry-benchmark citations.

File-note line: "Rate-filing memo AI-assisted via prompt actuary_v[X]; verified per SERFF checklist v[X] by [pricing actuary name] [date]; chief actuary concurrence [name] [date]; no defects." Prompt-log archive: "[Archive path]." Model-version stamp: "[Model version]; prompt v[X]; ASOP citations confirmed."

Checklist 8: Broker Quote Comparison

Producer-side comparison of three-to-five carrier quotes for client decision support. Verification:

(1) Each carrier identified with rating (A.M. Best, S&P, Moody's, Fitch) and date; (2) Each quote's policy structure documented with form-edition citations; (3) Coverage limits and sublimits compared side-by-side; (4) Deductibles compared; (5) Endorsements compared with specific form numbers; (6) Premium and retention compared; (7) Coverage gaps identified explicitly (not "all terms similar" handwaves); (8) Client-facing simplification accurate (technical accuracy preserved with simplified language); (9) Recommendation rationale documented; (10) Forbidden outputs absent - no fabricated carrier ratings; no fabricated form numbers; no misrepresented coverage scope.

File-note line: "Broker quote comparison AI-assisted via prompt producer_v[X]; verified per comparison checklist v[X] by [producer name] [date]; principal review [name] [date]; no defects." Prompt-log archive: "[Archive path]." Model-version stamp: "[Model version]; prompt v[X]."

Checklist 9: Treaty Cession Recommendation

Reinsurance-side cession analysis. Verification:

(1) Submission identification complete; (2) Carrier treaty structure documented - quota share retention/cession with specific reinsurer cession (Hannover Re, Swiss Re, Munich Re consortium); XL treaty with cedent retention and ceded participants; (3) Single-risk limit referenced accurately; (4) Excess-capacity gap identified if applicable; (5) Recommended cession structure across primary/treaty/facultative; (6) Cat-exposure analysis with multi-model reconciliation (Verisk AIR + RMS + KCC) if applicable; (7) Treaty-broker engagement (Guy Carpenter / Aon Re / Howden Re / Gallagher Re); (8) Chief-underwriter approval requirement noted; (9) Forbidden outputs absent - no fabricated treaty terms; no fabricated cat-model output; no misrepresented reinsurer positioning.

File-note line: "Treaty cession recommendation AI-assisted via prompt [actuary/underwriter]_v[X]; verified per treaty checklist v[X] by [treaty actuary name] [date]; chief underwriter approval [name] [date]; no defects." Prompt-log archive: "[Archive path]." Model-version stamp: "[Model version]; prompt v[X]."

Checklist 10: MGA Bordereau

Managing General Agent reporting back to fronting carrier under delegated authority. Verification:

(1) Reporting period accurate; (2) Policy issuances enumerated with carrier-required detail; (3) Premium aggregation accurate to penny; (4) Loss reporting per policy and aggregate; (5) Reserve aggregation per fronting carrier requirement; (6) Surplus-lines tax and stamping fee aggregation if applicable; (7) Compliance with delegated authority documented (issued within authority scope); (8) Discrepancy flags surfaced; (9) Forbidden outputs absent - no underwriting decisions outside delegated authority; no fabricated policy entries; no misrepresented loss data.

File-note line: "MGA bordereau AI-assisted via prompt [producer/MGA]_v[X]; verified per bordereau checklist v[X] by [MGA underwriting director name] [date]; fronting carrier review [name] [date]; no defects." Prompt-log archive: "[Archive path]." Model-version stamp: "[Model version]; prompt v[X]."

Worked Verification: The ROR Letter That Missed Ordinance-or-Law Endorsement

A commercial property loss at a 2008-built printing facility in California. Fire damages building and BPP; investigation suggests possible building-code violation in the 2008 electrical installation (now 18 years before loss). The carrier's policy is CP 00 10 10 12 Special Form with endorsements including CP 04 05 06 13 Ordinance or Law sublimit $250K, CP 11 32 10 13 Spoilage, and CP 14 12 06 07 Equipment Breakdown. An AI-generated ROR letter is reviewed.

The AI output includes: letterhead complete; claim ID present; CP 00 10 10 12 cited; CP 11 32 10 13 Spoilage cited; CP 14 12 06 07 Equipment Breakdown cited; investigation-status statement accurate; cooperation language consistent; no-waiver close present. The letter looks professional. The defect: CP 04 05 06 13 Ordinance or Law is NOT cited in the endorsement enumeration. The defect matters because the building-code-violation aspect of the loss may invoke the ordinance-or-law sublimit; if the carrier issues an ROR without enumerating the ordinance-or-law endorsement, the carrier may have inadvertently limited its ability to invoke the endorsement's sublimit during eventual coverage determination. The omission is silent - the AI did not affirmatively misrepresent; it failed to include a relevant endorsement.

The verification checklist's Step 2 - "Coverage form and endorsement enumeration cites form number AND edition for each (CP 00 10 10 12, CP 04 05 06 13, CP 11 32 10 13, CP 14 12 06 07 - all relevant endorsements)" - catches the defect. The adjuster reviewing against the policy declarations page sees CP 04 05 06 13 listed; the AI output omits it; the checklist flag fires; the AI output is corrected before the letter issues. Without the checklist, the omission survives to issuance; subsequent coverage determination may be compromised. The verification discipline is the structural defense against this exact failure mode.

The corrected ROR letter includes the full endorsement enumeration; the file-note line documents the verification catch; the prompt-log archive includes both the AI's defective draft and the verified version; the model-version stamp identifies the prompt version that produced the defective draft (supporting prompt-refinement consideration in the next cycle).

Key Takeaways

  • The verification checklist catches errors before they enter the file or leave the carrier, documents human review for NAIC §4 personal-review attestation, and produces chain-of-custody for examination, litigation, and rating-agency review. Each artifact has its own checklist; each checklist closes with file-note line, prompt-log archive location, model-version stamp.
  • Ten core insurance artifacts each have dedicated verification checklists: submission summary, FNOL, ROR letter, EUO outline, SIU referral, adverse determination, rate-filing memo, broker quote comparison, treaty cession, MGA bordereau. Each checklist's specific verification steps reflect the artifact's specific failure modes.
  • Submission-summary verification cross-checks named insured, classification triad (NAICS + SIC + ISO GL Class Code), exposure base, locations, loss runs, appetite reference, treaty considerations against source documents. Forbidden-output verification catches protected-class proxies, fabricated form numbers, fabricated regulatory citations.
  • FNOL verification cross-checks claim ID, loss type, coverage form citations with editions (CA 00 01 11 20 / HO 00 03 05 11 / CP 00 10 10 12), endorsement citations, policy dates, coverage flags, reserves ranges, contact plan, subrogation potential, renewal-cycle awareness. HIPAA-environment confirmation included for L&H/WC/BI scope.
  • ROR verification cross-checks letterhead, coverage form and endorsement enumeration with editions (every relevant endorsement including ordinance-or-law CP 04 05 06 13), investigation-status, specific reservations, specific rights reserved, full-policy-in-effect, cooperation language, document-request list, no-waiver close. State-specific ROR requirements verified.
  • Adverse-determination verification (ERISA §503 / FCRA §615) cross-checks insured identification, adverse-action specificity, plan/policy provision citations, specific reasons with evidence, internal review procedures, decision timelines (45 days + extensions for ERISA), document-access rights, civil-action rights, FCRA CRA identifications with 60-day rights. No medical-information disclosure beyond authorization scope.
  • SERFF rate-filing verification cross-checks tracking number, effective date timing, data/methodology/variable-selection/bias-testing/class-plan/effective-date sections, ASOP 23 + 41 + 56 compliance, BISG proxy testing per NY DFS Circular Letter 2024-7, pricing-actuary signature with chief-actuary concurrence.
  • Each checklist closes with three documentation lines: file-note line (single sentence in claim or underwriting file), prompt-log archive location (specific path with retention), model-version stamp (specific model + prompt + schema versions). The three lines produce the audit-credible chain-of-custody.
  • Worked verification on AI-generated ROR letter caught omitted CP 04 05 06 13 Ordinance or Law endorsement that would have compromised eventual coverage determination on a building-code-violation loss. The checklist's Step 2 endorsement enumeration verification is the structural defense; without it, silent omissions survive to issuance.