Catching the Hallucinated Claim
An L&D manager is doing the quarterly compliance refresh, and the AI-assisted draft is almost perfect. One sentence reads: "Employees must report a data breach to the privacy office within 72 hours." It is fluent, it is formatted like every other line, and it is wrong. The company's policy says 24 hours, not 72. The model borrowed the famous GDPR figure from its training data and dropped it into a module that 2,800 people will treat as the rule. Nobody flagged it, because nothing about the sentence looks wrong. That is the entire problem with a hallucinated claim, and learning to catch it is the single habit that separates an AI-assisted designer from a liability generator.
Why the Wrong Claim Looks Exactly Like the Right One
The previous lesson taught you to ground a draft so that claims trace to a source. This lesson is about the claims that slip through anyway, the ones that survived grounding, sailed past a tired reviewer, or got added in a later revision. Because here is the uncomfortable truth: grounding reduces hallucination, but it does not eliminate it, and no prompt ever will. A hallucination is a fluent, confident statement the model produces that is not true, not because the model is broken but because a language model generates the most plausible next words rather than the most accurate ones. Plausible and accurate usually overlap. The danger lives entirely in the gap where they do not.
Understand the mechanism and the verification habit becomes obvious. The model has read, in training, thousands of documents that say "72 hours" near the words "data breach" and "report," because GDPR's 72-hour rule is one of the most repeated facts in the privacy literature. When your draft needs a breach-reporting deadline, the model reaches for the deadline that is most statistically associated with those words, not the one in your policy. It is not guessing wildly. It is producing the single most probable wrong answer, which is far more dangerous than a random one, because the most probable wrong answer is the one that looks most right. A reviewer scanning for obvious errors finds nothing, because a hallucination is engineered, by its very nature, to not look like an error.
This is why "it reads fine" is worthless as a verification standard. Of course it reads fine. Reading fine is what the model optimizes for. The only standard that survives contact with a hallucination is "it matches the approved source," checked claim by claim, against the document, with your finger on the line. There is no shortcut, no tell in the prose, no confidence cue you can trust. The fluent sentence and the fabricated sentence are written by the same process and look the same on the screen.
It is worth naming the cognitive trap here, because it is the reason good designers ship bad claims. When you read your own draft, you are not reading it cold; you are reading it against the version in your head, and the model has written something that matches the shape of what you expected. A breach-reporting line is supposed to have a number of hours in it. The draft has a number of hours in it. Your brain registers "correct shape" and moves on, and the actual value, the only part that matters, never gets checked against anything external. This is the same reason proofreading your own writing is so hard: you see what you meant, not what is on the page. The verification routine works precisely because it refuses to engage your sense of whether the sentence looks right. It forces an external comparison, claim to source, that bypasses the pattern-matching your brain wants to do instead.
A hallucination is not a typo you can spot by reading carefully. It is a confident lie engineered to look exactly like the truth, and the only thing that exposes it is the source.
The Four Claim Types That Hurt You Most
Not every sentence in a module needs the same scrutiny. A verification routine that treats all text equally either wastes your time on harmless prose or, worse, dilutes your attention so the dangerous claims get the same glance as the safe ones. The skill is knowing which claims are load-bearing, the ones where being wrong has a real consequence, and aiming your verification there. Four types of claim do almost all the damage in learning content.
Thresholds and Numbers
Any number that triggers an action or a judgment: a reporting deadline, a dollar approval limit, a temperature, a dosage, a tolerance, a retention period, a pass score. These are the most dangerous because they are the most precise, the most consequential, and the most likely to be borrowed from a famous default. The 72-hour breach window, a "two signatures above 50,000 dollars" approval rule, a 90-day password cycle the company retired, all are numbers the model can supply with total confidence and zero connection to your policy. Every number that drives behavior is guilty until proven sourced.
Procedures and Step Order
Any sequence where order matters: a lockout/tagout procedure, an emergency shutdown, an escalation path, the steps to handle a customer-data request. Hallucination here is especially vicious because the steps can all be individually correct while the order is reversed, and a reversed safety step is the kind that hurts someone at a live panel. The model knows what the steps are; it does not know that in your plant step three comes before step two. Verify the sequence against the SOP, not just the presence of the steps.
Citations and References
Any reference to a named authority: a regulation clause, a standard, a statute, an internal policy section, a study. Models invent citations with alarming fluency, producing a regulation subsection that sounds real, a standard number that does not exist, or a study with a plausible author and year that was never written. A fabricated citation is doubly dangerous because it lends false authority to whatever claim it supports. If a draft cites "Section 12.4(b)," your job is to open Section 12.4(b) and confirm it exists and says what the draft claims it says.
Definitions and Policy Language
Any place the exact wording carries legal or operational weight: the definition of a reportable incident, the line between acceptable and prohibited conduct, the scope of a policy. The model will paraphrase, and a paraphrase of a legal definition is a different definition. "Promptly" is not "within 24 hours." "Sensitive data" is not "personal data." When wording is the substance, the draft must carry the source's wording, not the model's smoother version. This one is sneaky because the model's paraphrase is usually clearer and easier to learn from than the legal original, which makes it tempting to keep. Resist the temptation on anything where the precise scope matters; a more readable definition that quietly widens or narrows what counts as a reportable incident is not an improvement, it is a new policy you just invented. If the clarity genuinely helps, teach the plain-language version alongside the verbatim source language, never instead of it.
The Verification Routine
Catching hallucinations is not a feeling or a talent. It is a routine, a repeatable sequence you run the same way every time so that nothing load-bearing reaches a learner unchecked. A routine beats vigilance, because vigilance fades on screen 31 of a 40-screen module and a routine does not. Here is the routine, and the discipline is in running all of it, every time, not in running it well once.
| Step | What you do | What it catches |
|---|---|---|
| 1. Extract the claims | List every load-bearing claim: numbers, steps, citations, definitions. | Forces you to separate consequential claims from harmless prose. |
| 2. Source each one | For each claim, find the exact line in the approved source that backs it. | Exposes any claim with no source: the prime hallucination suspect. |
| 3. Match the content | Confirm the source line actually says what the claim says, not just that it exists. | Catches a real citation attached to a fabricated value. |
| 4. Check the version | Confirm the source is the current approved version. | Catches a correctly retrieved but stale fact. |
| 5. Resolve or escalate | Fix from source, or send unsourced and conflicting claims to the SME. | Ensures no load-bearing claim ships unverified. |
A word on why this is a routine and not a checklist you eyeball. A checklist you read is itself subject to the glance problem: you can tick "verified" while having only confirmed the claim looks right. The five steps are written as physical actions, extract, find the line, compare the words, check the date, resolve, precisely because each one forces you to touch the source rather than consult your memory. The moment any step becomes "confirm it seems correct" instead of "open the document and compare," the routine has quietly turned back into the glance, and the glance is what ships the 72-hour deadline. Run the steps as actions on the source, every load-bearing claim, every time.
Notice that step 3 is the one that catches the cleverest failures. A draft can pass a lazy check by citing a real section while quoting a value that section never contained. "Per Section 7.4, report within 72 hours" looks grounded; it has a citation. But if you actually open Section 7.4 and it says 24 hours, the citation was real and the claim was fabricated, the worst kind of hallucination because it wears the costume of provenance. The routine does not let you stop at "is there a citation." It makes you stop at "does the cited source say this." That single discipline catches the hallucination that has fooled the most reviewers.
Make the Model Help, Without Trusting It
You can use AI to accelerate the routine itself, as long as you never let it be the verification. Ask the model to extract every numeric claim, every procedure step, and every citation from its own draft and list them in a table, so you are not hunting for the load-bearing claims by eye. Ask it to flag any claim it cannot tie to the supplied source. This is genuinely useful: the model is good at finding and listing claims, which is a classification job, not a generation job. But the listing is a worklist, not a verdict. The human still opens the source and confirms each one, because asking a model to check its own hallucinations is asking the same plausibility engine that produced the lie to certify it, and it will, with the same confidence. The model builds the checklist. You sign it.
A Worked Example: The 72-Hour Trap
Return to the breach-reporting sentence and watch the routine work.
Before (the glance). The L&D manager reads the draft top to bottom. It is well written and consistent. The breach-reporting line, "report within 72 hours," reads exactly like a real requirement, because it is a real requirement, just not this company's. She nods, approves, and ships. Three months later the privacy office discovers employees waiting up to 72 hours to report breaches that policy required within 24, and a near-miss becomes a reportable failure because the official training told people the wrong deadline. The post-incident question is brutal: "the mandatory training said 72 hours; where did that come from?" The answer, "the AI drafted it and it looked right," ends the conversation and starts a different one.
After (the routine). She runs the routine instead of reading. Step 1: she extracts the load-bearing claims and finds the breach-reporting deadline among them. Step 2: she goes to source it and notices it is a number that drives action, exactly the type that gets borrowed. Step 3: she opens the company privacy policy and finds the breach-reporting requirement: 24 hours. The draft says 72. The mismatch is immediate and unmissable, not because she read more carefully, but because she compared to the source instead of to her sense of plausibility. She corrects it to 24, traces it to the policy section, and moves on. The whole catch took ninety seconds, and it prevented an incident, an audit finding, and a quarter of confused employees. The difference between the two versions was not skill or attention. It was whether she checked the sentence against the document or against her gut.
This is the lesson in one scene. The hallucinated claim did not announce itself. It could not be caught by reading, by being smart, or by trusting a well-formatted draft. It could only be caught by the boring, repeatable act of putting the claim next to the source and confirming they match. That boring act is the single most valuable habit in AI-assisted learning design.
The Habit That Keeps an Invented Policy Out of a Live Module
The bright-line rule of this program states it without softening: AI does not author a regulated or safety claim that ships unverified, and every compliance, safety, or policy statement traces to a human-approved source of truth, full stop. Catching the hallucinated claim is how that rule is honored at the level of a single sentence. It is not a one-time review you do at the end. It is a habit you apply to every load-bearing claim, every time, treating each number, step, citation, and definition as guilty until the source proves it innocent.
The discipline scales down and up. On a single module it is the routine above. On a function, it becomes a verification checklist every AI-assisted build must clear before sign-off, with the load-bearing claims extracted, sourced, and matched, and the gaps escalated to the SME. Either way the principle is the same: the fluency of the draft earns it nothing. A claim is a suspect until the source clears it, and "the AI wrote it and it looked right" is the sentence that you exist to make sure no one ever has to say after an incident. The model can write the claim in a second. Only you can clear it, and clearing it, claim by claim against the source, is the job.
One last reframe to carry out of this lesson. New AI-assisted designers tend to think of verification as the tax they pay for using AI, the slow, annoying part that eats into the speed the tool gave them. That framing is backwards and it is dangerous, because a tax is something you minimize, and a designer who minimizes verification is a designer who will eventually ship a 72-hour deadline. The accurate framing is that verification is the value. Drafting is now cheap; anyone with a login can generate a confident, plausible, possibly-wrong module in two minutes. What is scarce, and what your organization is actually paying you for, is the judgment that a claim has been checked against an approved source and can be defended. The model produces volume. You produce trust. The day you internalize that the checking is the job and the drafting is just the raw material, you have made the leap the Bersin disruption rewards, from a person who makes content to a person who can stand behind it.
Key Takeaways
- A hallucination is a fluent, confident statement that is not true, produced because the model generates the most plausible next words, not the most accurate ones; plausible and accurate diverge exactly where the danger lives.
- The most probable wrong answer is more dangerous than a random one, because it looks the most right; "it reads fine" is worthless as a verification standard since reading fine is what the model optimizes for.
- Four claim types do almost all the damage: thresholds and numbers, procedures and step order, citations and references, and definitions and policy language. Aim verification at these load-bearing claims.
- The verification routine is extract the claims, source each one, match the content to the cited line, check the version, then resolve or escalate; a routine beats vigilance because vigilance fades and a routine does not.
- The cleverest hallucination wears a real citation while quoting a value the source never contained, so never stop at "is there a citation," always confirm "does the cited source say this."
- You can use the model to extract and list load-bearing claims, but never to verify them, because asking the plausibility engine to certify its own lie returns the same confident error.
- The 72-hour breach trap shows the habit: the wrong claim was caught not by reading more carefully but by comparing the sentence to the document instead of to a sense of plausibility.
- The bright-line rule holds at the sentence level: every regulated claim is guilty until the source proves it innocent, and "the AI wrote it and it looked right" is the sentence this habit exists to prevent.
Skill.re