AI-Assisted Needs and Task Analysis
It is a Monday, and an instructional designer has 14 stakeholder interviews, a 60-page operations manual, three Slack export files, and a ticket from the head of sales that says "build us onboarding training, the new reps are ramping too slowly." She pastes all of it into an AI tool and asks for an analysis. Ninety seconds later she has a crisp, confident document: five themes, a tidy task list, a recommended curriculum. It reads like a senior consultant wrote it. And buried on page two is a "finding" that nobody ever said, a performance gap the data does not support, stated with the same calm authority as the eleven findings that are real. If she trusts the document, she will build a course to close a gap that does not exist. This lesson is about turning that 90-second output into a structured analysis she verifies, not a confident guess she trusts.
The Analysis Is the Foundation, and AI Makes It Fast, Not True
Every defensible course rests on an analysis. Before a single objective is written, before a storyboard exists, someone has to answer a deceptively hard question: what do these people actually need to be able to do differently, and is training even the right fix? In instructional design this front-end work has a name. Needs analysis is the discipline of finding the real performance gap, the distance between what the workforce does today and what the business needs them to do, and confirming that the gap is caused by a lack of skill or knowledge rather than by a broken process, a missing tool, or a bad incentive. Why you care: if you skip it or get it wrong, you build a beautiful course that fixes nothing, and the metric the business cared about does not move. The CFO notices.
Sitting underneath needs analysis is its more granular cousin. Task analysis is the discipline of breaking a real job task into the ordered steps, decisions, and conditions a competent person performs, so the training teaches the actual work and not a sanitized textbook version of it. Why you care: a task analysis that misses a step, or invents one, produces a module that teaches people to do the job slightly wrong, which in a safety or compliance context is exactly the failure this whole program is built to prevent.
Here is the inversion AI forces on this work. For decades, the front-end analysis was slow and expensive precisely because synthesis is hard: reading 14 transcripts, clustering what people said, separating signal from venting, and writing it up took days. That slowness was a feature in one accidental way. It forced the designer to actually read every word. AI collapses that cost to minutes. The synthesis that took three days now takes three minutes. But the thing that made the slow version trustworthy, a human who read every line and can vouch for every claim, is exactly the thing the fast version removes. Speed did not make the analysis true. It made it fast. Truth is now a separate, deliberate act you perform on top of the speed.
AI can synthesize your interviews in three minutes. It cannot tell you which of its findings actually happened. That separation, fast synthesis and slow verification, is the entire skill.
What AI Is Actually Doing When It Analyzes Your Inputs
To verify an AI analysis you first have to know which job it did, because each job fails differently. When you paste 14 transcripts and a manual into a model and ask for a needs analysis, the model is doing three of the four AI jobs at once, blended into one smooth document.
It is doing classification when it groups scattered comments into themes: "six of these interviews mention the CRM being confusing, that is a cluster." This is the safest part, because a human can spot-check a cluster fast. It is doing retrieval, in the loose sense, when it pulls a specific quote or a specific procedure step out of the material you gave it. This is checkable, because the source is right there in your inputs. And it is doing generation when it writes the prose summary, names the gaps, and recommends a curriculum. Generation is where the danger lives, because the model will write a finding in the same confident voice whether it came from your data or from its own training-data sense of what "sales onboarding problems usually look like."
That last point is the heart of the lesson. A model trained on the whole internet has a strong prior about what a sales-onboarding needs analysis should contain. Asked to analyze your specific data, it will helpfully blend what your data actually says with what it expects such an analysis to say. The result is a document where a real, evidenced finding sits beside a plausible, invented one, in identical typeface, with identical confidence. The technical name for the invented part is hallucination: fluent, confident output that is not supported by the source. In an analysis, a hallucination does not look like an error. It looks like an insight.
The Grounding Move That Changes Everything
There is a single discipline that turns AI analysis from a guessing machine into a verifiable assistant, and it is worth stating as a rule before anything else. Grounding means forcing the model to work only from the material you provide and to attribute every claim to a specific place in that material, rather than answering from its training data. Why you care: an ungrounded analysis gives you findings you cannot trace, and a finding you cannot trace is a finding you cannot defend. A grounded analysis gives you findings with a return address.
In practice, grounding the analysis means two things you build into the prompt and the workflow. First, you tell the model explicitly that it may only use the documents you provide, and that if something is not in those documents it must say "not found in the source" rather than fill the gap. Second, and this is the move most people skip, you require the model to cite. Every theme, every gap, every recommended task must point back to which interview, which page, which line it came from. A finding with a citation is a finding you can check in 20 seconds. A finding without one is a rumor in a nice font.
A Worked Example: The Onboarding Analysis, Before and After
Return to the head of sales and the 14 interviews. Watch two versions of the same Monday.
Before (the guess you trust). The designer pastes everything in and prompts: "Analyze this and give me a needs analysis with the top performance gaps and a recommended training plan." The model returns five gaps. Four of them are real and well-evidenced. The fifth reads: "Reps lack confidence in objection-handling, particularly around pricing pushback, which is delaying deal closure." It is a beautiful sentence. It is the kind of thing sales-onboarding analyses always say. The problem is that not one of the 14 interviews mentioned objection-handling or pricing pushback. The model generated it from its prior, because that finding belongs in the genre. The designer, charmed by how senior the document sounds, builds a four-hour objection-handling module. It is excellent. It closes a gap that did not exist, while the real gap, that reps cannot find current pricing because it lives in three disconnected spreadsheets, a process problem training cannot fix, goes untouched. Ramp time does not improve. The training is judged a failure, and the designer cannot explain why, because she never knew which findings were real.
After (the analysis you verify). The same designer runs the same model with a grounded prompt: "Using only the 14 attached interview transcripts and the operations manual, identify the performance gaps the interviewees actually describe. For each gap, quote the specific lines that support it and name the interview. If a common onboarding problem is not evidenced in these documents, do not include it. Separately, flag anything that looks like a process, tool, or incentive problem rather than a skill gap." Now the document is different. It lists four evidenced gaps, each with quoted lines and an interview name she can check. The objection-handling finding does not appear, because the model was forbidden to invent it. And a new section appears at the bottom: "Possible non-training causes: multiple interviewees describe pricing information being scattered across spreadsheets, which appears to be a tooling or process issue, not a knowledge gap." That single flag is worth the entire exercise. It tells her the real bottleneck is not training at all. She spends 30 minutes verifying the four gaps against the quoted lines, confirms three, and pushes back on one where the quote did not actually support the claim. Same tool, same speed, completely different fate, because she grounded the analysis and then verified it.
The lesson is not that AI analysis is untrustworthy. It is that an ungrounded analysis is a guess wearing the costume of a finding, and a grounded, cited, verified analysis is a foundation you can build on and defend. The model did not get smarter between the two versions. The discipline around it did.
The Verification Pass: What You Actually Check
Grounding makes the analysis checkable. The verification pass is the act of actually checking it. This is the part that is now your real job, and it has a structure. Work through every finding the model produced against four questions, and treat any finding that fails as a draft, not a fact.
| Check | The question you ask of each finding | What a failure looks like |
|---|---|---|
| Provenance | Does this finding cite a specific source, and does that source actually say it? | A finding with no citation, or a citation that does not support the claim when you read it |
| Fabrication | Is this gap something the data describes, or something the model expected to find? | A plausible, genre-typical finding that appears nowhere in your inputs |
| Cause | Is this actually a skill or knowledge gap, or is it a process, tool, or incentive problem? | A "training need" that no amount of training would fix, like missing or scattered information |
| Task fidelity | For each task, are the steps complete, correctly ordered, and matching how the work is really done? | A missing step, an invented step, or a textbook order that the SME says is wrong |
The provenance and fabrication checks defend you against the invented finding. The cause check defends the business against the most expensive mistake in all of L&D: building training to fix a problem that training cannot fix. There is an old discipline behind this, the practice of asking whether a performance gap comes from a genuine lack of skill or from environmental factors like missing tools, unclear expectations, or no incentive to perform. AI is especially prone to missing this, because its training prior assumes the answer to "we have a performance problem" is "build a course." Your job is to be the person in the room who asks whether a course is even the right intervention, and a grounded analysis that surfaces non-training causes is your evidence.
The task-fidelity check is where the safety stakes live. When the analysis includes a task breakdown for a regulated or hazardous procedure, an AI that smooths a transcript into clean steps can silently drop a verification step, reorder two actions, or invent a step that "usually" appears in such procedures. A subject-matter expert, a person who actually does the job and can be named and held accountable for the procedure, has to confirm the steps against reality before they become the spine of a module. The iron rule of this program applies in full at the analysis stage, not just at content review: AI assists, the human verifies, the human owns the decision, and "the AI summarized it that way" is never a defense to a SME or an auditor.
Interviews and Documents Need Different Skepticism
The two main inputs to an analysis carry different risks, and a good verifier treats them differently. Interview transcripts are messy, contradictory, and full of opinion. When AI synthesizes them, the danger is that it resolves contradictions you needed to see, sands down a dissenting voice, or treats one loud interviewee's complaint as a workforce-wide theme. Check that the model's themes reflect how many people actually said a thing, not how strongly one person said it. A useful grounded instruction is to ask the model to report, for each theme, how many distinct interviewees support it, so a finding backed by one venting manager does not masquerade as consensus.
Documents like SOPs, manuals, and policies are the opposite. They are authoritative but easy for AI to paraphrase into subtle wrongness. When the model "summarizes" a procedure or a policy threshold from a manual, it can change a number, soften a "must" into a "should," or merge two steps. With documents, the check is exactness: does the model's version match the source word-for-word on every load-bearing fact, every threshold, every sequence. A paraphrase is fine for the narrative. It is unacceptable for the regulated claim.
The Numbers You Will Hear, and How to Treat Them
The pressure to move fast here is real and well-documented, and you will hear figures used to justify pasting everything into a model and trusting the output. Treat all of them as numbers to verify, not slogans to repeat. The Josh Bersin Company, in February 2026 research, frames AI as disrupting a corporate-learning market it sizes at roughly 400 billion dollars, and reports that about 74 percent of companies say they are not keeping up with skill demand. LinkedIn's 2025 Workplace Learning Report finds that around 71 percent of L&D professionals are already exploring, experimenting with, or integrating AI, while only about 25 percent factor it into their work routinely. The World Economic Forum's Future of Jobs 2025 projects that roughly 59 percent of the workforce will need reskilling or upskilling by 2030.
Read those numbers correctly. They establish that the demand for fast analysis is real and that most of the profession has touched AI but few operate it inside a disciplined workflow. They do not establish that an AI analysis is correct. The gap between 71 percent who have touched AI and 25 percent who use it routinely is precisely the gap this lesson closes: the difference between pasting inputs into a model and actually running a grounded, verified analysis you can defend. Every one of those figures is a number to verify against its source, not a permission slip to skip the verification pass.
Key Takeaways
- The front-end analysis is the foundation of every defensible course: needs analysis finds the real performance gap and confirms training is the right fix, and task analysis breaks the real job into accurate, ordered steps. Get it wrong and you build a course that fixes nothing.
- AI collapses the cost of synthesis from days to minutes, but speed makes the analysis fast, not true. Verification is now a separate, deliberate act you perform on top of the speed.
- When AI analyzes your inputs it blends classification (clustering themes), retrieval (pulling quotes), and generation (writing findings and recommendations), and generation is where invented findings hide in identical confident prose.
- Grounding is the move that makes analysis verifiable: force the model to use only your documents, to say "not found in the source" rather than fill gaps, and to cite every theme, gap, and task back to a specific place in the material.
- Run every finding through four checks: provenance (is it cited and does the source support it), fabrication (is it evidenced or genre-typical invention), cause (is it a skill gap or a process, tool, or incentive problem), and task fidelity (are the steps complete, ordered, and real).
- The most expensive mistake in L&D is building training to fix a problem training cannot fix; a grounded analysis that surfaces non-training causes is your protection against it, because AI's prior assumes the answer is always a course.
- Interviews and documents need different skepticism: interviews risk one loud voice becoming a false consensus, so ask how many distinct people support each theme; documents risk paraphrased wrongness, so check load-bearing facts and thresholds word-for-word.
- The iron rule holds at the analysis stage: AI assists, the human verifies, the human owns the decision, and "the AI summarized it that way" is never a defense to a SME, a compliance officer, or a CFO.
Skill.re