Documentation and Competency Expectations
Two pharmacies use AI in exactly the same way, with exactly the same care. Both verify their AI-assisted prior authorizations. Both keep the clinical decision human. Both protect patient information. By every measure of actual practice, they are identical. Then a problem surfaces, an audit, a complaint, a payer review, an accreditation visit, and the two pharmacies diverge completely. The first can show precisely what it did: the verification records, the training files proving its staff were competent, the documented governance, the audit trail reconstructing exactly what the AI produced and what the human checked. The second can show nothing but its good intentions, because it did the right things and never wrote any of it down. To the auditor, the accreditor, or the court, the first pharmacy practiced responsibly and the second is indistinguishable from one that did not, even though their actual care was the same. This lesson is about the gap between doing the right thing and being able to show you did it, because in a world of AI accreditation and AI-related scrutiny, that gap is the difference between a defensible practice and an exposed one. Documentation and competency are not the boring administrative tail of AI use; they are what converts good practice into provable practice, and provable is the only kind that protects you when it counts.
Why Undocumented Good Practice Does Not Count
The hard truth at the center of this lesson is one that conscientious professionals often resist, because it feels unfair: when an external party evaluates your AI use, undocumented good practice is functionally indistinguishable from no practice at all. This is not because anyone doubts your sincerity; it is because an auditor, accreditor, or court cannot credit what cannot be shown. They were not there when you carefully verified the prior authorization, traced the clinical facts to the chart, and made a sound human decision. The only thing they can evaluate is the evidence that those things happened. If the evidence does not exist, then from their position, the careful verification and the careless rubber-stamp look exactly alike, and they are obligated to treat the unproven claim with the skepticism it warrants. The professional who finds this unfair is correct that it is unfair to the diligent; but it is the only workable standard, because the alternative, taking every pharmacy's word that it practiced well, would make oversight meaningless and would protect the careless as much as the careful.
Once you accept this, documentation stops looking like bureaucratic busywork and starts looking like what it is: the act of making your good practice visible to the people who will one day need to evaluate it. The verification you did is real, but it is also ephemeral; it happened and then it was gone, unless you captured a record of it. That record is not a separate task bolted onto the verification; it is the part of the verification that survives the moment and can speak for you later. A pharmacy that internalizes this builds the record as it does the work, not because a rule demands the paperwork, but because the pharmacy understands that work it cannot later prove is, for the purposes that matter most, work it might as well not have done. This reframing, from documentation-as-burden to documentation-as-the-durable-form-of-good-practice, is the single most useful shift this lesson offers.
To an external evaluator, undocumented good practice is indistinguishable from no practice. Documentation is not busywork; it is the part of good practice that survives the moment and can speak for you later.
What AI Documentation Actually Looks Like
Documentation can sound abstract, so it helps to name what it concretely consists of in an AI-using pharmacy, because the specifics make it manageable rather than daunting. The first kind is the verification record: evidence that AI output touching a clinical decision was checked by a human before it took effect. For a prior-authorization workflow, this means a record that the clinical facts were verified against the chart and the criteria against the payer rules, with the verifier identifiable. This is the documentary form of the cardinal rule, the proof that the human decision point was real rather than a rubber stamp. The second kind is the audit trail: a record sufficient to reconstruct an AI-assisted event later, what the AI produced, what data it used, who reviewed it, and what was decided. The audit trail is what lets someone six months later answer the question "what actually happened here," which is exactly the question asked when something goes wrong.
The third kind is governance documentation: the policies, roles, and decisions that show the pharmacy has deliberately decided how AI is used and overseen, rather than leaving it to chance. The fourth, and the focus of the competency half of this lesson, is the training and competency record: evidence that the people using AI were prepared to use it responsibly. None of these need to be elaborate to be effective; the goal is not maximal paperwork but sufficient evidence, a record clear enough that an external party could look at it and see that the right things happened. A pharmacy that builds these four kinds of documentation, proportionate to the stakes of each AI use, has converted its good practice into the demonstrable form that accreditation, board review, and legal defense all require. It is worth noticing that these four kinds of documentation are not separate inventions; they fall naturally out of practices the program already teaches. The verification record is simply the act of capturing the verification you were already doing. The audit trail is the natural exhaust of a well-designed workflow. The governance documentation records decisions a thoughtful pharmacy was going to make anyway. And the competency records track training a responsible pharmacy was going to provide regardless. Documentation, properly understood, is rarely extra work invented to satisfy an evaluator; it is the durable record of good work the pharmacy was already doing, captured rather than allowed to evaporate. The later levels of this program develop each of these in operational depth; the awareness to carry now is simply that they exist, that they matter, and that they are built as the work is done rather than reconstructed under pressure afterward. One clarification prevents a common misunderstanding: documentation does not mean writing a lengthy narrative about every AI interaction, which would be both impossible at volume and unnecessary. In a well-designed system, much of the documentation is captured automatically as a byproduct of the workflow, the system logs what the AI produced and who approved it, so the human's deliberate effort is small and the record accumulates on its own. The pharmacist's job is less to write documentation than to work within systems that capture it and to ensure that the capture is happening for the uses that matter. This is why documentation, done well, is not the time sink pharmacists fear; the heavy lifting is in designing the workflow so the evidence is produced as a natural consequence of doing the work, which is a design problem the later levels address, not a daily writing burden on the individual.
The Competency Half: Proving People Can Use the Tools
The competency expectation is the second pillar, and it answers a question that AI accreditation and responsible practice both ask directly: how do you know the people using these tools are competent to use them? It is not enough for a pharmacy to have good tools and good policies if the individuals operating the tools do not understand them well enough to use them safely. A pharmacist who does not grasp that a generative model hallucinates will not verify its output with appropriate skepticism. A technician who does not understand the cardinal rule may treat an AI suggestion as a decision. The danger here is specific and worth naming: an incompetent user of a good tool can be more dangerous than no tool at all, because the tool's fluent, confident output gives a false sense of reliability that an unprepared user has no defense against. A pharmacy that deploys a capable AI tool to staff who do not understand its failure modes has not added a safety layer; it has added a confident, plausible source of potential error in the hands of people who do not know to distrust it, which is arguably worse than the manual process it replaced. This is why competency is not a nice-to-have alongside the tools but a precondition for deploying them safely at all. Competency is the human foundation that the verification discipline rests on, and an organization serious about AI safety must ensure, and be able to show, that its people have it.
This is where a program like this one connects directly to the accreditation and governance landscape, because completing a structured, role-grounded AI program is, quite literally, the kind of competency development that the expectation calls for. The expectation has two parts: that the competency is real, the staff genuinely understand the tools and the discipline, and that it is documented, the pharmacy can show who was trained, on what, and when. A pharmacy that trains its people through a genuine curriculum and keeps the records of that training is building exactly what the competency expectation requires: a workforce that is demonstrably prepared, not just assumed to be. This is also why competency is not a one-time event but an ongoing expectation; as tools and risks evolve, competency has to be maintained, which means training and its documentation are a continuing practice rather than a box checked once. The pharmacy that treats staff AI competency as a living, documented program, rather than a one-off orientation, is the one that can answer the competency question with evidence rather than assurance, which is the only answer that counts when an accreditor or a board is asking.
Proportionate, Not Maximal: Documenting Without Drowning
A reasonable fear about documentation is that it becomes a crushing burden, a pharmacy so busy recording its work that it has no time to do the work, and addressing that fear directly is important because the fear, left unaddressed, drives pharmacies to document nothing rather than risk documenting everything. The resolution is the same calibration principle that governed the operational-AI lesson: documentation should be proportionate to the stakes of the AI use, not uniform and maximal. A high-stakes clinical use, an AI-assisted prior authorization, an AI-supported verification, warrants a real verification record and an audit trail, because that is exactly the use whose soundness someone may later need to reconstruct. A low-stakes operational use, an inventory forecast, warrants far lighter documentation, because the consequence of an unprovable forecast is a recoverable business question, not a patient-safety or accreditation exposure.
This calibration keeps documentation sustainable. The goal is not to generate the maximum possible paper trail; it is to ensure that for each AI use, there is sufficient evidence that the right things happened, proportionate to what is at stake if they did not. A pharmacy that documents its high-stakes clinical AI thoroughly and its low-stakes operational AI lightly is spending its documentation effort where it matters, exactly as it spends its verification effort where it matters, and the two calibrations align: the uses that deserve the most verification are the same uses that deserve the most documentation, because both are driven by the same question of whether a patient is downstream of an error. A pharmacy that understands this does not experience documentation as an undifferentiated burden but as a targeted investment, heaviest where the stakes are highest, light where they are low, which is both sustainable and exactly what an external evaluator would consider reasonable and sufficient.
Building the Habit Early, While the Stakes Are Low
The practical wisdom this lesson points toward is to build the documentation and competency habits now, at the awareness stage, rather than waiting until an accreditation deadline or an incident forces them, because habits built under pressure are built badly and habits built calmly become second nature. A pharmacy that begins documenting its AI verification and tracking its staff competency early, even before any external party requires it, accrues two advantages. The first is readiness: when the accreditation, the audit, or the incident comes, the evidence already exists and does not have to be frantically reconstructed, often imperfectly, from memory and partial records. The second, subtler advantage is that the act of documenting improves the practice itself; a pharmacy that knows it is recording its verification tends to verify more consistently, and a pharmacy that tracks competency tends to actually ensure its people are competent, because the documentation creates a feedback loop that the good intention alone does not.
This is the note on which the first level of this program closes its treatment of governance, and it sets up everything that follows. The verification workflows of the middle levels will each produce documentation as a natural byproduct. The governance work of the upper levels is, in large part, the work of building the documentation and competency systems at organizational scale. And the accreditation that the program prepares a pharmacy to pursue is, fundamentally, an external party asking to see exactly the documentation and competency evidence this lesson has described. So the awareness to carry forward is both simple and load-bearing: doing the right thing with AI is necessary but not sufficient; you must also be able to show that you did, through documentation built as the work happens and competency developed and recorded as an ongoing practice. The pharmacy that holds both, the good practice and the proof of it, is the one that is not only safe but demonstrably safe, which in a world of AI accreditation and scrutiny is the position worth occupying. This lesson also closes the loop on the regulatory chapter as a whole: the board guidance pointed to obligations that already apply, the URAC accreditation turns those obligations into something a pharmacy must demonstrate, the HIPAA duty protects the patient's information through it all, and documentation and competency are the means by which all of it becomes provable. Awareness of that whole picture is the exit state of this chapter, and it is what lets a pharmacist move into the hands-on levels understanding not just how to use AI, but how to use it in a way that is accountable, governed, safe, and demonstrable, which is the only kind of AI use a serious pharmacy should be building.
Key Takeaways
- There is a critical gap between doing the right thing with AI and being able to show you did it; to an external evaluator (auditor, accreditor, court), undocumented good practice is functionally indistinguishable from no practice, because they can only credit what can be shown.
- This standard feels unfair to the diligent but is the only workable one, since taking every pharmacy's word would make oversight meaningless and protect the careless as much as the careful.
- Documentation is not bureaucratic busywork; it is the part of good practice that survives the moment and can speak for you later, so it should be built as the work is done rather than reconstructed under pressure.
- AI documentation concretely consists of verification records (proof the human decision point was real), audit trails (enough to reconstruct an event later), governance documentation (deliberate decisions about AI use), and training and competency records.
- The competency expectation asks how you know the people using the tools are competent; verification discipline rests on a human foundation, so an organization must ensure, and be able to show, that its staff genuinely understand the tools and the discipline.
- Completing a structured, role-grounded AI program is exactly the kind of competency development the expectation calls for, and competency is an ongoing, documented practice rather than a one-time orientation, because tools and risks evolve.
- Documentation should be proportionate to the stakes, not uniform and maximal: high-stakes clinical AI uses warrant thorough verification records and audit trails, while low-stakes operational uses warrant far lighter documentation, which keeps the practice sustainable.
- An incompetent user of a good tool can be more dangerous than no tool, because fluent, confident output gives a false sense of reliability an unprepared user cannot defend against, which is why competency is a precondition for safe deployment, not an optional extra.
- Build the documentation and competency habits early, while the stakes are low: it ensures readiness when scrutiny comes and creates a feedback loop that improves the underlying practice, making the pharmacy not just safe but demonstrably safe.
Skill.re