AI for Healthcare & Clinical Practice
Strategic · M5 · lesson 5 of 23 · queued
Preview — browse every lesson free. Enroll to mark lessons complete, open partner links and save your progress. Login & enroll →
Designing Disclosure and Consent at Scale
📖
now learning

Designing Disclosure and Consent at Scale

15 min

A patient in California opens a message in her portal about her lab results. It is clear, warm, and reassuring. It was drafted by generative AI, and under a law that took effect on the first of January, 2025, that message was required to carry a prominent disclaimer that AI was used and instructions for how to reach a human. It did not. No one at the health system decided to break the law; there was simply no design that made the compliant message the one that got sent. Somewhere between a well-meaning pilot and a system-wide rollout, the disclosure fell through a gap no one owned. Multiply that message by the tens of thousands the system sends each week, and you have a compliance exposure, and a trust failure, operating at industrial scale. This lesson is about closing that gap by design.

Disclosure Is Now a Workflow Problem, Not a Policy Problem

For most of the history of medicine, disclosure and consent were conversations: a clinician, a patient, a form, a signature. AI at scale breaks that model, not because the ethical principle changed but because the volume did. When a system uses generative AI to draft patient communications, or predictive AI in diagnosis or treatment, across dozens of service lines and hundreds of thousands of encounters, disclosure can no longer live in an individual clinician's discretion or a policy binder on a shelf. It has to live in the workflow, fired automatically and consistently, or it will not happen reliably at all. A policy that says "clinicians should disclose AI use" is not a control; it is a hope, and hope does not survive the tens of thousands of messages, the night shifts, the new hires, and the edge cases that define real operations.

This is the central reframe for a leader: disclosure and consent at scale are a design and engineering problem, and the compliant path must be the default path. If doing the right thing requires a busy clinician to remember an extra step, the right thing will be done inconsistently, and inconsistency is exactly what a regulator, a plaintiff, or an auditor finds. If instead the workflow itself attaches the disclaimer, offers the human-contact path, and records that it did so, then compliance is not a matter of individual diligence; it is a property of the system. The goal is a deployment where a clinician would have to work to produce a non-compliant communication, rather than one where they have to work to produce a compliant one. Make the compliant path the path of least resistance, and the scale problem solves itself.

A useful diagnostic for a leader auditing an existing deployment is to ask, for each AI use in the building, three questions: does the compliant output happen without anyone remembering, does the record capture that it happened, and could a busy person on a night shift accidentally produce the non-compliant version. If the answer to the first two is no, or the answer to the third is yes, you do not have a control; you have a policy dressed up as one. The rest of this lesson is about converting those policies into controls: understanding which laws bite which deployments, standardizing the small number of building blocks that satisfy them, operationalizing the human-review exemption so it is a real gate rather than a rubber stamp, and designing the manipulative patterns out so the disclosure that appears is one a patient can actually see and act on.

At scale, a policy that says clinicians should disclose is not a control; it is a hope. The only reliable disclosure is the one the workflow fires automatically, so that the compliant message is the one that gets sent by default.

You are not designing in a vacuum. A patchwork of state laws now imposes concrete disclosure duties, and while the patchwork is evolving and you must verify the current text against your own counsel, the shape of the obligations is clear enough to design against today. The right posture toward every statistic, penalty figure, and effective date in this lesson is the same: treat it as something to verify with counsel before you rely on it, not something to repeat blindly, because the ground is visibly still moving and the details decide cases.

California AB 3030: the disclaimer and the human path

California AB 3030, in force since January 1, 2025, governs the use of generative AI to produce written or verbal patient clinical communications. Where such a communication is generated by GenAI, the law requires a prominent disclaimer that it was AI-generated and clear instructions on how the patient can contact a human, a real clinician or staff member. Critically, there is a safe harbor: a communication that is read and reviewed by a licensed or certified human provider is exempt from the disclaimer requirement. That single exemption is a design gift, because it maps precisely onto the program's iron rule. A communication a clinician actually reads and reviews is both safer and, by the terms of the law, treated differently from one sent by the machine unreviewed. The human review is not just good practice; it is the legal pivot.

Texas TRAIGA / HB 149: disclosing AI in diagnosis and treatment

Texas TRAIGA, House Bill 149, effective January 1, 2026, takes a different cut. It requires health care providers to disclose to the patient, or the patient's representative, when AI is used in their diagnosis or treatment. The disclosure must be clear and conspicuous, in plain language, and free of dark patterns, the manipulative design tricks that technically disclose while practically hiding. Enforcement sits with the Texas Attorney General, with penalties reported in the range of roughly ten thousand to two hundred thousand dollars per violation, numbers you should verify against the current text but which are large enough that a systemic design failure is a material financial risk, not a rounding error. The picture keeps evolving: Colorado's SB 26-189, signed May 14, 2026 and effective January 1, 2027, largely exempts HIPAA-covered entities from the developer and deployer duties in its broader AI framework while still requiring notice and specified disclosures for covered automated decision-making technology. The details differ by state, and you must verify them, but the direction is unmistakable and the design response is the same.

A leader reading these laws side by side should notice that they cut across different axes of the same problem, which is exactly why a piecemeal response fails. AB 3030 is about the channel: communications generated by GenAI. TRAIGA is about the use: AI in diagnosis or treatment. Colorado's duties turn on whether a system is a covered automated decision-making technology and on the HIPAA status of the entity. A single AI deployment can trigger both, one, or none depending on what it does and how the output reaches the patient. The table below is a leader's first-pass map of which obligation bites which deployment. It is a design aid, not a legal opinion: verify the current statutory text and its application to your facts with counsel before you rely on it.

AI use in the deploymentDoes AB 3030 apply?Does TRAIGA apply?Required control
Ambient scribe drafting a portal message to the patientYes, if GenAI generates a clinical communication sent to the patientOnly if the content also conveys AI use in diagnosis or treatmentProminent AI disclaimer plus a human-contact path, unless a licensed provider reads and reviews it (safe harbor)
GenAI patient-communication assistant sending replies at scaleYes, GenAI-generated patient communications are squarely coveredOnly where the communication touches diagnosis or treatmentDefault disclaimer and human-contact path on every unreviewed send; safe-harbor review captured in the record for reviewed sends
Predictive model shaping a treatment decisionGenerally no, unless its output becomes a GenAI patient communicationYes, AI used in diagnosis or treatment triggers the disclosure dutyClear-and-conspicuous, plain-language disclosure to the patient that AI informed the diagnosis or treatment
Inbox auto-reply generated by GenAIYes, if it is a clinical communication rather than pure logisticsRarely, unless it conveys diagnosis or treatment contentTemplated disclaimer and human-contact path by default; route clinically meaningful replies to human review
Imaging AI informing a diagnosisGenerally no on its own, absent a GenAI patient communicationYes, AI informing diagnosis triggers the disclosure dutyClear-and-conspicuous disclosure that AI assisted the diagnosis, in plain language and free of dark patterns

The lesson of the table is not the individual cells, which you will verify and which will shift as statutes are amended and new states enter. The lesson is the shape: a small number of underlying obligations, disclose that AI was involved, provide a human path, let genuine human review change the picture where the law allows, and make diagnosis-and-treatment AI clear and conspicuous, recur across every row. If you try to comply law-by-law and tool-by-tool, you will build a tangle no one can maintain and gaps no one can see. If instead you design against the underlying obligations, you cover the axes rather than chasing the statutes. This is the difference between compliance as a maintainable property of your system and compliance as an ever-growing checklist you are perpetually behind on.

The Three Things to Standardize

Faced with an evolving patchwork, the leader's instinct might be to build a different disclosure process for every law and every service line. That way lies chaos and gaps. The better strategy is to standardize the small number of building blocks that, assembled, satisfy the whole landscape, and to build them once, well, into the workflow. There are three.

The first is the disclaimer: a standard, approved, plain-language statement that AI was used, attached automatically to the communications that require it. Standardizing it means it is clear rather than buried, consistent across the system rather than reinvented by each department, and legally reviewed once rather than improvised many times. The second is the human-review safe harbor: an explicit, designed workflow step where a licensed provider reads and reviews the communication before it goes out, capturing that review in the record. This is the step that both makes the communication safer and, under laws like AB 3030, changes its legal status. Designing it well means making the review real, not a rubber stamp, and making the record of it automatic. The third is the opt-out and fallback, the human-contact path: a clear, easy, non-manipulative way for a patient to reach a human, decline AI-mediated communication, or escalate. Standardizing this means the same reliable path exists everywhere, not a maze that differs by clinic and technically satisfies the law while practically defeating it.

Standardizing does not just mean writing the three components down; it means giving each one a home, an owner, and a change-control discipline. The table below is a concrete specification a leader can hand to a governance committee: where each block is templated, who owns and updates it, and how a legal change propagates.

Building blockWhere it is templatedWho owns and updates itChange-control when a law changes
Approved AI disclaimerA single templated string in the EHR communication engine, referenced by every service line rather than copiedCompliance and legal jointly, with a named accountable ownerUpdate the one canonical template; legal reviews once; the change propagates to every message that references it
Human-review safe-harbor stepA workflow gate in the message-send pathway that requires an affirmative reviewer action before releaseClinical informatics with compliance sign-off on the gate logicUpdate the gate rule and the attestation text in one place; validate once in a test environment; deploy system-wide
Human-contact and opt-out pathA templated block inserted into every relevant communication and a single documented escalation routePatient experience with compliance oversightUpdate the templated block and the routing once; confirm the human endpoint is staffed; propagate everywhere

The power of standardizing these three is that they compose. The disclaimer plus the human-contact path satisfies the core of AB 3030 for unreviewed GenAI communications; the human-review safe harbor satisfies it a different way, by exemption, for reviewed ones; the clear-and-conspicuous, no-dark-patterns disclosure satisfies TRAIGA's diagnosis-and-treatment duty; and the human-contact path handles the opt-out and escalation that patients and regulators expect everywhere. Build three reliable components into the workflow and you have a system that bends to the patchwork instead of shattering against it.

There is a governance benefit to this composability that a leader should not miss. When the law changes, and it will, a system built from three well-defined components can be updated in three well-defined places, by the people who own those components, with the change reviewed once and propagated everywhere. The discipline is worth stating plainly: update in the small, fixed number of places, review once, propagate automatically. A system built from a hundred department-specific improvisations has no such lever; a legal change becomes a hundred separate remediation projects, each of which can be forgotten. The standardized approach is not only more compliant today; it is more adaptable tomorrow, which matters enormously in a domain where the statutory ground is visibly still moving. The leader who standardizes is buying not just consistency but the ability to respond to the next law without a fire drill.

Operationalizing the Provider-Review Exemption

The AB 3030 safe harbor is the most valuable single mechanism in the whole landscape, because it lets genuine human review, which you want anyway for patient safety, do double duty as a compliance path. But a safe harbor is only as good as the workflow that earns it. A vague instruction that "a provider should review AI-drafted messages" recreates exactly the diligence-dependent hope the design was meant to eliminate. To rely on the exemption at scale, the review has to be an actual gate, and the record has to prove it was a real review rather than a click.

Concretely, the send pathway should stop an unreviewed GenAI communication at a review gate that does not auto-advance and cannot be cleared by inaction. The provider must take an affirmative action to release the message, and that action should require a genuine attestation, not a reflexive one. The record the EHR writes when the message is released should capture, at minimum, the reviewer's identity (the specific licensed or certified provider, not a shared service account), a timestamp for when the review occurred, and an explicit attestation that the reviewer read and reviewed the communication before release. Ideally it also captures the message version reviewed, so that a later edit does not silently inherit an old review. These are the fields a surveyor will ask to see, and they are the fields that convert "we review our AI messages" from an assertion into evidence.

Keeping the review real, not a rubber stamp, is a design problem, not an exhortation. Several concrete choices matter. The gate should not auto-advance on a timer or after a default period, because a review that happens by the clock passing is not a review. It should require an affirmative click or signature rather than treating silence as approval, so that inaction never releases a message. It should avoid pre-checked attestations and one-click bulk approval of large batches, both of which turn review into a formality. And it should surface the actual content the provider is attesting to, rather than a collapsed summary, so the attestation means what it says. None of this makes review slow; it makes review real, which is the only kind that earns the exemption and protects the patient.

The audit trail is the payoff. Because the gate writes reviewer identity, timestamp, and attestation for every released message, a surveyor can be answered with a query rather than a promise. A surveyor could reasonably ask you to run something like: for a given date range, return every GenAI-generated patient communication and show, for each, either a captured provider review (reviewer identity, timestamp, and attestation) or the attached disclaimer and human-contact path. A well-designed deployment answers that query with a complete table and no null rows. A deployment that relies on hope answers it with a shrug, and the null rows are the violations. The query is not an afterthought; it is the specification. If you cannot imagine the query returning cleanly, you have not yet operationalized the exemption.

Designing So the Compliant Path Is the Default Path

The whole discipline comes down to a design stance: engineer the workflow so that the compliant, disclosed, human-reachable communication is the one that happens automatically, and the non-compliant one is the one that takes deliberate effort to produce. In practice this means the disclaimer is attached by the system, not typed by a clinician who might forget; the human-review step is a built-in gate in the workflow, not an optional courtesy; the human-contact instructions are templated into every relevant communication rather than left to each author; and the record captures, as a byproduct, that disclosure was made and review occurred, so that the audit trail exists without anyone having to remember to create it. Dark patterns are designed out deliberately, because a disclosure that technically appears but practically hides is not only an ethical failure but, under laws like TRAIGA, a legal one.

Dark patterns deserve their own explicit design pass, because they are the way a well-intentioned disclosure quietly fails the "clear and conspicuous, no dark patterns" bar. A dark pattern is any design choice that makes the compliant element technically present but practically invisible or hard to act on. Leaders should treat the following as a checklist of patterns to design out, and should recognize that each has a straightforward compliant alternative.

Dark patternWhy it fails clear-and-conspicuous / no-dark-patternsCompliant alternative
Tiny gray disclaimer textTechnically present but not conspicuous; a reasonable patient would not notice itDisclaimer in readable size and contrast, placed where the patient's attention already is
Pre-checked consent or opt-in boxManufactures agreement the patient never actively gave; consent is not freely chosenUnchecked by default, requiring an affirmative action to consent
Disclosure buried behind multiple clicksPractically hidden; conspicuousness fails when the notice is several screens awayDisclosure on the same screen as the content it describes, no extra navigation required
Confusing double-negatives in the choiceNot plain language; the patient cannot easily tell what checking or unchecking doesPlain, direct wording where the effect of each choice is obvious
No easy path to a humanDefeats the human-contact requirement and traps the patient in AI-mediated channelsA clear, easy, always-available route to reach a real person or opt out

Notice how this mirrors the lesson on automation bias from the foundations of this program. There, the insight was that you cannot solve a failure of attention with more attention; the defenses that work are structural, firing whether or not the clinician is sharp in the moment. Disclosure at scale is the same principle applied to compliance. You cannot solve a scale problem with more individual diligence; the defense that works is a workflow that fires the disclosure whether or not any individual remembers. A leader who understands this stops issuing reminders and starts changing the default. The reminder is the tool of a leader who has not yet solved the problem; the default is the tool of one who has.

It is worth being honest about why leaders reach for reminders anyway, because the pull is real. Reminders are cheap, fast, and feel like action; changing a default requires engineering work, cross-department coordination, and a willingness to make the workflow slightly less flexible in exchange for making it reliably safe. The reminder lets a leader tell themselves the problem is addressed while pushing the actual burden onto the busiest people in the building. The default costs more up front and pays for itself every day thereafter, in gaps that never open and audits that go quietly well. A serious leader recognizes the reminder for what it is, a way of feeling responsible without being effective, and does the harder, quieter work of changing what happens automatically. Patients do not experience your intentions; they experience your defaults.

A Worked Example: Two Portal Messages

Consider two versions of the same lab-result message, generated by the same AI, in the same California health system. In the first version, the message is drafted by AI and sent through an automated pathway that a clinician does not review. Because the workflow was never designed to attach the disclaimer or the human-contact instructions, the message goes out bare: no notice that AI was involved, no easy way to reach a person. It is warm, clear, and quietly non-compliant with AB 3030, and it is one of forty thousand such messages that month. There is no single villain, only an undesigned gap, which is exactly what makes it dangerous: it is invisible until a complaint, an audit, or a journalist makes it visible, and by then it has happened forty thousand times.

In the second version, the same AI drafts the same message, but the workflow is designed. One of two things happens by default. Either a licensed provider reviews the message before it is sent, and that review is captured in the record, placing the message inside the AB 3030 safe harbor and inside the program's iron rule at once; or, if the message is sent without human review, the workflow automatically attaches the standardized disclaimer and the standardized human-contact path, so it goes out compliant. In neither case did an individual clinician have to remember anything. The record shows, for every message, either that a human reviewed it or that the required disclosures were attached. When an auditor arrives, the answer to "show me how you comply at scale" is not a policy document and a promise; it is a workflow and an audit trail. Same AI, same message, same volume. The only difference is that someone designed the compliant path to be the default, and that difference is the entire lesson.

It is worth making the audit trail from the second version concrete, because the record is where the design proves itself. For a reviewed message, the row a surveyor pulls shows the message identifier, the reviewing provider's identity and license, the timestamp of review, the attestation that they read and reviewed it, and the version of the content that review attached to. For an unreviewed-but-disclosed message, the same row shows the message identifier, a flag that no human review occurred, and confirmation that the standardized disclaimer and human-contact block were attached at send. Neither row was created by anyone remembering to create it; both are byproducts of passing through the gate. Run the surveyor's query across forty thousand messages and every row resolves to one of those two clean outcomes, with no nulls. That absence of nulls is the difference between a deployment that can prove compliance and one that can only assert it.

One caution before leaving the example, because it is where good intentions go wrong. It is tempting, having built the two compliant routes, to lean hard on the automated disclaimer route because it requires no clinician time. But the disclaimer route and the human-review route are not equivalent in safety, only in disclosure compliance. A message that is disclosed but never reviewed still carries whatever error the AI introduced; the disclaimer tells the patient AI was used, but it does not catch a confabulated result or a dangerously wrong reassurance. So the design should reserve the unreviewed-plus-disclaimer route for genuinely low-stakes communications and route anything that could carry clinical consequence through real human review. Compliance and safety overlap here, but they are not the same thing, and a leader who optimizes only for the cheaper compliant route has satisfied the law while leaving the patient-safety half of the iron rule unaddressed. Disclose everything the law requires, and review everything that patient safety requires, and let the two routes serve their different masters.

Key Takeaways

  • AI at scale turns disclosure and consent from a conversation into a workflow problem; a policy that says clinicians should disclose is not a control but a hope, and hope does not survive tens of thousands of communications, night shifts, and new hires.
  • The central design stance is that the compliant path must be the default path: engineer the system so a clinician would have to work to produce a non-compliant communication, not the reverse.
  • California AB 3030 requires GenAI-generated patient clinical communications to carry a prominent disclaimer and human-contact instructions, with a safe harbor for communications a licensed provider reads and reviews, which maps precisely onto the program's iron rule.
  • Texas TRAIGA requires clear, conspicuous, plain-language disclosure of AI use in diagnosis or treatment, with no dark patterns, enforced by the Attorney General at penalties reported around ten thousand to two hundred thousand dollars per violation; verify the figures, but treat a systemic design failure as a material financial risk.
  • The landscape is an evolving patchwork you must verify against current counsel; use a which-law-bites-which-deployment map to see that a small set of underlying obligations recurs, and design against those rather than chasing individual statutes.
  • Standardize three composable building blocks and build them once into the workflow: the approved plain-language disclaimer, the human-review safe-harbor step captured in the record, and the clear human-contact and opt-out path, each with a named owner and change-control that updates in a few places, reviews once, and propagates.
  • Operationalize the provider-review exemption as a real gate: no auto-advance, an affirmative action to release, and a record capturing reviewer identity, timestamp, and attestation, so a surveyor's query returns review-or-disclosure for every message with no null rows.
  • Design dark patterns out deliberately, tiny gray text, pre-checked consent, buried disclosures, confusing double-negatives, and dead-end human paths, because a disclosure that technically appears but practically hides is both an ethical failure and, under laws like TRAIGA, a legal one.