Tracking Adoption and Behavioral Change
Overview
You've launched your AI system. Usage is climbing. The dashboard shows that 45% of eligible transactions are flowing through the AI workflow. Leadership sees the numbers and declares success.
But success is incomplete. Usage and adoption are not the same thing. A team member can use your AI system every day and still work around it, still fundamentally distrust it, still process transactions the old way and then verify them through AI. Usage is behavioral input. Adoption is behavioral output.
This chapter teaches you to measure what actually changed: not how much the tool is being accessed, but how much teams are changing their work because of the tool.
Usage vs. Adoption: The Critical Distinction
This is the most important conceptual frame for adoption tracking. Get it wrong, and you'll claim success based on metrics that have no relationship to actual impact.
Usage: Input Metrics
Usage measures how often people interact with the AI system. These are important. You can't have adoption without usage, but they don't prove adoption:
- Weekly active users (how many people opened the system this week?)
- Daily active transactions (how many decisions went through the system?)
- Average session length (how much time did users spend?)
- Feature adoption (what percentage of users are using advanced features?)
- Login frequency and patterns
Usage metrics tell you whether the system is being accessed. They're useful for detecting catastrophic failures ("nobody's using it") but can be misleading about success.
Example of usage without adoption: Your procurement team uses your AI system for 50% of POs. But for each AI recommendation, they spend 10 minutes verifying it, comparing it against their old process, and confirming it matches what they would have decided anyway. They then enter the order the old way into their legacy system. The AI system is being used but hasn't changed their actual workflow. This is not adoption. It's validation theater.
Adoption: Output Metrics
Adoption measures how much teams have actually changed their workflow and decision-making. It answers the question: "If we removed the AI system, would anything break?"
High adoption: Teams rely on AI recommendations. They process transactions based on AI output. If the AI system went down, they'd have to manually recreate recommendations. They trust the system enough that they'll act on it with minimal verification.
Low adoption: Teams still follow the old process, using AI as a secondary check or verification tool. If the AI system went down, they wouldn't notice because they're not relying on it.
Adoption metrics include:
- Workflow integration depth: What percentage of the process is AI-driven vs. manual?
- Recommendation acceptance rate: When AI recommends something, do people act on it or override it?
- Verification time reduction: Are people spending less time verifying AI output?
- Process path analysis: Are transactions flowing through the AI-optimized path or the legacy path?
- Dependency indicators: Do teams plan around AI system availability?
The relationship between usage and adoption is directional but not deterministic: Usage is necessary for adoption but doesn't guarantee it. If usage is zero, adoption is zero. But high usage with low adoption is common and misleading.
Tip: Track both usage and adoption, but weight adoption much more heavily in your success assessment. A team with 20% usage but 100% adoption when they use it (every interaction changes their workflow) is more successful than a team with 80% usage but 40% adoption (most of their interactions are verification/validation theater).
Building an Adoption Measurement Dashboard
An effective adoption dashboard tracks four layers of data, updated weekly:
Layer 1: Usage Volume and Velocity
This is the foundation. Track:
- Weekly active users (number and trend)
- Transactions processed through AI (number and trend)
- Transactions as percentage of eligible volume (the key metric)
- User engagement (sessions per user per week)
Set targets. "We want 80% of eligible transactions through AI within 6 months" is a clear, measurable goal. Track progress weekly and adjust change management if adoption is lagging.
Layer 2: Workflow Integration
This measures whether teams have actually changed their processes or are just adding AI as a verification step.
Track the following per team/location:
- AI-first transactions: Transactions where the decision starts with the AI recommendation (not where the decision comes first and AI verifies)
- Average verification time: Time from AI recommendation to action. Should decrease as teams trust the system more.
- Process path metrics: Percentage of transactions flowing through the optimized AI path vs. the legacy path. Over time, this should shift toward AI path.
- Handoff quality: Error rate in downstream processes. If AI improves upstream decision quality, downstream processes should have fewer exceptions and rework.
Workflow integration is where you'll detect whether adoption is real or superficial. High volume but sustained high verification time suggests teams are using the system but not trusting it.
Layer 3: Recommendation Acceptance and Override Analysis
When the AI system recommends an action, how often do teams act on it?
Track:
- Overall acceptance rate: Percentage of recommendations accepted as-is (no human modification)
- Acceptance rate by recommendation type: Some recommendation types might be accepted more than others (e.g., "approve" recommendations 92% accepted, "escalate" recommendations 75% accepted)
- Override reasons: When teams override recommendations, why? "Didn't trust the system," "had additional context," "didn't understand the reasoning"
- Override by team: Which teams override most frequently? This identifies adoption resistance that needs targeted support.
A healthy acceptance rate is 75-90%. Lower than 75% and the system has a confidence/quality problem. Higher than 90% and you might have insufficient verification (people are trusting blindly, which is risky).
Override reasons are gold for improving adoption. If people override because they "didn't understand the reasoning," you need better AI explainability. If they override because they "had additional context the system didn't have," you need to improve input data quality or recommendation design.
Layer 4: Sentiment and Resistance Signals
Beyond metrics, track team sentiment. Quantified:
- Quarterly pulse survey: "How confident are you in AI recommendations?" (1-5 scale). Track by team and over time.
- Feedback sentiment analysis: Are comments about the system positive, neutral, or negative? Analyze feedback themes (too slow, too inconsistent, doesn't understand my business, etc.)
- Support ticket themes: What questions are people asking? If tickets spike on specific topics, you've found adoption friction points.
- Team adoption variance: If one team has 30% adoption and another has 85%, investigate. It often points to different managers, different confidence levels, or local process differences.
Sentiment data is predictive. Declining sentiment often precedes declining adoption. Early sentiment detection lets you intervene before adoption stalls.
Resistance indicators include:
- Rising override rates (people are actively rejecting the system)
- Declining session frequency (people are gradually using it less)
- Concentrated resistance from specific teams or individuals (not distributed skepticism, but organized resistance)
- Negative feedback themes clustering (e.g., multiple people reporting the same problem)
- Adoption plateaus (usage hit a ceiling and stopped growing)
Adoption Curves: Why Adoption Doesn't Grow Linearly
Adoption doesn't follow a smooth upward curve. It follows predictable patterns. Understanding these patterns prevents panic and guides intervention.
The S-Curve (Most Common): Slow start (Week 1-4: 20-30%) → Acceleration (Week 5-12: 30-60%) → Plateau (Week 13-20: 60-75%) → Renewed growth if pushed (Week 21+: 75-95%)
The plateau is normal. It's where you've captured the willing and are facing the reluctant. Pushing through the plateau requires targeted intervention.
The Disaster Curve (Avoid): Fast start (Week 1-4: 50%+) → Cliff (Week 5-8: drops to 20%). This happens with inadequate PoC, poor change management, or system quality issues. You get honeymoon then collapse.
The Slow Burn (Diagnose Problem): Adoption stuck at 15-25% from the start. This suggests system doesn't work for your process, change management is weak, or well-organized resistance. Requires diagnosis before continuing.
The Adoption Lifecycle: What to Expect
Adoption doesn't climb linearly. It follows a predictable pattern with four distinct phases. Knowing the phases prevents you from panicking at normal stages:
Phase 1: Early Adoption (Weeks 1-4)
Usage pattern: 20-30% of eligible volume flows through AI. Adoption is concentrated in early-adopter teams and individuals. Change champions are actively encouraging usage.
Sentiment: Generally positive. Early adopters are pleased. Skeptics are watching.
Resistance: Minimal but present. Skeptics are quietly waiting for the project to fail.
Your job: Celebrate early wins. Share user success stories. Provide extra support to early adopters so they become advocates. Document obstacles they encounter.
Phase 2: Expansion (Weeks 5-12)
Usage pattern: 40-60% of volume. More skeptical users are being pulled in. Some resistance becomes active.
Sentiment: More mixed. Early adopters are enthusiastic. Late majority is skeptical. A group is trying it reluctantly.
Resistance: Active. People are experimenting but finding reasons it doesn't work for their situation. "Our suppliers are different," "Our process has exceptions," etc.
Your job: Address real problems. Some resistance is feedback, your system might need adjustment. Some is normal change resistance. Differentiate by testing whether the stated problem is real or rationalized resistance. Provide training to people struggling with adoption.
Phase 3: Plateau (Weeks 13-20)
Usage pattern: Adoption stalls. You've captured the willing adopters. The reluctant majority isn't moving.
Sentiment: Divergence. Adopters are satisfied. Non-adopters are critical.
Resistance: Entrenched. This is where adoption projects often die. It feels like the system isn't working because growth stopped, but really you've hit the natural adoption plateau.
Your job: This is critical leadership moment. Either drive adoption through the plateau (direct management action, mandatory adoption, or removing workarounds), or accept a lower adoption rate and work with what you have. Most projects need a deliberate push to break through the plateau.
Phase 4: Sustained Adoption (Weeks 21+)
Usage pattern: Adoption climbs again after the push. Eventually reaches your target (80-95% depending on business model).
Sentiment: Generally stabilizes. People who adopted are satisfied. Holdouts remain skeptical but have accepted the system as a permanent part of the workflow.
Your job: Maintain adoption through continuous improvement. Monitor for degradation (people working around the system after adoption). Support teams that are struggling.
Important: Adoption plateaus are not failures; they're normal. What kills AI projects is treating the plateau as the ceiling and declaring victory. It's not. The plateau is a test of your resolve and change management capability. Push through plateaus with targeted intervention (process simplification, removing workarounds, direct mandates from leadership, or system improvements addressing adoption barriers).
Levers for Breaking Through Adoption Plateaus
When adoption stalls, you have three primary levers to break through. Each works for different underlying causes:
Lever 1: Improve the system (4-8 week timeline)
Use when: Override rates are high, adoption is stalling because people don't trust the system.
Approach: Investigate why people override. Often it reveals real problems (system misses edge cases, data quality is poor, system reasoning is wrong for your business). Fix the real problems.
Example: Supply planning adoption stuck at 60%. Investigation shows people override 30% of AI recommendations because system doesn't account for customer promotions. Add promotion calendar to AI inputs. Override rate drops to 8%. Adoption climbs to 80%.
Lever 2: Simplify the change (2-4 week timeline)
Use when: Adoption is stalling due to friction (learning curve too steep, process change too big, people don't see immediate value).
Approach: Reduce the scope of change. Instead of "do 80% of your work through AI," try "use AI for the top 20% of cases (routine/high-volume), keep manual for everything else." Once people succeed with 20%, expand to 40%, then 80%.
Example: Procurement adoption at 55%. Staff say AI system is too complicated, takes too long to learn. Scope reduction: limit AI to standard commodity suppliers (60% of volume). Scope is simpler, learning curve is lower, early success is visible. Adoption of scoped functionality reaches 85%. Expand to additional supplier types next phase.
Lever 3: Direct mandate with support (1-2 week timeline, but requires organizational will)
Use when: System works well, adoption is stalling due to laziness or entrenched opposition, not due to system quality or learning curve.
Approach: Leadership mandates AI use. "Starting Monday, all POs above $5,000 must be routed through AI first. Human review required for final approval, but AI recommendation is required input." Couple mandate with extra support (extra training, champion availability, reduced rework expectations for first two weeks).
Example: Compliance adoption at 65%, system works well, but some teams prefer old process. Leadership mandate: "All transactions must flow through AI system before submission." Coupled with extra champion time. Adoption jumps to 85% in two weeks because people stop working around the system.
Which lever to pull?
Investigate first. Ask overriding users why they override. Talk to non-adopting teams. Their feedback reveals which lever works: "System doesn't work for my cases" → Improve system. "Too complicated" → Simplify change. "Works fine but I prefer the old way" → Direct mandate.
Detecting Adoption Problems Early
Some adoption problems are red flags that require immediate investigation and potentially systemic changes:
Problem 1: Usage High, Acceptance Low
People are using the system but overriding most recommendations. This suggests either:
- The AI system has quality or confidence problems (recommendations often wrong)
- The system doesn't understand nuance or exceptions in the business
- Change management didn't build sufficient trust
Response: Analyze override reasons. Are they systematic (people always override for the same reason) or random? If systematic, fix the root cause (retrain the model, adjust decision rules, improve input data). If random, increase change management and confidence-building activities.
Problem 2: Concentrated Resistance
One team or group is adopting at 20% while another is at 80%. This indicates:
- Different managers with different leadership approaches (one mandating adoption, one not)
- Different local processes (the system works for some teams but not others)
- Different team cultures (some teams naturally embrace tools, others resist)
Response: Investigate the high-adoption team. What are they doing differently? Can it be scaled? For low-adoption teams, diagnose whether the problem is the system, the change management, or local process incompatibilities. Customize your approach.
Problem 3: Adoption Plateau Before Target
You hit 65% adoption and it stopped. You targeted 85%. This is common and fixable but requires direct action.
Response: Identify who isn't adopting. Is it a role issue (managers adopting but frontline staff not)? A location issue (one office using it, others not)? A team issue? Target change management at the gap. Make adoption a performance metric. Remove workarounds. Sometimes you need organizational mandate: "Starting next month, all POs must go through the AI system."
Problem 4: Declining Sentiment with Stable Usage
People are still using the system, but satisfaction is dropping. This precedes adoption collapse.
Response: Investigate reasons. Often it's small usability problems or frustrations that accumulate. Sometimes it's degraded system performance or data quality issues. Address the feedback quickly. Sentiment recovery often requires visible improvements and manager acknowledgment that problems were heard and fixed.
The Adoption Dashboard: What to Report Weekly
Create a simple one-page dashboard that covers all four adoption layers:
- Usage volume: Weekly active users, transactions processed, % of eligible volume
- Trend: Is adoption growing, flat, or declining week-over-week?
- Workflow integration: % of transactions on AI-optimized path, average verification time
- Acceptance rate: % of recommendations accepted, override rate by type
- Sentiment score: From weekly pulse survey or feedback analysis
- Resistance indicators: Teams with low adoption, rising override rates, negative feedback themes
- Actions this week: What are you doing to address adoption gaps?
This dashboard is your steering mechanism. Update it every Friday. Use it in your Monday morning leadership huddle. It's not about vanity. It's about detecting problems early and adjusting your approach.
Monday Morning: Adoption Decisions
Your Monday huddle includes adoption review. Ask yourself:
- Is adoption tracking our target timeline?
- Are any teams significantly lagging? Why?
- Are override rates rising, falling, or stable? What's driving changes?
- Are any resistance signals emerging? What's driving skepticism?
- What changes do we need to make this week to maintain adoption momentum?
This shouldn't be more than 10 minutes. The goal is to stay aware and adjust quickly if adoption is drifting from target.
Key Takeaways
- Usage and adoption are different concepts: Usage is accessing the tool. Adoption is changing your workflow because of the tool. High usage + low adoption (verification theater) is worse than moderate usage + high adoption (true behavior change).
- Build a four-layer adoption dashboard: Usage volume, workflow integration, recommendation acceptance, and sentiment signals. Together they tell the complete adoption story.
- Adoption follows predictable curves: Most projects follow an S-curve (slow start, acceleration, plateau, renewed growth). Expect the plateau. It's normal. Some projects follow a disaster curve (fast start, cliff) if launched without proper PoC or change management.
- The adoption plateau is where most projects fail or succeed: You've captured the willing (30-70% adoption). The question is whether you have the resolve to push through to the reluctant (70-90% adoption). Three levers work: improve the system, simplify the change, or use direct mandate with support.
- Override rates are a leading indicator: Rising overrides signal diminishing trust or system quality problems. Investigate the reason immediately. Each override type has a different intervention.
- Adoption problems usually have fixable root causes: High usage + high overrides = system quality problem. Low usage = adoption friction (learning curve, change size, lack of support). Concentrated resistance from one team = local process incompatibility or poor manager support. Diagnosis reveals which lever to pull.
FAQs
Q: What's a good adoption rate?
A: It depends on your business model. Procurement systems typically reach 85-95%. Compliance monitoring systems reach 90%+. Process automation reaches 70-85% (some edge cases will always need human judgment). Planning systems reach 60-75% (forecasts inform but don't determine decisions). Set a target based on your function and measure against it.
Q: My team is using the system but overriding 80% of recommendations. Should I declare this a success?
A: No. High usage + high override rate = low adoption. The team is using the system as a secondary validation tool, not as a primary decision driver. This is actually worse than no adoption because it consumes resources without delivering value. Investigate why they're overriding so often. Either improve the system or change the change management approach.
Q: How do I break through an adoption plateau?
A: Usually through one of three levers: (1) Direct mandate (leaders require adoption), (2) Remove workarounds (ban the old process), (3) Improve the system (address the real problems that are preventing adoption). Most successful breakthrough uses all three. Pick your lever based on why adoption plateaued.
Q: Should I measure adoption by individual team member or by team?
A: By team for trending and overall progress. By individual for diagnosing problems (who's not adopting and why). Use team-level reporting externally, individual-level diagnosis internally for change management.
Q: When can I declare adoption complete?
A: When you've reached your target rate (usually 80%+) and sustained it for at least 2 full business cycles. Adoption isn't complete until people aren't thinking about the system anymore. It's just how they work.
Skill.re