AI for Risk, Compliance & Audit · Self-Assessment and Readiness for Level 3 Progression

←

AI for Risk, Compliance & Audit

Capable · M20 · lesson 20 of 26 · queued

Preview — browse every lesson free. Enroll to mark lessons complete, open partner links and save your progress. Login & enroll →

↗ open on YouTube

📖

in this lesson

Self-Assessment and Readiness for Level 3 Progression

15 min

Introduction

You will learn how to assess whether you're ready to progress to Level 3 (Independent Application) and what you should prepare before stepping up to less-supervised AI use.

At the Assisted Use level, you are moving from understanding concepts to applying them with guidance. You will begin using AI tools under supervision, learning to evaluate their outputs critically and document your verification processes. This is where theory meets practice -- with appropriate guardrails in place.

This lesson is designed to be accessible to professionals at all experience levels while providing the depth needed for practical application. Whether you are encountering these concepts for the first time or building on existing knowledge, the material ahead will strengthen your ability to navigate AI governance challenges with confidence and competence.

Core Concepts

Anti-Patterns / Misuse Risks

Anti-Pattern 1: Overconfidence "I've been doing this for a few months and I feel confident, so I'm ready for L3."

Risk: Confidence isn't the same as competency. You might feel ready but actually have gaps.

Safeguard: Use a formal self-assessment; get feedback from supervisors; be honest about gaps.

Anti-Pattern 2: Hiding Gaps "I've been uncertain about some decisions, but I haven't mentioned it to anyone because I didn't want to look incompetent."

Risk: Hiding gaps means they don't get addressed. You progress with unresolved weaknesses.

Safeguard: Be transparent with your supervisor about areas where you're uncertain or want to improve.

Anti-Pattern 3: False Portfolio "I'm including examples that show me in the best light, but I'm not being honest about issues."

Risk: A portfolio based on selective information doesn't provide an accurate picture.

Safeguard: Include both successes and issues. Be honest about your development.

Anti-Pattern 4: No Supervisor Input "I think I'm ready for L3, so I'll request it without discussing with my supervisor."

Risk: Your supervisor may see gaps you don't recognize. You need their input on readiness.

Safeguard: Have an explicit conversation with your supervisor: "I'm thinking about requesting L3 evaluation. What's your assessment of my readiness?"

Anti-Pattern 5: Rushing Progression "I've been in L2 for three months. I'm ready to move to L3."

Risk: Not enough time to demonstrate sustained competency and build habits.

Safeguard: Plan to spend 6-12 months in L2 before requesting progression. This gives time to build habits and demonstrate consistency.

Human Judgment Checkpoints

Before requesting L3 progression, ask yourself:

Verification: Can I independently verify AI output for accuracy?
Judgment: Can I independently assess when AI should be used?
Escalation: Do I escalate appropriately when uncertain?
Documentation: Am I consistently documenting AI use?
Compliance: Have I followed policies without violation?
Habits: Have I built sustainable habits or am I relying on checklists?
Feedback: What is my supervisor's assessment of readiness?
Time: Have I spent sufficient time in L2 (recommend 6-12 months)?

[Practical Tip]

As you work through these concepts, consider how each one applies to your current role. Think of a specific scenario from your recent work where this concept would have been relevant. Building these mental connections between theory and practice is the fastest way to internalize new knowledge and make it actionable in your daily responsibilities.

Traceability / Defensibility Considerations

Progression decisions should be documented:

What to Record: - Self-assessment showing readiness - Supervisor feedback on readiness - Portfolio of L2 work demonstrating competency - Timeline in L2 - Any gaps identified and how they were addressed

Why This Matters: - Shows that progression wasn't casual - Demonstrates rigorous self-assessment - Provides evidence of competency - Supports defensibility of independent decisions made at L3

Responsible AI and Control Considerations

Responsible Progression: 1. Rigor: Use formal assessment, not gut feeling 2. Honesty: Be honest about gaps and areas for growth 3. Supervisor input: Get explicit feedback from your supervisor 4. Time: Allow sufficient time in L2 to build habits 5. Continued learning: Recognize that progression is not the end; you'll continue learning at L3

Control Considerations: - Organizations should have clear progression criteria - Progression should be based on demonstrated competency - Managers should assess readiness before approving progression - L3 should still have oversight, just less frequent than L2

[Practical Tip]

Practice / Reflection Prompts

Complete the self-assessment. Use the template to honestly assess your readiness for L3. Identify any gaps.
Develop a gap closure plan. If you have gaps, create an action plan to address them. Set a timeline.
Build a portfolio. Start collecting examples of your best L2 work. Document the process, verification, and approval for each.
Get supervisor feedback. Ask your supervisor: "How do you assess my readiness for L3? What areas are you confident about? Where do you see gaps?"
Plan your progression conversation. Draft the conversation you'll have with your supervisor about requesting L3 evaluation. What will you say? What evidence will you bring?

End of Chapter 5

Chapter Summary:

Chapter 5 addressed guardrails and boundaries for L2 work:

Lesson 1: Understanding organizational AI use policies and ensuring compliance
Lesson 2: Recognizing when to stop using AI and escalate to human expertise
Lesson 3: Building sustainable habits and routines for responsible AI use
Lesson 4: Self-assessing readiness and preparing for L3 progression

Key principles: - Policy compliance: Follow organizational guidelines; escalate when unsure - Boundary awareness: Recognize when AI reaches its limits; escalate appropriately - Habit building: Make responsible practices automatic, not effortful - Honest assessment: Assess your readiness rigorously before progressing - Continuous learning: Recognize that L2 is a learning stage; progression isn't the end

Conclusion to Level 2

You have completed Level 2: Assisted Use. You have learned how to: 1. Summarize and research with AI while maintaining verification discipline 2. Draft with AI while ensuring review and quality control 3. Review AI-generated content critically and detect common errors 4. Document and defend your AI-assisted work with complete audit trails 5. Work within guardrails by understanding policies, recognizing boundaries, and building sustainable habits

Level 2 is where most professionals will spend 12-18 months. The focus is on learning to use AI responsibly in supervised, low-risk contexts. By the end of Level 2, you should be able to use AI confidently and defensibly for summarization, research, drafting, and analysis--with appropriate verification, documentation, and escalation.

When you are ready, you will progress to Level 3: Independent Application, where you will take on more complex AI use and less frequent supervision, with the habits and judgment you've developed in Level 2.

Terms / Glossary (Chapter 5):

Organizational AI policy: Written guidance from your organization on how AI can be used
Low-risk use: AI tasks that are approved without special approval (e.g., summarization)
Medium-risk use: AI tasks that require compliance or supervisor approval before proceeding
High-risk use: AI tasks that require legal or executive approval; often require human final judgment
Prohibited use: AI tasks that should not be done with AI (e.g., legal advice)
Escalation: Bringing an issue to someone with higher authority or expertise for decision
Habit: Automatic behavior you perform without conscious effort
Routine: Series of steps you perform consistently
Self-assessment: Honest evaluation of your own competencies and readiness
Portfolio: Collection of examples demonstrating competency

Links to Related Lessons:

Chapter 1: Research discipline -- foundational to understanding policy content
Chapter 2: Drafting quality -- essential to recognizing when supervision is appropriate
Chapter 3: Critical review -- needed to verify policy compliance
Chapter 4: Documentation -- required for audit trails showing compliance
All chapters: Understanding guardrails ensures responsible implementation

Practical Application

Understanding concepts in the abstract is valuable, but the real test is whether you can apply them in professional practice. This section bridges the gap between theory and application with concrete scenarios drawn from oversight work.

Use Case 1: Self-Assessment for Readiness You've been at L2 for 8 months. Your manager asks: "Do you think you're ready for L3?" You conduct a self-assessment:

Assessment: 1. Verification: You've regularly spot-checked AI output and caught several errors; you're confident in your verification discipline 2. Judgment: You recognize when AI should and shouldn't be used; you've escalated appropriately three times 3. Documentation: You have consistently documented AI use and maintained version control 4. Escalation: You've escalated for policy guidance twice and legal review once; each escalation was appropriate 5. Compliance: You've followed organizational policies with no violations 6. Habits: You follow your verification routine automatically; you no longer need the checklist 7. Results: Your supervisors have given positive feedback; no errors have been found in your work

Conclusion: You're likely ready for L3. You should formally request evaluation.

Use Case 2: Identifying Gaps Before Requesting Progression You've been at L2 for 6 months. You want to progress to L3, but you recognize a gap: You've avoided escalating on uncertain issues because you didn't want to seem incompetent. You're using AI for things you should have escalated.

Action: 1. Acknowledge the pattern: "I've been reluctant to escalate; I need to be more proactive about asking for help." 2. Plan to correct: "For my next three medium-risk projects, I'll escalate for guidance on classification rather than deciding myself." 3. Get feedback: "I'd like feedback on my escalation practices from my supervisor." 4. Practice: You escalate on the next three projects, get guidance, and adjust your practices 5. Then request progression: Once you've demonstrated appropriate escalation, request L3 evaluation

Use Case 3: Building a Portfolio for Progression You keep a file of AI-assisted work demonstrating competency: - Five policy or procedure drafts (with approval documentation) - Three risk assessments (with verification notes) - Two research syntheses (with source documentation) - Five memos or communications (with review notes) - Documentation showing five escalations handled appropriately

When you request L3 evaluation, you share this portfolio showing consistent quality, appropriate escalation, and good habits.

Detailed Examples

The following examples illustrate how the concepts from this lesson play out in real-world oversight scenarios. Each example is designed to help you recognize similar situations in your own work and respond with appropriate professional judgment.

Example 1: L2-to-L3 Self-Assessment

Use this template to assess your readiness:

``` L2-TO-L3 READINESS SELF-ASSESSMENT

Name: [Your name] Role: [Your role] L2 Start Date: [When you started L2] Today's Date: [Today] Time in L2: [Months]

VERIFICATION DISCIPLINE (Can you independently verify AI output?) Question: Have you regularly spot-checked AI output against sources? Self-Assessment: [Y/N] Evidence: [specific example]

Question: Have you caught errors in AI output? Can you describe them? Self-Assessment: [Y/N] Evidence: [specific example]

Question: Do you know how to verify different types of work (policies, analyses, research)? Self-Assessment: [Y/N] Evidence: [describe methods]