CAP Certification
Strategic · M58 · lesson 58 of 60 · queued
Preview — browse every lesson free. Enroll to mark lessons complete, open partner links and save your progress. Login & enroll →
Vendor & Platform Landscape Assessment
📖
now learning

Vendor & Platform Landscape Assessment

15 min

Overview

Ioana Munteanu had been tasked with selecting an AI platform for her firm's legal operations team. The RFP process was already underway when she attended a briefing from her industry association and realized she had been evaluating vendors for the last three months without a clear map of what the market even looked like. "I knew the vendors who had called us," she told me. "I did not know what I did not know." She paused the evaluation for two weeks to build that map. It changed her shortlist completely.

The AI vendor market is large, fast-moving, and deliberately difficult to navigate. Vendors use inconsistent terminology. Category boundaries shift. A "generative AI platform" can mean anything from a writing assistant to a full development environment for building custom models. Before evaluating specific vendors, you need to understand the landscape - what categories exist, what each category does, and how to position your needs within that structure.

This is not a one-time exercise. The market changes fast enough that a landscape assessment conducted 18 months ago may be significantly outdated. Build the habit of reassessing annually.

The AI Vendor Landscape: A Practical Map

The AI vendor market can be organized into five broad layers. Each layer represents a different type of value being sold.

Foundation model providers. These organizations build and operate the large AI models that power most of the market. OpenAI, Anthropic, Google DeepMind, Meta, and Mistral are the most prominent examples. You interact with their products either directly through APIs or indirectly through tools built on top of their models. For most non-technology organizations, direct engagement with foundation model providers is via API access or enterprise licensing - not model development.

AI platform and tooling providers. These vendors provide the infrastructure for building, deploying, and managing AI systems: cloud ML platforms from Amazon, Google, and Microsoft; MLOps tools like Weights and Biases or MLflow; vector databases for search and retrieval. Your need for these depends on how much custom AI development you are doing in-house. Organizations that rely primarily on off-the-shelf AI applications may not need dedicated ML platform tooling.

Horizontal AI application vendors. These organizations build AI-powered tools for general business functions: writing and content creation, meeting transcription and summarization, coding assistance, customer service automation, search and knowledge management. Microsoft Copilot, Notion AI, GitHub Copilot, and similar products sit here. These are the vendors most organizations encounter first.

Vertical AI application vendors. These organizations build AI solutions for specific industries or functions: AI for legal review and contract analysis, AI for medical imaging interpretation, AI for supply chain forecasting, AI for financial risk modeling. Vertical vendors typically offer more domain-specific accuracy and compliance alignment but less flexibility than horizontal tools.

AI services providers. Consulting firms, systems integrators, and boutique AI implementation specialists who help organizations build, deploy, and manage AI systems. These are not software vendors; they sell expertise and labor. For organizations that lack internal AI capability, a services provider is often the first AI investment made - before selecting platforms or applications.

How to Conduct a Landscape Assessment

A landscape assessment has four steps.

Step 1: Define your use case categories. Before researching vendors, be explicit about what you are trying to do. "We want to use AI" is not a use case. "We want to reduce time spent on first-draft contract review by 40%" is a use case. Most organizations have three to eight distinct AI use case categories that are either currently active or planned within 18 months. List them. This list defines the categories of vendors you need to understand.

Step 2: Map the market for each use case. For each use case category, identify the vendors that serve it. Industry analyst reports - Gartner Magic Quadrant evaluations, Forrester Wave reports - provide structured market maps for established categories. For newer or more specialized categories, peer conversations, professional association research, and specialist press provide better coverage than general analyst firms.

A useful shortcut: ask your top-three most sophisticated peer organizations who they use for each function and what their experience has been. Peer intelligence cuts through vendor marketing more efficiently than almost any other source.

Step 3: Assess market dynamics. Understanding the market means understanding more than the current vendor list. You need to understand the forces shaping the market:

  • Is this category consolidating (fewer, larger vendors acquiring smaller ones), or fragmenting (new entrants appearing regularly)?
    - Are the dominant vendors in this space financially stable, or are they burning venture capital at a rate that creates longevity risk?
    - Is the technology in this category mature and differentiating on features, or is it still early and differentiating on reliability?
    - Are there regulatory developments that might change what products in this category can legally offer?

Step 4: Identify your shortlist criteria. Before approaching vendors, document the criteria you will use to create your evaluation shortlist. Common criteria: minimum scale of organization the vendor can serve, geographic data residency requirements, integration requirements with your existing technology stack, security certifications, pricing model fit, and references in your industry or function. Apply the criteria to create a shortlist of five to eight vendors before you begin detailed evaluation.

Red Flags in Vendor Positioning

The AI vendor market contains a proportion of vendors who market capabilities they do not yet reliably deliver. Several signals warrant additional scrutiny.

"AI-powered" without specifics. When a vendor describes their product as "AI-powered" but cannot explain which AI capabilities are doing which jobs, the AI component may be superficial - a marketing layer on top of traditional software.

No referenceable customers in your context. A vendor who cannot provide two or three customer references in your industry or for your specific use case is either very new (legitimate for early-stage products) or has been unable to retain customers at scale (a warning sign).

Accuracy claims without methodology. "Our system achieves 97% accuracy" sounds compelling. But accuracy on what dataset, with what definition of accuracy, measured by whom, under what conditions? Claims without methodology are not evidence.

Resistance to proof of concept. A vendor who discourages or complicates a limited proof of concept before a significant commitment is a vendor who is uncertain about how their product will perform on your data and in your context.

Key Takeaways

  • Map the market before evaluating vendors. Knowing the landscape prevents you from optimizing within a subset of the available options.
    - The AI vendor market has five layers: foundation model providers, AI platform and tooling, horizontal AI applications, vertical AI applications, and AI services. Each layer serves different needs.
    - Define use cases before researching vendors. Vague buying intent produces vague vendor responses and poor selection decisions.
    - Assess market dynamics, not just vendor lists. Consolidation trends, vendor financial health, and regulatory trajectories affect the long-term viability of any vendor relationship.
    - Peer intelligence is underused and undervalued. What your respected peers have experienced with specific vendors is more actionable than analyst reports or vendor marketing.
    - Red flags in vendor positioning: vague AI capability claims, absence of relevant references, unsupported accuracy statistics, and resistance to proof of concept.