Avoiding Vanity Metrics
At the regional carrier meeting in Memphis, the operations director of a 52-truck dry van fleet stood up and announced that his carrier had moved 14 percent more tons in the first half of the year than the same period the year before. The room applauded. He sat down feeling like the star of the day. What he did not announce, because the number was not on his dashboard, was that his carrier's net margin had declined from 7.2 percent to 4.1 percent over the same period, that deadhead had risen from 19 percent to 28 percent as the fleet chased volume, and that three trucks had suffered roadside breakdowns in the past 60 days totaling $43,000 in repair and penalty costs. The fleet was working harder than it had ever worked. It was also making less money than it had in three years. The tons-moved number was a standing ovation for activity that was destroying margin.
What a Vanity Metric Actually Is
A vanity metric is a number that makes you feel good without telling you whether the business is healthy. In freight, vanity metrics cluster around volume, activity, and technology adoption: tons moved, loads dispatched, miles run, AI feature utilization rates, and on-time delivery percentages measured against low-bar internal standards. These numbers are not lies. They measure real activity. But they systematically conceal the economic reality of how that activity is being executed because they measure output without measuring cost, efficiency, or margin.
The critical distinction is between metrics that tell you what happened and metrics that tell you whether what happened was good for the business. Tons moved tells you what happened. Tons moved per dollar of operating cost tells you whether it was good for the business. Loads dispatched tells you what happened. Revenue per truck per week tells you whether those dispatched loads were being executed profitably. Miles driven tells you what happened. Deadhead percentage tells you whether those miles were being converted to revenue.
A fleet that measures only vanity metrics is operating with a dashboard that shows the engine working hard while the speedometer is broken. The harder the engine works, the more confident the driver feels, even as the car moves nowhere useful. In freight, the equivalent is a carrier that celebrates rising load counts while its empty miles are rising, its maintenance costs are spiking, and its CSA (Compliance, Safety, Accountability) scores are drifting toward the alert thresholds that close freight sourcing channels.
The dual-axis scorecard, introduced in the first lesson of this chapter, is the antidote. But this lesson goes deeper: it examines the specific ways that volume dashboards hide deadhead and breakdown problems, the psychological mechanisms that make vanity metrics so persistent despite the damage they cause, and the concrete substitutions that convert a vanity dashboard into an operational intelligence tool for a fleet AI strategist.
Volume Metrics and What They Hide
Volume metrics are the most common vanity metrics in freight and the most dangerous, because volume growth is often the genuine strategic goal of a carrier's sales and operations plan. Rising load counts and rising miles are not bad signals in isolation. They become vanity metrics when the dashboard reports them without the margin context that determines whether the growth is profitable. There are four specific hiding patterns that volume dashboards produce in AI-assisted fleet environments.
The Deadhead Hidden by Load Count
Load count is the metric that most perfectly conceals deadhead deterioration. When an AI dispatch system increases the fleet's load acceptance rate by matching drivers to available freight more efficiently, the load count rises. But if the AI is optimizing for load count rather than for loaded-mile efficiency, the routes it proposes may send trucks to loads that are geographically convenient but require long empty repositioning legs to reach the next load. The load count keeps rising. The deadhead percentage keeps rising too. The fleet is moving more loads and making less money per mile.
The specific mathematical relationship: if a fleet runs 100 loads per week at 22 percent deadhead and rises to 116 loads per week at 28 percent deadhead, the load count improvement (16 percent growth) is visible on the volume dashboard. What is hidden is that the loaded-mile ratio has deteriorated. Pre-improvement: 100 loads, assume 200 miles per load average, 20,000 loaded miles, 5,620 deadhead miles, revenue at $2.20 per loaded mile equals $44,000. Post-"improvement": 116 loads, same 200 miles per load, 23,200 loaded miles, but deadhead has risen to 28 percent of now 32,222 total miles, meaning 9,022 deadhead miles. Revenue at $2.20 per loaded mile: $51,040. Revenue per mile has fallen because operating costs (fuel, driver hours, wear) apply to total miles, not loaded miles. The fleet is spending more on the same lanes while reporting a load count success.
The substitution: replace load count with loaded-mile ratio (loaded miles divided by total miles) and revenue per truck per week as the primary volume metrics. These immediately expose the deadhead problem that load count conceals. An AI dispatch system should be evaluated by whether it improves the loaded-mile ratio, not by whether it increases the raw number of loads dispatched.
The Maintenance Cost Hidden by Utilization Rate
Utilization rate (the percentage of available truck time spent under load) is a metric that fleets deploy AI to improve, and a rising utilization rate is generally a good signal. But utilization rate hides a specific breakdown problem when it rises faster than the maintenance program can accommodate. A truck running at 80 percent utilization accumulates miles and engine hours at a faster rate than a truck running at 65 percent. If the maintenance intervals are calibrated to a 65 percent utilization assumption (as they often are when a fleet first deploys AI dispatch and its trucks are suddenly running harder), the maintenance schedule falls behind the actual wear rate, and failure events begin to accumulate.
The hiding mechanism is temporal: a utilization rate improvement appears on the dashboard within weeks of AI deployment. The maintenance backlog that the higher utilization is creating takes two to four months to manifest as roadside failures. By the time the breakdown rate rises, the utilization rate has been celebrated in two or three monthly reports, and the causal connection between the two is invisible to a fleet that is measuring utilization without simultaneously tracking breakdown rate on the same dashboard.
The substitution: track utilization rate and breakdown rate together on the dual-axis scorecard, with an explicit note that rising utilization on a fleet that has not adjusted maintenance intervals is a breakdown-rate leading indicator. A fleet whose utilization rises from 65 to 78 percent in month one after AI deployment should immediately audit the maintenance schedule for all trucks and confirm that preventive maintenance intervals have been compressed proportionally. If they have not, the dashboard's utilization success is a 60-to-90-day advance notice of a breakdown problem the fleet is currently celebrating.
The Driver Shortage Problem Hidden by Headcount Metrics
Driver headcount and driver-hours-run are volume metrics that AI tools routinely improve by optimizing the use of available drivers against available loads, and both are worth tracking. But in a market with an 80,000-driver shortage where driver-hours are the scarcest resource in the business, headcount metrics hide the specific problem that matters most: are the drivers the fleet has being used profitably or merely heavily?
A fleet can improve driver-hours-run while simultaneously worsening the revenue generated per driver-hour if the AI is optimizing for driver utilization rather than for revenue-per-driver-hour. The driver runs more hours. The fleet shows more driver-hours on the dashboard. But if those additional hours include a larger share of non-revenue time (repositioning, loading and unloading dwell, waiting for available loads in a lane with thin backhaul opportunities), the revenue per driver-hour declines even as the raw driver-hours number rises.
The substitution: track revenue per driver-hour or revenue per driver per week alongside driver utilization. The combination reveals whether additional driver-hours are being converted to revenue or merely converting a driver's compliance-allowed hours into non-revenue activity that looks like work on the dashboard but does not appear in the margin.
The CSA Drift Hidden by On-Time Delivery Rate
On-time delivery rate is a customer-satisfaction metric that most carriers track and most shippers require. It is also one of the most reliable vanity metrics in freight AI dashboards, because on-time delivery can be maintained in the short term through driver behavior that accumulates HOS (hours of service) violations: drivers pushing hours to make a delivery window, skipping required rest breaks, or running beyond their ELD (electronic logging device) limits with the expectation that the log will be corrected later. The on-time delivery rate holds or improves. The HOS Compliance BASIC score deteriorates. The fleet reports a delivery success while building a compliance liability that will appear in the CSA data three to six months later.
The hiding mechanism is a fundamental mismatch in reporting cadence: on-time delivery rate updates daily or weekly. CSA BASIC scores update monthly, with a rolling 24-month weighting that smooths the signal and delays the appearance of a new violation pattern. A fleet using AI dispatch to chase on-time targets that can only be met by pushing drivers can show six months of excellent on-time data before the HOS violations accumulated during that period begin to dominate the CSA score.
The substitution: track on-time delivery rate alongside HOS violation count per period on the same dashboard. If on-time rate is improving while HOS violations are rising, the dashboard is showing the carrier working harder than its drivers can legally do, and the CSA consequence is already in process even if it has not yet appeared in the BASIC scores. The AI dispatch system's route plans should be reviewed for HOS feasibility as a standard compliance check, not an optional verification step.
AI Feature Metrics: The Technology Vanity Category
When a fleet deploys an AI dispatch or predictive maintenance system, the vendor typically provides a dashboard showing tool adoption and usage statistics: number of AI-suggested loads accepted, number of predictive maintenance alerts reviewed, percentage of dispatches routed through the AI system, and similar activity metrics. These numbers exist because the vendor wants to demonstrate that the tool is being used, and a fleet manager who is asked whether the AI is working can point to them as evidence of adoption. They are the most pure form of vanity metric in a fleet AI context because they measure the use of the tool, not the outcome of using it.
A fleet that accepts 85 percent of AI-suggested load assignments is not necessarily improving its deadhead percentage. It is accepting 85 percent of the tool's suggestions, which may or may not be good routing decisions depending on whether the tool is well-calibrated to the fleet's lanes and freight mix. A fleet that reviews 94 percent of predictive maintenance alerts is not necessarily preventing breakdowns. It is reviewing alerts, which may be producing good shop work orders or may be generating review activity that does not change the maintenance schedule because the shop is overwhelmed or skeptical of the alerts.
The substitution: for AI dispatch, replace "AI suggestions accepted" with deadhead percentage and revenue per truck. For predictive maintenance, replace "alerts reviewed" with breakdown rate and average time from alert generation to work order completion. These metrics measure what the tool's outputs are actually doing to the business, not whether the tool is being used. A 40 percent AI suggestion acceptance rate that produces a 9-point deadhead improvement is far more valuable than a 90 percent acceptance rate that produces a 2-point improvement because the tool is proposing marginally better loads rather than dramatically better load sequences.
Building a Vanity-Metric Audit for Your Fleet
A vanity-metric audit is a structured review of the fleet's current reporting dashboard that asks a single question about each metric on the dashboard: does this metric tell me whether the business is healthier or does it tell me whether the business is busier? If the answer is the latter, the metric needs a margin partner on the same dashboard or it needs to be removed from the primary reporting view.
The audit has five steps that any fleet manager can complete in a half-day working session with the TMS (transportation management system) data and the telematics system's alert log.
Step One: List Every Metric Currently on the Dashboard
Pull the last three monthly dashboard reports and list every metric that appears. Count the number of metrics that measure volume or activity (loads, miles, utilization rate, on-time rate, alert count, tool acceptance rate) versus the number that measure margin or safety (deadhead percentage, revenue per truck, breakdown rate, CSA BASIC scores, HOS violation count). In most fleet AI dashboards, the volume metrics outnumber the margin-and-safety metrics by three to one or worse. This ratio is the most honest summary of whether the dashboard is measuring business health or business activity.
Step Two: Apply the Hiding Test
For each volume metric on the dashboard, ask: can this metric show an improvement number while the corresponding margin or safety metric is worsening simultaneously? If the answer is yes, the volume metric is capable of hiding a margin or safety problem. Load count: yes, can rise while deadhead rises. Miles driven: yes, can rise while revenue per mile falls. Utilization rate: yes, can rise while breakdown rate rises. On-time delivery rate: yes, can hold while HOS violations accumulate. AI suggestions accepted: yes, can be high while deadhead improvement is minimal. Every metric that passes the hiding test needs a companion metric on the same dashboard that would catch the hidden problem.
Step Three: Add the Margin and Safety Companions
For each volume metric that passed the hiding test, add the margin or safety companion metric to the same dashboard view. The companions are the metrics from the dual-axis scorecard: deadhead percentage, revenue per truck, loaded-mile rate, cost per mile, breakdown rate, CSA BASIC scores for all seven categories, HOS violation count, and DVIR (driver vehicle inspection report) defect rate. If the dashboard cannot display the companion metrics in the same view as the volume metrics, the volume metrics and the companion metrics should at minimum appear on the same page or slide in the management report, so the owner sees them together every time.
Step Four: Define the Alert Thresholds
A vanity metric becomes most dangerous when the dashboard has no alert threshold that flags a problem. Volume metrics feel safe precisely because they almost never alert: load count rarely falls dramatically in a short period, miles driven rarely collapse without an obvious cause, utilization rate trends smoothly. Margin and safety metrics alert when something is actually wrong: deadhead crosses a threshold, breakdown rate exceeds the baseline by a percentage point, a BASIC score approaches the FMCSA alert level. Define the alert thresholds for each metric on the dashboard and configure the reporting system or the monthly report template to flag any metric that crosses its threshold in red. A dashboard that shows green on all volume metrics while hiding red on all margin metrics is doing precisely the wrong thing.
Step Five: Set the Primary and Secondary Metrics
After the audit, the dashboard should have a clear hierarchy: the primary metrics are the margin and safety indicators (deadhead percentage, revenue per truck, breakdown rate, CSA BASIC scores), and the secondary metrics are the volume and activity indicators that provide context. The volume metrics are not removed from the dashboard, but they are no longer the headline. They are the supporting data that explains the primary metric's movement: load count rose because the fleet was chasing volume, which also explains why deadhead rose. That narrative is only possible if the primary metric (deadhead) is in the headline position and the secondary metric (load count) is in the context position.
The AI Program Vanity Trap
There is one final category of vanity metric that is specific to AI fleet programs and deserves direct attention: the metrics that make the AI program look successful without demonstrating that the AI is producing business value. These include the adoption metrics discussed above (acceptance rate, alert review rate), but they also include a more subtle category of milestone metrics: "AI fully integrated with TMS," "all dispatchers trained on AI tool," "predictive maintenance module activated on all trucks," "first AI-suggested dispatch executed." These are real milestones and they are worth celebrating internally. They are not ROI metrics and they should never be presented to an owner as evidence that the AI program is working.
An AI program that is fully integrated, fully adopted, and producing zero improvement in deadhead, zero reduction in breakdowns, and no change in CSA scores is a fully implemented failure. The milestones tell you the tool is deployed. The margin and safety metrics tell you whether the deployment is producing value. A fleet AI strategist who presents milestone adoption metrics to an owner as evidence of success is making the same error as the operations director at the Memphis carrier meeting: celebrating a standing ovation for activity that is not moving the margin.
The specific guard against the AI program vanity trap is the same dual-axis scorecard the chapter has been building: if the metric cannot be expressed as a change in deadhead percentage, revenue per truck, breakdown rate, or CSA BASIC score, it is likely a vanity metric or an internal milestone. It may be worth tracking internally for program management purposes. It should not be the headline of an owner-level ROI report. The headline of an owner-level ROI report is the margin story, and the margin story is made entirely of metrics that tell you whether the business is healthier, not whether the AI tool is busier.
Key Takeaways
- A vanity metric is a number that makes you feel good without telling you whether the business is healthy; in freight, vanity metrics cluster around volume and activity (tons moved, loads dispatched, miles run, AI acceptance rate) and systematically conceal the economic reality of how that activity is being executed.
- Load count is the metric that most perfectly conceals deadhead deterioration; a fleet can report 16 percent load count growth while simultaneously running 28 percent deadhead versus 22 percent pre-growth, converting the efficiency improvement into a margin decline the dashboard does not show.
- Utilization rate hides breakdown risk because the maintenance backlog created by higher utilization takes two to four months to manifest as roadside failures; a fleet celebrating a utilization rise from 65 to 78 percent without immediately auditing and compressing its maintenance intervals is building a breakdown problem it will not see coming.
- On-time delivery rate is one of the most reliable vanity metrics in freight AI dashboards because it can be maintained short-term through driver HOS violations that take three to six months to appear in CSA BASIC scores; tracking on-time rate alongside HOS violation count on the same dashboard is the only way to catch this hiding pattern.
- AI feature adoption metrics (suggestions accepted, alerts reviewed, percentage of dispatches routed through AI) measure tool usage, not business outcomes; the substitutions are deadhead percentage and revenue per truck for dispatch AI, and breakdown rate and alert-to-work-order time for predictive maintenance AI.
- The vanity-metric audit has five steps: list every current dashboard metric, apply the hiding test to each volume metric, add the margin-and-safety companion metrics, define alert thresholds, and set the primary (margin-and-safety) and secondary (volume) metric hierarchy.
- AI program milestone metrics (TMS integration complete, dispatchers trained, module activated) are worth celebrating internally and should never be presented to an owner as evidence the AI is working; a fully deployed AI program producing zero improvement in the dual-axis scorecard is a successfully implemented failure.
- The fundamental question that separates a margin metric from a vanity metric is: does this number tell me the business is healthier, or does it tell me the business is busier? Busier is not better in a margin-constrained, driver-scarce freight market.
Skill.re