Recognizing Bad AI Output in Dispatch
Marcus has been dispatching flatbed freight for eleven years. On a Friday afternoon with four phones ringing and three drivers waiting on callbacks, he asks the AI to help him sort through eight load options for a driver named Keisha dropping off a steel coil load in Indianapolis. The AI returns a clean, confident two-paragraph recommendation in about five seconds. Load four looks perfect: a 48,500-pound machinery haul from Indianapolis to Nashville, $2.45 per mile, pickup in 62 miles, drive time three hours and forty minutes with two hours and fifty minutes of Keisha's HOS (hours of service) remaining. Marcus catches it before he calls Keisha. Three hours and forty minutes of drive time against two hours and fifty minutes of available hours is not a schedule problem. It is an FMCSA (Federal Motor Carrier Safety Administration) violation. The load also exceeds Keisha's flatbed trailer payload limit of 48,000 pounds by 500 pounds. And the pickup at 62 miles is outside Marcus's 50-mile deadhead limit. The AI's recommended load fails every single operational constraint. It got the rate right and the direction right and nothing else.
Why AI Dispatch Output Fails in Specific Ways
AI dispatch output does not fail randomly. It fails in predictable, pattern-driven ways that a trained skeptic can identify in about 90 seconds of focused review. Understanding the failure patterns before you read an AI recommendation is what separates a dispatcher who catches bad output before it rolls out the door from one who finds out from the driver on the shoulder of I-65 that something went wrong.
The reason AI dispatch output fails in patterns is that the model is doing pattern-matching, not the kind of rule-checking a human dispatcher does. When the AI recommends a load, it is identifying the load that looks most like a good recommendation based on its training data about what good dispatch recommendations look like. It is not running the load through a sequential checklist of hard constraints the way a careful human would. The AI sees a flatbed load in Indianapolis going south at a competitive rate and pattern-matches it to "good recommendation," without fully processing that a 48,500-pound load on a 48,000-pound trailer is not just a concern to note in passing: it is a legal prohibition that makes the load impossible regardless of its other attributes.
This pattern-matching behavior produces consistent failure signatures. Once you learn to recognize the signatures, you can scan an AI recommendation in a structured way that takes less time than calling the driver to tell them about the load, and far less time than dealing with the consequences of dispatching a non-compliant load. The skeptic's review is the professional discipline that converts AI speed into real productivity without surrendering the judgment that keeps the business safe and legal.
Bad AI dispatch output almost always has a tell. The load looks attractive on the attributes the AI can see: rate, direction, approximate timing. It fails on the constraints the AI was not told, or did not correctly apply. Knowing which constraints to check first is the skeptic's edge.
The Root Causes of Dispatch AI Failures
Before cataloging the specific failure patterns, it helps to understand the three root causes that produce them, because each root cause has a different remedy.
Root cause one: missing context. The AI was not given one or more of the constraints that determine whether a load is viable. It recommended a load that exceeds the payload limit because the payload limit was not in the prompt. It recommended a load that violates HOS because the HOS balance was not provided. The remedy is better prompting (the subject of the previous lesson in this chapter). But the recognition skill remains relevant because prompts can be incomplete even with the best intentions, and the skeptic's review catches what the prompt missed.
Root cause two: constraint mis-application. The constraint was in the prompt but the AI applied it incorrectly. A common example is HOS math: the dispatcher said the driver has 3:30 of drive time remaining, and the AI correctly identified a load with a drive time of 3:15 as fitting within that window. But the AI used an estimated drive time based on distance divided by average speed, without accounting for the 62-mile deadhead leg to the pickup, which consumes additional drive time before the loaded haul even begins. The total drive time (deadhead plus haul) is actually 4:15, which exceeds the 3:30 available. The AI correctly applied the constraint to the wrong input.
Root cause three: hallucination. The AI stated a fact in its recommendation that is not supported by the data provided and is not accurate based on any verifiable source. Rate hallucinations are the most common: the AI cites a rate that does not appear in the load board data provided and that does not match the actual posted rate for the load. Route hallucinations also occur: the AI states a drive time that does not match the actual route mileage at any realistic speed. These hallucinations are particularly dangerous because they look like specific facts sourced from specific data. The skeptic's review of these claims requires checking the cited figures against the actual load board posting or the actual routing tool, not just accepting that the AI has correctly transcribed what it saw.
The Skeptic's Checklist: Five Reads Before You Commit
The skeptic's checklist is a five-item review that a dispatcher, fleet manager, or owner-operator runs on any AI-generated dispatch recommendation before taking action on it. It takes approximately 90 seconds when done consistently and catches the majority of problematic AI recommendations before they become dispatched loads or quoted rates.
Read One: The HOS Math
Every dispatch recommendation from an AI should state the drive time it is assuming and the driver's available hours. Your first read is to check whether those numbers are consistent, and whether the drive time calculation is correct given the actual route.
The HOS math check has three components. First, verify the driver's current HOS balance against the live ELD (electronic logging device), not against the balance you gave the AI (which may be stale). Second, verify that the drive time the AI is using actually reflects the total miles the driver will cover, including any deadhead to the pickup. A common AI error is calculating drive time only from the pickup to the delivery, ignoring the empty miles to reach the pickup. Third, verify the speed assumption. If the AI is calculating drive time at 65 miles per hour on a route with significant urban sections or posted speed limits of 55 miles per hour, the actual drive time will be longer than the AI's estimate. A 280-mile haul that the AI calculates at 4:18 at 65 mph takes 5:05 at 55 mph, enough to flip a compliant recommendation into a violation.
The HOS check is always the first read because an HOS violation is the most acute regulatory risk in a dispatch recommendation. A wrong rate costs money. An HOS violation costs money, CSA (Compliance, Safety, Accountability) score points, and potentially operating authority. The FMCSA penalty for placing a driver in violation is up to $16,000 per instance for the carrier, and a driver who is caught in a violation during a roadside inspection faces their own consequences that can affect the carrier's safety rating. HOS is the non-negotiable first check.
Read Two: The Weight and Equipment Match
The second read verifies that the recommended load is physically compatible with the truck and trailer assigned to the recommendation. This check has two parts: the payload weight and the equipment type.
Payload check: compare the load's stated gross weight against the trailer's legal payload capacity. This is not "does it feel close enough" math. Federal bridge laws and state permit requirements have specific weight limits, and exceeding them creates both a violation risk and a safety risk. A 500-pound overage on a 48,000-pound limit may seem minor, but it is legally the same as a 5,000-pound overage: both are over-weight operations that require either a permit or a weight reduction. The AI will not know your trailer's specific rated capacity unless you told it, and even if you did, payload math is an area where AI mis-application errors are common.
Equipment check: confirm that the recommended load type is compatible with your specific equipment configuration. A flatbed load cannot go in a dry van. A refrigerated load requires a reefer with an operating unit and adequate refrigerant. A load requiring a lift gate needs a truck with one. A load with height restrictions requires confirming the trailer deck height against the clearances on the posted route. If the AI was not given detailed equipment specifications, its recommendation may match the general equipment category (flatbed, reefer, dry van) without matching the specific configuration details that determine whether the load can actually be accepted.
Read Three: The Rate Check
The rate check verifies that the rate the AI is citing matches what is actually posted on the load board for this specific load, and that the rate meets your carrier's minimum floor after fuel surcharge and accessorial charges are factored in.
The first part of the rate check is simple: pull up the actual load board posting for the recommended load and confirm the rate matches what the AI stated. This sounds obvious, but rate discrepancies between AI output and actual postings are surprisingly common. They arise from three sources: the AI cited a rate from stale data (the posting changed between when the data was pulled and when the recommendation was made), the AI rounded or approximated a rate from the data, or the AI hallucinated a rate that was not in the data at all. A 30-second load board confirmation catches all three of these errors before you quote the rate to the driver or commit to the broker.
The second part is the all-in rate check. Load board posted rates are base rates. The actual revenue per mile depends on whether fuel surcharge, detention pay, accessorial charges, or other adjustments apply to the specific load. An AI that cites a base rate of $2.20 per mile on a load that requires two hours of driver wait time for loading (detention starting at a rate you are not sure the broker honors) may be citing a revenue-per-mile figure that does not reflect the real economics of the load. The all-in rate check asks: what is the actual revenue when all costs and adjustments are included, and does that all-in figure meet the carrier's floor?
Read Four: The Deadhead and Pickup Window
The fourth read checks two time and distance elements that AI recommendations frequently get wrong: the deadhead miles to the pickup location and the pickup window.
Deadhead check: verify the actual mileage from the driver's current location (or the planned drop point) to the load pickup address. AI systems frequently underestimate deadhead distance because they calculate "as the crow flies" distances or use route estimates that do not account for the driver's actual location, posted truck route restrictions, or urban routing that adds significant miles versus the straight-line estimate. A load the AI calls 45 miles of deadhead may be 78 miles by the actual truck route from the driver's drop point to the pickup address. If your deadhead tolerance is 75 miles, that 78-mile actual makes the load non-viable regardless of how attractive the rest of the match looks.
Pickup window check: confirm the load's stated pickup window against the driver's realistic arrival time given deadhead distance and current location. An AI that recommends a load with a pickup window closing in 90 minutes from a location that is actually 95 minutes away has given you a recommendation that is physically impossible to execute. This error is particularly common when the AI is not given the driver's precise current location and instead estimates from the last known position (which may be the origin city, not the specific drop address, adding significant position error).
Read Five: The Route and Permit Flag
The fifth read is a brief scan for any characteristics of the load that might indicate a permitting requirement, a restricted route, or a specialized compliance need that the AI may not have surfaced in its recommendation.
Oversize and overweight loads are the primary trigger. If the AI is recommending a load that appears to have unusual dimensions (width over 8 feet 6 inches for standard highway travel, height over 13 feet 6 inches, length over legal limits for the applicable state) or weight approaching or exceeding 80,000 pounds gross vehicle weight, the dispatcher needs to confirm whether the load requires a state permit, a specific route, an escort vehicle, or travel-time restrictions (many oversize loads cannot travel at night or during restricted hours). An AI recommendation that does not mention permit requirements for an oversize or overweight load is not a clean recommendation: it is an incomplete one that the dispatcher needs to research before committing.
Hazardous materials (hazmat) loads are the second trigger. If the load involves any commodity that requires a hazmat placard, the driver must hold the appropriate endorsement on their CDL (commercial driver's license), the trailer must be clean and placarded, and the carrier must have a current hazmat registration with the FMCSA. An AI that recommends a hazmat load without verifying the driver's endorsement and the carrier's registration is recommending a load the carrier may not legally haul. A quick check of the driver's CDL endorsements and the carrier's DOT authority is the five-minute review that prevents a hazmat violation.
For most loads on standard lanes with standard freight, the route and permit read takes about 30 seconds: a glance at the commodity description and dimensions, and a quick confirmation that nothing triggers a specialized compliance requirement. For loads that do trigger a flag, the investigation takes longer but is far preferable to the alternative of discovering the permit requirement at the pickup dock when the shipper asks for your oversize permit and you do not have one.
The Five Bad Output Patterns and Their Tells
Beyond the five-read checklist, certain output characteristics indicate a higher probability that the AI recommendation contains errors. Recognizing these patterns allows the skeptic to apply extra scrutiny before committing.
Pattern One: The Suspiciously Clean Recommendation
The suspiciously clean recommendation satisfies every constraint the dispatcher stated, has a rate that is noticeably above market, and is presented with no qualifications, no flagged uncertainties, and no noted trade-offs. In real freight, a load that perfectly matches every constraint and pays above market is rare. A recommendation with that profile and no caveats should trigger extra scrutiny: is the rate real (check the board), is the drive time achievable (check the routing), is the weight accurate (check the load spec). Perfect-looking recommendations are worth the most careful verification precisely because they are the ones most likely to be accepted without a second look.
Pattern Two: The Smooth Round-Number Rate
As established in the previous lesson, training-data rate estimates come out as smooth, round numbers: "$2.25 per mile," "$1.95 per mile." Actual load board postings are typically less tidy: "$2.17 per mile," "$2.31 per mile." A recommendation that cites a smooth, round rate is worth checking against the actual posting. This does not mean the round-number rate is wrong: sometimes the actual posting is a round number. But it is a tell that warrants a 30-second board check.
Pattern Three: The Time That Doesn't Add Up
Check the arithmetic whenever the AI cites a drive time. Divide the mileage by the stated speed assumption. If the AI says "245 miles, approximately 3 hours 45 minutes," that implies a speed of about 65 miles per hour. On an interstate route, that may be optimistic. On a route with significant urban sections through Nashville or Memphis, it may be significantly optimistic. Grab the route in Google Maps or your routing software for a quick sanity check. If the AI's drive time estimate is 20 minutes shorter than the routing tool shows, that 20 minutes may be the difference between a compliant run and a violation.
Pattern Four: The Unstated Data Source
Any specific fact in an AI dispatch recommendation that does not include a citation to the data you provided is a fact the AI may have generated from training knowledge rather than from the actual load board or document data. Rate figures with no citation, drive times with no routing source, weight figures with no load-spec citation: each of these is an unstated data source that the skeptic should verify before committing. The citation requirement habit from the previous lesson produces cited output; the skeptic's review catches the uncited facts that slip through when citations are imperfect.
Pattern Five: The Confident Compliance Claim
Be particularly alert to any AI output that makes an explicit compliance claim: "This load satisfies your HOS requirements," "This load is within your payload limit," "The driver holds the required endorsements for this freight." Compliance claims are only as accurate as the data the AI had available to make them, and they require specific, current data to be reliable. A compliance claim made on stale HOS data (from two hours ago), on an assumed payload limit (never stated in the prompt), or on general knowledge of what a flatbed driver typically hauls is a compliance claim that has not been verified against the real facts. Treat confident compliance claims as hypotheses to be confirmed, not as determinations to be trusted.
The Bad Output Scenario Workshop
This section works through three realistic bad-output scenarios in detail, showing how the skeptic's checklist catches each one and what the correct dispatch action is.
Scenario One: The HOS Miss
The AI recommends Load B for driver Keisha: a 310-mile dry van haul from Indianapolis to Louisville at $2.30 per mile, with a stated drive time of 4 hours 45 minutes against Keisha's stated HOS of 5 hours remaining. Appears compliant with 15 minutes to spare.
Skeptic's first read (HOS math): Keisha's HOS was provided as 5 hours, but what time was that balance pulled? The dispatcher checks the live ELD: Keisha logged into driving status 18 minutes ago after completing the delivery, putting her current HOS at 4:42 remaining, not 5:00. The recommended load requires 4:45 of drive time, which now exceeds the actual available hours by 3 minutes. Additionally, the pickup for Load B is 28 miles from Keisha's current drop point, adding approximately 28 minutes of additional drive time not reflected in the AI's 4:45 estimate. Total actual drive time: approximately 5:13, against 4:42 remaining. This is not a close call: it is a violation. The dispatcher does not dispatch this load.
Correct action: Re-prompt with Keisha's current HOS of 4:42 (verified against live ELD) and a note that total drive time must include the deadhead leg to pickup. Or, if the timing cannot be made to work with any available compliant load, park Keisha for 10 consecutive hours to reset the daily clock and check again in the morning.
Scenario Two: The Rate Hallucination
The AI recommends Load F for driver Marcus: a flatbed steel haul from Columbus to Pittsburgh at "$2.78 per mile, consistent with current market conditions on this lane." The dispatcher pulls up the actual load board posting for Load F. The posted rate is $2.12 per mile. The $2.78 figure appears nowhere in the load board data pasted into the prompt. The AI hallucinated a rate that is $0.66 per mile higher than the actual posting, producing a recommendation that looks profitable at $2.78 but falls below the carrier's $2.25 per mile floor at the actual rate of $2.12.
Correct action: Verify every specific rate figure against the actual load board posting before treating it as a real market figure. A rate cited by the AI that cannot be found in the data provided is a fabricated rate and should be treated as such. In this case, Load F at $2.12 per mile falls below the floor and should be declined.
Scenario Three: The Equipment Mismatch
The AI recommends Load G for driver Priya: a fresh produce haul from Indianapolis to Atlanta at $2.55 per mile with a stated drive time of 7 hours and 30 minutes, fitting within Priya's 8 hours of remaining HOS. The load sounds excellent. The dispatcher notices the commodity: fresh produce requiring continuous temperature control at 34 degrees Fahrenheit. Priya drives a standard dry van. No reefer unit. The load is physically impossible for Priya's equipment.
Correct action: The dispatcher checks the original equipment spec in the prompt and confirms that dry van was stated. The AI applied the constraint "driver has a suitable truck" correctly in the sense that it matched a flatbed driver to a flatbed load, but failed in the sense that the produce load requires refrigeration that a dry van cannot provide. The equipment check in the skeptic's second read catches this before Priya drives 45 minutes to the pickup only to be turned away because the trailer is not refrigerated.
Building the Verification Habit Into the Workflow
The skeptic's checklist is most effective when it becomes a reflexive part of the dispatch workflow rather than an occasional extra step when something looks wrong. The dispatcher who only applies the checklist when a recommendation "seems off" is the dispatcher who gets tripped up by the recommendation that looks right but is not. Bad AI output typically looks good. That is precisely why it is dangerous and why the checklist needs to be applied consistently, not selectively.
Integrating the five-read checklist into the daily workflow takes approximately 90 seconds per recommendation when done consistently. For a dispatcher handling 15 to 20 loads per day, that is 23 to 30 minutes of verification time for roughly 75 to 85 percent time savings versus doing the full load analysis manually. The math strongly favors keeping the checklist in place even on the days when nothing in the AI's output looks suspicious.
The checklist also functions as a professional accountability document. When a dispatcher runs the five-read checklist and commits a load, they can note in the TMS (transportation management system) dispatch record that HOS was confirmed against live ELD, rate was confirmed against board posting, weight was confirmed against trailer limit. That notation is not just good practice: it is the documentation that matters when a shipper or an FMCSA auditor asks how the dispatch decision was made. A dispatch record that shows AI recommendation plus human verification is a defensible record. A dispatch record that shows only an AI recommendation with no documented human review is a record that says the AI was the decision-maker, which is both operationally wrong and legally problematic.
For owner-operators, the verification habit is especially important because there is no second set of eyes on the dispatch decision. A solo operator who dispatches on AI recommendations without running the five-read checklist is operating without the review layer that a two-person dispatch team provides automatically through the simple act of one dispatcher showing a recommendation to another before committing. The owner-operator has to build that second-set-of-eyes function into their own workflow, and the five-read checklist is how they do it.
The deeper lesson of all three scenarios in the workshop section is that AI output that fails a checklist item fails for a reason that is directly connected to the carrier's operational and regulatory reality. The HOS miss fails because it would put a driver in violation and expose the carrier to a $16,000 FMCSA fine. The rate hallucination fails because it would produce a below-floor dispatch that erodes margin on every load where it goes undetected. The equipment mismatch fails because it would waste a driver's drive time and HOS on a load they cannot physically haul, creating a compounded problem: a wasted deadhead, a missed pickup, and an angry shipper. Each checklist item exists to catch a specific category of harm before it happens. Running the checklist is the practice of preventing harm, not of second-guessing the AI.
The AI proposes. The dispatcher verifies. The dispatcher commits. That sequence, consistently applied, is how a 23-truck regional carrier captures the speed advantage of AI-assisted dispatch without surrendering the compliance posture that keeps it operating. The checklist is the mechanism that makes that sequence real rather than aspirational.
Key Takeaways
- AI dispatch output fails in predictable patterns, not randomly. The failure modes are HOS math errors, weight and equipment mismatches, rate hallucinations or stale-data rate errors, deadhead underestimates, and pickup window impossibilities. Knowing the patterns lets you apply the skeptic's checklist in 90 seconds rather than discovering problems after dispatch.
- The three root causes of bad AI dispatch output are missing context (the AI was not given a constraint), constraint mis-application (the AI applied a constraint incorrectly, often by using the wrong input for HOS drive time math), and hallucination (the AI stated a specific fact not supported by the provided data or any verifiable source).
- The five-read skeptic's checklist covers HOS math (verify drive time including deadhead against live ELD balance), weight and equipment match (payload against trailer limit, equipment type against load requirements), rate check (confirm against actual board posting and all-in economics), deadhead and pickup window (actual routing tool miles and realistic arrival time), and route and permit flags (oversize, overweight, hazmat triggers). Runs in approximately 90 seconds consistently applied.
- A suspiciously clean recommendation, a smooth round-number rate, a drive time that does not compute at realistic speeds, a rate or fact with no cited data source, and a confident compliance claim made on unverified data are the five bad-output patterns that warrant extra scrutiny before committing a load.
- An HOS miss caught by the checklist prevents a $16,000 FMCSA civil penalty per instance plus CSA (Compliance, Safety, Accountability) score damage. A rate hallucination caught by the checklist prevents below-floor dispatching that erodes margin on every load where it goes undetected. An equipment mismatch caught by the checklist prevents a wasted deadhead and a shipper penalty at the pickup dock.
- The checklist must be applied consistently, not selectively. Bad AI output typically looks good; that is why it is dangerous. Applying the checklist only when something looks suspicious is the strategy that gets a dispatcher tripped up by the recommendation that appears perfect but fails a constraint check on the second read.
- Documenting the verification in the TMS dispatch record (HOS confirmed against live ELD, rate confirmed against board posting, weight confirmed against trailer limit) creates the defensible dispatch record that a shipper or FMCSA auditor can review. A record with documented human verification is meaningfully different from a record showing only an AI recommendation.
- The accountability chain never changes: AI proposes, dispatcher verifies with the five-read checklist, dispatcher commits and documents. Owner-operators who run solo must internalize the checklist as their built-in second review, because the absence of a colleague does not relax the compliance or safety requirements the checklist is designed to protect.
Skill.re