โ†
AI for Energy & Utilities
Aware ยท M1 ยท lesson 1 of 19 ยท in progress
Preview โ€” browse every lesson free. Enroll to mark lessons complete, open partner links and save your progress. Login & enroll โ†’
AI Hallucinations in an Energy Context
๐Ÿ“–
now learning

AI Hallucinations in an Energy Context

15 min

The outage report looked perfect. Clean structure, industry-standard language, the right NERC standard references, a plausible restoration sequence with equipment IDs. The field supervisor signed it and it went into the incident log. Three weeks later, during a compliance audit, the auditor pulled the report and tried to cross-reference the equipment ID referenced in the switching sequence. It did not exist in the GIS. It had never existed. The AI had invented it, confidently, fluently, without a single hedging word. That is what a hallucination looks like in an energy context. Not a mistake the system apologizes for. A fabrication the system presents as fact.

What Hallucination Means Technically and Why It Happens

AI hallucination is the term used when a large language model (LLM) produces output that is factually incorrect, fabricated, or internally inconsistent, but delivered with the same fluency and confidence as accurate output. The word "hallucination" is borrowed from psychology, and it is an apt metaphor: the model is not lying (it has no intent), and it is not guessing randomly. It is generating the most statistically plausible sequence of words given the input, and sometimes that sequence happens to be wrong.

Understanding why this happens requires a brief look at how LLMs work. A language model is trained on a vast corpus of text, learning statistical relationships between tokens (words and word-parts). When you give it a prompt, it generates a continuation by sampling from probability distributions over possible next tokens, conditioned on everything that came before. The model does not have a database of facts it looks up; it has learned compressed statistical representations of patterns in training text.

For a utility professional, the critical implication is this: the model has no mechanism to distinguish "I know this fact from training data" from "I am generating a plausible-sounding sequence that follows the pattern of this type of document." When it writes an equipment ID in a switching sequence, it is not looking up your GIS database. It is generating a character string that looks like equipment IDs it has seen in training text. If your actual equipment ID format is "SUBS-TX-14B," the model might generate "SUBS-TX-14B" because it has seen that pattern, or it might generate "SUBS-TX-22C" because that also follows the pattern. Both look identical in the document. Only one is real.

This is the hallucination problem in its most dangerous utility form: not obvious nonsense, but plausible fabrication that passes casual review.

The Five Failure Modes That Hurt in Utility Operations

Hallucination manifests differently across utility use cases. Each failure mode has a specific mechanism and a specific detection move. Knowing both is what separates a professional who uses AI safely from one who trusts it naively.

Invented Asset IDs and Equipment References

In any document that references specific utility assets, the AI will generate IDs and references in the style of real IDs without consulting your actual asset registry. Switching orders, outage reports, maintenance work orders, and interconnection study references are all vulnerable. The fabricated asset ID is invisible in the document text because it is formatted correctly. It becomes visible only when someone tries to look it up in GIS, EMS (Energy Management System), or the asset database and it is not there.

Detection move: every asset reference in an AI-generated document must be cross-referenced against the live asset registry before the document is signed, filed, or executed. This is not optional verification; it is the minimum required step for any document that will drive field work or regulatory filing.

Fabricated Regulatory Citations

LLMs have been trained on utility industry text that includes regulatory filings, standards documents, and compliance narratives. They know the naming convention of NERC reliability standards (CIP-003, FAC-003, PRC-019, etc.), FERC orders, and state commission rules. When asked to draft a compliance narrative, the model will produce standard citations that look correct. Sometimes they are wrong: the wrong standard number for the obligation described, a requirement number that does not exist in the cited standard, a version of a standard that has been superseded.

Detection move: every standard citation in an AI-drafted compliance document must be verified against the currently effective version of that standard, pulled directly from the NERC Standards website or the applicable commission docket. Do not verify against your memory of the standard; verify against the text.

Confidently Wrong Restoration Estimates

When asked to summarize an outage and estimate restoration time, an AI using OMS (Outage Management System) data summaries will produce a restoration estimate based on patterns it has seen in training: similar outage types, similar crew counts, similar weather conditions. The estimate will be stated with the same authority as accurate historical data. But it does not know your specific crew's current location, the road access condition of the affected segment, whether the required equipment is in stock at the nearest depot, or the actual switching steps required for your system topology.

Detection move: treat AI restoration estimates as a starting template, not an operational commitment. The field supervisor or dispatch coordinator verifies crew location, equipment availability, and access conditions before any restoration estimate is communicated to customers or regulators. Never let an AI-generated restoration time enter a customer notification without an experienced dispatcher's review.

Invented Precedent and Regulatory History

In rate-case and regulatory work, AI may cite commission orders, precedent cases, or policy interpretations that do not exist. It will give them plausible docket numbers, approximate dates, and summary descriptions that sound authoritative. A regulatory professional who is unfamiliar with the specific proceeding might not catch the fabrication immediately. If a rate-case brief cites a non-existent commission order, the discovery of that fabrication by opposing counsel or commission staff is a serious credibility problem.

Detection move: every regulatory citation in an AI-drafted document must be verified against the commission's actual docket system. Run the docket number, retrieve the actual order, and confirm that the AI's characterization of that order is accurate. If the AI cannot cite a source that exists in the actual docket record, the citation must be removed or replaced with a verified source.

Numerical Interpolation and Fabrication

When an AI is asked to produce a document containing numerical data that was not explicitly in the prompt, it will generate numbers that are plausible in context. A load forecast narrative might contain capacity factor estimates the AI invented. A cost-benefit analysis might contain dollar figures the AI extrapolated from patterns in training data. These numbers are not labeled as estimates or approximations; they appear as facts.

Detection move: any number in an AI-generated document that is not traceable to a source document you provided in the prompt must be flagged for verification. Develop the habit of asking "where did this number come from?" for every quantitative claim before the document leaves your desk.

Worked Example: The Compliance Narrative Failure

Consider a concrete sequence. A compliance analyst at a utility is preparing the annual NERC self-certification for CIP-003-9 (the standard enforceable April 1, 2026 that addresses vendor electronic remote access and supply-chain security for low-impact BES Cyber Systems). She uses an AI tool to draft the compliance narrative, prompting it with a summary of the utility's cyber security controls.

The AI produces a fluent, well-structured narrative. It cites CIP-003-9 correctly. But it also cites "CIP-003-9 Requirement R1.3" as the basis for the physical security control description. CIP-003-9 Requirement R1 has specific sub-requirements, but the analyst does not remember their exact structure. The AI's "R1.3" citation sounds right. She does not verify it against the actual standard text.

In the audit, the auditor notes that CIP-003-9 R1.3 does not exist in the form described. The narrative is citing a requirement that does not match the standard. The utility must now explain how a fabricated requirement citation ended up in a signed self-certification. The compliance posture is exposed: not because the utility's actual controls were deficient, but because the AI-generated narrative was accepted without verification of the regulatory citations.

Watch how the same situation works when a trained professional applies the detection discipline. The analyst receives the AI draft. Before doing anything else, she opens the current effective version of CIP-003-9 in a separate window. She works through the AI narrative line by line, cross-referencing every requirement citation against the actual standard text. She catches the R1.3 discrepancy immediately. She corrects it to the accurate requirement reference. She also catches a second error: the AI cited "CIP-003-9 Attachment 1" for a control that actually lives in CIP-003-9 Attachment 2. Two fabrications caught, neither of which would have been obvious to a reader without the standard open.

The AI draft saved her 45 minutes of writing. The verification step took 20 minutes. Net time savings: 25 minutes. Compliance posture: clean. This is what professional AI use looks like in a compliance context.

Why Energy Context Amplifies Hallucination Risk

Hallucination is a universal LLM problem, but it is amplified in energy and utility work for three reasons.

First, the stakes of an error are high. A hallucinated asset ID in a switching order could send a crew to operate on the wrong equipment. A fabricated regulatory citation in a rate-case brief could undermine testimony. A wrong restoration estimate communicated to hospital administrators could affect patient care decisions. The energy industry does not have the tolerance for casual error that a low-stakes consumer application can absorb.

Second, utility content is specialized enough that general-purpose verification instincts do not always catch hallucinations. A non-expert reading an AI-generated switching order will not know whether "SUBS-TX-22C" is a real substation transformer or an invented one. The verification requires access to authoritative utility-specific data sources, and it requires the reader to know which sources to check. This is not a task that can be delegated to someone unfamiliar with the utility's asset naming conventions.

Third, the regulatory environment means that AI-generated errors can become part of the permanent record. A filing made to NERC, FERC, or a state commission containing a hallucinated citation is not easily recalled. The correction requires a supplemental filing with an explanation of the error. In an audit context, that explanation becomes part of the audit record. The error does not disappear; it creates a compliance trail.

Building Your Personal Hallucination Defense

The professional discipline for working with AI in utility operations is a consistent set of verification habits applied to every AI-generated output before it is used. These habits are not heroic; they are methodical. They take time, but they take far less time than recovering from an undetected hallucination that makes it into a signed document or a field operation.

Four core habits form the foundation.

Habit one: ground AI with source documents. When you need AI to draft something that references specific facts, standards, or assets, include the source documents or the relevant excerpts in your prompt. Tell the model "use only the information in these documents." This does not eliminate hallucination entirely, but it substantially reduces it by giving the model accurate material to draw from instead of its statistical pattern library.

Habit two: verify asset references against live systems. Any equipment ID, circuit number, substation name, or asset reference in an AI document is unverified until you check it in GIS, EMS, or the asset registry. Build the check into your workflow as a non-negotiable step, not an optional quality control measure.

Habit three: verify regulatory citations at the source. Pull the actual standard or order. Open it. Find the requirement or section the AI cited. Confirm that the AI's description of what that requirement says is accurate. Do this for every citation in every compliance document, rate-case exhibit, and regulatory correspondence that has AI-drafted content.

Habit four: flag every number that is not traceable to your input. If a number appears in the AI output and you cannot trace it back to a document or data source you provided in the prompt, treat it as unverified. Ask where it came from. If you cannot find a primary source, replace it with your own number from a verified source, or remove it and note that the figure requires sourcing.

The rule is simple and non-negotiable: AI drafts, professionals verify, humans sign. The professional who signs the document is accountable for every fact in it, regardless of what produced the first draft.

The Organizational Dimension: Governance and AI Hallucination Policy

Individual verification habits are essential, but they are not sufficient at scale. When dozens of engineers and analysts at a utility are using AI tools every week, the organization needs a structural response to hallucination risk, not just a collection of individual practices. That structural response is an AI governance policy that addresses hallucination specifically.

What belongs in a hallucination governance policy? Four components are foundational.

First, approved-use definitions. Not every use case carries the same hallucination risk profile. A policy should distinguish between high-risk uses (documents that will be filed with regulators, signed by a licensed PE, executed as field work orders, or used in rate-case testimony) and lower-risk uses (internal summaries, research orientation, first-draft brainstorming). High-risk uses should require documented verification steps. Lower-risk uses may require only general professional judgment. The policy should make this distinction explicit so that staff know which verification requirements apply in which context.

Second, approved tool designations. Not all AI tools are equivalent in their hallucination risk. A tool that is grounded with access to your specific asset database and regulatory filings is less likely to hallucinate asset IDs and standard citations than a general-purpose LLM used with no system grounding. A policy should specify which tools are approved for which use cases, and why. This is not about endorsing specific vendors; it is about ensuring staff use tools whose hallucination risk profile is appropriate to the task.

Third, documentation requirements. For any AI-assisted output that enters a regulatory filing, a signed work order, or an operational decision, the policy should require that someone document the verification steps taken. What was checked? Against which source? Who did the checking? When? This documentation protects the utility in audit and enforcement proceedings: it demonstrates that the verification discipline was applied, not just that staff knew about it in principle.

Fourth, incident reporting for detected hallucinations. When a staff member catches an AI hallucination, that detection should be logged. Not as a punitive process, but as an organizational learning mechanism. Over time, a log of detected hallucinations tells the organization which tools fail in which ways, which use cases are highest-risk, and whether the verification discipline is working. A utility that has caught 40 hallucinations in 12 months and corrected every one has a healthier AI posture than one that has caught zero and does not know whether it is because its tools are perfect or because its staff are not looking.

Building a verification culture also requires leadership modeling. If senior engineers and compliance leads treat AI verification as optional or bureaucratic overhead, staff will treat it that way too. If the department head who uses AI to draft a regulatory comment visibly opens the standard and checks the citations before signing off, that norm propagates through the team. The professional standard that applies to AI-generated content is identical to the professional standard that applies to any other content: every fact, citation, and asset reference must be accurate and verifiable. The method of initial drafting is irrelevant to that standard.

When to Use AI and When to Work from Primary Sources

Not every task is better with AI assistance in a utility context. Understanding where AI adds genuine value versus where it introduces more verification cost than it saves is itself a professional competency that this program returns to throughout the curriculum.

AI assistance adds the most value when it is accelerating tasks that have low hallucination risk or where the output is easy to verify. Internal research orientation, first-draft prose generation for familiar topics, summarization of long documents where you already know the key facts, code snippets for data processing, and template-filling tasks where the factual content comes from sources you provide: these are all areas where AI productivity gains are real and the hallucination risk is manageable.

AI assistance adds the least value, and sometimes adds negative value, in tasks where the required facts are highly specific to your organization's actual assets, actual regulatory filings, or actual system state, and where the model's training data cannot possibly know those specifics. In those tasks, the model will generate plausible-sounding but fabricated specifics because that is the only thing it can do with a request for information it does not have. The more specific the required facts, the higher the hallucination risk, and the lower the net productivity gain from AI assistance.

The practical test is: can the model access the actual data it would need to answer this accurately? If the answer is no, either provide the data in the prompt or work from primary sources without AI assistance. An equipment-specific switching sequence should be generated from your actual GIS and EMS data, not drafted by an AI that does not have access to your system topology. A compliance narrative for a specific NERC self-certification should be drafted against the actual text of the standard, not a model's compressed representation of what such narratives typically say.

This is not a counsel against using AI tools. It is a counsel for using them where they add genuine value and recognizing, rather than ignoring, the use cases where they introduce more risk than benefit. That recognition is the sign of a professional who understands the technology, not one who either fears it or trusts it uncritically.

Key Takeaways

  • AI hallucination is not random noise or obvious error. It is plausible-sounding fabrication delivered with the same confidence as accurate output. This is what makes it dangerous in a utility context: it passes casual review.
  • The five failure modes that hurt in utility operations are: invented asset IDs and equipment references, fabricated regulatory citations, confidently wrong restoration estimates, invented precedent and regulatory history, and fabricated numerical data.
  • Detection requires access to authoritative sources and the knowledge of which sources to check. A non-expert reviewing an AI switching order cannot detect a fabricated asset ID without GIS access. The verification discipline belongs to the person responsible for the document.
  • Energy context amplifies hallucination risk in three ways: the stakes of an error are high, the content is specialized enough that general-purpose verification instincts are insufficient, and regulatory filings create permanent records that cannot be quietly corrected.
  • Four habits form the professional hallucination defense: ground AI with source documents in the prompt, verify every asset reference against live systems, verify every regulatory citation at the source text, and flag every number that is not traceable to input you provided.
  • The time cost of verification is almost always less than the time cost of recovering from an undetected hallucination in a signed document, a regulatory filing, or a field operation. Professional AI use is not trust, it is verify-then-use.
  • The cardinal principle: the professional who signs the document is accountable for every fact in it. The model has no legal standing, no professional license, and no NERC registration. You do.