Data Governance and Interoperability Strategy
An AI model is only as good as the data it can see. In a utility, the hardest problem in AI deployment is almost never the model; it is getting coherent, current, and correctly labeled data from an EMS, an ADMS, an OMS, a GIS, and a market system into the same pipeline at the same moment. The systems that hold the grid's operational data were built across decades, by different vendors, using different standards, and they were not designed to talk to each other at the speed and fidelity that modern AI requires. Data governance and interoperability strategy is not infrastructure overhead. It is the foundational enabler of every AI use case on this list.
Why Data Is the Real AI Constraint
When a utility's forecasting team deploys a new AI load forecasting model and the MAPE is worse than the old statistical model, the almost universal root cause is not the algorithm. It is the data. The training data was missing three years of behind-the-meter solar additions because the GIS had not been updated with new DER interconnections. The weather station data had a 15-minute offset from the load data because the two systems used different timestamp conventions. The EV charging load had been categorized as industrial load in the AMI system, and the model trained on a category that does not reflect the physical reality it was supposed to predict.
These are not exotic failure modes. They are the routine reality of a utility data environment where systems were procured separately, integrated minimally, and maintained by different teams with different data quality standards. The AI model is a diagnostic tool for the data environment as much as it is a forecasting tool. When the model performs badly, the first question is always: what is wrong with the data?
The same principle applies in operations. An AI topology optimizer that recommends a switching sequence is generating that recommendation from a network model. If the GIS asset record for a switch is wrong (the switch was replaced last year and the GIS was not updated), the topology optimizer is optimizing a network that does not exist. The recommendation may be technically correct for the modeled network and dangerously wrong for the actual grid. This is not a model failure. It is a data governance failure that the model faithfully propagated.
The implication is direct: a utility that wants to deploy AI at scale must first answer the question of whether its data environment is fit for AI. That question encompasses five dimensions: data accuracy (is the data correct), data currency (is the data current), data completeness (is the relevant data captured), data consistency (do different systems have consistent records for the same asset or event), and data accessibility (can the AI pipeline reach the data it needs within the latency the application requires).
The Five Systems and Their Data Roles
The utility's operational data landscape is dominated by five platform categories. Each holds data that is critical for specific AI use cases, and understanding what each system does and what data it holds is the prerequisite for building an interoperability strategy.
EMS: Energy Management System
The EMS is the control room's real-time brain. It ingests SCADA telemetry from transmission substations, runs state estimation (the mathematical process of determining the best estimate of the real-time grid state from noisy, sometimes missing sensor data), performs automatic generation control (AGC) to balance generation and load in real time, and runs contingency analysis (the N-1 security check that asks whether the grid can survive the loss of any single major element). The EMS produces the data that defines the real-time operational state of the bulk electric system.
For AI, the EMS is the source of real-time operational data for topology optimization, contingency prediction, and real-time load estimation. It is also the most security-sensitive data source in the utility because its data, and any system that touches it, falls under NERC CIP classification. EMS data latency is measured in seconds; any AI application that needs real-time EMS data must be designed for that latency requirement, and any application that introduces additional latency in the data pathway risks compromising state estimation accuracy.
ADMS: Advanced Distribution Management System
The ADMS is the distribution-grid equivalent of the EMS. It manages switching, fault isolation, service restoration (FDIR: Fault Detection, Isolation, and Restoration), and increasingly the integration of DERs (Distributed Energy Resources: rooftop solar, battery storage, electric vehicles, demand response). The ADMS holds the real-time state of the distribution network: switch positions, feeder loads, voltage profiles, and the location and status of active DER devices.
For AI, the ADMS is the primary data source for distribution-level load forecasting, DER dispatch optimization, and volt-VAR optimization. The ADMS's data quality challenge is that the distribution network changes constantly: switches are operated manually, DERs come online and go offline, transformer connections are updated during maintenance. An AI model that forecasts distribution feeder load based on an ADMS network model that is three weeks stale from field operations updates will produce forecasts that are wrong in ways the planner cannot diagnose without knowing the network state.
OMS: Outage Management System
The OMS manages the workflow of outage events: it receives customer calls and AMI-detected outage notifications, applies network intelligence to estimate the probable fault location and affected customer count, dispatches crews, tracks restoration progress, and produces the SAIDI (System Average Interruption Duration Index) and SAIFI (System Average Interruption Frequency Index) metrics that regulators and commissions use to evaluate distribution reliability.
For AI, the OMS is the source of historical outage data used to train predictive maintenance and outage prediction models. The OMS's data governance challenge is that the quality of its historical data depends heavily on how well field crews updated ticket statuses during restoration. A storm event where crews were overwhelmed and did not update OMS tickets promptly produces a training dataset with incorrect event durations, wrong fault locations, and missing equipment codes. An AI model trained on that data learns the wrong patterns about what causes outages, where they occur, and how long they take to restore.
GIS: Geographic Information System
The GIS is the asset master. It holds the spatial and attribute records for every piece of infrastructure in the utility's system: substations, transmission lines, distribution feeders, poles, transformers, cables, switches, and, increasingly, DER interconnection records. The GIS is the source of truth for asset identity, asset location, asset specifications, and asset connectivity.
For AI, the GIS is essential because most AI models in utilities need to know what the network looks like: which transformer is connected to which feeder, where the switch is relative to the fault, what the conductor rating is on the line being loaded. When the GIS is wrong, every AI model that uses it is wrong in a way that is very difficult to detect from the AI side. A transformer that was replaced in 2024 but still appears in GIS under its old ratings will cause every AI model that uses transformer ratings to make decisions based on the wrong capacity. GIS data quality is the foundational data quality problem for utility AI because the GIS underlies every other model's network representation.
Market Systems
Market systems manage the financial flows of wholesale electricity markets: day-ahead and real-time energy market bidding, capacity market participation, ancillary services procurement, settlement, and (for vertically integrated utilities) bilateral contract management. Market data is distinct from operational data in that it is priced, time-stamped to the specific market interval, and subject to FERC market transparency rules.
For AI, market systems are the source of data for price forecasting, portfolio optimization, and settlement verification. The interoperability challenge for market AI is that market data lives on a different clock than operational data: market intervals are hourly or sub-hourly but are defined in market time, while operational data is measured in real time at subsecond resolution. An AI model that uses both market price data and operational SCADA data as inputs must correctly align these timebases or it will learn spurious correlations between market prices and operational states that are artifacts of temporal misalignment.
The Interoperability Architecture: CIM, APIs, and the Data Lake
The practical problem of getting data from five systems into an AI pipeline has three layers: data model standardization, physical integration architecture, and governance of the shared data environment.
The CIM Standard
The Common Information Model (CIM) is the IEC standard (IEC 61968/61970) for representing power system data. It provides a shared vocabulary for describing network elements (lines, transformers, generators, loads) in a way that different systems can interpret consistently. When a utility's EMS, ADMS, and GIS all use CIM-compliant data representations, the process of combining their data for an AI model becomes significantly more tractable. When they do not, the integration team must build and maintain custom translation layers between every pair of systems, creating a maintenance burden that grows with the number of systems and the pace of change in each system.
In practice, most utilities have partial CIM adoption: their EMS may be fully CIM-compliant because it is a modern platform, their GIS may have a CIM export capability but use a proprietary internal model, and their OMS may have been built before CIM adoption was common. The interoperability strategy must account for this heterogeneity and define a migration path toward greater CIM consistency, while building the integration layers that support AI use cases in the meantime.
API Strategy
Modern AI pipelines need programmatic access to operational data. The traditional approach of exporting files from each system on a scheduled basis is insufficient for real-time AI applications and creates data freshness problems even for near-real-time forecasting. A utility that wants to support AI at scale needs to define an API strategy: a set of conventions for how each platform exposes its data to downstream consumers, including the AI pipeline.
The API strategy for a utility covers: the data format (CIM-compliant JSON or XML for network data; time-series formats for telemetry and market data), the latency commitment (what is the maximum acceptable delay between a field change and its appearance in the API response), the authentication model (how AI systems authenticate to operational APIs, which must be consistent with CIP access management requirements), and the rate limits (what query frequency is permitted without degrading the source system's performance).
A key design principle for the utility API strategy is that the operational systems (EMS, ADMS, OMS) should not be the direct database backends for AI model training. Training workloads are computationally intensive and can degrade the performance of operational systems if they query directly. The architecture should separate operational data stores from the analytical data store (the data lake or data warehouse) that serves AI training and batch inference workloads.
The Data Lake and AI Pipeline
The data lake is the analytical copy of operational data that AI models train and run against. It is populated from the operational systems via controlled pipelines that handle the transformation, timestamp alignment, and quality checks necessary to make the data usable for AI. The data lake is where the data governance effort is most concentrated: the pipelines that feed it must be instrumented to detect and alert on data quality problems before they contaminate training datasets.
A well-designed data lake for utility AI should maintain: a historical archive of EMS state estimation snapshots (for training real-time operations AI), a historical archive of ADMS network states and feeder loads (for distribution forecasting and DER optimization), the OMS historical outage record with correct field-crew-reported data (for outage prediction training), the GIS asset records with their effective dates (so that AI models know what the network looked like at any historical moment, not just what it looks like today), and market interval data aligned to operational time stamps.
The hardest data governance problem in the data lake is the temporal alignment of records from different systems. An EMS state snapshot taken at 13:47:30 must be aligned with the GIS network model that was current at 13:47:30, not the current GIS model, because the AI model is being trained to predict or explain what happened at 13:47:30. If the GIS was updated at 14:00:00 to reflect a transformer replacement that was physically done at 12:30:00, the data lake must maintain the pre-update GIS record as the correct context for the 13:47:30 EMS snapshot.
The data lake is not a backup system. It is the analytical environment where data from across the enterprise is aligned, quality-checked, and prepared for AI. Its accuracy determines the accuracy ceiling of every AI model the utility builds.
Data Governance Program Structure
Data governance in a utility context requires more than a technical architecture; it requires a governance program with defined accountabilities, data quality standards, and remediation processes.
The data governance program for utility AI should define: data ownership (who is responsible for the quality of each data domain, such as the GIS team owns asset record accuracy, the field operations team owns OMS ticket quality), data quality standards (what are the acceptable levels of completeness, accuracy, and currency for each data element used in AI), data quality monitoring (automated checks that detect problems in operational data before they are ingested into the AI pipeline), and data quality remediation (a defined process for investigating and correcting data quality problems when they are detected).
A critical element of the data governance program is the feedback loop from AI model performance to data quality. When an AI forecasting model's MAPE degrades, the investigation should begin with a data quality audit: have any new data sources been added to the pipeline, have any existing sources changed their format or conventions, has any field procedure change affected how data is captured (for example, a change in how OMS tickets are categorized by field crews)? This feedback loop connects the AI governance program to the data governance program, ensuring that model performance monitoring triggers data quality reviews.
Worked Example: The DER Data Gap
Consider a medium-sized distribution utility that deploys an AI-based net load forecasting model. The model is trained on three years of feeder-level load data from the ADMS historian, supplemented by residential customer AMI data. The utility has been experiencing significant DER growth: rooftop solar penetration on some residential feeders is approaching 30% of peak load, and residential battery storage adoption has been increasing since a state incentive program launched 18 months ago.
The AI model is performing reasonably on most feeders, but on three feeders in a high-DER neighborhood, the day-ahead forecast is consistently 8-12% above actual measured load on clear summer afternoons. The forecasting team investigates and finds three data governance failures. First, the DER interconnection records in GIS are incomplete: 140 new battery storage systems installed under the incentive program were interconnected through a fast-track process that bypassed the normal GIS update workflow, so the AI model has no record of 140 battery systems that are actively reducing net load on summer afternoons. Second, the AMI data for the three feeders includes a category error: the AMI system categorized EV charging load at 22 addresses as commercial load because the accounts were registered to small business owners who charge work vehicles at home; the AI model trained on the AMI category, not the physical load, and its predictions for those 22 accounts are based on the wrong load shape. Third, the battery storage systems that are in GIS have export-only ratings recorded (their maximum solar export capacity) but not their import capacity (their ability to absorb load for charging); the AI model's net load calculation for these assets is one-directional and misses a significant portion of their operational behavior.
The remediation required was not an AI model redesign. It was a data governance remediation: the GIS update workflow was revised to include battery storage systems in the fast-track process; the AMI category error for the 22 accounts was corrected; and the GIS schema was updated to capture both export and import capacity for bidirectional DER assets. When the model was retrained on corrected data, the forecast error on the three feeders dropped to within 2% of the system average.
This story repeats itself across utility AI deployments with different details but the same structure: the model is fine, the data is wrong, and the data problem requires a governance solution rather than a modeling solution.
Key Takeaways
- Data quality, not algorithm sophistication, is the primary constraint on AI model performance in utilities; when a model underperforms, investigate the data before investigating the model.
- The five critical data systems for utility AI (EMS, ADMS, OMS, GIS, and market systems) were built on different platforms, different standards, and different data models, and making them interoperable requires a deliberate architectural and governance strategy, not just a data pipeline.
- The CIM (IEC 61968/61970) standard provides a common vocabulary for network data that significantly reduces the integration burden when adopted consistently; the interoperability strategy should define a path toward greater CIM consistency across platforms.
- The data lake is the analytical environment that serves AI training and inference workloads; it must be populated by controlled pipelines with data quality checks, and it must maintain temporally aligned historical snapshots so that AI models can reconstruct what the network looked like at any historical moment.
- The data governance program must define data ownership by domain, data quality standards for AI inputs, automated quality monitoring before data enters the AI pipeline, and a feedback loop from AI model performance to data quality investigation.
- DER data is the fastest-growing data governance challenge in utility AI: rooftop solar, battery storage, and EV charging are all changing the load shape faster than GIS and AMI update workflows were designed to accommodate, and AI models trained on stale DER data will systematically underperform on high-DER feeders.
- Temporal alignment of records from different systems is the hardest technical problem in utility data governance for AI: the AI pipeline must maintain the historical network model as it existed at each training data timestamp, not just the current model.
- Every AI model that uses GIS network data is only as good as the GIS; the GIS is the foundational data quality problem for utility AI and must be treated as a first-priority data governance investment.
Skill.re