Read cofounder Muhammad Umar's memo, Compression and Reinflation
CodeNinja AtomsUnited StatesSaudi ArabiaPakistan

Sector · Energy and utilities

Physical AI for energy and utilities

Grids and plants run on control systems, maintenance records and field crews that were never designed to share one picture of risk. These are the questions engineers ask first, answered from 8 published CodeNinja Atoms reference architectures.

  1. What does a physical AI system for energy and utilities look like?
  2. Which AI models can an energy and utilities operator run on its own hardware?
  3. How much compute and hardware does AI in energy and utilities need?
  4. Is it cheaper to own AI hardware or rent cloud GPUs in energy and utilities?
  5. What ontology or object model does an energy and utilities AI system need?
  6. Who approves the decisions an AI system makes in energy and utilities?

What does a physical AI system for energy and utilities look like?

A complete physical AI design for energy and utilities names what to sense, which existing systems to join, the object model that joins them, the models and hardware, the three-year cost and the person who approves every action. CodeNinja Atoms has published 8 such reference architectures for energy and utilities, each free to reuse under CC BY 4.0.

DesignCountryWhat it does
Grid Context WatchUnited Statesone system of context that sees every device on a utility's control networks, flags abnormal behaviour and assembles the evidence a NERC CIP audit asks for, on the operator's own hardware.
Reliability AtlasSaudi Arabiaa records-based reliability and availability assessment that joins each plant's work orders, trip history and design documents into one reliability object model the operator owns, so every availability figure, criticality rank and root cause finding traces to its source.
Feeder FirewatchUnited Statesa live ignition and outage risk score for every distribution feeder segment, built on the cooperative's own hardware, with every de-energisation and fast-trip change approved by a named operator.
Turbine Island WatchPakistanAn open reference architecture for system design in physical AI. A condition monitoring and diagnostics platform for a rehabilitated 280 MW hydrogen-cooled steam turbine generator at a combined cycle plant in Pakistan: it reads the DCS, the vibration monitoring rack and the generator protection systems through a one-way path, ranks anomalies into prescribed actions for the shift operator, and runs entirely on the operator's own hardware.
Sovereign AI Architecture for a Grid Control Room in Saudi ArabiaSaudi ArabiaAn open reference architecture for system design in physical AI, built for a national grid operator in Saudi Arabia that runs the electricity transmission grid from regional and national control centers, where owning the inference node that runs it costs about 570,000 US dollars over three years. When one 380 kilovolt line trips at summer peak, the design joins the alarms, the network model, the outage plan, the protection record and the procedure library into one argument, so the control engineer sees which protection operated, what it affects, what work is already in progress nearby and which procedure governs the next step. The model runs entirely on the operator's own hardware under the national cybersecurity controls for operational technology, the grid code and export control on the GPU node.
Industrial Data Ontology for a Water Utility in the United StatesUnited StatesAn open reference architecture for system design in physical AI, built for a municipal water utility in the United States that runs a treatment plant, wells, a distribution reservoir, pump and lift stations and a pipe network under PLCs and RTUs, in the middle of a control system migration, where owning the inference server that runs it costs about 59,000 US dollars over three years. Every alarm tag is tied to the pump it measures, the station and pressure zone the pump serves, the work orders on it and the sampling points and permit limits on its zone, so the operator on shift can ask, the night a duty pump trips, which asset tripped, what work is open on it and what the permit requires of the zone it feeds. The model runs entirely on the utility's own hardware, reads the segregated control network only through a hardware data diode, and answers to the drinking water and discharge permit regime and the obligations of a state and local critical infrastructure owner.
Sovereign AI Architecture for Distribution Loss and Theft Reduction in PakistanPakistanAn open reference architecture for system design in physical AI, built for an electricity distribution company in Pakistan that serves several million customers through hundreds of grid stations and thousands of feeders, where owning the inference hardware that runs it costs about 641,000 US dollars over three years. When a transformer's monthly energy balance crosses its threshold, the design joins the smart meter interval load, the tamper events, the billing history, the network topology and the inspection record into one argument, so the subdivision engineer sees the ranked causes, the inspection officer opens a case file already populated with the load history and the billing record, and the revenue officer approves the correction. The models run entirely on the operator's own hardware in the country under the regulator's performance standards, the national data protection rules, the electricity theft laws and export control on the GPU node.
A Self-Improving AI System for OT Vulnerability Management at a Utility in the United StatesUnited StatesAn open reference architecture for system design in physical AI, built for an electric utility in the United States whose substations, control centers and generating plants fall under the critical infrastructure protection standards, where owning the inference node that runs it costs about 477,000 US dollars over three years. When a vendor publishes a relay firmware advisory on day thirty of a cycle, the design joins the device inventory, the verified baseline, the advisory, the national vulnerability record and the decisions made the last time this vendor's advisories touched these devices into one argument, so the compliance engineer sees which devices it touches and why, the asset owner approves apply or mitigate with its outage window and change request, and the auditor finds the evidence package where audits already look. The model runs entirely on the utility's own hardware, on open weights of United States origin, with nothing about its assets leaving its network.

Which AI models can an energy and utilities operator run on its own hardware?

Each published energy and utilities design names its models and why, and every model is open-weight or no model is used at all, so the operator can run it on hardware it owns.

DesignModels
Grid Context WatchGLM 5.2 (MIT) for reasoning and Qwen3-Embedding-0.6B (Apache-2.0) for retrieval; detection stays in the procured sensors
Reliability AtlasNone: the register is empty by design because no inference workload is contracted
Feeder FirewatchSelf-hosted open-weight models: GLM 5.2 under MIT (reasoning) on site, RF-DETR (vision) at the edge
Turbine Island WatchMOMENT-1 (MIT) for zero-shot anomaly detection over vibration, hydrogen, winding and process telemetry; IBM Granite 4.2 8B (Apache-2.0) for diagnostic notes and test-report drafts; no training run
Sovereign AI Architecture for a Grid Control Room in Saudi ArabiaGLM 5.3 (GLM-5.3 bespoke licence, 753B at FP8) for all four drafting agents (alarm triage, switching programs, handover and the sequence of events), the command center and ontology maintenance; BGE-M3 (MIT) for Arabic and English retrieval so every answer cites its procedure or record; no third party model service, nothing trained into weights
Industrial Data Ontology for a Water Utility in the United Statesgpt-oss-120b (Apache-2.0, 117B, MXFP4) for the agentic work surface: the tag mapping agent, the alarm context agent, the monthly compliance drafting agent and cited answers; Nomic Embed Text v2 MoE (Apache-2.0) for retrieval so every answer cites its record; United States origin weights for a state and local critical infrastructure buyer; no third party model service, nothing trained into weights
Sovereign AI Architecture for Distribution Loss and Theft Reduction in PakistanGLM 5.3 (GLM-5.3 bespoke licence, 753B at FP8) for the loss, tamper and billing agents, the command center and ontology maintenance; BGE-M3 (MIT) for cited retrieval over tariff codes, meter numbers, PPC sections and inspection findings; Chronos-2 (Apache 2.0) forecasting each transformer's energy balance so the residual is the anomaly signal; no third party model service, nothing trained into weights
A Self-Improving AI System for OT Vulnerability Management at a Utility in the United Statesgpt-oss-120b (Apache-2.0, about 120B parameters in MXFP4, United States origin) for the applicability, disposition and evidence agents, the command center's cited conversational surface and ontology maintenance; Nomic Embed Text v2 MoE (Apache-2.0, 475M parameters at FP16) embedding advisories, baselines and confirmed decisions for retrieval memory; no third party model service, nothing trained on the fly
DesignChoiceWhat was pickedWhy
Grid Context WatchReasoning modelGLM 5.2, 753B parameters, frontier class, FP8, 1M contextPlain MIT license with no revenue trigger or security-review clause; one node of eight 141 GB HBM GPUs holds it; the work surface's role demands long-context agentic reasoning
Grid Context WatchEmbedding modelQwen3-Embedding-0.6B, Apache-2.0, 32K windowWhole playbooks and CIP procedures retrieve as single passages; runs beside the frontier model for about 1.2 GB at BF16
Grid Context WatchSizing rule1.2 planning factor over FP8 weights753 GB of weights times 1.2 is 904 GB against 1,128 GB of node memory, leaving governed headroom for KV cache and activations
Grid Context WatchFrontier computeOne node of eight 141 GB HBM GPUsThe smallest class that holds the FP8 weights; sized from the model's filed parameters
Grid Context WatchEdge computeFanless, extended-temperature, cabinet-mount classCompute stays out of electronic security perimeters wherever topology allows
Grid Context WatchEnclosure and powerNEMA 3R/4X class cabinets with uninterruptible power supplies under Network UPS ToolsClean shutdown ordering protects capture integrity environment
Grid Context WatchTime synchronizationOCP Time Card GNSS grandmaster with holdover, Linuxptp and chronyPcap, sensor and log clocks must agree for evidence to correlate
Grid Context WatchOne-way transferHardware data diodes with the one-way transfer appliance at highest-impact perimetersDemonstrable one-way flow where policy demands it; constrained DMZ conduit elsewhere
Grid Context WatchSite networkingHardened, fanless, dual-DC industrial switches with SPAN/TAP portsSegmentation remains the operator's policy decision; the design reads a copy, never the control path
Grid Context WatchSensingPassive network traffic capture via the procured OT monitoring sensors at SPAN/TAP sourcesThe scope watches OT traffic, not premises; no cameras or video models
Grid Context WatchPrimary patternSystem of Context over one Hyper-style object model of 14 objectsThe lasting asset is the living model of the OT estate, not any single alert
Grid Context WatchGroundThe operator's own on-premises OT hardware and data centerOwnership of weights, ontology, decision record and boundary stays with the operator; identity and update paths run inside the air gap
Reliability AtlasModelsNone: the register is empty by designNo inference workload is contracted; the deliverable is the study, and an empty register recorded plainly outranks a speculative entry the scope cannot justify
Reliability AtlasHardware classes and sizing rulesNone procured; the study runs on the operator's own in-country servers, storage and data center capacityNo field hardware, no edge compute and no serving runtime is installed under this scope
Reliability AtlasSensingNo cameras, no sensors and no positioning; site verification is by engineer walkdownsThe world is read through records, so nothing is watched and nothing needs country legality stated
Reliability AtlasThe pattern it stands onSystem of context as the primary pattern, with the reliability object model as a projection over the three systems of recordUnavailability ranking, sparing confirmation and RCA validation are cross-silo joins that no single source system can produce alone
Reliability AtlasThe ground it runs onIn-country hosting in Saudi Arabia, with identity through the operator's own directory and single sign-on, procured by classThe operator's requirement keeps data inside the country's boundary and under the operator's identity, which the operator already operates
Feeder FirewatchLanguage model parameters filed, FP8, MIT licenseGLM 5.2, mixture-of-experts, 753 billion weights the cooperative owns; one 8-GPUAgentic reasoning over the ontology with FP8 node holds it
Feeder FirewatchDetection model to 68 MB and 2XL at about 254 MB, BF16, Apache-2.0RF-DETR, Nano to Large checkpoints at 61 detection on the edge box class, fine-tuned on the cooperative's own fire-season framesSmoke, pole, vegetation and equipment
Feeder FirewatchEdge compute class and sealed, NEMA 3R/4 enclosuresIndustrial edge accelerator modules, fanless streams, rated for dust, heat, hail and coldSized decode-first from the actual camera
Feeder FirewatchSite inference server center, one node of 8 GPUs of the 141 GB HBM classRuggedised server class at the operations sized from filed parameters at FP81,128 GB against a 904 GB requirement,
Feeder FirewatchServing runtimes Runtime or OpenVINO class at the edgevLLM on site; Triton Inference Server, ONNX a bench measurement of the real streamsThe edge runtime is pinned at design against
Feeder FirewatchSizing rules thermal beats visible; reuse existing cameras or not; size GPUs from filed parametersSize edge compute from streams; when measured duty rather than a vendor defaultEvery hardware choice derives from a
Feeder FirewatchSensing camera feeds, truck and drone cameras, mesonet wind and humidity, 310 recloser fault indicators, AMI last gasp from 61,000 meters, crew AVL on 20 trucks42 substation PTZ cameras, 12 wildfire thermal only where a coverage gap is provenReused through the reuse gates; new fixed
Feeder FirewatchPatterns read-only systems of record; human-approved write-back; one-way diode for SCADASystem of context; adapters-only ingestion; record authoritative while the platform joins themKeeps the grid protected and the systems of
Feeder FirewatchGround as primary; sovereign cloud for overflow and recovery onlyCooperative servers at the operations center during a storm, and the risk picture cannot live outside the boundaryThe model must survive an internet outage
Turbine Island WatchModelMOMENT-1, a time series foundation model for anomaly detection, MITRuns zero-shot on the 48 GB-class site card over vibration, hydrogen, winding and process telemetry, with no training run, because the rehabilitated unit's history may be too sparse to baseline
Turbine Island WatchModelIBM Granite 4.2 8B, Apache-2.0Drafts diagnostic notes and test reports for engineer review; licence-clean with an enterprise vendor behind it and real KV headroom on one site card, chosen over Qwen3.8 at 27B
Turbine Island WatchHardware class48 GB PCIe inference GPU class on ruggedised edge servers inside the plant perimeterPakistan has no hyperscaler region, so every tier runs on the operator's own hardware
Turbine Island WatchTool: event streaming and messagingApache Kafka 4.3 (KRaft, three dedicated controllers, dynamic quorum), Apache-2.0Condition streams need a self-managed backbone inside the plant that no managed service can serve from Pakistan.
Turbine Island WatchTool: time series and telemetry storageInfluxDB 3 Core, MITThousands of condition channels need a self-hosted OT historian whose retention the five-year NEPRA log rule stands on.
Turbine Island WatchTool: edge model servingONNX Runtime, MITThe anomaly model runs exported to ONNX at the site tier so serving survives without internet pulls.
Turbine Island WatchTool: on site language model servingvLLM, Apache-2.0Granite 4.2 8B is served on the site inference card with the KV headroom vLLM's memory discipline gives.
Turbine Island WatchTool: edge orchestration of containersRed Hat OpenShift AI 3.5 on OpenShift Container Platform 4.20, Red Hat subscriptionThe primary architecture's operator-managed, mirrored-install platform delivers serving, pipelines and the registry coherently to a plant with no internet route.
Turbine Island WatchTool: an air gapped artifact and model registryMLflow model registry with the mirrored private registry as the artifact supply chain, Apache-2.0Every model version entering the plant crosses the mirror once and carries provenance into the NEPRA log trail.
Turbine Island WatchTool: labelling and retrainingLabel Studio, Apache-2.0Engineer-confirmed vibration events become labelled training evidence for the anomaly model without leaving the perimeter.
Turbine Island WatchTool: time synchronisation across sensors and systemslinuxptp with PTP-aware switches, GPL-2.0The specification requires accurate stamping to a common time reference for sequence-of-events logs, which only a designed PTP spine delivers.
Turbine Island WatchTool: observability of the running systemPrometheus, Grafana and Loki, Apache-2.0 / AGPL-3.0 (Loki)The 2003 blackout lesson demands a positive heartbeat and freshness indication for the monitoring layer itself.
Turbine Island WatchTool: identity and access on siteKeycloak, Apache-2.0NEPRA least-privilege and approved-remote-access duties need an on-site identity provider without credentials inside the control zone.
Turbine Island WatchTool: integration with the sector's own operational systemsopen62541 OPC UA client, MPL-2.0The read contract into the DCS, vibration rack and detection systems is OPC UA subscriptions with bounded queues, run from the DMZ side.
Turbine Island WatchTool: time synchronisation hardwareOCP Time Card (PTP grandmaster with GNSS and holdover), MIT (repository; third-party FPGA cores LGPL-3.0)One open grandmaster card disciplines the whole estate for sequence-of-events ordering, with a second unit for failover.
Turbine Island WatchTool: one way data transferlidi beside a hardware data diode, LGPL-3.0The platform reads the DCS through a physically one-way egress path so no inbound route into the control network exists.
Sovereign AI Architecture for a Grid Control Room in Saudi ArabiaReasoning modelGLM 5.3, filed at 753B parameters, FP8 (753 GB of weights), GLM-5.3 bespoke licence, served on vLLM on one node in the operator's own data centre in the KingdomLicence allows commercial use, fine tuning and redistribution with an attribution notice and a managed access trigger above 10 billion US dollars of group revenue that internal control room use does not reach; the register's one frontier class model; carries all four drafting agents, the command centre and ontology maintenance
Sovereign AI Architecture for a Grid Control Room in Saudi ArabiaEmbedding modelBGE-M3, MIT, FP16, about 1.1 GB, on the platform zone's dual socket x86 rack server classMIT licence with no obligation; multilingual Arabic and English retrieval over procedures, switching instructions, records and past event analyses; recall on the operator's own Arabic procedures proved before go-live
Sovereign AI Architecture for a Grid Control Room in Saudi ArabiaFrontier hardware141 GB HBM GPU class, eight GPUs per node, one node (1,128 GB)Holds GLM 5.3's 753 GB of FP8 weights on one node; held at one node so the export licence determination naming the end user is asked once, early, as a phase one checkpoint before the order
Sovereign AI Architecture for a Grid Control Room in Saudi ArabiaFrontier footprint sizing ruleFrontier model GPU footprint sizing rule, vLLM and SGLang753 GB of weights times the 1.2 planning factor is 904 GB against the node's 1,128 GB, leaving 375 GB beside the weights for KV cache and activations
Sovereign AI Architecture for a Grid Control Room in Saudi ArabiaNode count ruleGLM 5.3 node count by GPU classOne node of eight 141 GB GPUs; two nodes of the 80 GB class rejected because they add an RDMA fabric
Sovereign AI Architecture for a Grid Control Room in Saudi ArabiaOne-way transferData diode class with forward error correctionCommitted fallback where the segmentation review demands demonstrable one-way flow; replication through a historian or DMZ feed is the default
Sovereign AI Architecture for a Grid Control Room in Saudi ArabiaServing runtimevLLMServes the FP8 weights within the KV cache ceiling the sizing reserves
Sovereign AI Architecture for a Grid Control Room in Saudi ArabiaRegistryHarbor, air gapped artifact and model registryUpdates are staged and signed inside the boundary; the platform keeps serving the last verified version if the update path fails
Sovereign AI Architecture for a Grid Control Room in Saudi ArabiaSensingReplicated SCADA and EMS streams, protection trip records, heartbeat and freshness signals, citation resolution checksNo cameras and no new field hardware; the platform watches its own data freshness and checks the citations on every answer
Sovereign AI Architecture for a Grid Control Room in Saudi ArabiaPattern: memoryMemory loops over confirmed decisions, nothing trained into weightsThe requirement asks that memory improve every shift without training a model, and a moving model would invalidate the frozen baselines
Sovereign AI Architecture for a Grid Control Room in Saudi ArabiaPattern: validationReplay of the operators' own recorded alarm floodsTrust is built on the control room's own history before summer go-live
Sovereign AI Architecture for a Grid Control Room in Saudi ArabiaPattern: topologyCIM import from the network model seeds the ontologyTopology comes from the model of record rather than assembled from documents
Sovereign AI Architecture for a Grid Control Room in Saudi ArabiaPattern: boundaryThe operator's own hardware in its own data centre in Saudi Arabia; one way inbound, read only, no write path into SCADA or EMSNational cybersecurity segmentation controls and the operator's own rule that the operational network stays separated
Industrial Data Ontology for a Water Utility in the United StatesWork surface modelgpt-oss-120b, 117B parameters filed, mixture of experts in MXFP4 at 4.25 bits with the rest at 16 bit (about 61 GB of weights), Apache-2.0, served by vLLM on the inference server in the utility's own server roomUnited States origin open weights for a state and local critical infrastructure buyer; the GLM 5.3 class is set aside because its maker sits on the US Entity List; Apache-2.0 carries no field of use restriction, so the utility holds the weights outright; carries the tag mapping agent, the alarm context agent, the monthly compliance drafting agent and the cited conversational interface
Industrial Data Ontology for a Water Utility in the United StatesEmbedding modelNomic Embed Text v2 MoE, 475 million parameters, 768 dimensions, 8K window, Apache-2.0, about 0.95 GB at fp16, on the same nodeUnited States publisher with published data provenance, chosen over BGE-M3 for origin; feeds the hybrid dense plus lexical index the citations depend on; Matryoshka truncation keeps the on-site index small enough for the utility's own hardware
Industrial Data Ontology for a Water Utility in the United StatesInference hardware48 GB PCIe GPU class, two cards in one air-cooled node, 96 GB total, about 88 GB usableThe 70.1 GB sized requirement fits with room for the key-value cache, and the class air-cools in a standard server room; frontier class nodes are set aside because 117B parameters sit below the 300B threshold
Industrial Data Ontology for a Water Utility in the United StatesFootprint sizing rule117B parameters at INT4, 0.5 bytes per parameter, 58.4 GB, times the 1.2 planning factor for key-value cache and activations70.1 GB against the 96 GB the two cards hold; one node of two cards is the whole cluster
Industrial Data Ontology for a Water Utility in the United StatesOne way transferLidi over a hardware-enforced data diode class, behind the historian mirror in the demilitarized zoneMakes the read a physical property that cannot be misconfigured into a write; the platform holds no credentials in the control network
Industrial Data Ontology for a Water Utility in the United StatesTime synchronizationOCP Time Card grandmaster with linuxptp and chronyOne clock for sensors, alarms, lab result dates and work orders, so the night trip argument orders correctly
Industrial Data Ontology for a Water Utility in the United StatesSensingPermanent vibration on critical pump and motor frames, motor current at starter panels, reservoir level and discharge pressure from existing instrumentationAnswers the night trip with condition data; discharge pressure carries the seal failure mode vibration cannot see; no cameras or video anywhere
Industrial Data Ontology for a Water Utility in the United StatesPattern: commitmentThe model proposes, a deterministic layer commits, named staff decideKeeps wrong mappings from becoming ground truth exactly when the cutover depends on them; nothing is trained into weights
Industrial Data Ontology for a Water Utility in the United StatesPattern: namespaceDual tag namespace bridge holding legacy and new namespaces at onceThe target historian is not yet selected, so connectors re-confirm against whatever is chosen before cutover
Industrial Data Ontology for a Water Utility in the United StatesPattern: boundaryThe utility's own server room, on premises in the United States, with Harbor offline registry, vLLM serving and RKE2 orchestration; no data leaves the boundaryThe intake requires self hosting on the utility's own servers, no third party model service and a segregated control network
Sovereign AI Architecture for Distribution Loss and Theft Reduction in PakistanReasoning modelGLM 5.3, filed at 753B parameters, FP8 (753 GB of weights), GLM-5.3 bespoke licence, served on vLLM on one node of the 141 GB HBM class in an in-country sovereign data centre or colocation on the operator's own hardwareLicence permits commercial use, fine tuning and redistribution, so the operator holds the weights; carries the agentic work surface (the loss, tamper and billing agents' drafts and the command centre's conversational interface) and ontology maintenance
Sovereign AI Architecture for Distribution Loss and Theft Reduction in PakistanEmbedding modelBGE-M3, MIT, FP16, about 1.1 GB (2.27 GB at float32, 0.6 GB at 8 bit), on the 48 GB PCIe inference card of the dual socket on site inference serverDense, sparse and multi-vector retrieval in one pass over an 8,192 token window, so tariff codes, meter numbers, PPC sections and inspection findings survive retrieval exactly and every answer cites its record; chosen over multilingual E5 (512 token window) and Nomic v2
Sovereign AI Architecture for Distribution Loss and Theft Reduction in PakistanForecast modelChronos-2, Apache 2.0, FP32, about 0.48 GB (0.24 GB at 16 bit), beside the embedder on the same 48 GB cardZero shot multivariate forecasting with covariates; the residual between each transformer's forecast and its measured energy balance is the anomaly signal, with no training run anywhere in the loop; chosen over TimesFM 3.0 and Moirai 2.0, whose non commercial terms cannot ship in an operator owned system
Sovereign AI Architecture for Distribution Loss and Theft Reduction in PakistanFrontier hardware141 GB HBM GPU class, eight GPUs per node, one node (1,128 GB), the frontier inference cluster class for 300B to 1T parameter open weight models753 GB of FP8 weights times the 1.2 planning factor is 904 GB against 1,128 GB; BF16 on two nodes rejected because it doubles export licence exposure for an accuracy gain the ranking and drafting tasks have not been shown to need
Sovereign AI Architecture for Distribution Loss and Theft Reduction in PakistanOn site inference serverA dual socket server with one 48 GB PCIe inference GPU, the on site inference server classHosts the embedder (1.1 GB) and the forecaster (0.48 GB) together with two orders of magnitude of headroom, so the design gives them one server rather than two
Sovereign AI Architecture for Distribution Loss and Theft Reduction in PakistanFrontier footprint sizing ruleFrontier model GPU footprint sizing rule, vLLM and SGLangWeights times the 1.2 planning factor for KV cache and activations, checked per GPU class before any card is committed, with a non US accelerator class held open
Sovereign AI Architecture for Distribution Loss and Theft Reduction in PakistanNode count ruleGLM 5.3 node count by GPU classOne node of eight 141 GB GPUs holds the weights with 375 GB left beside them; the export licence determination precedes any card commitment for Pakistan and may change the accelerator class but never the country the node sits in
Sovereign AI Architecture for Distribution Loss and Theft Reduction in PakistanServing runtimevLLMServes the FP8 weights inside the KV cache ceiling the sizing reserves; on site language model serving on the operator's own hardware
Sovereign AI Architecture for Distribution Loss and Theft Reduction in PakistanEvent backboneApache KafkaInterval load and tamper events on topics partitioned by meter number, so ordering holds per meter; at least once delivery with idempotent adapter writes; buffering absorbs head end bursts after an outage and replication inside the data centre
Sovereign AI Architecture for Distribution Loss and Theft Reduction in PakistanTime series storeTimescaleDB on PostgreSQL, committed at design against the measured interval rateInterval load for several hundred thousand meters is the bulk of the design's storage and its rate is not yet stated; the shelf's InfluxDB 3, TimescaleDB and QuestDB comparison covers exactly this case
Sovereign AI Architecture for Distribution Loss and Theft Reduction in PakistanRegistryHarbor, air gapped artifact and model registryWeights and container images enter only as versioned, signed artifacts through the registry, never over an open link; a failed update leaves the previous version serving
Sovereign AI Architecture for Distribution Loss and Theft Reduction in PakistanIdentity and observabilityKeycloak inside the boundary; Chrony; PrometheusIdentity is held inside the boundary with no external links; Chrony aligns clocks so an event joins to the right billing period; Prometheus watches consumer lag so a feed falling behind is seen before it goes stale
Sovereign AI Architecture for Distribution Loss and Theft Reduction in PakistanSensingSmart meter interval load and tamper events from the meters and feeder head meters through the meter data management system; the records of seven systems of recordNo cameras, no field sensors and no edge compute; the meters and their head end already exist and the platform reads them from the data centre
Sovereign AI Architecture for Distribution Loss and Theft Reduction in PakistanPattern: asset to alert to work orderA threshold crossing or tamper alarm becomes a tamper event or an agent draft linked to the exact meter or transformer, resolved by an inspection or an approvalSupplied by the pinned energy and utilities brief; an anomaly is never closed by editing a status field
Sovereign AI Architecture for Distribution Loss and Theft Reduction in PakistanPattern: memoryThe kept record of confirmed causes and closed cases, with customer identifiers minimised, that the next ranking reads; nothing trained into weightsThe requirement asks that the next ranking be better without training a model on the fly, and historical labels are biased by where inspections happened to be sent
Sovereign AI Architecture for Distribution Loss and Theft Reduction in PakistanPattern: validationOne circle of feeders for one quarter against a measured baseline with unchanged control feeders; known answer probes in the normal approval queueOnly untouched control feeders make the numbers defensible before the billing audit; probes catch rubber stamping and step an agent class back to shadow mode when the upheld rate falls
Sovereign AI Architecture for Distribution Loss and Theft Reduction in PakistanPattern: boundaryIn-country sovereign data centre or colocation on the operator's own hardware; reads only across the network boundary; the approved correction as the single write path into a system of recordNothing about customers leaves the country or reaches a foreign model service; the national data protection rules, the regulator's performance standards and the privatisation conditions bind
A Self-Improving AI System for OT Vulnerability Management at a Utility in the United StatesReasoning modelgpt-oss-120b, filed at 117B parameters (about 120B), sparse mixture of experts, MXFP4 with the dense portions at 16 bit, Apache-2.0, served on vLLM 0.32 on one node of eight 80 GB GPUs inside the utility's own networkThe requirement names open weights of United States origin on owned hardware; Apache-2.0 is a permissive licence with no usage based trigger and no field of use restriction, so the utility holds the weights with no third party model service; carries the three drafting agents, the command centre's cited conversational surface and ontology maintenance
A Self-Improving AI System for OT Vulnerability Management at a Utility in the United StatesEmbedding modelNomic Embed Text v2 MoE, 475M parameters, sparse mixture of experts, FP16, about 0.95 GB resident (about 0.5 GB at 8 bit; the Hub weights are float32, about 1.9 GB to download), Apache-2.0, on the same nodeEmbeds advisories, baselines and confirmed decisions for retrieval memory, which is how the system improves cycle to cycle; all 475 million parameters stay resident because every expert is in play at inference
A Self-Improving AI System for OT Vulnerability Management at a Utility in the United StatesServing runtimevLLM 0.32Serves the reasoning model from the node the weights sit on, with headroom for concurrent agent sessions; KV cache about 4.8 GB per session
A Self-Improving AI System for OT Vulnerability Management at a Utility in the United StatesGPU class80 GB HBM GPU class, one node of eight GPUs (640 GB), about 10 kWHolds the 70.1 GB the sizing rule demands with generous headroom; owned hardware inside the utility's own network; domestic supply, so no export control complication for a United States end user
A Self-Improving AI System for OT Vulnerability Management at a Utility in the United StatesSizing ruleFrontier model GPU footprint rule: filed parameters at INT4, 0.5 bytes each, times 1.2 for KV cache and activations117 billion parameters at 0.5 bytes is 58.4 GB; times 1.2 is 70.1 GB against the node's 640 GB; the checkpoint itself is 60.8 GiB (65.2 GB of root safetensors), and expanded to 16 bit it would need about 234 GB, which rules out a smaller host
A Self-Improving AI System for OT Vulnerability Management at a Utility in the United StatesOne-way transferHardware enforced data diode class, with a DMZ conduit as the lighter alternativeOT side data (the network monitoring tool's device list) leaves the electronic security perimeter with no return path and no credentials inside the perimeter where the utility's policy demands it; the choice between the two is an open item
A Self-Improving AI System for OT Vulnerability Management at a Utility in the United StatesSensingNone: the network monitoring tool's device list read only across the one way path, with Chrony 4.9 holding UTC orderingThe design watches advisories, baselines and decisions; no cameras, no telemetry feed, no historian in scope
A Self-Improving AI System for OT Vulnerability Management at a Utility in the United StatesEvent backboneApache Kafka 4.4Ordering keyed on advisory and record identifiers, delivery at least once with idempotent upserts keyed on record identity and content hash, buffering for scheduled exports, replication inside the utility's own cluster
A Self-Improving AI System for OT Vulnerability Management at a Utility in the United StatesRegistryHarbor v2.15.2, air gapped artifact and model registryModel and artifact updates travel as signed artifacts; a fine tuned model is promoted only through the instruction gate with the prior version retained for rollback, never inside an active cycle week
A Self-Improving AI System for OT Vulnerability Management at a Utility in the United StatesLabelling and retrainingLabel Studio 1.23.2Supports the governed offline fine tune lane; nothing changes the served weights inside a cycle
A Self-Improving AI System for OT Vulnerability Management at a Utility in the United StatesIdentityKeycloak 26.8, federated to the utility's own directoryNo person acts anonymously; every confirmation carries the person who made it
A Self-Improving AI System for OT Vulnerability Management at a Utility in the United StatesObservabilityPrometheus 3.13 LTSWatches the running system; record freshness and the acceptance rate are instrumented and visible in the command centre
A Self-Improving AI System for OT Vulnerability Management at a Utility in the United StatesPattern: memoryRetrieval memory of confirmed decisions plus a governed offline fine tune lane, nothing trained on the flyThe requirement asks for improvement from confirmed decisions without training a model on the fly; served weights must not change inside a cycle and no third party may read the record
A Self-Improving AI System for OT Vulnerability Management at a Utility in the United StatesPattern: projectionA projection ontology over the seven systems of record, never a migrationThe governed systems stay authoritative and evidence lands where audits already look; the write surface stays two paths wide
A Self-Improving AI System for OT Vulnerability Management at a Utility in the United StatesPattern: boundaryThe utility's own data centre rack, power, cooling and virtualisation in the United States; inbound feeds verified for source identity and integrity; nothing about the assets leaves the networkThe critical infrastructure protection standards and the utility's own segregation commitment; every weight on the node is one it holds

How much compute and hardware does AI in energy and utilities need?

The compute follows from the models: the published energy and utilities designs size it as follows, from no new hardware to a full GPU node.

DesignPartThe design
Grid Context WatchComputeOne node of eight 141 GB HBM-class GPUs: 753 GB of FP8 weights, 904 GB with the 1.2 planning factor, against 1,128 GB
Grid Context WatchBoundaryRead only and one way out of the control networks; nothing writes into an electronic security perimeter, and no data leaves the operator
Reliability AtlasComputeNo hardware bought; the study runs on the operator's own in-country servers
Feeder FirewatchFrontier computeOne node of eight 141 GB HBM-class GPUs holds GLM 5.2 at FP8 (753 GB of weights, 904 GB with headroom)
Feeder FirewatchEdgeSealed industrial boxes at substations and on patrol trucks detect smoke and damaged equipment when cellular coverage drops
Turbine Island WatchComputeOne 48 GB PCIe inference GPU class card on ruggedised edge servers inside the plant perimeter, a PTP grandmaster time card and a one-way egress path; no cloud, because Pakistan has no hyperscaler region
Sovereign AI Architecture for a Grid Control Room in Saudi ArabiaComputeOne node of eight 141 GB HBM cards (1,128 GB) in the operator's own data center in the Kingdom, holding 753 GB of FP8 weights with a 1.2 planning factor, 904 GB; BGE-M3 on the platform zone's rack server class; no edge tier. The node is a 4A090 class item for a D:3 and D:4 destination, so an export licence determination naming the end user is a phase one checkpoint before the order
Industrial Data Ontology for a Water Utility in the United StatesComputeOne air-cooled node of two 48 GB PCIe cards (96 GB, about 88 GB usable) in the utility's own server room, holding 58.4 GB of INT4 weights with a 1.2 planning factor, 70.1 GB; no inference at the stations or wells, and no data leaves the boundary. The room's power, cooling and rack space are confirmed at design and serving acceptance is gated on a measured load run
Sovereign AI Architecture for Distribution Loss and Theft Reduction in PakistanComputeOne node of eight 141 GB HBM GPUs (1,128 GB) holding 753 GB of FP8 weights with the 1.2 planning factor, 904 GB, plus one dual socket server with a 48 GB PCIe card for the embedder and the forecaster, both in an in-country sovereign data center or colocation on the operator's own hardware; no edge tier. The node is a 4A090 class item for a D:3 and D:4 destination, so the export licence determination precedes any card commitment, with a non US accelerator class held open
A Self-Improving AI System for OT Vulnerability Management at a Utility in the United StatesComputeOne node of eight 80 GB HBM cards (640 GB, about 10 kW) in the utility's own data center, holding 70.1 GB by the sizing rule (117 billion parameters at INT4 times 1.2) with generous headroom for concurrent agent sessions; the embedding model on the same node; no edge tier; domestic supply, so no export control complication for a United States end user

Is it cheaper to own AI hardware or rent cloud GPUs in energy and utilities?

Each energy and utilities design prices three years of ownership in its Appendix A, with every price cited, against renting the same capacity from a cloud region at its deepest three-year commitment where hardware is bought.

DesignLineThree years
Grid Context WatchThree-year costAbout 510,000 dollars to own the reasoning node, about four fifths the deepest three-year AWS commitment (Appendix A)
Reliability AtlasThree-year costNo hardware line to price: the cost is the assessment work itself (Appendix A)
Feeder FirewatchThree-year cost, ownedAbout 841,000 US dollars with support and power at the Texas industrial power price
Feeder FirewatchThree-year cost, rented0.88 million to 1.92 million US dollars for the same GPUs around the clock; ownership costs about the same as the deepest three-year commitment (version 2)
Feeder FirewatchClosed model break-evenThe cheapest closed model matches the owned stack at about 41 users; above that, ownership is cheaper and the gap grows with every user
Turbine Island WatchThree-year costAbout 22,500 US dollars to own the site envelope over three years (21,600 to 23,400), about the same as the deepest three-year AWS commitment for one L40S card in the UAE region, which could not keep the read one-way in any case (Appendix A)
Sovereign AI Architecture for a Grid Control Room in Saudi ArabiaThree-year costAbout 570,000 US dollars to own the node for three years (a range of 542,000 to 594,000: server, support and power at the national commercial electricity tariff), against about 751,000 to rent the same eight cards on the deepest three year commitment in AWS Middle East (UAE), so ownership costs about three quarters of it, and about 2.00 million on demand, against which ownership costs a little over a quarter. Renting is a price reference only, because AWS lists no Saudi region on the day read and every rented option would carry grid data across the border (Appendix A)
Industrial Data Ontology for a Water Utility in the United StatesThree-year costAbout 59,000 US dollars to own the server for three years (a range of 57,000 to 61,000: server, two 48 GB cards, support and power at the United States average commercial tariff), against about 104,000 to rent the same card class on the deepest three-year commitment in AWS US East, so ownership costs a little under three fifths of it, and about 276,000 on demand. The lowest priced rented instance that holds the model, one 96 GB card of a different class, is about 33,000, against which ownership costs about 1.8 times as much. Renting is a price reference only, because every rented option would carry the utility's records outside its boundary (Appendix A)
Sovereign AI Architecture for Distribution Loss and Theft Reduction in PakistanThree-year costAbout 641,000 US dollars to own the node and the inference server for three years (a range of 615,000 to 667,000: servers, support and power at the regulator's uniform commercial tariff), against about 773,000 to rent the same cards on the deepest three year commitment in AWS Asia Pacific (Mumbai), so ownership costs about five sixths of it, and about 2.05 million on demand, against which ownership costs a little under a third. Renting is a price reference only, because AWS lists no Pakistan region and every rented option would carry customer and meter data across the border (Appendix A)
A Self-Improving AI System for OT Vulnerability Management at a Utility in the United StatesThree-year costAbout 477,000 US dollars to own the node for three years (a range of 437,000 to 496,000: server, support and power at the national average commercial price), against about 544,000 to rent the same eight H100 cards on the deepest three year commitment in AWS US East, so ownership costs about seven eighths of it, and about 1.45 million on demand, against which ownership costs about a third; the region's other 80 GB class instance, eight A100 cards, rents for about 268,000 on the same plan, against which owning the H100 node costs about 1.8 times as much. Renting is a price reference only, because every rented option would carry the asset and vulnerability record outside the utility's network (Appendix A)

What ontology or object model does an energy and utilities AI system need?

The object model is the part that makes the system an ontology rather than a pipeline: typed objects for the things in the energy and utilities operation, with properties, status values and typed links. Every published design ships its object model as hyper-ontology/1 JSON that loads into Hyper Ontology.

DesignSizeObjectsDownload
Grid Context Watch14 objects, 14 linksSubstation, OT Asset, Network Sensor, Anomaly Alert, Investigation Case, Vulnerability Finding, Detection Rule, Threat Intelligence Item, Pcap Evidence Record, CIP Evidence Artefact, OT Security Analyst, SIEM, Energy management system, Substation data platformobjects.json
Reliability Atlas13 objects, 14 linksPlant, Production train, Equipment, Failure mode, Work order, Downtime event, Availability prediction, Availability target, Criticality index, RCA report, Major event, Spare part, Reliability programobjects.json
Feeder Firewatch14 objects, 12 linksSubstation, Feeder, Feeder segment, Pole, Recloser, Meter, Pole inspection record, Outage event, Feeder segment ignition risk score, Red flag warning, Wildfire camera station, Field crew, Work order, PSPS decision recordobjects.json
Turbine Island Watch10 objects, 10 linksSteam Turbine STG-1, New Steam Turbine Generator (280 MW, 20 kV hydrogen-cooled), 3500 Vibration Monitoring Rack, Condition Anomaly Alert, Condition Work Order, Instrument Calibration Record, Commissioning and Performance Test Record, Shift Operator (Employer's operational personnel), Warranty Engineer (Contractor, DLP), STG-1 Availability (RTR-derived)objects.json
Sovereign AI Architecture for a Grid Control Room in Saudi Arabia16 objects, 13 linksSubstation, Transmission line, Busbar, Transformer, Breaker, Protection relay, Alarm, Grid event, Switching program, Planned outage, Shift log, Operating procedure, Weather cell, Connected customer, Control engineer, Shift supervisorobjects.json
Industrial Data Ontology for a Water Utility in the United States16 objects, 14 linksTreatment plant, Well, Distribution reservoir, Pump station, Lift station, Pressure zone, Pump, Pipe segment, PLC, RTU, Tag, Alarm, Work order, Sampling point, Lab result, Permit limitobjects.json
Sovereign AI Architecture for Distribution Loss and Theft Reduction in Pakistan15 objects, 14 linksGrid station, Feeder, Transformer, Service connection, Meter, Interval load, Reading, Billing account, Tariff, Inspection, Tamper event, Theft case, Recovery, Agent draft, Approvalobjects.json
A Self-Improving AI System for OT Vulnerability Management at a Utility in the United States16 objects, 13 linksSubstation, Protective relay, Engineering workstation, Firmware and software version, Configuration baseline, Vendor, Advisory, Vulnerability, Applicability decision, Disposition, Change request, Outage window, Work order, Evidence item, Auditor question, Cycle agentobjects.json

Who approves the decisions an AI system makes in energy and utilities?

In every published energy and utilities design a named person makes the decision that changes the physical world; the system prepares it.

DesignHuman control
Grid Context WatchEvery triage, case and risk acceptance carries a named OT security analyst; agents draft, the analyst decides
Reliability AtlasPredictions are accepted only by a named reviewer and RCA reports validated only by a named engineer
Feeder FirewatchEvery public safety power shutoff (PSPS) recommendation becomes a decision record a named operator approves or declines; the design never opens or closes a recloser
Turbine Island WatchThe platform advises and the protection layer trips: every alert carries a prescribed action a named shift operator acknowledges, and nothing writes to the DCS
Sovereign AI Architecture for a Grid Control Room in Saudi ArabiaAgents draft and people decide, by name: the control engineer confirms the alarm triage ranking, the shift supervisor approves every switching program draft, the incoming supervisor approves the handover, and the event analysis is prepared for the protection engineer; disagreement is a first class path faster than agreement, and every confirmation is kept as memory the next shift reads
Industrial Data Ontology for a Water Utility in the United StatesAgents draft and named staff decide: the engineer confirms each tag mapping, the operator on shift confirms each alarm context pack, and the compliance manager approves the monthly permit report draft before any figure leaves the room; a monthly sampled audit of confirmed mappings logs the error rate, and a 15 minute staleness alarm on the historian mirror puts the command center into an explicit degraded mode
Sovereign AI Architecture for Distribution Loss and Theft Reduction in PakistanAgents draft and people decide, by name: the subdivision engineer approves the ranked causes and the inspection visits, the inspection officer approves the case file, the revenue officer approves the correction, and the Grade 17 officer signs the complaint; every approval carries the approver role, the officer grade, the timestamp, the artifact hash and a written reason, known answer probes police the approvers, and every confirmed cause and closed case is kept as the record the next ranking reads
A Self-Improving AI System for OT Vulnerability Management at a Utility in the United StatesAgents draft and people decide, by name: the compliance engineer confirms each applicability decision, the asset owner approves each disposition and its change request, the compliance manager confirms each evidence package, and no agent applies a patch, changes a baseline or closes a change; the acceptance rate is instrumented both ways, unflagged drafts are sampled independently each cycle, and a confirmed call becomes a precedent the next cycle retrieves

Every answer on this page is drawn from the papers linked in it: each paper's At a glance table, model register and cost appendix. Full text for agents: llms-full.txt. Designed on Praxis; object models load into Hyper Ontology.

Want one of these designs for your own operation? Talk to us.