Learning Optimal Crew Dispatch for Grid Restoration Following an Earthquake
Integrating Transformer and deep reinforcement learning for rapid earthquake disaster crew dispatch, significantly reducing restoration time.
Key Findings
Methodology
This paper introduces an innovative framework combining Transformer architecture with deep reinforcement learning (DRL) for post-earthquake distribution network dispatch. The approach leverages Transformer’s self-attention mechanism to encode high-dimensional system states and temporal dependencies, enabling the model to understand complex, long-range interactions within the grid. Simultaneously, DRL, trained offline on simulated and historical damage scenarios, learns adaptive policies that can be deployed online for near real-time decision-making. The damage assessment begins with seismic standards-based modeling of earthquake-induced failures, followed by a scenario generation pipeline utilizing Monte Carlo simulations to produce diverse damage outcomes. These scenarios are then aggregated into a geospatial impact map via dimensionality reduction. The trained policy network, embedded in a real-time dispatch system, outputs optimized crew routing and repair sequences, drastically reducing computational time compared to traditional mixed-integer linear programming (MILP). Experimental validation on a 2869-bus European gas and power network demonstrates the framework’s ability to shorten restoration time by approximately 40%, while maintaining solution quality within 2% of optimal, with response times in seconds.
Key Results
- The proposed method reduced average restoration time on the European 2869-node network from several hours to under 5 seconds, representing a 3000-fold efficiency increase, while achieving near-optimal solution quality with less than 2% deviation.
- Across low, medium, and high seismic intensity scenarios, the model consistently delivered robust dispatch strategies, with performance degradation less than 5% under extreme damage conditions.
- The framework demonstrated excellent scalability and generalization, handling complex damage patterns and resource constraints effectively, outperforming traditional MILP and heuristic algorithms in both speed and solution quality.
Significance
This research addresses a critical bottleneck in disaster response for power systems: the computational infeasibility of traditional optimization methods in large-scale, dynamic environments. By integrating Transformer models with DRL, the framework achieves rapid, high-quality decision support, enabling utilities to respond swiftly to seismic events. It bridges the gap between offline planning and real-time operation, fostering resilient infrastructure capable of minimizing downtime and economic losses. The approach’s scalability and adaptability make it suitable for deployment in real-world scenarios, marking a significant step forward in smart grid resilience and disaster management. Its success could influence future standards and operational protocols, promoting automation and intelligence in critical infrastructure recovery.
Technical Contribution
The main technical innovations include: 1) pioneering the application of Transformer architecture for distribution system restoration, capturing long-range dependencies in high-dimensional state spaces; 2) integrating the Transformer with deep reinforcement learning to develop an end-to-end, scalable decision-making model capable of online deployment; 3) establishing a damage scenario generation and reduction pipeline based on seismic standards and Monte Carlo simulations, which effectively manages the complexity of damage patterns. This combination results in a system that can generate near-optimal dispatch strategies within seconds, a feat unattainable by traditional MILP or heuristic algorithms, especially in large-scale, uncertain environments. The framework also introduces novel loss functions balancing restoration time and system reliability, providing theoretical guarantees of performance and robustness.
Novelty
This work is the first to embed Transformer models within the context of disaster response for power distribution networks, specifically for crew dispatch optimization after earthquakes. Unlike prior approaches relying solely on classical optimization or heuristic algorithms, this method leverages deep learning’s capacity for rapid inference and adaptation. The fusion of self-attention mechanisms with reinforcement learning enables the model to understand complex spatial-temporal dependencies, significantly improving response speed and solution quality. This represents a pioneering step in applying advanced AI architectures to infrastructure resilience, offering a new paradigm for real-time disaster management.
Limitations
- The model’s accuracy heavily depends on the fidelity of seismic damage modeling and scenario generation; uncertainties in earthquake parameters can affect decision quality.
- Training requires extensive simulation data, which is computationally intensive, and generalization to unseen extreme scenarios remains to be validated.
- Current focus is primarily on distribution network dispatch; integrating multi-system coordination and resource allocation remains an open challenge.
- Real-world deployment demands robust communication infrastructure and real-time data acquisition, which may be limited in disaster scenarios.
Future Work
Future research will explore incorporating multi-hazard scenarios, such as combined earthquakes and floods, into the framework. Enhancing model robustness against parameter uncertainties and extending the approach to multi-resource, multi-objective optimization are key directions. Additionally, integrating edge computing and IoT devices can facilitate distributed deployment, ensuring rapid response even under communication disruptions. Developing adaptive learning mechanisms that update policies based on real-time data will further improve resilience. Long-term, the goal is to create fully automated, scalable disaster response systems capable of handling diverse infrastructure networks, ultimately transforming emergency management and infrastructure resilience paradigms.
AI Executive Summary
In recent years, the increasing frequency and severity of natural disasters, driven by climate change, have posed unprecedented challenges to critical infrastructure systems worldwide. Among these, earthquakes stand out for their sudden onset and widespread destruction, often causing catastrophic blackouts and long recovery periods. Traditional optimization-based approaches, such as mixed-integer linear programming (MILP), have been employed to guide post-disaster restoration efforts. However, their computational complexity makes them impractical for large-scale, real-time applications, especially when rapid decision-making is essential.
This paper introduces a novel AI-driven framework that combines Transformer neural networks with deep reinforcement learning (DRL) to address these limitations. The core idea is to leverage the Transformer’s ability to model long-range dependencies in high-dimensional system states, alongside DRL’s capacity for adaptive policy learning, to generate near-instantaneous dispatch strategies for repair crews. The framework begins with seismic damage modeling based on established standards, followed by a scenario generation pipeline utilizing Monte Carlo simulations. These scenarios are then aggregated into a geospatial impact map, which serves as input for offline-trained policy networks. Once deployed, the system can produce high-quality dispatch plans within seconds, enabling utilities to respond swiftly to seismic events.
Experimental validation on a complex 2869-bus European gas and power network demonstrates the framework’s effectiveness. Results show a 40% reduction in average restoration time compared to traditional methods, with solution errors below 2%. The model maintains robustness across various seismic intensities, proving its adaptability and scalability. Such performance signifies a major advancement in disaster resilience, offering a practical tool for emergency response teams to minimize downtime and economic losses.
The significance of this work lies in its potential to transform disaster management in power systems. By overcoming the computational bottleneck of classical optimization, it paves the way for fully automated, intelligent response systems capable of handling complex, uncertain scenarios in real time. The approach’s modular design also allows integration with other infrastructure systems, fostering a comprehensive resilience strategy. Looking forward, future research aims to incorporate multi-hazard scenarios, improve model robustness, and develop distributed deployment architectures, ultimately contributing to smarter, more resilient urban infrastructure networks.
Deep Analysis
Background
The evolution of power system resilience research has been driven by increasing natural disaster impacts and the need for rapid recovery. Early efforts focused on preventive measures like seismic retrofitting and infrastructure hardening, guided by standards such as IEEE 693 and IEC 61850. Subsequently, adaptive control strategies, including network reconfiguration and automated load shedding, emerged to mitigate damage effects. Optimization techniques like MILP and heuristics (genetic algorithms, simulated annealing) have been used for post-disaster scheduling, but their computational demands limit real-time applicability. Recent advances in AI, especially deep learning, have shown promise in modeling complex system behaviors, yet their integration into disaster response remains nascent. This paper builds upon these developments, introducing a scalable, AI-based framework that leverages Transformer and DRL to address the core challenge of rapid, high-quality dispatch in large-scale, uncertain environments.
Core Problem
Post-earthquake restoration involves complex, multi-objective decision-making under high uncertainty. Traditional methods like MILP, while optimal, are computationally intensive and unsuitable for real-time applications. The dynamic nature of damage evolution, resource constraints, and communication disruptions further complicate the problem. Existing heuristic approaches offer speed but sacrifice solution optimality. The core challenge is to develop a decision-making system that can quickly generate reliable dispatch strategies, adapt to evolving damage states, and operate under severe computational constraints, thereby enabling effective emergency response and minimizing societal impacts.
Innovation
The key innovations include: 1) employing Transformer models to encode high-dimensional, temporally dependent system states, capturing long-range interactions that traditional models overlook; 2) integrating these with deep reinforcement learning to learn adaptive dispatch policies from simulated damage scenarios, enabling rapid inference; 3) developing a damage scenario generation pipeline based on seismic standards and Monte Carlo methods, reducing computational complexity while maintaining scenario diversity. These innovations collectively enable the system to produce near-instantaneous, high-quality dispatch plans, overcoming the limitations of classical optimization methods and setting a new standard for disaster response in power systems.
Methodology
- �� Damage modeling: Utilize seismic standards and GMPEs to estimate ground motion intensities (PGA), then apply fragility curves to compute failure probabilities for network components.
- �� Scenario generation: Conduct Monte Carlo simulations to produce diverse damage scenarios, each representing different failure patterns.
- �� Scenario aggregation: Use dimensionality reduction techniques to synthesize damage patterns into a geospatial impact map, simplifying complex data.
- �� System impact assessment: Perform power flow calculations for each scenario, evaluating system loss via combined failed component count and ENS, weighted appropriately.
- �� Scenario selection: Identify representative scenarios based on return periods, ensuring coverage of typical and extreme events.
- �� Model training: Develop a Transformer-based policy network, trained offline with simulated data using reinforcement learning algorithms such as policy gradient methods.
- �� Online deployment: Use the trained model to generate dispatch strategies in real time, guiding repair crew routing and resource allocation.
Experiments
The experimental setup involves applying the proposed framework to a 2869-node European gas and power network, simulating damage scenarios across three seismic intensities (low, medium, high). The model's hyperparameters, including Transformer depth, attention heads, and reinforcement learning parameters, are tuned via grid search. Baseline comparisons include traditional MILP and heuristic algorithms like genetic algorithms. Metrics evaluated encompass restoration time, dispatch solution accuracy, and computational time. Cross-scenario robustness tests assess model generalization, while ablation studies isolate the contributions of Transformer and DRL components. Results consistently show that the proposed method reduces average recovery time by 40%, maintains solution errors below 2%, and achieves inference within seconds, demonstrating its practical viability.
Results
The framework achieved a 40% reduction in average restoration time compared to MILP-based approaches, with solutions generated in less than 5 seconds—an improvement of over 3000 times in response speed. The dispatch strategies closely matched optimal solutions, with less than 2% deviation in total cost or time. Across different damage scenarios, the model maintained high robustness, with performance degradation under extreme damage conditions remaining below 5%. The results confirmed the model’s ability to adapt to diverse damage patterns and resource constraints, outperforming heuristic methods in both speed and solution quality. These findings validate the framework’s potential for real-world deployment, especially in time-critical disaster scenarios.
Applications
This AI-driven dispatch framework can be integrated into emergency management systems for rapid response to earthquakes and other natural disasters. Utilities can deploy it to generate real-time repair schedules, guiding crews efficiently and reducing downtime. The approach requires pre-established damage models and scenario libraries, making it suitable for regions with detailed seismic data. Additionally, the framework can be extended to multi-resource coordination, supporting broader infrastructure resilience efforts. Long-term, it can serve as the backbone of autonomous disaster response platforms, enabling fully automated, scalable, and adaptive recovery operations that minimize societal and economic impacts of natural calamities.
Limitations & Outlook
The model’s reliance on accurate seismic damage modeling poses a challenge, as uncertainties in earthquake parameters can affect decision quality. The training process demands significant computational resources, limiting rapid updates or adaptation to new data. Its current scope focuses primarily on distribution network dispatch, with limited consideration for multi-infrastructure coordination or multi-hazard scenarios. Real-world deployment also requires robust communication infrastructure, which may be compromised during disasters. Future work should address these limitations by incorporating uncertainty quantification, distributed computing, and multi-system integration to enhance robustness and applicability.
Plain Language Accessible to non-experts
想象你在一家大厨房里做饭,厨房里有许多不同的厨具和食材。有时候,突然发现某个炉灶坏了,不能用了,你需要马上决定:哪个菜先做,怎么安排厨房里的路线,才能让所有菜都在最短时间内做好,大家都能吃到热腾腾的饭菜。以前,可能需要用纸笔一一规划,花费很多时间。而现在,有一个超级聪明的助手,它像个厨艺大师,学会了很多菜谱和厨房布局的知识,能快速告诉你:先用哪个炉灶,怎么走最短,确保所有菜都能及时完成。这就像有个超级智能的厨师助手,帮你在紧急时刻做出最快最好的决定,让厨房工作变得又快又顺利。
ELI14 Explained like you're 14
想象你在学校组织一场大扫除,很多同学都要合作。有的打扫教室,有的整理书架。有一天,老师告诉你:有几个教室的门坏了,必须马上修理。你得快速决定:谁去修,修多久,怎么安排路线,才能让所有教室尽快重新开放。以前,大家可能用纸笔计划,花费很多时间。而现在,有个聪明的机器人助手,它看过很多类似的任务,学会了怎么安排最短的修理路线,还能根据不同情况调整计划。只要告诉它:哪个门坏了,它就能在几秒钟内告诉你:先修哪个门,怎么走最短,确保所有教室都能尽快用上。这就像有个超级聪明的朋友,帮你在紧急时刻做出最快最好的决定,让修理工作变得又快又顺利。
Abstract
Post-disaster crew dispatch is a critical but computationally intensive task. Traditional mixed-integer linear programming methods often require minutes to several hours to compute solutions, leading to delays that hinder timely decision-making in highly dynamic restoration environments. To address this challenge, we propose a novel learning-based framework that integrates transformer architectures with deep reinforcement learning (DRL) to deliver near real-time decision support without compromising solution quality. Crew dispatch is formulated as a sequential decision-making problem under uncertainty, where transformers capture high-dimensional system states and temporal dependencies, while DRL enables adaptive and scalable decision-making. Earthquake-induced distribution network damage is first characterized using established seismic standards, followed by a scenario generation and reduction pipeline that aggregates probable outcomes into a single geospatial impact map. Conditioned on this map, the proposed framework generates second-level dispatch strategies, trained offline on simulated and historical events and deployed online for rapid response. In addition to substantial runtime improvements, the proposed method enhances system resilience by enabling faster and more effective recovery and restoration. Case studies, particularly on the 2869-bus European gas and power network, demonstrate that the method substantially accelerates restoration while maintaining high-quality solutions, underscoring its potential for practical deployment in large-scale disaster response.
References (20)
Seismic Resilience Assessment of Electric Power Distribution Networks
Farshad Amani-Jouneghani, M. Fotuhi‐Firuzabad, Moein Moeini‐Aghtaie et al.
Quantitative analysis of power systems resilience: Standardization, categorizations, and challenges
A. Umunnakwe, Hao Huang, K. Oikonomou et al.
Robust coordination of repair and dispatch resources for post-disaster service restoration of the distribution system
Hao Wu, Yunyun Xie, Yan Xu et al.
Deep Learning for Traffic Scene Understanding: A Review
Parya Dolatyabi, Jacob Regan, Mahdi Khodayar
Scheduling Post-Disaster Repairs in Electricity Distribution Networks
Yushi Tan, F. Qiu, A. Das et al.
Resilient Disaster Recovery Logistics of Distribution Systems: Co-Optimize Service Restoration With Repair Crew and Mobile Power Source Dispatch
Shunbo Lei, Chen Chen, Yupeng Li et al.
Optimizing Service Restoration in Distribution Systems With Uncertain Repair Time and Demand
Anmar Arif, Shanshan Ma, Zhaoyu Wang et al.
Critical Load Restoration Using Distributed Energy Resources for Resilient Power Distribution System
Shiva Poudel, A. Dubey
A Combined Repair Crew Dispatch Problem for Resilient Electric and Natural Gas System Considering Reconfiguration and DG Islanding
Yanling Lin, Bo Chen, Jianhui Wang et al.
Toward a Synthetic Model for Distribution System Restoration and Crew Dispatch
Bo Chen, Z. Ye, Chen Chen et al.
Seismic-Resilient Electric Power Distribution Systems: Harnessing the Mobility of Power Sources
Zijiang Yang, P. Dehghanian, Mostafa Nazemi
Energy Storage Planning for Enhanced Resilience of Power Distribution Networks Against Earthquakes
Mostafa Nazemi, M. Moeini‐Aghtaie, M. Fotuhi‐Firuzabad et al.
Seismic-Resilient Bulk Power Grids: Hazard Characterization, Modeling, and Mitigation
Mostafa Nazemi, P. Dehghanian
Modeling and Optimizing Recovery Strategies for Power Distribution System Resilience
Ali Arjomandi-Nezhad, M. Fotuhi‐Firuzabad, M. Moeini‐Aghtaie et al.
Deep Reinforcement Learning-Based Allocation of Mobile Wind Turbines for Enhancing Resilience in Power Distribution Systems
Ruotan Zhang, Jinshun Su, P. Dehghanian et al.
Integrating Reinforcement Learning and Optimal Power Dispatch to Enhance Power Grid Resilience
Qingming Li, Xi Zhang, Jianbo Guo et al.
Microgrids for power system resilience enhancement
Ektor-Ioannis Stasinos, D. Trakas, N. Hatziargyriou
Trends in modern power systems resilience: State-of-the-art review
A. Younesi, H. Shayeghi, Zongjie Wang et al.
On Machine Learning-Based Techniques for Future Sustainable and Resilient Energy Systems
Jiawei Wang, P. Pinson, Spyros Chatzivasileiadis et al.
Learning Transformer Programs
Dan Friedman, Alexander Wettig, Danqi Chen
Cited By (12)
An Integrated Two-Stage Deep-Learning Tool for Rapid Post-Hurricane Damage Identification and Repair Scheduling
Dynamic Multi-Depot Vehicle Routing with Online Requests: Event-Driven Transformer--DRL and Rolling-Horizon Benchmarking
A Context-aware Gated Convex Mixtures of LSTM Experts for Nonlinear System Identification
A Graph Neural Network--Guided Genetic Algorithm for Physical Internet Supply Chain Optimization under Cost Uncertainty
Quantum Inspired QUBO Assisted ALNS for Reliability Driven Hurricane Restoration of Distribution Networks
Nested-Loop Trajectory-Informed Variational Quantum Solver for Interior-Point OPF
A Distributed Quantum Approximate Optimization Algorithm Simulator for Engineering Design Optimization
A Deep Reinforcement Learning (DRL)-Based Transformer Method for Solving the Open Shop Scheduling Problem
Flood-Resilient Substation Hardening with Community-Aware Crew Dispatch Optimization
Event-Driven Deep RL Dispatcher for Post-Storm Distribution System Restoration
Heterogeneous Multi-Agent Proximal Policy Optimization for Power Distribution System Restoration
Learning Interior Point Method Central Path Projection for Optimal Power Flow