journal article·2025-12-24Open access

Dynamic Multi-Core Task Scheduling for Real-Time Hybrid Simulation Model in Power Grid: A Deep Reinforcement Learning-Based Method

Dingyu Hu, Zhi Wang, Qitao Liu, Jianbing Xu, Lu Zhang, Bo Shen

Applied Sciences· Volume 16· Issue 1

Abstract

With the increasing scale and complexity of power systems, the Security and Stability Control System (SSCS) plays a vital role in ensuring the safe operation of the grid. However, existing SSCS implementations still face many limitations in cross-regional coordination, control precision, and risk prediction. Establishing the digital simulation model is an effective way to verify the control policy of SSCS. This paper proposes a neural heuristic task scheduling method based on deep reinforcement learning (DRL) to schedule the simulation tasks. It models the task dependencies of SSCS as a directed acyclic graph (DAG) and then dynamically optimizes task priorities and resource allocation through deep reinforcement learning. The method introduces multi-head attention and heterogeneous attention mechanisms to effectively capture complex dependencies among tasks, enabling efficient multi-core task scheduling. Simulation results show that the proposed algorithm significantly outperforms traditional scheduling methods in terms of makespan, load balancing, and resource utilization. It can also adapt to dynamic changes under different task scales and multi-core environments, demonstrating strong robustness and scalability.
Source: crossref · Quality: baseline

Research context

OpenAlex topics: Real-time simulation and control systems · Smart Grid Security and Resilience · Smart Grid Energy Management

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

School of Software, Northwestern Polytechnical University, Xi’an 710129, China

School of Computer Science and Engineering, Northwestern Polytechnical University, Xi’an 710129, China

State Grid Electric Power Research Institute, Nanjing 211000, China

Electric Power Research Institute, Xinjiang Electric Power Co., Ltd., Urumqi 830011, China

Funding

Science and Technology Project of SGCC Headquarters Management

References (34)

Show source-provided references
1. Chamana, M., Bhatta, R., Schmitt, K., Shrestha, R., and Bayne, S. (2023). An Integrated Testbed for Power System Cyber-Physical Operations Training. Appl. Sci., 13.10.20944/preprints202307.1243.v1 ↗
2. Rubio, S., Bogarra, S., Nunes, M., and Gomez, X. (2025). Smart Grid Protection, Automation and Control: Challenges and Opportunities. Appl. Sci., 15.10.3390/app15063186 ↗
3. Grigsby, L.L. (2007). Power System Stability and Control, CRC Press.10.1201/9781420009248 ↗
4. Sutton, R.S., and Barto, A.G. (1998). Reinforcement Learning: An Introduction, MIT Press.10.1109/TNN.1998.712192 ↗
5. Bertsekas, D. (2012). Dynamic Programming and Optimal Control: Volume I, Athena Scientific.
6. Improved decomposition-based global EDF scheduling of DAGs10.1142/S0218126618501013 ↗
7. Mastering the game of go without human knowledge10.1038/nature24270 ↗
8. A dynamic task scheduling algorithm for airborne device clouds10.1155/2024/9922714 ↗
9. A survey of hard real-time scheduling for multiprocessor systems10.1145/1978802.1978814 ↗
10. Grajcar, M. (1999, January 21–25). Genetic list scheduling algorithm for scheduling and allocation on a loosely coupled heterogeneous multiprocessor system. Proceedings of the 36th Annual ACM/IEEE Design Automation Conference, New Orleans, LA, USA.10.1145/309847.309931 ↗
11. Performance-effective and low-complexity task scheduling for heterogeneous computing10.1109/71.993206 ↗
12. Pop, F., Dobre, C., and Cristea, V. (2009, January 27–29). Genetic algorithm for DAG scheduling in grid environments. Proceedings of the 2009 IEEE 5th International Conference on Intelligent Computer Communication and Processing, Cluj-Napoca, Romania.10.1109/ICCP.2009.5284747 ↗
13. A particle swarm optimization algorithm for hybrid flow-shop scheduling with multiprocessor tasks10.1080/00207540701294627 ↗
14. Multi-Agent Deep Reinforcement Learning Framework for Renewable Energy-Aware Workflow Scheduling on Distributed Cloud Data Centers10.1109/TPDS.2024.3360448 ↗
15. Mao, H., Alizadeh, M., Menache, I., and Kandula, S. (2016, January 9–10). Resource management with deep reinforcement learning. Proceedings of the 15th ACM Workshop on Hot Topics in Networks, Atlanta, GA, USA.10.1145/3005745.3005750 ↗
16. DRLBTSA: Deep reinforcement learning based task-scheduling algorithm in cloud computing10.1007/s11042-023-16008-2 ↗
17. Multi-Agent Reinforcement Learning for Efficient Task Scheduling in Edge-Cloud Systems
18. Deep Reinforcement Learning for Dynamic Task Scheduling in Edge-Cloud Environments
19. Energy-aware task scheduling optimization with deep reinforcement learning for large-scale heterogeneous systems10.1007/s42514-021-00083-8 ↗
20. Graph neural networks for job shop scheduling problems: A survey10.1016/j.cor.2024.106914 ↗
21. Flexible job-shop scheduling via graph neural network and deep reinforcement learning10.1109/TII.2022.3189725 ↗
22. GA-DRL: Graph neural network-augmented deep reinforcement learning for DAG task scheduling over dynamic vehicular clouds10.1109/TNSM.2024.3387707 ↗
23. Parisotto, E., Song, F., Rae, J., Pascanu, R., Gulcehre, C., Jayakumar, S., Jaderberg, M., Kaufman, R.L., Clark, A., and Noury, S. (2020, January 13–18). Stabilizing transformers for reinforcement learning. Proceedings of the 37th International Conference on Machine Learning, PMLR, Virtual.
24. Nachum, O., Gu, S., Lee, H., and Levine, S. (2018). Data-efficient hierarchical reinforcement learning. arXiv.
25. Kool, W., Van Hoof, H., and Welling, M. (2018). Attention, learn to solve routing problems!. arXiv.
26. Meta-hierarchical reinforcement learning (MHRL)-based dynamic resource allocation for dynamic vehicular networks10.1109/TVT.2022.3146439 ↗
27. Han, L., Zhou, Z., and Li, Z. (2024, January 3–7). Pantheon: Preemptible multi-dnn inference on mobile edge gpus. Proceedings of the 22nd Annual International Conference on Mobile Systems, Applications and Services, Tokyo, Japan.10.1145/3643832.3661878 ↗
28. Review on the research and practice of deep learning and reinforcement learning in smart grids10.17775/CSEEJPES.2018.00520 ↗
29. Reinforcement learning for electric power system decision and control: Past considerations and perspectives10.1016/j.ifacol.2017.08.1217 ↗
30. Dixit, V., Patil, M.B., and Chandorkar, M.C. (2009, January 2–5). Real time simulation of power electronic systems on multi-core processors. Proceedings of the 2009 International Conference on Power Electronics and Drive Systems (PEDS), Taipei, Taiwan.10.1109/PEDS.2009.5385756 ↗
31. A comprehensive study of load balancing approaches in real-time multi-core systems for mixed real-time tasks10.1109/ACCESS.2024.3388291 ↗
32. Resource management in sustainable cyber-physical systems using heterogeneous cloud computing10.1109/TSUSC.2017.2723954 ↗
33. Li, Y., Yan, J., and Naili, M. (2022, January 18–23). Deep reinforcement learning for penetration testing of cyber-physical attacks in the smart grid. Proceedings of the 2022 International Joint Conference on Neural Networks (IJCNN), Padua, Italy.10.1109/IJCNN55064.2022.9892584 ↗
34. Ng, A.Y., Harada, D., and Russell, S. (1999, January 27–30). Policy invariance under reward transformations: Theory and application to reward shaping. Proceedings of the International Conference on Machine Learning, Bled, Slovenia.