Multi-Source Energy Storage Day-Ahead and Intra-Day Scheduling Based on Deep Reinforcement Learning with Attention Mechanism
Source abstract
Abstract
With the rapid integration of high-penetration renewable energy, its inherent uncertainty complicates power system day-ahead/intra-day scheduling, leading to challenges like wind curtailment and high operational costs. Existing methods either rely on inflexible physical models or use deep reinforcement learning (DRL) without prioritizing critical variables or synergizing multi-source energy storage and demand response (DR). This study develops a multi-time scale coordination scheduling framework to balance cost minimization and renewable energy utilization, with strong adaptability to real-time uncertainties. The framework integrates a day-ahead optimization model and an intra-day rolling model powered by an attention-enhanced DRL Actor–Critic network—where the attention mechanism dynamically focuses on critical variables to correct real-time deviations. Validated on an East China regional grid, the framework significantly enhances renewable energy absorption and system flexibility, providing a robust technical solution for the economical and stable operation of high-renewable power systems.
Source: crossref · Quality: baseline
Research context
OpenAlex topics: Smart Grid Energy Management · Microgrid Control and Optimization · Integrated Energy Systems Optimization
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
Affiliations
State Grid Shandong Electric Power Research Institute, Jinan 250003, China
School of Automation Science and Engineering, Xi’an Jiaotong University, Xi’an 710049, China
School of Cyber Science and Engineering, Xi’an Jiaotong University, Xi’an 710049, China
Funding
Science and Technology Project of State Grid Shandong Electric Power Research Institute “Research and Application of Collaborative Control Technology for Multi-type Energy Storage and Temporal Complementarity”
References (28)
Show source-provided references
1. Analysis of Optimal Dispatching Technology for Electric Vehicles Participating in Day-ahead Wind Power Consumption
2. Deep Synchronization Control of Grid-Forming Converters: A Reinforcement Learning Approach10.1109/JAS.2024.124824 ↗
3. Physics-informed reinforcement learning for real-time optimal power flow with renewable energy resources10.1109/TSTE.2024.3452489 ↗
4. Research On The Day-ahead Economic Dispatch Method of Microgrid Including Solar-ESS-EV
5. Day-ahead optimal scheduling considering thermal and electrical energy management in smart homes with photovoltaic–thermal systems10.1016/j.apenergy.2024.124070 ↗
6. Distributed Robust Self-scheduling Method for Integrated Energy Production Unit Participating in Day-ahead Electricity-gas Joint Market
7. Auxiliary decision-making method of optimal dispatching for microgrid based on deep learning
8. Distributionally robust chance-constrained energy management for islanded microgrids10.1109/TSG.2018.2792322 ↗
9. Economic dispatch of microgrid based on two stage robust optimization
10. Adaptive robust energy and reserve co-optimization of integrated electricity and heating system considering wind uncertainty10.1016/j.apenergy.2019.114230 ↗
11. Optimal scheduling of integrated energy system considering renewable energy uncertainties based on distributionally robust adaptive MPC10.1016/j.renene.2024.120457 ↗
12. Day-ahead optimal dispatch strategy for active distribution network based on improved deep reinforcement learning10.1109/ACCESS.2022.3141824 ↗
13. Liu, Z., Zhang, M., Huang, J., Hu, Z., and Dai, P. (2022, January 24–26). Power and energy balance method of multivariate interactive distribution network based on source network load coordination. Proceedings of the 2022 2nd International Conference on Control and Intelligent Robotics, Nanjing, China.10.1145/3548608.3559288 ↗
14. Multi-time scale based improved energy management model for microgrid
15. Yang, J., Li, Y., Yang, P., Duan, Z., and Yan, J. (2024, January 1–3). A robust scheduling method of ac/dc distribution network based on diamond-shaped cutting convex hull set. Proceedings of the 2024 4th International Conference on Intelligent Power and Systems (ICIPS), Yichang, China.10.1109/ICIPS64173.2024.10899980 ↗
16. Model-free load frequency control of nonlinear power systems based on deep reinforcement learning10.1109/TII.2024.3353934 ↗
17. Li, Y. (2017). Deep reinforcement learning: An overview. arXiv.
18. Self-adaptive uncertainty economic dispatch based on deep reinforcement learning
19. Optimal energy management strategies for energy Internet via deep reinforcement learning approach10.1016/j.apenergy.2019.01.145 ↗
20. Bui, V.-H., Hussain, A., and Kim, H.-M. (2019). Q-learning-based operation strategy for community battery energy storage system (cbess) in microgrid system. Energies, 12.10.3390/en12091789 ↗
21. Real-time economic dispatch of community integrated energy system based on a double-layer reinforcement learning method
22. Deep reinforcement learning for scenario-based robust economic dispatch strategy in internet of energy10.1109/JIOT.2020.3040294 ↗
23. Deep reinforcement learning for energy management in a microgrid with flexible demand10.1016/j.segan.2020.100413 ↗
24. A day-ahead scheduling model of power systems incorporating multiple tidal range power stations10.1109/TSTE.2022.3224231 ↗
25. Day-ahead scheduling of a gravity energy storage system considering the uncertainty10.1109/TSTE.2020.3030815 ↗
26. Load Frequency Control of Multi-microgrids Based on Deep Deterministic Policy Gradient Integrated with Online Learning10.1109/TSG.2025.3587312 ↗
27. Vaswani, A., Shazeer, N., Parmar, N., Uszkoreit, J., Jones, L., Gomez, A.N., Kaiser, Ł., and Polosukhin, I. (2017). Attention is all you need. Adv. Neural Inf. Process. Syst., 30.
28. Multiple time-scales source-storage-load coordination scheduling strategy of grid connected to energy storage power station considering characteristic distribution