journal article·2025Open access

Intelligent Scheduling of Virtual Power Plants Based on Deep Reinforcement Learning

Shaowei He, Wenchao Cui, Gang Li, Hairun Xu, Xiang Chen, Yu Tai

Computers, Materials & Continua· Volume 84· Issue 1

Abstract

The Virtual Power Plant (VPP), as an innovative power management architecture, achieves flexible dispatch and resource optimization of power systems by integrating distributed energy resources. However, due to significant differences in operational costs and flexibility of various types of generation resources, as well as the volatility and uncertainty of renewable energy sources (such as wind and solar power) and the complex variability of load demand, the scheduling optimization of virtual power plants has become a critical issue that needs to be addressed. To solve this, this paper proposes an intelligent scheduling method for virtual power plants based on Deep Reinforcement Learning (DRL), utilizing Deep Q-Networks (DQN) for real-time optimization scheduling of dynamic peaking unit (DPU) and stable baseload unit (SBU) in the virtual power plant. By modeling the scheduling problem as a Markov Decision Process (MDP) and designing an optimization objective function that integrates both performance and cost, the scheduling efficiency and economic performance of the virtual power plant are significantly improved. Simulation results show that, compared with traditional scheduling methods and other deep reinforcement learning algorithms, the proposed method demonstrates significant advantages in key performance indicators: response time is shortened by up to 34%, task success rate is increased by up to 46%, and costs are reduced by approximately 26%. Experimental results verify the efficiency and scalability of the method under complex load environments and the volatility of renewable energy, providing strong technical support for the intelligent scheduling of virtual power plants.
Source: openalex_inverted_index · Quality: baseline

Research context

OpenAlex topics: Smart Grid and Power Systems · Power Systems and Renewable Energy · Power Systems and Technologies

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

References (24)

Show source-provided references
1. Strategies to achieve a carbon neutral society: a review10.1007/s10311-022-01435-8 ↗
2. Frequency control studies: a review of power system, conventional and renewable generation unit modeling10.1016/j.epsr.2022.108191 ↗
3. SolarFlux predictor: a novel deep learning approach for photovoltaic power forecasting in South Korea10.3390/electronics13112071 ↗
4. Intermittent and stochastic character of renewable energy sources: consequences, cost of intermittence and benefit of forecasting10.1016/j.rser.2018.02.007 ↗
5. A review on distributed generation impacts on electric power system10.1016/j.ijhydene.2022.04.142 ↗
6. Wang · 2019 IEEE innovative smart grid technologies-Asia (ISGT Asia) · 2019 · 432810.1109/ISGT-Asia.2019.8881433 ↗
7. A review on the virtual power plant: components and operation systems
8. A Markovian decision process
9. A new model for optimal generation scheduling of power system considering generation units availability10.1016/j.ijepes.2012.11.001 ↗
10. A fast method for the unit scheduling problem with significant renewable power generation10.1016/j.enconman.2015.01.071 ↗
11. Optimal stochastic scheduling of electrical and thermal renewable and non-renewable resources in virtual power plant10.1016/j.ijepes.2020.106658 ↗
12. Study on hybrid generator scheduling based on multi-agent
13. Xiao T, Chen Y, Diao H, Huang S, Shen C. On fast-converged deep reinforcement learning for optimal dispatch of large-scale power systems under transient security constraints. arXiv:2304.08320. 2024.10.2139/ssrn.4703658 ↗
14. Performance comparison of deep RL algorithms for energy systems optimal scheduling
15. Dynamic parallel machine scheduling with deep Q-network10.1109/TSMC.2023.3289322 ↗
16. Workneh · Artificial intelligence and industrial applications. A2IA 2023. Lecture notes in networks and systems · 2023 · 771
17. Deep-Q-network-based intelligent reschedule for power system operational planning
18. Flexibility-based generation maintenance scheduling in presence of uncertain wind power plants forecasted by deep learning considering demand response programs portfolio10.1016/j.ijepes.2022.108225 ↗
19. Intelligent traffic light via policy-based deep reinforcement learning
20. Deep reinforcement learning: a brief survey10.1109/MSP.2017.2743240 ↗
21. Heuristic mean-variance optimization in Markov decision processes using state-dependent risk aversion
22. A review of residential demand response of smart grid10.1016/j.rser.2016.01.016 ↗
23. Daily load curve based power consumption mode extraction and clustering analysis
24. Double deep Q-network-based self-adaptive scheduling approach for smart shop floor10.1007/s00521-023-08877-3 ↗