Multi-agent reinforcement learning based distributed smart grid load balancing scheduling algorithm design
Source abstract
Abstract
This study addresses the challenges of high-dimensional nonlinear coupling in distributed smart grids, such as voltage instability and load imbalance caused by renewable energy fluctuations. A multi-agent reinforcement learning (MARL) based distributed scheduling algorithm is proposed. It constructs a system with multiple intelligent energy hubs, where each agent manages a specific device class using local observations to avoid the dimensionality issues of centralized approaches. Dynamic conversion factors are introduced to handle renewable energy fluctuations and dynamic electricity prices, forming two complementary optimization strategies. Furthermore, based on the four elements of MARL algorithm, an algorithm is designed to solve the optimal adjustment strategy. Each intelligent body is responsible for a class of devices, and each intelligent body observes the local state to avoid the dimensional disaster and global state space explosion of centralized load scheduling. A multi-objective load balancing scheduling model is constructed for the power grid with the objectives of minimizing network loss, minimizing voltage offset, and achieving optimal load balance. An improved hybrid multi-objective particle swarm optimization algorithm based on R2 index and decomposition strategy is employed to solve the problem. An R2 index is used to screen the particle swarm, the global extremum is randomly selected, the individual extremum is updated using the Penalty-based Boundary Intersection (PBI) decomposition strategy, and elite and Gaussian learning strategies are combined to help particles escape local optima and achieve balanced scheduling. The experiment shows that this method reduces the fluctuation of power grid output and significantly improves network loss and load balancing indicators.
Source: crossref · Quality: baseline
Research context
OpenAlex topics: Smart Grid Energy Management · Microgrid Control and Optimization · Integrated Energy Systems Optimization
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
Affiliations
China Southern Power Grid Company Limited , Guangzhou 510663,
References (25)
Show source-provided references
1. Systemic risk in the global energy sector: Structure, determinants and portfolio management implications10.5547/01956574.44.6.ssha ↗
2. A novel efficient and lightweight authentication scheme for secure smart grid communication systems10.1007/s11227-022-04944-z ↗
3. Assessment of the status and trends of photovoltaic distributed generation in Brazil: An in-depth approach based on big data processing10.1016/j.solener.2022.12.018 ↗
4. Joint planning of distributed generations and energy storage in active distribution networks: A bi-level programming approach10.1016/j.energy.2022.123226 ↗
5. The balance groups mechanism for improving the operational efficiency of power system10.30919/es1712 ↗
6. A bi-level dispatch optimization of multi-microgrid considering green electricity consumption willingness under renewable portfolio standard policy10.1016/j.apenergy.2023.122428 ↗
7. A bilevel optimization model based on edge computing for microgrid10.3390/s22207710 ↗
8. Coordinated stochastic optimal energy management of grid-connected microgrids considering demand response, plug-in hybrid electric vehicles, and smart transformers10.1016/j.rser.2021.111861 ↗
9. A discrete optimal control model for the distributed energy system considering multiple disturbance inputs10.1049/gtd2.12195 ↗
10. RETRACTED: Application of an intelligent method for hydrogen-based energy hub in multiple energy markets10.1016/j.ijhydene.2023.03.124 ↗
11. Agent transparency in mixed-initiative multi-UxV control: How should intelligent agent collaborators speak their minds?10.1016/j.chb.2023.107866 ↗
12. Optimal operation strategy of combined heat and power system considering demand response and household thermal inertia10.1109/tce.2023.3250276 ↗
13. Theoretical analysis and economic evaluation of wind power consumption by electric boiler and heat storage tank for distributed heat supply system10.1016/j.epsr.2023.110060 ↗
14. Reinforcement learning-based optimized multi-agent finite-time optimal synchronisation control and its application to the harmonic oscillator10.1007/s11071-024-09758-7 ↗
15. UAV assisted cooperative caching on network edge using multi-agent actor-critic reinforcement learning10.1109/tvt.2022.3209079 ↗
16. Distributed multiagent reinforcement learning with action networks for dynamic economic dispatch10.1109/tnnls.2023.3234049 ↗
17. USV path following controller based on DDPG with composite state-space and dynamic reward function10.1016/j.oceaneng.2022.112449 ↗
18. Power flow study of MT-HVDC grid compensated by multiport interline DC power flow controller10.1109/TIA.2023.3258937 ↗
19. Economic analysis of isolator placement in the radial network for enhancement of reliability indicators10.1007/s00202-023-02013-z ↗
20. Optimal placement of distributed generation based on DISCO’s financial benefit with loss and emission reduction using hybrid Jaya–Red deer optimizer10.1007/s00202-022-01709-y ↗
21. Robust Pareto solutions for convex quadratic multiobjective optimization problems under data uncertainty10.1007/s10479-021-04461-x ↗
22. Structural design optimization of CFRP/Al hybrid co-cured high-speed flywheel with the particle swarm optimization algorithm10.1002/pc.27233 ↗
23. Continuous reactor temperature control with optimized PID parameters based on improved sparrow algorithm10.3390/pr11051302 ↗
24. Multi-objective design of aircraft maintenance using Gaussian process learning and adaptive sampling10.1016/j.ress.2021.108123 ↗
25. FlightBERT: Binary encoding representation for flight trajectory prediction10.1109/tits.2022.3219923 ↗