journal article·2025Open access

Improved PPO-Based Task Offloading Strategies for Smart Grids

Qian Wang, Ya Zhou

Computers, Materials & Continua· Volume 84· Issue 2

Abstract

Edge computing has transformed smart grids by lowering latency, reducing network congestion, and enabling real-time decision-making. Nevertheless, devising an optimal task-offloading strategy remains challenging, as it must jointly minimise energy consumption and response time under fluctuating workloads and volatile network conditions. We cast the offloading problem as a Markov Decision Process (MDP) and solve it with Deep Reinforcement Learning (DRL). Specifically, we present a three-tier architecture—end devices, edge nodes, and a cloud server—and enhance Proximal Policy Optimization (PPO) to learn adaptive, energy-aware policies. A Convolutional Neural Network (CNN) extracts high-level features from system states, enabling the agent to respond continually to changing conditions. Extensive simulations show that the proposed method reduces task latency and energy consumption far more than several baseline algorithms, thereby improving overall system performance. These results demonstrate the effectiveness and robustness of the framework for real-time task offloading in dynamic smart-grid environments.
Source: openalex_inverted_index · Quality: baseline

Research context

OpenAlex topics: Smart Grid Security and Resilience · Smart Grid Energy Management · IoT and Edge/Fog Computing

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

References (30)

Show source-provided references
1. Acarali · Managing Internet of Things applications across edge and cloud data centres · 2024 · 25510.1049/PBPC027E_ch11 ↗
2. Metaheuristic optimization with deep learning enabled smart grid stability prediction
3. Internet of Things-based robust green smart grid10.3390/computers13070169 ↗
4. Evolution in computing paradigms for Internet of Things-enabled smart grid applications
5. Arcas GI, Cioara T, Anghel I, Lazea D, Hangan A. Edge offloading in smart grid. arXiv:2402.01664. 2024.10.3390/smartcities7010028 ↗
6. Fusion-communication MEC offloading strategy for smart grid
7. Research status of mobile cloud computing offloading technology and its application in the power grid
8. A new task scheduling scheme based on genetic algorithm for edge computing
9. Research on edge computing-oriented resource-aware access and intelligent gateway technology for power transmission, transformation and distribution
10. A novel distributed computing resource operation mechanism for edge computing
11. Task offloading strategies for mobile edge computing: a survey10.1016/j.comnet.2024.110791 ↗
12. Adaptive real-time offloading decision-making for mobile edges: deep reinforcement learning framework and simulation results10.3390/app10051663 ↗
13. A survey on computation offloading in edge systems: from the perspective of deep reinforcement learning approaches10.1016/j.cosrev.2024.100656 ↗
14. Zhu · Proceedings of the Fifth International Conference on Computer Communication and Network Security (CCNS 2024); 2024 May 3–5; Guangzhou, China · 1322813
15. DRL-based optimization of privacy protection and computation performance in MEC computation offloading
16. Resource allocation techniques in underlay cognitive radio networks based on mixed-integer programming: a survey10.1109/JCN.2016.000104 ↗
17. A greedy algorithm for task offloading in mobile edge computing system10.1109/CC.2018.8543056 ↗
18. Energy theft detection in smart grids with genetic algorithm-based feature selection
19. DRL-based latency-energy offloading optimization strategy in wireless VR networks with edge computing10.1016/j.comnet.2025.111034 ↗
20. Parameterized deep reinforcement learning with hybrid action space for edge task offloading10.1109/JIOT.2023.3327121 ↗
21. Energy-efficient offloading based on hybrid bio-inspired algorithm for edge-cloud integrated computation
22. Mobile edge computing task offloading method for the power Internet of Things
23. Quota matching-based task offloading for WSN in smart grid
24. Deep reinforcement learning for task offloading in edge computing assisted power IoT10.1109/ACCESS.2021.3092381 ↗
25. Joint optimization of computing offloading and service caching in edge computing-based smart grid10.1109/TCC.2022.3163750 ↗
26. Design of a Q-learning based smart grid and smart water scheduling model based on heterogeneous task specific offloading process
27. Collaborative task offloading and resource allocation in small-cell MEC: a multi-agent PPO-based scheme10.1109/TMC.2024.3496536 ↗
28. Computation offloading in vehicular communications using PPO-based deep reinforcement learning10.1007/s11227-025-07009-z ↗
29. A distributed deep reinforcement learning technique for application placement in edge and fog computing environments10.1109/TMC.2021.3123165 ↗
30. Offloading in mobile edge computing: task allocation and computational frequency scaling