journal article·2026-05-04Open access

Research on Dynamic Computing Power Network Transmission Optimization Based on DGNN-PPO and a Variant of the Polya Ball Method

Ping He, Chunchao Liu, Luen Zhou, Shufu Cao

Applied Sciences· Volume 16· Issue 9

Abstract

To meet the growing computational demands of expanding intelligence application scenarios, computing networks are becoming increasingly complex. However, operational challenges such as frequent node online/offline events and dynamic link status changes significantly complicate the coordinated scheduling of computational and transmission resources. Furthermore, traditional static optimization methods exhibit stability issues and slow convergence in medium-scale dynamic networks, limiting their ability to satisfy low-latency and high-reliability requirements for complex services. Therefore, we propose a dynamic computing network transmission optimization method that integrates Dynamic Graph Neural Networks (DGNN), dual virtual queues, and Proximal Policy Optimization (PPO) with Nesterov momentum acceleration. This approach aims to optimize network transmission performance during frequent node changes. This approach employs DGNN for real-time modeling of dynamic topology and node load characteristics, utilizes a dual virtual queue mechanism to characterize stability constraints of computational and transmission loads, and incorporates Nesterov momentum during policy optimization to enhance convergence speed and stability of policy updates. Simulation experiments indicate that the proposed method outperforms comparison models in queue stability, convergence performance, and quality of service, thereby improving transmission efficiency in dynamic computing networks.
Source: crossref · Quality: baseline

Research context

OpenAlex topics: Software-Defined Networks and 5G · Advanced Data and IoT Technologies · Advanced Graph Neural Networks

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

School of Management Science and Information Engineering, Hebei University of Economics and Business, Shijiazhuang 050061, China

Hebei Cross-Border E-Commerce Technology Innovation Center, Shijiazhuang 050061, China

Funding

Hebei based Universities and Shijiazhuang Industry University Research Cooperation Project · Science and Technology Research Project of Higer Eduation of Hebei Province

References (27)

Show source-provided references
1. Deep reinforcement learning for task offloading in mobile edge computing systems10.1109/TMC.2020.3036871 ↗
2. Dynamic task offloading and resource allocation for ultra-reliable low-latency edge computing10.1109/TCOMM.2019.2898573 ↗
3. A survey on mobile edge computing: The communication perspective10.1109/COMST.2017.2745201 ↗
4. Deep reinforcement learning for vehicular edge computing: An intelligent offloading system10.1145/3317572 ↗
5. State-augmented learnable algorithms for resource management in wireless networks10.1109/TSP.2022.3229948 ↗
6. Rate control for communication networks: Shadow prices, proportional fairness and stability10.1057/palgrave.jors.2600523 ↗
7. Foundations and modeling of dynamic networks using dynamic graph neural networks: A survey10.1109/ACCESS.2021.3082932 ↗
8. Zheng, Y., Yi, L., and Wei, Z. (2025). A survey of dynamic graph neural networks. Front. Comput. Sci., 19.10.1007/s11704-024-3853-2 ↗
9. You, J., Du, T., and Leskovec, J. (2022, January 14–18). ROLAND: Graph learning framework for dynamic graphs. Proceedings of the 28th ACM SIGKDD Conference on Knowledge Discovery and Data Mining, Washington, DC, USA.10.1145/3534678.3539300 ↗
10. A comprehensive survey of dynamic graph neural networks: Models, frameworks, benchmarks, experiments and challenges10.1109/TKDE.2025.3621291 ↗
11. Chen, W., Liu, S., Yang, Y., Hu, W., and Yu, J. (2025). Dynamic Edge Loading Balancing with Edge Node Activity Prediction and Accelerating the Model Convergence. Sensors, 25.10.3390/s25051491 ↗
12. Liu, Z., Liu, K., Zhang, J., and Guan, J. (2021, January 28–29). In-network computing-based transmission optimization mechanism in SDN. Proceedings of the 2021 ACM International Conference on Intelligent Computing and Its Emerging Applications, Jinan, China.10.1145/3491396.3506538 ↗
13. Data transmission optimization in edge computing using multi-objective reinforcement learning10.1007/s11227-024-06213-7 ↗
14. Integrating intelligent sensing, transmission, and control for industrial IoT networks: Key technologies and future directions
15. Mobile cloud computing for computation offloading: Issues and challenges10.1016/j.aci.2016.11.002 ↗
16. Some methods of speeding up the convergence of iteration methods10.1016/0041-5553(64)90137-5 ↗
17. Analysis and design of optimization algorithms via integral quadratic constraints10.1137/15M1009597 ↗
18. Yin, X., Jindal, A., Sekar, V., and Sinopoli, B. (2015, January 17–21). A control-theoretic approach for dynamic adaptive video streaming over HTTP. Proceedings of the 2015 ACM Conference on Special Interest Group on Data Communication (SIGCOMM), London, UK.10.1145/2785956.2787486 ↗
19. Huang, T.Y., Johari, R., McKeown, N., Trunnell, M., and Watson, M. (2014, January 17–21). A buffer-based approach to rate adaptation: Evidence from a large video streaming service. Proceedings of the 2014 ACM Conference on Special Interest Group on Data Communication (SIGCOMM), Chicago, IL, USA.10.1145/2619239.2626296 ↗
20. Dynamic graph representation learning with neural networks: A survey10.1109/ACCESS.2024.3378111 ↗
21. Neely, M. (2010). Stochastic Network Optimization with Application to Communication and Queueing Systems, Morgan & Claypool Publishers.10.1007/978-3-031-79995-2 ↗
22. Representation learning for dynamic graphs: A survey
23. Deep reinforcement learning for dynamic computation offloading and resource allocation in cache-assisted mobile edge computing systems10.23919/ICN.2020.0014 ↗
24. EMM: Energy-aware mobility management for mobile edge computing in ultra dense networks10.1109/JSAC.2017.2760160 ↗
25. Schulman, J., Wolski, F., Dhariwal, P., Radford, A., and Klimov, O. (2017). Proximal policy optimization algorithms. arXiv.
26. Henderson, P., Islam, R., Bachman, P., Pineau, J., Precup, D., and Meger, D. (2018). Deep reinforcement learning that matters. Proc. AAAI Conf. Artif. Intell., 32.10.1609/aaai.v32i1.11694 ↗
27. Joint computation and transmission optimization method for “cloud-edge-end” computing systems