journal article·2024Open access

QoS Routing Optimization Based on Deep Reinforcement Learning in SDN

Yu Song, Xusheng Qian, Nan Zhang, Wei Wang, Ao Xiong

Computers, Materials & Continua· Volume 79· Issue 2

Abstract

To enhance the efficiency and expediency of issuing e-licenses within the power sector, we must confront the challenge of managing the surging demand for data traffic. Within this realm, the network imposes stringent Quality of Service (QoS) requirements, revealing the inadequacies of traditional routing allocation mechanisms in accommodating such extensive data flows. In response to the imperative of handling a substantial influx of data requests promptly and alleviating the constraints of existing technologies and network congestion, we present an architecture for QoS routing optimization with in Software Defined Network (SDN), leveraging deep reinforcement learning. This innovative approach entails the separation of SDN control and transmission functionalities, centralizing control over data forwarding while integrating deep reinforcement learning for informed routing decisions. By factoring in considerations such as delay, bandwidth, jitter rate, and packet loss rate, we design a reward function to guide the Deep Deterministic Policy Gradient (DDPG) algorithm in learning the optimal routing strategy to furnish superior QoS provision. In our empirical investigations, we juxtapose the performance of Deep Reinforcement Learning (DRL) against that of Shortest Path (SP) algorithms in terms of data packet transmission delay. The experimental simulation results show that our proposed algorithm has significant efficacy in reducing network delay and improving the overall transmission efficiency, which is superior to the traditional methods.
Source: openalex_inverted_index · Quality: baseline

Research context

OpenAlex topics: Software-Defined Networks and 5G · Caching and Content Delivery · Advanced Optical Network Technologies

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

References (27)

Show source-provided references
1. Quality of service improvement with optimal software-defined networking controller and control plane clustering
2. Performance comparison of QoS routing algorithms applicable to large-scale SDN networks
3. Comparison of routing algorithms with static and dynamic link cost in software defined networking (SDN)10.1109/ACCESS.2019.2946707 ↗
4. Software defined networks: A survey10.1016/j.jnca.2016.03.016 ↗
5. Challenge based collaborative intrusion detection in software-defined networking: An evaluation10.1016/j.dcan.2020.09.003 ↗
6. Secure service offloading for internet of vehicles in SDN-enabled mobile edge computing10.1109/TITS.2020.3034197 ↗
7. Energy-efficient and SDN-enabled routing algorithm for wireless body area networks10.1016/j.comcom.2020.06.003 ↗
8. DetFed: Dynamic resource scheduling for deterministic federated learning over time-sensitive networks10.1109/TMC.2023.3303017 ↗
9. A three-party hierarchical game for physical layer security aware wireless communications with dynamic trilateral coalitions
10. Edge-Assisted video transmission with adaptive key frame selection: A hierarchical DRL approach
11. A DRL-based hierarchical game for physical layer security with dynamic trilateral coalitions
12. Fast and efficient bandwidth-delay constrained routing algorithm for SDN networks
13. A review on routing information protocol (RIP) and open shortest path first (OSPF) routing protocol
14. Modified smell detection algorithm for optimal paths engineering in hybrid SDN10.1016/j.jpdc.2023.104834 ↗
15. Ananthalakshmi · Advances in Swarm Intelligence, · Jul. 27, Aug. 1, 2017 · 10386 · 502
16. Comparative analysis of SDN and conventional networks using routing protocols
17. An adaptive greedy flow routing algorithm for performance improvement in software-defined network10.1002/jnm.2676 ↗
18. Moving target defense of routing randomization with deep reinforcement learning against eavesdropping attack10.1016/j.dcan.2022.01.003 ↗
19. DROM: Optimizing the routing in software-defined networks with deep reinforcement learning10.1109/ACCESS.2018.2877686 ↗
20. G. Stampa et al., “A deep-reinforcement learning approach for software-defined networking routing optimization,” arXiv preprint arXiv:1709.07080, 2017.
21. Improving energy efficiency and QoS of lpwans for IoT using q-learning based data routing10.1109/TCCN.2021.3114147 ↗
22. C. Zhao et al., “DRL-M4MR: An intelligent multicast routing approach based on DQN deep reinforcement learning in SDN,” arXiv preprint arXiv:2208.00383, 2022.10.1016/j.phycom.2022.101919 ↗
23. Performance of SDN routing in comparison with legacy routing protocols
24. A survey on software defined networking: Architecture for next generation network10.1007/s10922-016-9393-9 ↗
25. Q-learning: Theory and applications10.1146/annurev-statistics-031219-041220 ↗
26. Regularly updated deterministic policy gradient algorithm10.1016/j.knosys.2020.106736 ↗
27. Reinforcement learning with deep deterministic policy gradient