journal article·2025Open access

DRL-AMIR: Intelligent Flow Scheduling for Software-Defined Zero Trust Networks

Wenlong Ke, Zilong Li, Peiyu Chen, Benfeng Chen, Jinglin Lv, Qiang Wang, Ziyi Jia, Shigen Shen

Computers, Materials & Continua· Volume 84· Issue 2

Abstract

Zero Trust Network (ZTN) enhances network security through strict authentication and access control. However, in the ZTN, optimizing flow control to improve the quality of service is still facing challenges. Software Defined Network (SDN) provides solutions through centralized control and dynamic resource allocation, but the existing scheduling methods based on Deep Reinforcement Learning (DRL) are insufficient in terms of convergence speed and dynamic optimization capability. To solve these problems, this paper proposes DRL-AMIR, which is an efficient flow scheduling method for software defined ZTN. This method constructs a flow scheduling optimization model that comprehensively considers service delay, bandwidth occupation, and path hops. Additionally, it balances the differentiated requirements of delay-critical K-flows, bandwidth-intensive D-flows, and background B-flows through adaptive weighting. The proposed framework employs a customized state space comprising node labels, link bandwidth, delay metrics, and path length. It incorporates an action space derived from node weights and a hybrid reward function that integrates both single-step and multi-step excitation mechanisms. Based on these components, a hierarchical architecture is designed, effectively integrating the data plane, control plane, and knowledge plane. In particular, the adaptive expert mechanism is introduced, which triggers the shortest path algorithm in the training process to accelerate convergence, reduce trial and error costs, and maintain stability. Experiments across diverse real-world network topologies demonstrate that DRL-AMIR achieves a 15–20% reduction in K-flow transmission delays, a 10–15% improvement in link bandwidth utilization compared to SPR, QoSR, and DRSIR, and a 30% faster convergence speed via adaptive expert mechanisms.
Source: openalex_inverted_index · Quality: baseline

Research context

OpenAlex topics: Software-Defined Networks and 5G · Security and Verification in Computing · IoT and Edge/Fog Computing

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

References (31)

Show source-provided references
1. ATT&CK-based advanced persistent threat attacks risk propagation assessment model for zero trust networks10.1016/j.comnet.2024.110376 ↗
2. Token as a service for software-defined zero trust networking
3. Distributed edge caching for zero trust-enabled connected and automated vehicles: a multi-agent reinforcement learning approach10.1109/MWC.001.2300414 ↗
4. Exploiting blockchain for dependable services in zero-trust vehicular networks10.1007/s11704-023-2495-0 ↗
5. An overview of QoS-aware load balancing techniques in SDN-based IoT networks10.1186/s13677-024-00651-7 ↗
6. Software defined multicast using segment routing in LEO satellite networks10.1109/TMC.2022.3215976 ↗
7. Industrial wireless internet zero trust model: zero trust meets dynamic federated learning with blockchain10.1109/MWC.001.2300368 ↗
8. Software defined multicast for large-scale multi-Layer LEO satellite networks10.1109/TNSM.2022.3151552 ↗
9. Matyas-Meyer Oseas based device profiling for anomaly detection via deep reinforcement learning (MMODPAD-DRL) in zero trust security network10.1007/s00607-024-01269-y ↗
10. Intelligent joint network slicing and routing via GCN-powered multi-task deep reinforcement learning10.1109/TCCN.2021.3136221 ↗
11. Dealing with changes: resilient routing via graph neural networks and multi-agent deep reinforcement learning10.1109/TNSM.2023.3287936 ↗
12. A review and comparative analysis of relevant approaches of zero trust network model10.3390/s24041328 ↗
13. SCIRD: revealing infection of malicious software in edge computing-enabled IoT networks
14. SGD3QN: joint stochastic games and dueling double deep Q-networks for defending malware propagation in edge intelligence-enabled internet of things10.1109/TIFS.2024.3420233 ↗
15. Okegbile · Blockchain and digital twin for smart hospitals · 2025 · 33710.1016/B978-0-443-34226-4.00018-6 ↗
16. A reputation-enhanced shard-based byzantine fault-tolerant scheme for secure data sharing in zero trust human digital twin systems10.1109/JIOT.2024.3382829 ↗
17. Personalized device authentication scheme using Q-learning-based decision-making with the aid of transfer fuzzy learning for IIoT devices in zero trust network (PDA-QLTFL)10.1016/j.compeleceng.2024.109435 ↗
18. Hybrid-hierarchical synchronization for resilient large-scale SDN architectures10.1109/ACCESS.2025.3527224 ↗
19. An SDN-based framework for E2E QoS guarantee in internet-of-things devices
20. An effective deep-Q learning scheme for QoS improvement in physical layer of software-defined networks10.1016/j.phycom.2024.102387 ↗
21. A multi-phase DRL-driven SDN migration framework addressing budget, legacy service compatibility, and dynamic traffic10.1109/ACCESS.2025.3543236 ↗
22. SNS: smart node selection for scalable traffic engineering in segment routing networks10.1109/TNSM.2024.3424928 ↗
23. MFGD3QN: enhancing edge intelligence defense against DDoS with mean-field games and dueling double deep Q-Network10.1109/JIOT.2024.3387090 ↗
24. Joint mean-field game and multiagent asynchronous advantage actor-critic for edge intelligence-based IoT malware propagation defense
25. DRSIR: a deep reinforcement learning approach for routing in software-defined networking10.1109/TNSM.2021.3132491 ↗
26. Routing optimization with deep reinforcement learning in knowledge defined networking10.1109/TMC.2023.3235446 ↗
27. Joint differential game and double deep Q-networks for suppressing malware spread in industrial internet of things10.1109/TIFS.2023.3307956 ↗
28. Enabling scalable routing in software-defined networks with deep reinforcement learning on critical nodes10.1109/TNET.2021.3126933 ↗
29. Delay-aware routing in software-defined networks via network tomography and reinforcement learning10.1109/TNSE.2024.3371384 ↗
30. SAC-PP: jointly optimizing privacy protection and computation offloading for mobile edge computing10.1109/TNSM.2024.3447753 ↗
31. DHRL-FNMR: an intelligent multicast routing approach based on deep hierarchical reinforcement learning in SDN10.1109/TNSM.2024.3402275 ↗