journal article·2026-06-16Open access

Quantum Deep Q-Network for Intelligent Packet Routing in 6G Heterogeneous Wireless Networks

Tong Xie, Taoyong Li, Xinxin Yuan, Jiacheng Ni

Applied Sciences· Volume 16· Issue 12

Abstract

Intelligent packet routing in sixth-generation (6G) heterogeneous wireless networks must contend with stochastic link failures, heterogeneous delay profiles, and the severe memory constraints of edge nodes. We propose a quantum deep Q-network (Q-DQN) that replaces the multi-layer perceptron in a standard DQN agent with a six-qubit variational quantum circuit (VQC) employing ring-topology entanglement and angle embedding. The total trainable parameter count follows the closed-form expression |ϕ|=12L+7n, growing at only seven parameters per additional network node. On a 10-node heterogeneous topology with stochastic link failures, Q-DQN achieves an average end-to-end delay of 54.29±1.72 ms with only 106 parameters, a 49.6× reduction relative to the MLP-based DQN baseline (5258 parameters, 52.89±2.67 ms). A three-seed scalability evaluation across n∈{6,8,10,12} nodes shows that under a limited 200-episode training budget DQN converges more consistently, while Q-DQN matches DQN performance under full 500-episode training at a fraction of the parameter cost. Ablation experiments confirm that local-topology entanglement substantially outperforms full-connection alternatives. These results indicate that VQC-based routing agents can match classical counterparts at a fraction of the parameter cost, providing a path toward ultra-lightweight intelligent routing in 6G edge deployments.
Source: crossref · Quality: baseline

Research context

OpenAlex topics: Quantum Computing Algorithms and Architecture · Molecular Communication and Nanonetworks · Quantum Information and Cryptography

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

School of Information and Navigation, Air Force Engineering University, Xi’an 710038, China

References (40)

Show source-provided references
1. A vision of 6G wireless systems: Applications, enabling technologies, and design aspects10.1109/MNET.001.1900287 ↗
2. Toward 6G networks: Use cases and technologies10.1109/MCOM.001.1900411 ↗
3. 6G wireless networks: Vision, requirements, architecture, and key technologies10.1109/MVT.2019.2921208 ↗
4. Towards 6G wireless communication networks: Vision, enabling technologies, and new paradigm shifts10.1007/s11432-020-2955-6 ↗
5. Survey on intelligent routing in 6G: From model-driven to data-driven paradigms
6. A note on two problems in connexion with graphs10.1007/BF01386390 ↗
7. Valadarsky, A., Schapira, M., Shahaf, D., and Tamar, A. (December, January 30). Learning to route. Proceedings of the 16th ACM Workshop on Hot Topics in Networks, Palo Alto, CA, USA.
8. Xu, Z., Tang, J., Meng, J., Zhang, W., Wang, Y., Liu, C.H., and Yang, D. (2018). Experience-driven networking: A deep reinforcement learning based approach. Proceedings of the IEEE International Conference on Computer Communications (INFOCOM), IEEE.10.1109/INFOCOM.2018.8485853 ↗
9. Human-level control through deep reinforcement learning10.1038/nature14236 ↗
10. Q-learning
11. Deep reinforcement learning-based routing in 5G and beyond wireless networks: Challenges and state of the art
12. Intelligent routing for 6G heterogeneous wireless networks: A multi-objective deep reinforcement learning approach
13. Deep reinforcement learning for adaptive routing in heterogeneous 6G networks: Handling link failures and traffic dynamics
14. Resilient routing under link failure dynamics in heterogeneous wireless mesh networks: A deep reinforcement learning approach
15. Variational quantum algorithms10.1038/s42254-021-00348-9 ↗
16. Noisy intermediate-scale quantum algorithms10.1103/RevModPhys.94.015004 ↗
17. Quantum computing in the NISQ era and beyond10.22331/q-2018-08-06-79 ↗
18. Huang, H.Y., Broughton, M., Cotler, J., Chen, S., Li, J., Mohseni, M., Neven, H., Babbush, R., Kueng, R., and Preskill, J. (2023). Near-term quantum computing techniques: Variational quantum algorithms, error mitigation, circuit compilation, benchmarking and classical simulation. Science, 380.10.1007/s11433-022-2057-y ↗
19. The power of quantum neural networks10.1038/s43588-021-00084-1 ↗
20. Tight bounds on the expressibility of quantum circuits
21. Variational quantum circuits for deep reinforcement learning10.1109/ACCESS.2020.3010470 ↗
22. Lockwood, O., and Si, M. (2020, January 19–23). Reinforcement learning with quantum variational circuit. Proceedings of the AAAI Conference on Artificial Intelligence and Interactive Digital Entertainment, Virtual.
23. Quantum agents in the gym: A variational quantum algorithm for deep Q-learning10.22331/q-2022-05-24-720 ↗
24. Quantum reinforcement learning for adaptive network control in 6G heterogeneous environments
25. Hybrid quantum-classical routing protocol for 6G ultra-dense networks with stochastic link failures
26. Barren plateaus in quantum neural network training landscapes10.1038/s41467-018-07090-4 ↗
27. Quantum-enhanced routing for autonomous vehicular networks in heterogeneous environments
28. Quantum circuit learning10.1103/PhysRevA.98.032309 ↗
29. Data re-uploading for a universal quantum classifier10.22331/q-2020-02-06-226 ↗
30. Effect of data encoding on the expressive power of variational quantum-machine-learning models10.1103/PhysRevA.103.032430 ↗
31. Quantum bit encoding and information processing with field superposition states in a circuit10.1088/0953-4075/45/18/185505 ↗
32. Signal, detection and estimation using a hybrid quantum circuit10.1038/s41598-024-65520-4 ↗
33. Variational quantum policies for reinforcement learning
34. Kwak, Y., Yun, W.J., Jung, S., and Kim, J. (2021). Introduction to quantum reinforcement learning: Does it offer advantages over classical approaches?. Proceedings of the IEEE International Symposium on Information Theory and Its Applications (ISITA), IEEE.10.1109/ICTC52510.2021.9620885 ↗
35. Quantum-classical hybrid deep reinforcement learning for resource allocation in heterogeneous networks
36. Variational quantum circuits for intelligent network control: A survey and future directions
37. Kingma, D.P., and Ba, J. (2015, January 7–9). Adam: A Method for Stochastic Optimization. Proceedings of the International Conference on Learning Representations (ICLR), San Diego, CA, USA.
38. van Hasselt, H., Guez, A., and Silver, D. (2016, January 12–17). Deep reinforcement learning with double Q-learning. Proceedings of the AAAI Conference on Artificial Intelligence, Phoenix, AZ, USA.10.1609/aaai.v30i1.10295 ↗
39. Quantum deep reinforcement learning for energy-efficient resource management in B5G/6G networks
40. A quantum engineer’s guide to superconducting qubits10.1063/1.5089550 ↗