Resource Allocation in V2X Networks: A Double Deep Q-Network Approach with Graph Neural Networks
Source abstract
Abstract
With the advancement of Vehicle-to-Everything (V2X) technology, efficient resource allocation in dynamic vehicular networks has become a critical challenge for achieving optimal performance. Existing methods suffer from high computational complexity and decision latency under high-density traffic and heterogeneous network conditions. To address these challenges, this study presents an innovative framework that combines Graph Neural Networks (GNNs) with a Double Deep Q-Network (DDQN), utilizing dynamic graph structures and reinforcement learning. An adaptive neighbor sampling mechanism is introduced to dynamically select the most relevant neighbors based on interference levels and network topology, thereby improving decision accuracy and efficiency. Meanwhile, the framework models communication links as nodes and interference relationships as edges, effectively capturing the direct impact of interference on resource allocation while reducing computational complexity and preserving critical interaction information. Employing an aggregation mechanism based on the Graph Attention Network (GAT), it dynamically adjusts the neighbor sampling scope and performs attention-weighted aggregation based on node importance, ensuring more efficient and adaptive resource management. This design ensures reliable Vehicle-to-Vehicle (V2V) communication while maintaining high Vehicle-to-Infrastructure (V2I) throughput. The framework retains the global feature learning capabilities of GNNs and supports distributed network deployment, allowing vehicles to extract low-dimensional graph embeddings from local observations for real-time resource decisions. Experimental results demonstrate that the proposed method significantly reduces computational overhead, mitigates latency, and improves resource utilization efficiency in vehicular networks under complex traffic scenarios. This research not only provides a novel solution to resource allocation challenges in V2X networks but also advances the application of DDQN in intelligent transportation systems, offering substantial theoretical significance and practical value.
Source: openalex_inverted_index · Quality: baseline
Research context
OpenAlex topics: IoT and Edge/Fog Computing
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
References (30)
Show source-provided references
1. Revolutionizing intelligent transportation systems with Cellular Vehicle-to-Everything (C-V2X) technology: current trends, use cases, emerging technologies, standardization bodies, industry analytics and future directions
2. Radio resource management for C-V2X: from a hybrid centralized-distributed scheme to a distributed scheme10.1109/JSAC.2023.3242723 ↗
3. QoS based deep reinforcement learning for V2X resource allocation
4. Spectrum sharing in vehicular networks based on multi-agent reinforcement learning10.1109/JSAC.2019.2933962 ↗
5. Multi-agent reinforcement learning based channel access scheme for underwater optical wireless communication networks
6. Energy-efficient resource allocation for V2X communications10.1109/JIOT.2024.3410098 ↗
7. Energy efficient resource allocation framework based on dynamic meta-transfer learning for V2X communications10.1109/TNSM.2024.3400605 ↗
8. A survey of collaborative machine learning using 5G vehicular communications10.1109/COMST.2022.3149714 ↗
9. A resource optimization scheduling model and algorithm for heterogeneous computing clusters based on GNN and RL10.1007/s11227-024-06383-4 ↗
10. Intelligent resource allocation in joint radar-communication with graph neural networks10.1109/TVT.2022.3187377 ↗
11. ICGNN: graph neural network enabled scalable beamforming for MISO interference channels
12. Underestimation estimators to Q-learning10.1016/j.ins.2022.05.090 ↗
13. Enhancing channel selection in 5G with decentralized federated multi-agent deep reinforcement learning
14. Deep-reinforcement-learning-based mode selection and resource allocation for cellular V2X communications10.1109/JIOT.2019.2962715 ↗
15. A novel low-latency V2V resource allocation scheme based on cellular V2X communications10.1109/TITS.2018.2865173 ↗
16. Research on graph feature aggregation algorithm based on GCN and GAT
17. A self-learning cognitive architecture exploiting causality from rewards10.1016/j.neunet.2022.02.029 ↗
18. Comparative study of convolution neural network’s ReLU and leaky-ReLU activation functions
19. Dynamic spectrum sharing based on deep reinforcement learning in mobile communication systems10.3390/s23052622 ↗
20. Markov decision processes with applications in wireless sensor networks: a survey10.1109/COMST.2015.2420686 ↗
21. Graph neural networks and deep reinforcement learning based resource allocation for V2X communications10.1109/JIOT.2024.3469547 ↗
22. Joint spectrum allocation and power control in vehicular communications based on dueling double DQN
23. Resource allocation strategy for vehicular communication networks based on multi-agent deep reinforcement learning
24. Intelligent surface aided D2D-V2X system for low-latency and high-reliability communications10.1109/TVT.2022.3189627 ↗
25. DDQN-based centralized spectrum allocation and distributed power control for V2X communications10.1109/TVT.2024.3493137 ↗
26. Network representation learning: from preprocessing, feature extraction to node embedding10.1145/3433000 ↗
27. 3rd Generation Partnership Project; Technical Specification Group Radio Access Network; Evolved Universal Terrestrial Radio Access (E-UTRA); Further Advancements for E-UTRA Physical Layer Aspects (Release 9). [Internet]. [cited 2025 Jun 11]. Available from: https://api.semanticscholar.org/CorpusID:16652630.
28. Deep reinforcement learning based resource allocation for V2V communications10.1109/TVT.2019.2897134 ↗
29. Integrated task assignment and path planning for capacitated multi-agent pickup and delivery10.1109/LRA.2021.3074883 ↗
30. A distributed multi-agent deep reinforcement learning-aided transmission design for dynamic vehicular communication networks10.1109/TVT.2023.3326877 ↗