DQN-Based Proactive Trajectory Planning of UAVs in Multi-Access Edge Computing
Source abstract
Abstract
The main aim of future mobile networks is to provide secure, reliable, intelligent, and seamless connectivity. It also enables mobile network operators to ensure their customer’s a better quality of service (QoS). Nowadays, Unmanned Aerial Vehicles (UAVs) are a significant part of the mobile network due to their continuously growing use in various applications. For better coverage, cost-effective, and seamless service connectivity and provisioning, UAVs have emerged as the best choice for telco operators. UAVs can be used as flying base stations, edge servers, and relay nodes in mobile networks. On the other side, Multi-access Edge Computing (MEC) technology also emerged in the 5G network to provide a better quality of experience (QoE) to users with different QoS requirements. However, UAVs in a mobile network for coverage enhancement and better QoS face several challenges such as trajectory designing, path planning, optimization, QoS assurance, mobility management, etc. The efficient and proactive path planning and optimization in a highly dynamic environment containing buildings and obstacles are challenging. So, an automated Artificial Intelligence (AI) enabled QoS-aware solution is needed for trajectory planning and optimization. Therefore, this work introduces a well-designed AI and MEC-enabled architecture for a UAVs-assisted future network. It has an efficient Deep Reinforcement Learning (DRL) algorithm for real-time and proactive trajectory planning and optimization. It also fulfills QoS-aware service provisioning. A greedy-policy approach is used to maximize the long-term reward for serving more users with QoS. Simulation results reveal the superiority of the proposed DRL mechanism for energy-efficient and QoS-aware trajectory planning over the existing models.
Source: openalex_inverted_index · Quality: baseline
Research context
OpenAlex topics: UAV Applications and Optimization · IoT and Edge/Fog Computing · Advanced Neural Network Applications
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
References (46)
Show source-provided references
1. A survey on mobile edge computing: The communication perspective10.1109/COMST.2017.2745201 ↗
2. Edge computing: Current trends, research challenges and future directions10.1007/s00607-020-00896-5 ↗
3. Survey on multi-access edge computing security and privacy10.1109/COMST.2021.3062546 ↗
4. An efficient SDN-based LTE-WiFi spectrum aggregation system for heterogeneous 5G networks10.1002/ett.3943 ↗
5. Network slice lifecycle management for 5 g mobile networks: An intent-based networking approach10.1109/ACCESS.2021.3084834 ↗
6. Slicing the core network and radio access network domains through intent-based networking for 5G networks10.3390/electronics9101710 ↗
7. Collaborative cloud and edge computing for latency minimization10.1109/TVT.2019.2904244 ↗
8. Cloud-native network slicing using software defined networking based multi-access edge computing: A survey10.1109/ACCESS.2021.3050155 ↗
9. Intelligent edge computing enabled reliable emergency data transmission and energy efficient offloading in 6TiSCH-based IIoT networks10.1016/j.seta.2022.102492 ↗
10. Resource scheduling in edge computing: A survey10.1109/COMST.2021.3106401 ↗
11. Unmanned aerial vehicles and multi-access edge computing
12. UAV-assisted MEC networks with aerial and ground cooperation10.1109/TWC.2021.3086521 ↗
13. Integration of multi access edge computing with unmanned aerial vehicles: Current techniques, open issues and research directions10.1016/j.phycom.2022.101641 ↗
14. Multi-UAV network assisted intelligent edge computing: Challenges and opportunities10.23919/JCC.2022.03.019 ↗
15. Dynamic positioning and energy-efficient path planning for disaster scenarios in 5G-assisted multi-UAV environments10.3390/electronics11142197 ↗
16. Energy-efficient UAV-assisted mobile edge computing: Resource allocation and trajectory optimization10.1109/TVT.2020.2968343 ↗
17. A comprehensive survey on aerial mobile edge computing: Challenges, state-of-the-art, and future directions10.1016/j.comcom.2022.05.004 ↗
18. Thirty years of machine learning: The road to pareto-optimal wireless networks10.1109/COMST.2020.2965856 ↗
19. Sutton · Reinforcement Learning: An Introduction · 2018
20. Deep learning10.1038/nature14539 ↗
21. Drone deep reinforcement learning: A review10.3390/electronics10090999 ↗
22. An approach to surveillance an area using swarm of fixed wing and quad-rotor unmanned aerial vehicles UAVs
23. UAVs path planning architecture for effective medical emergency response in future networks10.1016/j.phycom.2021.101337 ↗
24. Clifford geometric algebra-based approach for 3D modeling of agricultural images acquired by UAVs10.1109/ACCESS.2020.3045443 ↗
25. UAV’s agricultural image segmentation predicated by clifford geometric algebra10.1109/ACCESS.2019.2906033 ↗
26. Simultaneous cooperation of refrigerated ground vehicle (RGV) and unmanned aerial vehicle (UAV) for rapid delivery with perishable food10.1016/j.apm.2022.02.024 ↗
27. Estimating forest structure from UAV-mounted LiDAR point cloud using machine learning10.3390/rs13030352 ↗
28. Distributed energy-efficient multi-UAV navigation for long-term communication coverage by deep reinforcement learning10.1109/TMC.2019.2908171 ↗
29. UAV navigation in high dynamic environments: A deep reinforcement learning approach10.1016/j.cja.2020.05.011 ↗
30. Unmanned aerial vehicles using machine learning for autonomous flight; state-of-the-art10.1080/01691864.2019.1586760 ↗
31. Explainable deep reinforcement learning for UAV autonomous navigation10.1016/j.ast.2021.107052 ↗
32. Mobile edge computing: A survey on architecture and computation offloading10.1109/COMST.2017.2682318 ↗
33. Energy efficient computation offloading mechanism in multi-server mobile edge computing—an integer linear optimization approach10.3390/electronics9061010 ↗
34. Secure transmission for multi-UAV-assisted mobile edge computing based on reinforcement learning
35. Joint design of access point selection and path planning for UAV-assisted cellular networks10.1109/JIOT.2019.2947718 ↗
36. 3D UAV trajectory design and frequency band allocation for energy-efficient and fair communication: A deep reinforcement learning approach10.1109/TWC.2020.3016024 ↗
37. Towards real-time path planning through deep reinforcement learning for a UAV in dynamic environments10.1007/s10846-019-01073-3 ↗
38. Drone-cell trajectory planning and resource allocation for highly mobile networks: A hierarchical DRL approach10.1109/JIOT.2020.3020067 ↗
39. A novel reinforcement learning based grey wolf optimizer algorithm for unmanned aerial vehicles (UAVs) path planning10.1016/j.asoc.2020.106099 ↗
40. A UAV path planning method based on deep reinforcement learning
41. Task offloading in edge computing for machine learning-based smart healthcare10.1016/j.comnet.2021.108019 ↗
42. Cross layer design for mobile adhoc unmanned aerial vehicle communication networks
43. Deep reinforcement learning based path planning for UAV-assisted edge computing networks
44. Path planning for UAV-mounted mobile edge computing with deep reinforcement learning10.1109/TVT.2020.2982508 ↗
45. Intelligent UAV navigation: A DRL-QiER solution
46. Non-convex optimization and rate control for multi-class services in the internet10.1109/TNET.2005.852876 ↗