journal article·2025-05-06Open access

A Hybrid Optimization Framework for Dynamic Drone Networks: Integrating Genetic Algorithms with Reinforcement Learning

Mustafa Ulaş, Anıl Sezgin, Aytuğ Boyacı

Applied Sciences· Volume 15· Issue 9

Abstract

The growing use of unmanned aerial vehicles (UAVs) in diverse fields such as disaster recovery, rural regions, and smart cities necessitates effective dynamic drone network establishment techniques. Conventional optimization techniques like genetic algorithms (GAs) and particle swarm optimization (PSO) are weak when it comes to real-time adjustment to the environment and multi-objective constraints. This paper proposes a hybrid optimization framework combining genetic algorithms and reinforcement learning (RL) to improve the deployment of drone networks. We integrate Q-learning into the GA mutation process to allow drones to adaptively adjust locations in real time under coverage, connectivity, and energy constraints. In the scenario of large-scale simulations for wildfire tracking, disaster response, and urban monitoring tasks, the hybrid approach performs better than GA and PSO. The greatest enhancements are 6.7% greater coverage, 7.5% less average link distance, and faster convergence to optimal deployment. The proposed framework allows drones to establish strong and stable networks that are dynamic in nature and adapt to dynamic mission demands with efficient real-time coordination. This research has important applications in autonomous UAV systems for mission-critical applications where adaptability and robustness are essential.
Source: crossref · Quality: baseline

Research context

OpenAlex topics: UAV Applications and Optimization · Distributed Control Multi-Agent Systems · Metaheuristic Optimization Algorithms Research

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

Department of Artificial Intelligence and Data Engineering, Fırat University, 23119 Elazığ, Turkey

Research and Development, Siemens A.S., 34870 Istanbul, Turkey

Department of Computer Engineering, National Defence University, Air Force Academy, 34149 Istanbul, Turkey

Funding

Firat University, Scientific Research Project Committee (FUBAP)

References (41)

Show source-provided references
1. Sezgin, A., and Boyacı, A. (2023, January 7–9). Securing the Skies: Exploring Privacy and Security Challenges in Internet of Drones. Proceedings of the 10th International Conference on Recent Advances in Air and Space Technologies (RAST), Istanbul, Turkiye.10.1109/RAST57548.2023.10197987 ↗
2. A constrained differential evolution algorithm to solve UAV path planning in disaster scenarios10.1016/j.knosys.2020.106209 ↗
3. A joint global and local path planning optimization for UAV task scheduling towards crowd air monitoring10.1016/j.comnet.2021.107913 ↗
4. RGG-PSO+: Random Geometric Graphs Based Particle Swarm Optimization Method for UAV Path Planning10.1007/s44196-024-00511-x ↗
5. Wang, X., Feng, Y., Tang, J., Dai, Z., and Zhao, W. (2024). A UAV path planning method based on the framework of multi-objective jellyfish search algorithm. Sci. Rep., 14.10.1038/s41598-024-79323-0 ↗
6. He, Y., and Wang, M. (2024). An improved chaos sparrow search algorithm for UAV path planning. Sci. Rep., 14.10.1038/s41598-023-50484-8 ↗
7. Path Planning for Fully Autonomous UAVs—A Taxonomic Review and Future Perspectives10.1109/ACCESS.2025.3529754 ↗
8. Navigation variable-based multi-objective particle swarm optimization for UAV path planning with kinematic constraints10.1007/s00521-024-10945-1 ↗
9. Combinatorial optimization for UAV swarm path planning and task assignment in multi-obstacle battlefield environment10.1016/j.asoc.2025.112773 ↗
10. Xiao, C., Yang, H., and Zhang, B. (2025). Multi-Unmanned Aerial Vehicle Path Planning Based on Improved Nutcracker Optimization Algorithm. Drones, 9.10.3390/drones9020116 ↗
11. An Efficient Path Planning Algorithm for 2D Ground Area Coverage Using Multi-UAV10.1007/s11277-023-10614-x ↗
12. Liu, X., Wang, F., Liu, Y., and Li, L. (2025). A Multi-Objective Black-Winged Kite Algorithm for Multi-UAV Cooperative Path Planning. Drones, 9.10.3390/drones9020118 ↗
13. Adaptive path planning method for UAVs in complex environments
14. Zhang, N., Zhang, B., Zhang, Q., Gao, C., Feng, J., and Yue, L. (2025). Large-Area Coverage Path Planning Method Based on Vehicle–UAV Collaboration. Appl. Sci., 15.10.3390/app15031247 ↗
15. Improving multi-UAV cooperative path-finding through multiagent experience learning10.1007/s10489-024-05771-w ↗
16. Report on optimisation for efficient dynamic task distribution in drone swarms using QRDPSO algorithm10.1016/j.asej.2024.103237 ↗
17. Wang, D., Zhang, M., and Huang, Z. (2025). A Path-Planning Method Recommended for Multi-UAV Police Patrols Based on the Wolf Pack Optimization Algorithm Using CRDS and DRSS. Symmetry, 17.10.3390/sym17020208 ↗
18. A multi-objective teaching-learning-based optimizer for a cooperative task allocation problem of weeding robots and spraying drones10.1016/j.swevo.2024.101565 ↗
19. Wang, J., and Wang, R. (2024). Multi-UAV Area Coverage Track Planning Based on the Voronoi Graph and Attention Mechanism. Appl. Sci., 14.10.3390/app14177844 ↗
20. HPO-RRT*: A sampling-based algorithm for UAV real-time path planning in a dynamic environment10.1007/s40747-023-01115-2 ↗
21. Adaptive multi-UAV path planning method based on improved gray wolf algorithm10.1016/j.compeleceng.2022.108377 ↗
22. Path planning of multi-UAVs based on deep Q-network for energy-efficient data collection in UAVs-assisted IoT
23. Abid, M., Kafhali, S.E., Amzil, A., and Hanini, M. (2024). Optimization of UAV Flight Paths in Multi-UAV Networks for Efficient Data Collection. Arab. J. Sci. Eng., 1–26.10.1007/s13369-024-09369-9 ↗
24. Kosior, M., Przystałka, P., and Panfil, W. (2024). Adaptive Path Planning for UAV-Based Pollution Sampling. Appl. Sci., 14.10.3390/app142412065 ↗
25. UAV path design with connectivity constraint based on deep reinforcement learning10.1016/j.phycom.2021.101582 ↗
26. Cong, W., Yi, H., Yu, F., Chen, J., Chen, X., and Xu, F. (2024). An Improved Pied Kingfisher Optimizer for Maritime UAV Path Planning. Appl. Sci., 14.10.3390/app142411816 ↗
27. Real-Time Drone Command Processing: A Large Language Model Approach for IoD Systems10.55525/tjst.1623326 ↗
28. MAHACO: Multi-algorithm hybrid ant colony optimizer for 3D path planning of a group of UAVs10.1016/j.ins.2024.121714 ↗
29. An adaptive Q-learning based particle swarm optimization for multi-UAV path planning10.1007/s00500-024-09691-2 ↗
30. Han, L., Zhang, H., and An, N. (2025). A Continuous Space Path Planning Method for Unmanned Aerial Vehicle Based on Particle Swarm Optimization-Enhanced Deep Q-Network. Drones, 9.10.3390/drones9020122 ↗
31. Sezgin, A. (2025). Scenario-Driven Evaluation of Autonomous Agents: Integrating Large Language Model for UAV Mission Reliability. Drones, 9.10.3390/drones9030213 ↗
32. Energy-Efficient Multi-UAV Multi-Region Coverage Path Planning Approach10.1007/s13369-024-09295-w ↗
33. Tang, H., Zhu, Q., Song, R., and Li, Z. (2023). UAV path planning based on third-party risk modeling. Sci. Rep., 13.10.1038/s41598-023-49396-4 ↗
34. Mitigating Risk in UAV Aid Delivery Missions: A Safe Path Prioritization Approach10.1109/ACCESS.2024.3491893 ↗
35. UAV flight path planning optimization10.1007/s11235-024-01167-w ↗
36. UAV Coverage Path Planning With Limited Battery Energy Based on Improved Deep Double Q-network10.1007/s12555-023-0724-9 ↗
37. UAV path selection in multi-hop cooperative UAV-based networks: A deep reinforcement learning approach10.1016/j.rineng.2025.103999 ↗
38. Cooperative path following control of USV-UAVs with genetic algorithm extended state observer10.1016/j.oceaneng.2025.120332 ↗
39. A survey on vehicle–drone cooperative delivery operations optimization: Models, methods, and future research directions10.1016/j.swevo.2024.101780 ↗
40. Sabag, J., Pinkovich, B., Rivlin, E., and Rotstein, H. (2025). Efficient Coverage Path Planning for a Drone in an Urban Environment. Drones, 9.10.3390/drones9020098 ↗
41. Global and Local Moth-flame Optimization Algorithm for UAV Formation Path Planning Under Multi-constraints10.1007/s12555-020-0979-3 ↗