A Multi-Agent Deep Reinforcement Learning Approach with Communication Resource Optimisation for Cooperative UAV Swarm Perception and Multi-Target Detection in Emergency Rescue
Source abstract
Abstract
The rapid localisation of survivors in disaster-affected areas remains a critical challenge due to complex terrains and limited communication infrastructure. Existing multi-UAV cooperative search methods suffer from insufficient perception of target distribution, inefficient use of scarce communication resources, and redundant coverage that degrades exploration efficiency. To address these issues, this paper proposes a multi-agent deep reinforcement learning framework based on the Multi-Agent Proximal Policy Optimisation (MAPPO) algorithm under centralised training with the decentralised execution (CTDE) paradigm. A detection-augmented observation mechanism is designed to encode target distribution information without introducing additional trainable parameters. A lightweight mean-pooling communication strategy is developed to optimise communication resource utilisation, reducing per-agent bandwidth to 64 bytes per step while preserving effective inter-agent coordination. Furthermore, a composite reward function is constructed to balance target detection, exploration, and redundancy suppression. Simulation results demonstrate that the proposed method achieves a recall of 0.70 and improves flight efficiency by 28% compared with the Grid Search baseline, while consuming over two orders of magnitude less communication bandwidth than representative feature-sharing approaches. The results support the use of the framework as a communication-resource-efficient solution for cooperative UAV swarm perception in bandwidth-constrained emergency rescue scenarios.
Source: crossref · Quality: baseline
Research context
OpenAlex topics: UAV Applications and Optimization · Distributed Control Multi-Agent Systems · Robotics and Sensor-Based Localization
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
Affiliations
Information and Navigation School, Air Force Engineering University, Xi’an 710043, China
References (23)
Show source-provided references
1. Unmanned aerial vehicles (UAVs): A survey on civil applications and key research challenges10.1109/ACCESS.2019.2909530 ↗
2. A tutorial on UAVs for wireless networks: Applications, challenges, and open problems10.1109/COMST.2019.2902862 ↗
3. Collaborative multi-robot search and rescue: Planning, coordination, perception, and active vision10.1109/ACCESS.2020.3030190 ↗
4. Multi-UAV surveillance with minimum information idleness and latency constraints10.1109/LRA.2020.3003884 ↗
5. UAV swarm intelligence: Recent advances and future trends10.1109/ACCESS.2020.3028865 ↗
6. Theile, M., Bayerlein, H., Nai, R., Gesbert, D., and Caccamo, M. (2020). UAV coverage path planning under varying power constraints using deep reinforcement learning. Proceedings of the IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), IEEE.10.1109/IROS45743.2020.9340934 ↗
7. Deep reinforcement learning multi-UAV trajectory control for target tracking10.1109/JIOT.2021.3073973 ↗
8. Energy-efficient multi-UAV collaborative reliable storage: A deep reinforcement learning approach10.1109/JIOT.2025.3545418 ↗
9. The complexity of decentralized control of Markov decision processes10.1287/moor.27.4.819.297 ↗
10. Lowe, R., Wu, Y., Tamar, A., Harb, J., Abbeel, P., and Mordatch, I. (2017). Multi-agent actor-critic for mixed cooperative-competitive environments. Proceedings of the Advances in Neural Information Processing Systems (NeurIPS), Curran Associates Inc.
11. Monotonic value function factorisation for deep multi-agent reinforcement learning
12. FACMAC: Factored multi-agent centralised policy gradients
13. The surprising effectiveness of PPO in cooperative multi-agent games
14. Wu, J., Luo, J., Jiang, C., and Gao, L. (2024). Multi-UAV cooperative search in multi-layered aerial computing networks: A multi-agent deep reinforcement learning approach. Proceedings of the IEEE International Conference on Communications (ICC), IEEE.10.1109/ICC51166.2024.10622367 ↗
15. Liang, Z., Li, Q., and Fu, G. (2023). Multi-UAV collaborative search and attack mission decision-making in unknown environments. Sensors, 23.10.3390/s23177398 ↗
16. Detection and tracking meet drones challenge10.1109/TPAMI.2021.3119563 ↗
17. Liu, Y., Ding, Z., Cao, Y., and Chang, M. (2020). Multi-scale feature fusion UAV image object detection method based on dilated convolution and attention mechanism. Proceedings of the 2020 8th International Conference on Information Technology: IoT and Smart City, Association for Computing Machinery.10.1145/3446999.3447023 ↗
18. Where2comm: Communication-efficient collaborative perception via spatial confidence maps
19. Xu, R., Tu, Z., Xiang, H., Shao, W., Zhou, B., and Ma, J. (2022, January 14–18). CoBEVT: Cooperative bird’s eye view semantic segmentation with sparse transformers. Proceedings of the Conference on Robot Learning (CoRL), Auckland, New Zealand.
20. Federated learning powered semantic communication for UAV swarm cooperation10.1109/MWC.005.2300147 ↗
21. (2023). Ultralytics YOLOv8, Version 8.0, GitHub, Inc.. Ultralytics YOLOv8, GitHub Repository.
22. Li, S., Yan, K., Xie, Y., Zhong, Q., Yang, J., and Liao, D. (2026). Finite-time neural adaptive control of electro-hydraulic servo systems with minimal input delay and parametric uncertainty via Padé approximation. Mathematics, 14.10.3390/math14081368 ↗
23. Li, S., Yan, Y., Yu, Y., Zhong, Q., Hua, L., and Liao, D. (2026). Fast finite-time position tracking control of electro-hydraulic servo systems with parametric uncertainty via dynamic surface and neural adaptive method. Mathematics, 14.10.3390/math14091551 ↗