journal article·2025-02-12Open access

Efficient Task Allocation in Multi-Agent Systems Using Reinforcement Learning and Genetic Algorithm

Zheng Fang, Tao Ma, Jun Huang, Zhao Niu, Fang Yang

Applied Sciences· Volume 15· Issue 4

Abstract

The multi-agent task allocation problem has attracted substantial research interest due to the increasing demand for effective solutions in large-scale and dynamic environments. Despite advancements, traditional algorithms often fall short in optimizing efficiency and adaptability within complex scenarios. To address this shortcoming, we propose a genetic algorithm-enhanced PPO (GAPPO) algorithm, specifically developed to enhance decision-making in challenging task allocation contexts. GAPPO employs a deep reinforcement learning framework, enabling each agent to independently evaluate its surroundings, manage energy resources, and adaptively adjust task allocations in response to evolving conditions. Through iterative refinement, GAPPO achieves balanced task distribution and minimizes energy consumption across diverse configurations. Comprehensive simulations demonstrate that GAPPO consistently outperforms traditional algorithms, resulting in reduced task completion time and heightened energy efficiency. Our findings underscore GAPPO’s potential as a robust solution for real-time multi-agent task allocation.
Source: crossref · Quality: baseline

Research context

OpenAlex topics: Distributed Control Multi-Agent Systems · Reinforcement Learning in Robotics · Adaptive Dynamic Programming Control

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

College of Electronic Engineering, National University of Defense Technology, Hefei 230037, China

Funding

high-level talent fund

References (44)

Show source-provided references
1. Multiagent dynamic task assignment based on forest fire point model10.1109/TASE.2021.3061757 ↗
2. Liu, S., Feng, B., Bi, Y., and Yu, D. (2024). An Integrated Approach to Precedence-Constrained Multi-Agent Task Assignment and Path Finding for Mobile Robots in Smart Manufacturing. Appl. Sci., 14.10.3390/app14073094 ↗
3. A Knowledge Flow Empowered Cognitive Framework for Decision Making with Task-Agnostic Data Regulation10.1109/TAI.2023.3322391 ↗
4. Zhuang, H., Lei, C., Chen, Y., and Tan, X. (2023). Cooperative Decision-Making for Mixed Traffic at an Unsignalized Intersection Based on Multi-Agent Reinforcement Learning. Appl. Sci., 13.10.3390/app13085018 ↗
5. An attention mechanism and adaptive accuracy triple-dependent MADDPG formation control method for hybrid UAVs10.1109/TITS.2024.3379508 ↗
6. Yu, Y., Zhai, Z., Li, W., and Ma, J. (2024). Target-Oriented Multi-Agent Coordination with Hierarchical Reinforcement Learning. Appl. Sci., 14.10.3390/app14167084 ↗
7. Multi-UAV collaborative dynamic task allocation method based on ISOM and attention mechanism10.1109/TVT.2023.3341878 ↗
8. Structured Cooperative Reinforcement Learning with Time-Varying Composite Action Space10.1109/TPAMI.2021.3102140 ↗
9. Route optimization in precision agriculture settings: A multi-Steiner TSP formulation10.1109/TASE.2022.3204584 ↗
10. Efficient and secure routing protocol based on artificial intelligence algorithms with UAV-assisted for vehicular ad hoc networks in intelligent transportation systems10.1109/TITS.2020.3041746 ↗
11. Edge Intelligence in Intelligent Transportation Systems: A Survey10.1109/TITS.2023.3275741 ↗
12. Unmanned aerial vehicle routing problem with mobile charging stations for assisting search and rescue missions in post-disaster scenarios10.1109/TSMC.2021.3088776 ↗
13. TEBChain: A trusted and efficient blockchain-based data sharing scheme in UAV-assisted IoV for disaster rescue10.1109/TNSM.2024.3394162 ↗
14. A fully-autonomous aerial robot for search and rescue applications in indoor environments using learning-based techniques10.1007/s10846-018-0898-1 ↗
15. Decentralized multi-UAV flight autonomy for moving convoys search and track10.1109/TCST.2016.2601287 ↗
16. Liu, Z., Qiu, C., and Zhang, Z. (2022). Sequence-to-Sequence Multi-Agent Reinforcement Learning for Multi-UAV Task Planning in 3D Dynamic Environment. Appl. Sci., 12.10.3390/app122312181 ↗
17. Joint task offloading and resource allocation in multi-UAV multi-server systems: An attention-based deep reinforcement learning approach10.1109/TVT.2024.3377647 ↗
18. Multi-UAV cooperative task offloading and resource allocation in 5G advanced and beyond10.1109/TWC.2023.3277801 ↗
19. Multi-agent reinforcement learning-based coordinated dynamic task allocation for heterogeneous UAVs10.1109/TVT.2022.3228198 ↗
20. Multi-agent deep reinforcement learning for task offloading in UAV-assisted mobile edge computing10.1109/TWC.2022.3153316 ↗
21. A deep reinforcement learning framework based on an attention mechanism and disjunctive graph embedding for the job-shop scheduling problem10.1109/TII.2022.3167380 ↗
22. Deployment and association of multiple UAVs in UAV-assisted cellular networks with the knowledge of statistical user position10.1109/TWC.2022.3150429 ↗
23. A multi-agent collaborative environment learning method for UAV deployment and resource allocation
24. Optimal placement of UAVs for minimum outage probability10.1109/TVT.2022.3178165 ↗
25. A hybrid task offloading and resource allocation approach for digital twin-empowered UAV-assisted MEC network using federated reinforcement learning for future wireless network10.1109/TCE.2024.3368156 ↗
26. PSE-D model-based cooperative path planning for UAV and USV systems in antisubmarine search missions10.1109/TAES.2024.3400923 ↗
27. Generating Task Reallocation Suggestions to Handle Contingencies in Human-Supervised Multi-Robot Missions10.1109/TASE.2022.3227415 ↗
28. Efficient and secured swarm pattern multi-UAV communication10.1109/TVT.2021.3082308 ↗
29. Task-driven relay assignment in distributed UAV communication networks10.1109/TVT.2019.2942095 ↗
30. Optimal Distributed Leader-Following Consensus of Linear Multi-Agent Systems: A Dynamic Average Consensus-Based Approach
31. Privacy-Preserved Distributed Optimization for Multi-Agent Systems With Antagonistic Interactions10.1109/TCSI.2022.3226578 ↗
32. Hierarchical Optimization Scheduling Algorithm for Logistics Transport Vehicles Based on Multi-Agent Reinforcement Learning10.1109/TITS.2023.3337334 ↗
33. Solving Specified-Time Distributed Optimization Problem via Sampled-Data-Based Algorithm10.1109/TNSE.2022.3169151 ↗
34. DL-DRL: A double-level deep reinforcement learning approach for large-scale task scheduling of multi-UAV10.1109/TASE.2024.3358894 ↗
35. Efficient resource allocation in multi-UAV assisted vehicular networks with security constraint and attention mechanism10.1109/TWC.2022.3229013 ↗
36. Joint optimization of data acquisition and trajectory planning for UAV-assisted wireless powered Internet of Things10.1109/TMC.2024.3470831 ↗
37. Joint UAV deployment and resource allocation: A personalized federated deep reinforcement learning approach10.1109/TVT.2023.3328609 ↗
38. Consensus seeking in multi-agent systems under dynamically changing interaction topologies10.1109/TAC.2005.846556 ↗
39. Low, C.B. (2011, January 19–21). A dynamic virtual structure formation control for fixed-wing UAVs. Proceedings of the 2011 9th IEEE International Conference on Control and Automation (ICCA), Santiago, Chile.10.1109/ICCA.2011.6137877 ↗
40. Behavior-based formation control for multi-robot teams10.1109/70.736776 ↗
41. Actor-critic algorithms
42. PPO-based PDACB traffic control scheme for massive IoV communications10.1109/TITS.2022.3160757 ↗
43. Human-level control through deep reinforcement learning10.1038/nature14236 ↗
44. DDPG-based joint time and energy management in ambient backscatter-assisted hybrid underlay CRNs10.1109/TCOMM.2022.3221422 ↗