journal article·2026-01-15Open access

Multi-Robot Task Allocation with Spatiotemporal Constraints via Edge-Enhanced Attention Networks

Yixiang Hu, Daxue Liu, Jinhong Li, Junxiang Li, Tao Wu

Applied Sciences· Volume 16· Issue 2

Abstract

Multi-Robot Task Allocation (MRTA) with spatiotemporal constraints presents significant challenges in environmental adaptability. Existing learning-based methods often overlook environmental spatial constraints, leading to spatial information distortion. To address this, we formulate the problem as an asynchronous Markov Decision Process over a directed heterogeneous graph and propose a novel heterogeneous graph neural network named the Edge-Enhanced Attention Network (E2AN). This network integrates a specialized encoder, the Edge-Enhanced Heterogeneous Graph Attention Network (E2HGAT), with an attention-based decoder. By incorporating edge attributes to effectively characterize path costs under spatial constraints, E2HGAT corrects spatial distortion. Furthermore, our approach supports flexible extension to diverse payload scenarios via node attribute adaptation. Extensive experiments conducted in simulated environments with obstructed maps demonstrate that the proposed method outperforms baseline algorithms in task success rate. Remarkably, the model maintains its advantages in generalization tests on unseen maps as well as in scalability tests across varying problem sizes. Ablation studies further validate the critical role of the proposed encoder in capturing spatiotemporal dependencies. Additionally, real-time performance analysis confirms the method’s feasibility for online deployment. Overall, this study offers an effective solution for MRTA problems with complex constraints.
Source: crossref · Quality: baseline

Research context

OpenAlex topics: Reinforcement Learning in Robotics · Robotics and Sensor-Based Localization · Multimodal Machine Learning Applications

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

College of Intelligence Science and Technology, National University of Defense Technology, Changsha 410073, China

References (35)

Show source-provided references
1. A Formal Analysis and Taxonomy of Task Allocation in Multi-Robot Systems10.1177/0278364904045564 ↗
2. A Voronoi Diagram-Based Workspace Partition for Weak Cooperation of Multi-Robot System in Orchard10.1109/ACCESS.2020.2969449 ↗
3. A Reinforcement Learning-Based Hyper-Heuristic for AGV Task Assignment and Route Planning in Parts-to-Picker Warehouses10.1016/j.tre.2024.103518 ↗
4. Multi-UAV Reconnaissance Task Allocation for Heterogeneous Targets Using Grouping Ant Colony Optimization Algorithm10.1007/s00500-021-05675-8 ↗
5. Multi-UAV Reconnaissance Task Allocation in 3D Urban Environments10.1109/ACCESS.2024.3368851 ↗
6. Wang, R., Zhao, D., and Min, B.-C. (2023, January 1–5). Initial Task Allocation for Multi-Human Multi-Robot Teams with Attention-Based Deep Reinforcement Learning. Proceedings of the 2023 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), Detroit, MI, USA.10.1109/IROS55552.2023.10341410 ↗
7. Initial Task Allocation in Multi-Human Multi-Robot Teams: An Attention-Enhanced Hierarchical Reinforcement Learning Approach10.1109/LRA.2024.3366414 ↗
8. Zhou, C., Li, J., Shi, M., and Wu, T. (2024). Multi-Robot Path Planning Algorithm for Collaborative Mapping under Communication Constraints. Drones, 8.10.3390/drones8090493 ↗
9. A Taxonomy for Task Allocation Problems with Temporal and Ordering Constraints10.1016/j.robot.2016.10.008 ↗
10. Multi-Robot Task Allocation in Disaster Response: Addressing Dynamic Tasks with Deadlines and Robots with Range and Payload Constraints10.1016/j.robot.2021.103905 ↗
11. Wang, H., Li, Y., Li, S., and Xu, G. (2024). Research on Multiple AUVs Task Allocation with Energy Constraints in Underwater Search Environment. Electronics, 13.10.3390/electronics13193852 ↗
12. Multi-Robot Task Allocation Clustering Based on Game Theory10.1016/j.robot.2022.104314 ↗
13. A Decentralized Cluster Formation Containment Framework for Multi-robot Systems10.1109/TRO.2021.3071615 ↗
14. Cui, W., Li, R., Feng, Y., and Yang, Y. (2022). Distributed Task Allocation for a Multi-UAV System with Time Window Constraints. Drones, 6.10.3390/drones6090226 ↗
15. David, J., and Valencia, R. (2025). Simultaneous Path Planning and Task Allocation in Dynamic Environments. Robotics, 14.10.3390/robotics14020017 ↗
16. Hu, Y., Wu, X., Zhai, J., Lou, P., Qian, X., and Xiao, H. (2022). Hybrid Task Allocation of an AGV System for Task Groups of an Assembly Line. Appl. Sci., 12.10.3390/app122110956 ↗
17. Liu, F., Xu, W., Feng, Z., Yu, C., Liang, X., Su, Q., and Gao, J. (2025). Task Allocation and Path Planning Method for Unmanned Underwater Vehicles. Drones, 9.10.3390/drones9060411 ↗
18. An Effective Collaboration Evolutionary Algorithm for Multi-Robot Task Allocation and Scheduling in a Smart Farm10.1016/j.knosys.2024.111474 ↗
19. Hwang, N.E., Kim, H.J., and Kim, J.G. (2022). Centralized Task Allocation and Alignment Based on Constraint Table and Alignment Rules. Appl. Sci., 12.10.3390/app12136780 ↗
20. Lin, J., Li, P., Dai, J., Liu, S., Tian, W., Li, B., and Wang, C. (2022, January 19–20). Multi-Robot Cooperative Assembly Task Planning for Large-Scale Aerospace Structures. Proceedings of the 2022 37th Youth Academic Annual Conference of Chinese Association of Automation (YAC), Beijing, China.10.1109/YAC57282.2022.10023897 ↗
21. Kool, W., van Hoof, H., and Welling, M. (2019, January 6–9). Attention, Learn to Solve Routing Problems!. Proceedings of the 7th International Conference on Learning Representations (ICLR 2019), New Orleans, LA, USA.
22. Learning Scheduling Policies for Multi-Robot Coordination with Graph Attention Networks10.1109/LRA.2020.3002198 ↗
23. Paul, S., Ghassemi, P., and Chowdhury, S. (2022, January 23–27). Learning Scalable Policies over Graphs for Multi-Robot Task Allocation Using Capsule Attention Networks. Proceedings of the 2022 International Conference on Robotics and Automation (ICRA), Philadelphia, PA, USA.10.1109/ICRA46639.2022.9812370 ↗
24. Learning to Allocate Time-Bound and Dynamic Tasks to Multiple Robots Using Covariant Attention Neural Networks10.1115/1.4065883 ↗
25. Heterogeneous Graph Attention Networks for Scalable Multi-Robot Scheduling with Tempospatial Constraints10.1007/s10514-021-09997-2 ↗
26. Wang, Z., Chen, J., and Chen, H. (2021, January 14–17). EGAT: Edge-Featured Graph Attention Network. Proceedings of the 30th International Conference on Artificial Neural Networks, Bratislava, Slovakia.10.1007/978-3-030-86362-3_21 ↗
27. Hu, Z., Dong, Y., Wang, K., and Sun, Y. (2020, January 20–24). Heterogeneous Graph Transformer. Proceedings of the Web Conference 2020 (WWW ’20), Taipei, Taiwan.10.1145/3366423.3380027 ↗
28. GNN-Based Deep Reinforcement Learning for Computation Task Scheduling in Autonomous Multi-Robot Systems10.1016/j.sysarc.2025.103534 ↗
29. Heterogeneous Multiagent Task Allocation Based on Graph-Based Convolutional Assignment Neural Network10.1109/JIOT.2025.3535641 ↗
30. Gilmer, J., Schoenholz, S.S., Riley, P.F., Vinyals, O., and Dahl, G.E. (2017, January 6–11). Neural Message Passing for Quantum Chemistry. Proceedings of the 34th International Conference on Machine Learning (ICML 2017), Sydney, Australia.
31. Park, B., Kang, C., and Choi, J. (2021). Cooperative Multi-Robot Task Allocation with Reinforcement Learning. Appl. Sci., 12.10.3390/app12010272 ↗
32. Wang, K., Shen, W., Yang, Y., Quan, X., and Wang, R. (2020, January 5–10). Relational Graph Attention Network for Aspect-based Sentiment Analysis. Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics, Online.10.18653/v1/2020.acl-main.295 ↗
33. Multi-Agent Pathfinding: Definitions, Variants, and Benchmarks
34. Iterated Local Search for Time-Extended Multi-Robot Task Allocation with Spatio-Temporal and Capacity Constraints
35. Gurobi Optimization, LLC (2024). Gurobi Optimizer Reference Manual, Gurobi.