Edge-Driven Multiple Trajectory Attention Model for Vehicle Routing Problems
Source abstract
Abstract
The vehicle routing problem (VRP), as one of the classic combinatorial optimization problems, has garnered widespread attention in recent years. Existing deep reinforcement learning (DRL)-based methods predominantly focus on node information, neglecting the edge information inherent in the graph structure. Moreover, the solution trajectories produced by these methods tend to exhibit limited diversity, hindering a thorough exploration of the solution space. In this work, we propose a novel Edge-Driven Multiple Trajectory Attention Model (E-MTAM) to solve VRPs with various scales. Our model is built upon the encoder–decoder architecture, incorporating an edge-driven multi-head attention (EDMHA) block within the encoder to better utilize edge information. During the decoding process, we enhance graph embeddings with visitation information, integrating dynamic updates into static graph embeddings. Additionally, we employ a multi-decoder architecture and introduce a regularization term to encourage the generation of diverse trajectories, thus promoting solution diversity. We conduct comprehensive experiments on three types of VRPs: (1) traveling salesman problem (TSP), (2) capacitated vehicle routing problem (CVRP), and (3) orienteering problem (OP). The experimental results demonstrate that our model outperforms existing DRL-based methods and most traditional heuristic approaches, while also exhibiting strong generalization across problems of different scales.
Source: crossref · Quality: baseline
Research context
OpenAlex topics: Data Management and Algorithms · Transportation and Mobility Innovations · Vehicle Routing Optimization Methods
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
Affiliations
State Key Laboratory of Electrical Insulation and Power Equipment, Xi’an Jiaotong University, Xi’an 710049, China
School of Electrical Engineering, Xi’an Jiaotong University, Xi’an 710049, China
Funding
National Natural Science Foundation of China · Natural Science Basic Research Program of Shaanxi Province · State Key Laboratory of Electrical Insulation and Power Equipment
References (47)
Show source-provided references
1. Machine learning for combinatorial optimization: A methodological tour d’horizon10.1016/j.ejor.2020.07.063 ↗
2. Combinatorial optimization-enriched machine learning to solve the dynamic vehicle routing problem with time windows10.1287/trsc.2023.0107 ↗
3. Learning collaborative policies to solve np-hard routing problems
4. Guan, Q., Hong, X., Ke, W., Zhang, L., Sun, G., and Gong, Y. (October, January 27). Kohonen self-organizing map based route planning: A revisit. Proceedings of the 2021 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), Prague, Czech Republic.10.1109/IROS51168.2021.9636025 ↗
5. A deep reinforcement learning approach for solving the traveling salesman problem with drone10.1016/j.trc.2022.103981 ↗
6. Tan, K., Liu, W., Xu, F., and Li, C. (2023). Optimization model and algorithm of logistics vehicle routing problem under major emergency. Mathematics, 11.10.3390/math11051274 ↗
7. Machine learning to solve vehicle routing problems: A survey10.1109/TITS.2023.3334976 ↗
8. A comprehensive survey on the generalized traveling salesman problem10.1016/j.ejor.2023.07.022 ↗
9. A reinforcement learning-variable neighborhood search method for the capacitated vehicle routing problem10.1016/j.eswa.2022.118812 ↗
10. An exact algorithm for the two-echelon vehicle routing problem with drones10.1016/j.trb.2023.01.002 ↗
11. Liu, F., Lu, C., Gui, L., Zhang, Q., Tong, X., and Yuan, M. (2023). Heuristics for vehicle routing problem: A survey and recent advances. arXiv.
12. Solving vehicle routing problem using quantum approximate optimization algorithm10.1109/TITS.2022.3172241 ↗
13. Solving generalized vehicle routing problem with occasional drivers via evolutionary multitasking10.1109/TCYB.2019.2955599 ↗
14. Explicit evolutionary multitasking for combinatorial optimization: A case study on capacitated vehicle routing problem10.1109/TCYB.2019.2962865 ↗
15. An extension of the Lin-Kernighan-Helsgaun TSP solver for constrained traveling salesman and vehicle routing problems
16. Optimal protocols for minimal work processes in underdamped stochastic thermodynamics10.1063/1.2948948 ↗
17. Minimal dissipation in processes far from equilibrium10.1103/PhysRevE.98.042103 ↗
18. Analytical solution for optimal protocols of weak drivings10.1088/1742-5468/ad5c57 ↗
19. Deep reinforcement learning for multiobjective optimization10.1109/TCYB.2020.2977661 ↗
20. Online vehicle routing with neural combinatorial optimization and deep reinforcement learning10.1109/TITS.2019.2909109 ↗
21. Deep Reinforcement Learning for Solving Vehicle Routing Problems with Backhauls
22. Analytics and machine learning in vehicle routing research10.1080/00207543.2021.2013566 ↗
23. Reinforcement learning for solving the vehicle routing problem
24. Solve routing problems with a residual edge-graph attention neural network10.1016/j.neucom.2022.08.005 ↗
25. Kool, W., van Hoof, H., and Welling, M. Attention, Learn to Solve Routing Problems! In Proceedings of the International Conference on Learning Representations, New Orleans, LA, USA, 6–9 May 2019.
26. Reinforcement learning with multiple relational attention for solving vehicle routing problems10.1109/TCYB.2021.3089179 ↗
27. Graph transformer with reinforcement learning for vehicle routing problem10.1002/tee.23771 ↗
28. Algorithms based on branch and bound for the flying sidekick traveling salesman problem10.1016/j.omega.2021.102493 ↗
29. Applegate, D.L. (2006). The Traveling Salesman Problem: A Computational Study, Princeton University Press.
30. Chen, C.M., Lv, S., Ning, J., and Wu, J.M.T. (2023). A genetic algorithm for the waitable time-varying multi-depot green vehicle routing problem. Symmetry, 15.10.3390/sym15010124 ↗
31. Solving Capacitated Vehicle Routing Problem by an Improved Genetic Algorithm with Fuzzy C-Means Clustering
32. Solving the vehicle routing problem with drone for delivery services using an ant colony optimization algorithm10.1016/j.aei.2022.101536 ↗
33. A dynamical artificial bee colony for vehicle routing problem with drones10.1016/j.engappai.2021.104510 ↗
34. An overview and experimental study of learning-based optimization algorithms for the vehicle routing problem10.1109/JAS.2022.105677 ↗
35. Pointer networks
36. Bello, I., Pham, H., Le, Q.V., Norouzi, M., and Bengio, S. (2016). Neural combinatorial optimization with reinforcement learning. arXiv.
37. Ma, Q., Ge, S., He, D., Thaker, D., and Drori, I. (2019). Combinatorial optimization by graph pointer networks and hierarchical reinforcement learning. arXiv.
38. Duan, L., Zhan, Y., Hu, H., Gong, Y., Wei, J., Zhang, X., and Xu, Y. (2020, January 6–10). Efficiently solving the practical vehicle routing problem: A novel joint learning approach. Proceedings of the 26th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining, Virtual Event.10.1145/3394486.3403356 ↗
39. Gao, L., Chen, M., Chen, Q., Luo, G., Zhu, N., and Liu, Z. (2020). Learn to design the heuristics for vehicle routing problem. arXiv.
40. Attention is all you need
41. Pomo: Policy optimization with multiple optima for reinforcement learning
42. Learning to perform local rewriting for combinatorial optimization
43. Learning to iteratively solve routing problems with dual-aspect collaborative transformer
44. Analysis of commercial and free and open source solvers for linear optimization problems
45. Search engine optimization with Google
46. Solving traveling salesman problem by using improved ant colony optimization algorithm
47. Joshi, C.K., Laurent, T., and Bresson, X. (2019). An efficient graph convolutional network technique for the travelling salesman problem. arXiv.