journal article·2022-05-24Open access

Fast Loop Closure Selection Method with Spatiotemporal Consistency for Multi-Robot Map Fusion

Wei Chen, Jian Sun, Qiang Zheng

Applied Sciences· Volume 12· Issue 11

Abstract

This paper presents a robust method based on graph topology to find the topologically correct and consistent subset of inter-robot relative pose measurements for multi-robot map fusion. However, the absence of good prior on relative pose gives a severe challenge to distinguish the inliers and outliers, and once the wrong inter-robot loop closures are used to optimize the pose graph, which can seriously corrupt the fused global map. Existing works mainly rely on the consistency of spatial dimension to select inter-robot measurements, while it does not always hold. In this paper, we propose a fast inter-robot loop closure selection method that integrates the consistency and topology relationship of inter-robot measurements, which both conform to the continuity characteristics of similar scenes and spatiotemporal consistency. Firstly, a clustering method integrating topology correctness of inter-robot loop closures is proposed to split the entire measurement set into multiple clusters. Then, our method decomposes the traditional high-dimensional consistency matrix into the sub-matrix blocks corresponding to the overlapping trajectory regions. Finally, we define the weight function to find the topologically correct and consistent subset with the maximum cardinality, then convert the weight function to the maximum clique problem from graph theory and solve it. We evaluate the performance of our method in a simulation and in a real-world experiment. Compared to state-of-the-art methods, the results show that our method can achieve competitive performance in accuracy while reducing computation time by 75%.
Source: crossref · Quality: baseline

Research context

OpenAlex topics: Robotics and Sensor-Based Localization · Image and Object Detection Techniques · Robotic Path Planning Algorithms

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

State Key Laboratory for Strength & Vibration of Mechanical Structures, School of Aerospace, Xi’an Jiaotong University, Xi’an 710049, China

Shaanxi Engineering Laboratory for Vibration Control of Aerospace Structures, Xi’an Jiaotong University, Xi’an 710049, China

References (40)

Show source-provided references
1. Ground and aerial collaborative mapping in urban environments10.1109/LRA.2020.3032054 ↗
2. Dong, J., Nelson, E., Indelman, V., Michael, N., and Dellaert, F. (2015, January 26–30). Distributed real-time cooperative localization and mapping using an uncertainty-aware expectation maximization approach. Proceedings of the 2015 IEEE International Conference on Robotics and Automation (ICRA), Seattle, WA, USA.10.1109/ICRA.2015.7140012 ↗
3. RTAB-Map as an open-source lidar and visual simultaneous localization and mapping library for large-scale and long-term online operation10.1002/rob.21831 ↗
4. Solution to the SLAM problem in low dynamic environments using a pose graph and an RGB-D sensor10.3390/s140712467 ↗
5. COP-SLAM: Closed-form online pose-chain optimization for visual SLAM10.1109/TRO.2015.2473455 ↗
6. Pragyan Paramita Das, M.N. (2013). Outlier Detection Methods—An Analysis. Intern. J. Eng. Res. Technol., 2, Available online: https://www.ijert.org/research/outlier-detection-methods-an-analysis-IJERTV2IS90377.pdf.
7. Past, Present, and Future of Simultaneous Localization and Mapping: Toward the Robust-Perception Age10.1109/TRO.2016.2624754 ↗
8. Simultaneous localization and mapping (SLAM): Part II
9. Building 3D visual maps of interior space with a new hierarchical sensor fusion architecture10.1016/j.robot.2013.04.016 ↗
10. Vins-mono: A robust and versatile monocular visual-inertial state estimator10.1109/TRO.2018.2853729 ↗
11. Orb-slam2: An open-source slam system for monocular, stereo, and rgb-d cameras10.1109/TRO.2017.2705103 ↗
12. Shan, T., and Englot, B. (2018, January 1–5). Lego-loam: Lightweight and ground-optimized lidar odometry and mapping on variable terrain. Proceedings of the 2018 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), Madrid, Spain.10.1109/IROS.2018.8594299 ↗
13. GR-LOAM: LiDAR-based sensor fusion SLAM for ground robots on complex terrain10.1016/j.robot.2021.103759 ↗
14. Keyframe-based visual–inertial odometry using nonlinear optimization10.1177/0278364914554813 ↗
15. Das, A., Elfring, J., and Dubbelman, G. (2021). Real-time vehicle positioning and mapping using graph optimization. Sensors, 21.10.3390/s21082815 ↗
16. Robust loop closing over time for pose graph SLAM10.1177/0278364913498910 ↗
17. Convex relaxations for pose graph optimization with outliers10.1109/LRA.2018.2793352 ↗
18. Sünderhauf, N., and Protzel, P. (2012, January 11–14). Towards a robust back-end for pose graph slam. Proceedings of the 2012 IEEE International Conference on Robotics and Automation, Guangzhou, China.10.1109/ICRA.2012.6224709 ↗
19. Koenig, A., Kessler, J., and Gross, H.M. (2008, January 22–26). A graph matching technique for an appearance-based, visual slam-approach using rao-blackwellized particle filters. Proceedings of the 2008 IEEE/RSJ International Conference on Intelligent Robots and Systems, Nice, France.10.1109/IROS.2008.4650878 ↗
20. A survey on visual-based localization: On the benefit of heterogeneous data10.1016/j.patcog.2017.09.013 ↗
21. Segal, A., Haehnel, D., and Thrun, S. (July, January 28). Generalized-icp. Proceedings of the Robotics: Science and Systems, Seattle, WA, USA. Available online: https://www.robots.ox.ac.uk/~avsegal/resources/papers/Generalized_ICP.pdf.
22. Multiple-robot simultaneous localization and mapping: A review10.1002/rob.21620 ↗
23. Andersone, I. (2019). Heterogeneous map merging: State of the art. Robotics, 8.10.3390/robotics8030074 ↗
24. Kim, B., Kaess, M., Fletcher, L., Leonard, J., Bachrach, A., Roy, N., and Teller, S. (2010, January 3–8). Multiple relative pose graphs for robust cooperative mapping. Proceedings of the 2010 IEEE International Conference on Robotics and Automation, Anchorage, AK, USA.
25. Mangelson, J.G., Dominic, D., Eustice, R.M., and Vasudevan, R. (2018, January 21–25). Pairwise consistent measurement set maximization for robust multi-robot map merging. Proceedings of the 2018 IEEE International Conference on Robotics and Automation (ICRA), Brisbane, Australia.10.1109/ICRA.2018.8460217 ↗
26. Robust loop closure method for multi-robot map fusion by integration of consistency and data similarity10.1109/LRA.2020.3010731 ↗
27. Indelman, V., Nelson, E., Michael, N., and Dellaert, F. (June, January 31). Multi-robot pose graph localization and data association from unknown initial relative poses via expectation maximization. Proceedings of the 2014 IEEE International Conference on Robotics and Automation (ICRA), Hong Kong, China.10.1109/ICRA.2014.6906915 ↗
28. Zhou, X.S., and Roumeliotis, S.I. (2006, January 9–15). Multi-robot SLAM with unknown initial correspondence: The robot rendezvous case. Proceedings of the 2006 IEEE/RSJ International Conference on Intelligent Robots and Systems, Beijing, China.10.1109/IROS.2006.282219 ↗
29. Berrio, J.S., Shan, M., Worrall, S., and Nebot, E. (2021). Camera-LIDAR integration: Probabilistic sensor fusion for semantic mapping. IEEE Trans. Intell. Transp. Syst.10.1109/TITS.2021.3071647 ↗
30. Distributed consistent multi-robot semantic localization and mapping10.1109/LRA.2020.3003275 ↗
31. DOOR-SLAM: Distributed, Online, and Outlier Resilient SLAM for Robotic Teams10.1109/LRA.2020.2967681 ↗
32. Kümmerle, R., Grisetti, G., Strasdat, H., Konolige, K., and Burgard, W. (2011, January 9–13). g2o: A general framework for graph optimization. Proceedings of the 2011 IEEE International Conference on Robotics and Automation, Shanghai, China.
33. iSAM2: Incremental smoothing and mapping using the Bayes tree10.1177/0278364911430419 ↗
34. Grisetti, G., Kümmerle, R., Stachniss, C., Frese, U., and Hertzberg, C. (2010, January 3–8). Hierarchical optimization on manifolds for online 2D and 3D mapping. Proceedings of the 2010 IEEE International Conference on Robotics and Automation, Anchorage, AK, USA.10.1109/ROBOT.2010.5509407 ↗
35. Recognizing places using spectrally clustered local matches10.1016/j.robot.2009.07.021 ↗
36. Smith, R., Self, M., and Cheeseman, P. (1990). Estimating uncertain spatial relationships in robotics. Autonomous Robot Vehicles, Springer.10.1007/978-1-4613-8997-2_14 ↗
37. A maximum edge-weight clique extraction algorithm based on branch-and-bound10.1016/j.disopt.2020.100583 ↗
38. Grupp, M. (2022, April 28). evo: Python Package for the Evaluation of Odometry and SLAM. Available online: https://github.com/MichaelGrupp/evo.
39. A fast and accurate approximation for planar pose graph optimization10.1177/0278364914523689 ↗
40. Teller, S., Olson, E., and Leonard, J. (2006, January 15–19). Fast iterative optimization of pose graphs with poor inital estimates. Proceedings of the IEEE International Conference on Robotics and Automation, Orlando, FL, USA.