Real-Time Geo-Localization for Land Vehicles Using LIV-SLAM and Referenced Satellite Imagery
Source abstract
Abstract
Existing Simultaneous Localization and Mapping (SLAM) algorithms provide precise local pose estimation and real-time scene reconstruction, widely applied in autonomous navigation for land vehicles. However, the odometry of SLAM algorithms exhibits localization drift and error divergence over long-distance operations due to the lack of inherent global constraints. In this paper, we propose a real-time geo-localization method for land vehicles, which only relies on a LiDAR-inertial-visual SLAM (LIV-SLAM) and a referenced image. The proposed method enables long-distance navigation without requiring GPS or loop closure, while eliminating accumulated localization errors. To achieve this, the local map constructed by SLAM is real-timely projected onto a downward-view image, and a highly efficient cross modal matching algorithm is proposed to estimate the global position by aligning the projected local image to a geo-referenced satellite image. The cross-modal algorithm leverages dense texture orientation features, ensuring robustness against cross-modal distortion and local scene changes, and supports efficient correlation in the frequency domain for real-time performance. We also propose a novel adaptive Kalman filter (AKF) to integrate the global position provided by the cross-modal matching and the pose estimated by LIV-SLAM. The proposed AKF is designed to effectively handle observation delays and asynchronous updates while simultaneously rejecting the impact of erroneous matches through an Observation-Aware Gain Scaling (OAGS) mechanism. We verify the proposed algorithm through R3LIVE and NCLT datasets, demonstrating superior computational efficiency, reliability, and accuracy compared to existing methods.
Source: crossref · Quality: baseline
Research context
OpenAlex topics: Robotics and Sensor-Based Localization
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
Affiliations
Research Institute of Aerospace Technology, Central South University, Changsha 410083, China
School of Electrical and Information Engineering, Hunan Institute of Engineering, Xiangtan 411104, China
College of Mechanical and Electrical Engineering, Central South University, Changsha 410083, China
Funding
National Natural Science Foundation of China · National Natural Science Foundation of Hunan Province · National Key Research and Development Program of China
References (38)
Show source-provided references
1. Autonomous exploration and mapping system using heterogeneous UAVs and UGVs in GPS-denied environments10.1109/TVT.2018.2890416 ↗
2. High Precision and Robust Vehicle Localization Algorithm with Visual-LiDAR-IMU Fusion10.1109/TVT.2024.3379435 ↗
3. Lin, J., and Zhang, F. (2022, January 23–27). R3LIVE: A Robust, Real-time, RGB-colored, LiDAR-Inertial-Visual tightly-coupled state Estimation and mapping package. Proceedings of the 2022 International Conference on Robotics and Automation (ICRA), Philadelphia, PA, USA.10.1109/ICRA46639.2022.9811935 ↗
4. R3LIVE++: A Robust, Real-time, Radiance Reconstruction Package with a Tightly-coupled LiDAR-Inertial-Visual State Estimator10.1109/TPAMI.2024.3456473 ↗
5. Zheng, C., Zhu, Q., Xu, W., Liu, X., Guo, Q., and Zhang, F. (2022, January 23–27). Fast-livo: Fast and tightly-coupled sparse-direct lidar-inertial-visual odometry. Proceedings of the 2022 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), Kyoto, Japan.10.1109/IROS47612.2022.9981107 ↗
6. Fast-livo2: Fast, direct lidar-inertial-visual odometry10.1109/TRO.2024.3502198 ↗
7. ORB-SLAM: A versatile and accurate monocular SLAM system10.1109/TRO.2015.2463671 ↗
8. Orb-slam2: An open-source slam system for monocular, stereo, and rgb-d cameras10.1109/TRO.2017.2705103 ↗
9. Orb-slam3: An accurate open-source library for visual, visual–inertial, and multimap slam10.1109/TRO.2021.3075644 ↗
10. Shan, T., and Englot, B. (2018, January 1–5). Lego-loam: Lightweight and ground-optimized lidar odometry and mapping on variable terrain. Proceedings of the 2018 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), Madrid, Spain.10.1109/IROS.2018.8594299 ↗
11. Affine template matching based on multi-scale dense structure principal direction10.1109/TCSVT.2020.3020970 ↗
12. University of Michigan North Campus long-term vision and lidar dataset10.1177/0278364915614638 ↗
13. MonoSLAM: Real-time single camera SLAM10.1109/TPAMI.2007.1049 ↗
14. Klein, G., and Murray, D. (2007, January 13–16). Parallel tracking and mapping for small AR workspaces. Proceedings of the 2007 6th IEEE and ACM International Symposium on Mixed and Augmented Reality, Nara, Japan.10.1109/ISMAR.2007.4538852 ↗
15. Keyframe-based visual–inertial odometry using nonlinear optimization10.1177/0278364914554813 ↗
16. Vins-mono: A robust and versatile monocular visual-inertial state estimator10.1109/TRO.2018.2853729 ↗
17. Gsv-cities: Toward appropriate supervised visual place recognition10.1016/j.neucom.2022.09.127 ↗
18. Ali-Bey, A., Chaib-Draa, B., and Giguere, P. (2023, January 2–7). Mixvpr: Feature mixing for visual place recognition. Proceedings of the IEEE/CVF Winter Conference on Applications of Computer Vision, Waikoloa, HI, USA.10.1109/WACV56688.2023.00301 ↗
19. Arandjelovic, R., Gronat, P., Torii, A., Pajdla, T., and Sivic, J. (2016, January 27–30). NetVLAD: CNN architecture for weakly supervised place recognition. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Las Vegas, NV, USA.10.1109/CVPR.2016.572 ↗
20. Berton, G., Masone, C., and Caputo, B. (2022, January 18–24). Rethinking visual geo-localization for large-scale applications. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, New Orleans, LA, USA.10.1109/CVPR52688.2022.00483 ↗
21. Berton, G., Trivigno, G., Caputo, B., and Masone, C. (2023, January 1–6). Eigenplaces: Training viewpoint robust models for visual place recognition. Proceedings of the IEEE/CVF International Conference on Computer Vision, Paris, France.10.1109/ICCV51070.2023.01017 ↗
22. Hausler, S., Garg, S., Xu, M., Milford, M., and Fischer, T. (2021, January 20–25). Patch-netvlad: Multi-scale fusion of locally-global descriptors for place recognition. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, Nashville, TN, USA.10.1109/CVPR46437.2021.01392 ↗
23. Jin Kim, H., Dunn, E., and Frahm, J.M. (2017, January 21–26). Learned contextual feature reweighting for image geo-localization. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Honolulu, HI, USA.10.1109/CVPR.2017.346 ↗
24. Xu, Y., Shamsolmoali, P., Granger, E., Nicodeme, C., Gardes, L., and Yang, J. (2023, January 2–7). TransVLAD: Multi-scale attention-based global descriptors for visual geo-localization. Proceedings of the IEEE/CVF Winter Conference on Applications of Computer Vision, Waikoloa, HI, USA.10.1109/WACV56688.2023.00286 ↗
25. Fervers, F., Bullinger, S., Bodensteiner, C., Arens, M., and Stiefelhagen, R. (October, January 29). Statewide Visual Geolocalization in the Wild. Proceedings of the European Conference on Computer Vision, Milan, Italy.
26. Hu, S., Feng, M., Nguyen, R.M., and Lee, G.H. (2018, January 18–23). Cvm-net: Cross-view matching network for image-based ground-to-aerial geo-localization. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Salt Lake City, UT, USA.10.1109/CVPR.2018.00758 ↗
27. Cross-view geo-localization with layer-to-layer transformer
28. Zhu, S., Shah, M., and Chen, C. (2022, January 18–24). Transgeo: Transformer is all you need for cross-view image geo-localization. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, New Orleans, LA, USA.10.1109/CVPR52688.2022.00123 ↗
29. Deuser, F., Habel, K., and Oswald, N. (2023, January 1–6). Sample4geo: Hard negative sampling for cross-view geo-localisation. Proceedings of the IEEE/CVF International Conference on Computer Vision, Paris, France.10.1109/ICCV51070.2023.01545 ↗
30. Oord, A., Li, Y., and Vinyals, O. (2018). Representation learning with contrastive predictive codin. arXiv.
31. Radford, A., Kim, J.W., Hallacy, C., Ramesh, A., Goh, G., Agarwal, S., Sastry, G., Askell, A., Mishkin, P., and Clark, J. (2021, January 18–24). Learning transferable visual models from natural language supervision. Proceedings of the International Conference on Machine Learning, PmLR, Honolulu, HI, USA.
32. Image-based geo-localization using satellite imagery10.1007/s11263-019-01186-0 ↗
33. Fast-lio: A fast, robust lidar-inertial odometry package by tightly-coupled iterated kalman filter10.1109/LRA.2021.3064227 ↗
34. Fast-lio2: Fast direct lidar-inertial odometry10.1109/TRO.2022.3141876 ↗
35. Gonzales, R.C., and Wintz, P. (1987). Digital Image Processing, Addison-Wesley Longman Publishing Co., Inc.. Chapter 4.
36. Jiang, H., Karpur, A., Cao, B., Huang, Q., and Araujo, A. (2024, January 16–22). Omniglue: Generalizable feature matching with foundation model guidance. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, Seattle, WA, USA.10.1109/CVPR52733.2024.01878 ↗
37. Medical image registration using mutual information10.1109/JPROC.2003.817864 ↗
38. Fast and robust matching for multimodal remote sensing image registration10.1109/TGRS.2019.2924684 ↗