Robust Visual–Inertial Odometry via Multi-Scale Deep Feature Extraction and Flow-Consistency Filtering
Source abstract
Abstract
We present a visual–inertial odometry (VIO) system that integrates a deep feature extraction and filtering strategy with optical flow to improve tracking robustness. While many traditional VIO methods rely on hand-crafted features, they often struggle to remain robust under challenging visual conditions, such as low texture, motion blur, or lighting variation. These methods tend to exhibit large performance variance across different environments, primarily due to the limited repeatability and adaptability of hand-crafted keypoints. In contrast, learning-based features offer richer representations and can generalize across diverse domains thanks to data-driven training. However, they often suffer from uneven spatial distribution and temporal instability, which can degrade tracking performance. To address these issues, we propose a hybrid front-end that combines a lightweight deep feature extractor with an image pyramid and grid-based keypoint sampling to enhance spatial diversity. Additionally, a forward–backward optical-flow-consistency check is applied to filter unstable keypoints. The system improves feature tracking stability by enforcing spatial and temporal consistency while maintaining real-time efficiency. Finally, the effectiveness of the proposed VIO system is validated on the EuRoC MAV benchmark, showing a 19.35% reduction in trajectory RMSE and improved consistency across multiple sequences compared with previous methods.
Source: crossref · Quality: baseline
Research context
OpenAlex topics: Robotics and Sensor-Based Localization · Advanced Vision and Imaging · 3D Surveying and Cultural Heritage
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
Affiliations
Department of AI, Gachon University, Seongnam-si 1332, Gyeonggi-do, Republic of Korea
Funding
Gachon University
References (25)
Show source-provided references
1. Du, X., Zhang, L., Ji, C., Luo, X., Zhang, H., Wang, M., Wu, W., and Mao, J. (2024). SP-VIO: Robust and Efficient Filter-Based Visual Inertial Odometry with State Transformation Model and Pose-Only Visual Description. arXiv.10.1109/JIOT.2025.3603436 ↗
2. Orb-slam3: An accurate open-source library for visual, visual–inertial, and multimap slam10.1109/TRO.2021.3075644 ↗
3. DM-VIO: Delayed marginalization visual-inertial odometry10.1109/LRA.2021.3140129 ↗
4. VINS-Mono: A Robust and Versatile Monocular Visual-Inertial State Estimator10.1109/TRO.2018.2853729 ↗
5. Rublee, E., Rabaud, V., Konolige, K., and Bradski, G. (2011, January 6–13). ORB: An efficient alternative to SIFT or SURF. Proceedings of the 2011 IEEE International Conference on Computer Vision, Barcelona, Spain.10.1109/ICCV.2011.6126544 ↗
6. Tareen, S.A.K., and Saleem, Z. (2018, January 3–4). A comparative analysis of sift, surf, kaze, akaze, orb, and brisk. Proceedings of the 2018 IEEE International Conference on Computing, Mathematics and Engineering Technologies (iCoMET), Sukkur, Pakistan.10.1109/ICOMET.2018.8346440 ↗
7. DeTone, D., Malisiewicz, T., and Rabinovich, A. (2018, January 18–22). Superpoint: Self-supervised interest point detection and description. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition Workshops, Salt Lake City, UT, USA.10.1109/CVPRW.2018.00060 ↗
8. Alike: Accurate and lightweight keypoint detection and descriptor extraction10.1109/TMM.2022.3155927 ↗
9. Potje, G., Cadar, F., Araujo, A., Martins, R., and Nascimento, E.R. (2024, January 16–22). Xfeat: Accelerated features for lightweight image matching. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, Seattle, WA, USA.10.1109/CVPR52733.2024.00259 ↗
10. Gao, M., Geng, Z., Pan, J., Yan, Z., Zhang, C., Shi, G., Fan, H., and Zhang, C. (2024, January 5–8). SuperPoint and SuperGlue-Based-VINS-Fusion Model. Proceedings of the International Conference on Intelligent Computing, Tianjin, China.10.1007/978-981-97-5666-7_39 ↗
11. Luo, H., Guo, C., Liu, Y., and Li, Z. (2024). SuperVINS: A visual-inertial SLAM framework integrated deep learning features. arXiv.
12. Keyframe-based visual—Inertial odometry using nonlinear optimization10.1177/0278364914554813 ↗
13. Leutenegger, S. (2022). Okvis2: Realtime scalable visual-inertial slam with loop closure. arXiv.
14. Qin, T., Pan, J., Cao, S., and Shen, S. (2019). A General Optimization-based Framework for Local Odometry Estimation with Multiple Sensors. arXiv.
15. Qin, T., Cao, S., Pan, J., and Shen, S. (2019). A General Optimization-based Framework for Global Pose Estimation with Multiple Sensors. arXiv.
16. Bloesch, M., Omari, S., Hutter, M., and Siegwart, R. (October, January 28). Robust visual inertial odometry using a direct EKF-based approach. Proceedings of the 2015 IEEE/RSJ international conference on intelligent robots and systems (IROS), Hamburg, Germany.10.1109/IROS.2015.7353389 ↗
17. Mourikis, A.I., and Roumeliotis, S.I. (2007, January 10–14). A multi-state constraint Kalman filter for vision-aided inertial navigation. Proceedings of the 2007 IEEE International Conference on Robotics and Automation, Roma, Italy.10.1109/ROBOT.2007.364024 ↗
18. HFNet: Hierarchical feedback network with multilevel atrous spatial pyramid pooling for RGB-D saliency detection10.1016/j.neucom.2021.11.100 ↗
19. Liu, L., and Aitken, J.M. (2023). Hfnet-slam: An accurate and real-time monocular slam system with deep features. Sensors, 23.10.3390/s23042113 ↗
20. Pan, Y., Zhou, W., Cao, Y., and Zha, H. (2024, January 16–22). Adaptive vio: Deep visual-inertial odometry with online continual learning. Proceedings of the 2024 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), Seattle, WA, USA.10.1109/CVPR52733.2024.01706 ↗
21. Revaud, J., De Souza, C., Humenberger, M., and Weinzaepfel, P. (2019). R2d2: Reliable and repeatable detector and descriptor. Adv. Neural Inf. Process. Syst., 32, Available online: https://proceedings.neurips.cc/paper/2019/hash/3198dfd0aef271d22f7bcddd6f12f5cb-Abstract.html.
22. Disk: Learning local features with policy gradient
23. Lucas, B.D., and Kanade, T. (1981, January 24–28). An iterative image registration technique with an application to stereo vision. Proceedings of the IJCAI’81: 7th International Joint Conference on Artificial Intelligence, Vancouver, BC, Canada.
24. VIO-DualProNet: Visual-inertial odometry with learning based process noise covariance10.1016/j.engappai.2024.108466 ↗
25. Sturm, J., Engelhard, N., Endres, F., Burgard, W., and Cremers, D. (2012, January 7–12). A benchmark for the evaluation of RGB-D SLAM systems. Proceedings of the 2012 IEEE/RSJ International Conference on Intelligent Robots and Systems, Vilamoura, Portugal.10.1109/IROS.2012.6385773 ↗