Semi-Direct Point-Line Visual Inertial Odometry for MAVs
Source abstract
Abstract
Traditional Micro-Aerial Vehicles (MAVs) are usually equipped with a low-cost Inertial Measurement Unit (IMU) and monocular cameras, how to achieve high precision and high reliability navigation under the framework of low computational complexity is the main problem for MAVs. To this end, a novel semi-direct point-line visual inertial odometry (SDPL-VIO) has been proposed for MAVs. In the front-end, point and line features are introduced to enhance image constraints and increase environmental adaptability. At the same time, the semi-direct method combined with IMU pre-integration is used to complete motion estimation. This hybrid strategy combines the accuracy and loop closure detection performance of the feature-based method with the rapidity of the direct method, and tracks keyframes and non-keyframes, respectively. In the back-end, the sliding window mechanism is adopted to limit the computation, while the improved marginalization method is used to decompose the high-dimensional matrix corresponding to the cost function to reduce the computational complexity in the optimization process. The comparison results in the EuRoC datasets demonstrate that SDPL-VIO performs better than the other state-of-the-art visual inertial odometry (VIO) methods, especially in terms of accuracy and real-time performance.
Source: crossref · Quality: baseline
Research context
OpenAlex topics: Robotics and Sensor-Based Localization · 3D Surveying and Cultural Heritage · Advanced Vision and Imaging
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
Affiliations
School of Electronics and Information, Northwestern Polytechnical University, Xi’an 710072, China
Funding
National Natural Science Foundation of China · Natural Science Basic Research Program of Shaanxi
References (36)
Show source-provided references
1. Citroni, R., Di Paolo, F., and Livreri, P. (2019). A Novel Energy Harvester for Powering Small UAVs: Performance Analysis, Model Validation and Flight Results. Sensors, 19.10.3390/s19081771 ↗
2. Delmerico, J., and Scaramuzza, D. (2018, January 21–25). A Benchmark Comparison of Monocular Visual-Inertial Odometry Algorithms for Flying Robots. Proceedings of the IEEE International Conference on Robotics and Automation (ICRA), Brisbane, Australia.10.1109/ICRA.2018.8460664 ↗
3. A review of visual SLAM methods for autonomous driving vehicles10.1016/j.engappai.2022.104992 ↗
4. Mourikis, A.I., and Roumeliotis, S.I. (2007, January 10–14). A Multi-State Constraint Kalman Filter for Vision-aided Inertial Navigation. Proceedings of the IEEE International Conference on Robotics and Automation (ICRA), Rome, Italy.10.1109/ROBOT.2007.364024 ↗
5. Keyframe-based visual-inertial odometry using nonlinear optimization10.1177/0278364914554813 ↗
6. Bloesch, M., Omari, S., Hutter, M., and Siegwart, R. (October, January 28). Robust visual inertial odometry using a direct EKF-based approach. Proceedings of the IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), Hamburg, Germany.
7. ORB-SLAM2: An Open-Source SLAM System for Monocular, Stereo, and RGB-D Cameras10.1109/TRO.2017.2705103 ↗
8. Pumarola, A., Vakhitov, A., Agudo, A., Sanfeliu, A., and Moreno-Noguer, F. (June, January 29). PL-SLAM: Real-time monocular visual SLAM with points and lines. Proceedings of the IEEE International Conference on Robotics and Automation (ICRA), Singapore.
9. Visual-Inertial Monocular SLAM With Map Reuse10.1109/LRA.2017.2653359 ↗
10. VINS-Mono: A Robust and Versatile Monocular Visual-Inertial State Estimator10.1109/TRO.2018.2853729 ↗
11. He, Y., Zhao, J., Guo, Y., He, W., and Yuan, K. (2019). PL-VIO: Tightly-Coupled Monocular Visual–Inertial Odometry Using Point and Line Features. Sensors, 18.10.3390/s18041159 ↗
12. Duan, R., Paudel, D.P., Fu, C., and Lu, P. (2022). Stereo Orientation Prior for UAV Robust and Accurate Visual Odometry. IEEE/ASME Trans. Mechatronics, 1–11.10.1109/TMECH.2022.3140923 ↗
13. Engel, J., Schps, T., and Cremers, D. (2014). LSD-SLAM: Large-Scale Direct Monocular SLAM, Springer.10.1007/978-3-319-10605-2_54 ↗
14. Direct Sparse Odometry10.1109/TPAMI.2017.2658577 ↗
15. Forster, C., Pizzoli, M., and Scaramuzza, D. (June, January 31). SVO: Fast semi-direct monocular visual odometry. Proceedings of the IEEE International Conference on Robotics and Automation (ICRA), Hong Kong, China.
16. Gomez-Ojeda, R., Briales, J., and Gonzalez-Jimenez, J. (2016, January 9–14). PL-SVO: Semi-direct Monocular Visual Odometry by combining points and line segments. Proceedings of the 2016 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), Daejeon, Korea.10.1109/IROS.2016.7759620 ↗
17. SVO: Semidirect Visual Odometry for Monocular and Multicamera Systems10.1109/TRO.2016.2623335 ↗
18. Semi-direct monocular visual and visual-inertial SLAM with loop closure detection10.1016/j.robot.2018.11.009 ↗
19. Loosely-Coupled Semi-Direct Monocular SLAM10.1109/LRA.2018.2889156 ↗
20. FSD-SLAM: A fast semi-direct SLAM algorithm10.1007/s40747-021-00323-y ↗
21. Hybrid Monocular SLAM Using Double Window Optimization10.1109/LRA.2021.3070298 ↗
22. PC-SD-VIO: A constant intensity semi-direct monocular visual-inertial odometry with online photometric calibration10.1016/j.robot.2021.103877 ↗
23. Visual-Inertial Mapping with Non-Linear Factor Recovery10.1109/LRA.2019.2961227 ↗
24. A Real-Time Sliding Window based Visual-Inertial Odometry for MAVs10.1109/TII.2019.2959380 ↗
25. A Novel Feature Points Tracking Algorithm in Terms of IMU-Aided Information Fusion10.1109/TII.2020.3024079 ↗
26. Xu, C., Liu, Z., and Li, Z. (2021). Robust Visual-Inertial Navigation System for Low Precision Sensors under Indoor and Outdoor Environments. Remote Sens., 13.10.3390/rs13040772 ↗
27. DM-VIO: Delayed Marginalization Visual-Inertial Odometry10.1109/LRA.2021.3140129 ↗
28. Sliding window filter with application to planetary landing10.1002/rob.20360 ↗
29. Bartoli, A., and Sturm, P. (2001, January 8–14). The 3D line motion matrix and alignment of line reconstructions. Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition, CVPR 2001, Kauai, HI, USA.
30. Structure-From-Motion Using Lines: Representation, Triangulation and Bundle Adjustment10.1016/j.cviu.2005.06.001 ↗
31. Faster and Better: A Machine Learning Approach to Corner Detection10.1109/TPAMI.2008.275 ↗
32. Lucas, B.D., and Kanade, T. (1981, January 24–28). An iterative image registration technique with an application to stereo vision. Proceedings of the Imaging Understanding Workshop, Vancouver, BC, Canada.
33. LSD: A Fast Line Segment Detector with a False Detection Control10.1109/TPAMI.2008.300 ↗
34. An efficient and robust line segment matching approach based on LBD descriptor and pairwise geometric consistency10.1016/j.jvcir.2013.05.006 ↗
35. Bags of Binary Words for Fast Place Recognition in Image Sequences10.1109/TRO.2012.2197158 ↗
36. The EuRoC micro aerial vehicle datasets10.1177/0278364915620033 ↗