journal article·2023-09-06Open access

An Improved Visual SLAM Method with Adaptive Feature Extraction

Xinxin Guo, Mengyan Lyu, Bin Xia, Kunpeng Zhang, Liye Zhang

Applied Sciences· Volume 13· Issue 18

Abstract

The feature point method is the mainstream method to accomplish inter-frame estimation in visual Simultaneous Localization and Mapping (SLAM) methods, among which the Oriented FAST and Rotated BRIEF (ORB) feature-based method provides an equilibrium of accuracy as well as efficiency. However, the ORB algorithm is prone to clustering phenomena, and its unequal distribution of extracted feature points is not conducive to the subsequent camera tracking. To solve the above problems, this paper suggests an adaptive feature extraction algorithm that first constructs multiple-scale images using an adaptive Gaussian pyramid algorithm, calculates adaptive thresholds, and uses an adaptive meshing method for regional feature point detection to adapt to different scenes. The method uses Adaptive and Generic Accelerated Segment Test (AGAST) to speed up feature detection and the non-maximum suppression method to filter feature points. The feature points are then divided equally by a quadtree technique, and the orientation of those points is determined by an intensity centroid approach. Experiments were conducted on publicly available datasets, and the outcomes demonstrate the algorithm has good adaptivity and solves the problem of a large number of corner point clusters that may result from using manually set detection thresholds. The RMSE of the absolute trajectory error of SLAM applying this method on four sequences of TUM RGB-D datasets is decreased by 13.88% when compared with ORB-SLAM3. It is demonstrated that the algorithm provides high-quality feature points for subsequent image alignment, and the application to SLAM improves the reliability and accuracy of SLAM.
Source: crossref · Quality: baseline

Research context

OpenAlex topics: Robotics and Sensor-Based Localization · Advanced Image and Video Retrieval Techniques · 3D Surveying and Cultural Heritage

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

College of Computer Science and Technology, Shandong University of Technology, Zibo 255000, China

Funding

National Natural Science Foundation of China

References (31)

Show source-provided references
1. MonoSLAM: Real-Time Single Camera SLAM10.1109/TPAMI.2007.1049 ↗
2. A Deep Learning-Based Target Recognition Method for Entangled Optical Quantum Imaging System10.1109/TIM.2023.3306828 ↗
3. Dynamic Convolution for 3D Point Cloud Instance Segmentation
4. A Survey of Visual SLAM Based on Deep Learning
5. Precise self-localization of a walking robot on rough terrain using parallel tracking and mapping10.1108/01439911311309924 ↗
6. Irani, M., and Anandan, P. (2000). International Workshop on Vision Algorithms, Springer. Theory and Practice.
7. Newcombe, R.A., Lovegrove, S.J., and Davison, A.J. (2011, January 6–13). DTAM: Dense tracking and mapping in real-time. Proceedings of the 2011 International Conference on Computer Vision, Barcelona, Spain.10.1109/ICCV.2011.6126513 ↗
8. Engel, J., Schöps, T., and Cremers, D. (2014). Computer Vision–ECCV 2014, Springer.
9. Wang, R., Schwörer, M., and Cremers, D. (2017, January 22–29). Stereo DSO: Large-Scale Direct Sparse Visual Odometry with Stereo Cameras. Proceedings of the 2017 IEEE International Conference on Computer Vision (ICCV), Venice, Italy.10.1109/ICCV.2017.421 ↗
10. ORB-SLAM: A Versatile and Accurate Monocular SLAM System10.1109/TRO.2015.2463671 ↗
11. ORB-SLAM2: An Open-Source SLAM System for Monocular, Stereo, and RGB-D Cameras10.1109/TRO.2017.2705103 ↗
12. ORB-SLAM3: An Accurate Open-Source Library for Visual, Visual–Inertial, and Multimap SLAM10.1109/TRO.2021.3075644 ↗
13. OV2SLAM: A Fully Online and Versatile Visual SLAM for Real-Time Applications10.1109/LRA.2021.3058069 ↗
14. Moravec, H.P. (1981, January 24–28). Rover Visual Obstacle Avoidance. Proceedings of the 7th International Joint Conference on Artificial Intelligence (IJCAI’81), Vancouver, BC, Canada.
15. Distinctive Image Features from Scale-Invariant Keypoints10.1023/B:VISI.0000029664.99615.94 ↗
16. Bay, H., Tuytelaars, T., and Gool, L.V. (2006, January 7–13). SURF: Speeded up robust features. Proceedings of the 9th European Conference on Computer Vision, Graz, Austria.10.1007/11744023_32 ↗
17. Rosten, E., and Drummond, T. (2006). Computer Vision–ECCV 2006, Springer.
18. Rublee, E., Rabaud, V., Konolige, K., and Bradski, G. (2011, January 6–13). ORB: An efficient alternative to SIFT or SURF. Proceedings of the 2011 International Conference on Computer Vision, Barcelona, Spain.10.1109/ICCV.2011.6126544 ↗
19. An improved ORB algorithm based on region division
20. Mair, E., Hager, G.D., Burschka, D., Suppa, M., and Hirzinger, G. (2010, January 5–11). Adaptive and Generic Corner Detection Based on the Accelerated Segment Test. Proceedings of the ECCV 2010 European Conference on Computer Vision, Heraklion, Crete, Greece.10.1007/978-3-642-15552-9_14 ↗
21. Xue, Y., and Gao, T. (2020, January 10–12). Feature Point Extraction and Matching Method Based on Akaze in Illumination Invariant Color Space. Proceedings of the 2020 IEEE 5th International Conference on Image, Vision and Computing (ICIVC), Beijing, China.10.1109/ICIVC50857.2020.9177459 ↗
22. Zhou, F., Zhang, L., Deng, C., and Fan, X. (2021). Improved Point-Line Feature Based Visual SLAM Method for Complex Environments. Sensors, 21.10.3390/s21134604 ↗
23. DeTone, D., Malisiewicz, T., and Rabinovich, A. (2018, January 18–22). SuperPoint: Self-Supervised Interest Point Detection and Description. Proceedings of the 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW), Salt Lake City, UT, USA.10.1109/CVPRW.2018.00060 ↗
24. A deep-learning real-time visual SLAM system based on multi-task feature extraction network and self-supervised feature points10.1016/j.measurement.2020.108403 ↗
25. ALIKE: Accurate and Lightweight Keypoint Detection and Descriptor Extraction10.1109/TMM.2022.3155927 ↗
26. Neubeck, A., and Gool, L.V. (2006, January 20–24). Efficient Non-Maximum Suppression. Proceedings of the 18th International Conference on Pattern Recognition (ICPR’06), Hong Kong, China.10.1109/ICPR.2006.479 ↗
27. Measuring Corner Properties10.1006/cviu.1998.0719 ↗
28. Vision meets robotics: The KITTI dataset10.1177/0278364913491297 ↗
29. Sturm, J., Engelhard, N., Endres, F., Burgard, W., and Cremers, D. (2012, January 7–12). A benchmark for the evaluation of RGB-D SLAM systems. Proceedings of the 2012 IEEE/RSJ International Conference on Intelligent Robots and Systems, Vilamoura-Algarve, Portugal.10.1109/IROS.2012.6385773 ↗
30. The EuRoC micro aerial vehicle datasets10.1177/0278364915620033 ↗
31. SVO: Semidirect Visual Odometry for Monocular and Multicamera Systems10.1109/TRO.2016.2623335 ↗