journal article·2023-04-20Open access

Fast Point Cloud Registration Method with Incorporation of RGB Image Information

Haiyuan Cao, Deng Chen, Zhaohui Zheng, Yanduo Zhang, Huabing Zhou, Jianping Ju

Applied Sciences· Volume 13· Issue 8

Abstract

Point cloud registration has a wide range of applications in 3D reconstruction, pose estimation, intelligent driving, heritage conservation, and digital cities. The traditional iterative closest point (ICP) algorithm has strong dependence on the initial position, poor robustness, and low timeliness. To address the above issues, a fast point cloud registration method that incorporates RGB image information is proposed. The SIFT algorithm is used to detect feature points of point clouds corresponding to the RGB image, followed by feature point matching. The RANSAC algorithm is applied to remove erroneous point pairs in order to calculate the initial transformation matrix. After applying a pass-through filter for noise reduction and transiting down with a voxel grid, the point cloud is subjected to rotation and translation transformation for initial registration. On the basis of initial alignment, the FR-ICP algorithm is utilized for achieving precise registration. This method not only avoids the problem of ICP easily getting stuck in local optima, but also has higher registration accuracy and efficiency. Experimental studies were conducted based on point clouds of automotive parts collected in real scenes, and the results showed that the proposed method has a registration error of only 0.487 mm. Among the same group of experimental point clouds with comparable registration error, the proposed method showed a speed improvement of 69%/48% compared to ICP/FR-ICP with regard to registration speed.
Source: crossref · Quality: baseline

Research context

OpenAlex topics: 3D Surveying and Cultural Heritage · Robotics and Sensor-Based Localization · Image Processing and 3D Reconstruction

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

Hubei Province Key Laboratory of Intelligent Robot, Wuhan Institute of Technology, Wuhan 430079, China

School of Mathematics and Physics, Wuhan Institute of Technology, Wuhan 430079, China

School of Artificial Intelligence, Hubei Business College, Wuhan 430079, China

Funding

National Natural Science Foundation of China · General Project of Hubei Natural Science Foundation · Science and Technology Research Project of Hubei Education Department · Science Research Project of Wuhan Institute of Technology · Graduate Innovative Fund of Wuhan Institute of Technology

References (31)

Show source-provided references
1. Review on 3D point cloud registration method10.11834/jig.210243 ↗
2. 3D Reconstruction of Array Virtual Camera
3. A Grasping Poses Detection Algorithm for Industrial Workpieces Based on Grasping Cluster and Collision Voxels
4. A robust perception algorithm based on a radar and LiDAR for intelligent driving
5. Reassembly of Fractured Fragments Based on Skeleton Graphs Matching
6. Acquisition of urban digital surface data based on mobile measurement technology in complex environments
7. A method for registration of 3-D shapes10.1109/34.121791 ↗
8. Huang, X., Mei, G., and Zhang, J. (2020, January 13–19). Feature-metric registration: A fast semi-supervised approach for robust point cloud registration without correspondences. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, Seattle, WA, USA.10.1109/CVPR42600.2020.01138 ↗
9. A joint network of point cloud and multiple views for roadside objects recognition from mobile laser point clouds
10. Yang, J., Li, H., and Jia, Y. (2013, January 1–8). Go-icp: Solving 3d registration efficiently and globally optimally. Proceedings of the IEEE International Conference on Computer Vision, Sydney, Australia.10.1109/ICCV.2013.184 ↗
11. A system for identifying an anti-counterfeiting pattern based on the statistical difference in key image regions10.1016/j.eswa.2021.115410 ↗
12. Pavlov, A.L., Ovchinnikov, G.W., Derbyshev, D.Y., Tsetserukou, D., and Oseledets, I.V. (2018, January 21–25). AA-ICP: Iterative closest point with Anderson acceleration. Proceedings of the 2018 IEEE International Conference on Robotics and Automation (ICRA), Brisbane, QLD, Australia.10.1109/ICRA.2018.8461063 ↗
13. Fast and robust iterative closest point
14. A point cloud registration algorithm based on ISS-SHOT features
15. Sun, R., Zhang, E., Mu, D., Ji, S., Zhang, Z., Liu, H., and Fu, Z. (2023). Optimization of the 3D Point Cloud Registration Algorithm Based on FPFH Features. Appl. Sci., 13.10.3390/app13053096 ↗
16. Adaptive binary simplification method for 3D feature descriptor
17. Point cloud registration method based on the SIFTfeature points combined with ICP algorithm
18. Rusu, R.B., Blodow, N., and Beetz, M. (2009, January 12–17). Fast point feature histograms (FPFH) for 3D registration. Proceedings of the 2009 IEEE international conference on robotics and automation, Kobe, Japan.10.1109/ROBOT.2009.5152473 ↗
19. Rigid registration method of 3D point cloud based on improved ICP algorithm
20. Improved sampling consistent point cloud registration algorithm
21. Zhu, L., Liu, D., Lin, C., Yan, R., Gómez-Fernández, F., Yang, N., and Feng, Z. (2021). Point cloud registration using representative overlapping points. arXiv.
22. Random sample consensus: A paradigm for model fitting with applications to image analysis and automated cartography10.1145/358669.358692 ↗
23. Li, Y., Luo, Y., Pu, Q., Mingfei, H., and Feng, S. (2022). A method for ground filtering of laser point cloud and extraction of tunnel wall and target sphere. Chin. J. Lasers, 1–20.
24. PointMLP-FD: A point cloud classification model based on multi-level adaptive downsampling
25. ORB-SLAM method based on local adaptive threshold extraction feature points
26. Speeded-up robust features (SURF)10.1016/j.cviu.2007.09.014 ↗
27. Circumferential local ternary pattern: New and efficient feature descriptors for anti-counterfeiting pattern identification10.1109/TIFS.2022.3154289 ↗
28. Pairwise coarse registration of point clouds in urban scenes using voxel-based 4-planes congruent sets10.1016/j.isprsjprs.2019.02.015 ↗
29. Least-squares rigid motion using svd
30. Lange, K. (2016). MM Optimization Algorithms, Society for Industrial and Applied Mathematics.10.1137/1.9781611974409 ↗
31. A novel improved probability-guided RANSAC algorithm for robot 3D map building