Calibration of Camera and Flash LiDAR System with a Triangular Pyramid Target
Source abstract
Abstract
Calibration between multiple sensors is a fundamental procedure for data fusion. To address the problems of large errors and tedious operation, we present a novel method to conduct the calibration between light detection and ranging (LiDAR) and camera. We invent a calibration target, which is an arbitrary triangular pyramid with three chessboard patterns on its three planes. The target contains both 3D information and 2D information, which can be utilized to obtain intrinsic parameters of the camera and extrinsic parameters of the system. In the proposed method, the world coordinate system is established through the triangular pyramid. We extract the equations of triangular pyramid planes to find the relative transformation between two sensors. One capture of camera and LiDAR is sufficient for calibration, and errors are reduced by minimizing the distance between points and planes. Furthermore, the accuracy can be increased by more captures. We carried out experiments on simulated data with varying degrees of noise and numbers of frames. Finally, the calibration results were verified by real data through incremental validation and analyzing the root mean square error (RMSE), demonstrating that our calibration method is robust and provides state-of-the-art performance.
Source: crossref · Quality: baseline
Research context
OpenAlex topics: Advanced Vision and Imaging · Optical measurement and interference techniques · Advanced Optical Sensing Technologies
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
Affiliations
State Key Lab of Precision Measuring Technology and Instruments, Tianjin University, Tianjin 300072, China
Science and Technology on Electro-Optic Control Laboratory, Luoyang Institute of Electro-Optic Equipment, Luoyang 471000, China
References (33)
Show source-provided references
1. Cho, H., Seo, Y.W., Kumar, B.V.K.V., and Rajkumar, R. (June, January 31). A Multi-sensor Fusion System for Moving Object detection and Tracking in Urban Driving Environments. Proceedings of the IEEE International Conference on Robotics and Automation (ICRA), Hong Kong, China.
2. Enhanced Autonomous Exploration and Mapping of an Unknown Environment with the Fusion of Dual RGB-D Sensors10.1016/j.eng.2018.11.014 ↗
3. Region-adaptive Path Planning for Precision Optical Polishing with Industrial Robots10.1364/OE.26.023782 ↗
4. Wulf, O., Arras, K.O., Christensen, H.I., and Wagner, B. (May, January 26). 2D Mapping of Cluttered Indoor Environments by Means of 3D Perception. Proceedings of the IEEE International Conference on Robotics and Automation, New Orleans, LA, USA.
5. Ford Campus Vision and Lidar Data Set10.1177/0278364911400640 ↗
6. Halterman, R., and Bruch, M. (2010, January 7). Velodyne HDL-64E Lidar for Unmanned Surface Vehicle Obstacle Detection. Proceedings of the Conference on Unmanned Systems Technology XII, Orlando, FL, USA.10.1117/12.850611 ↗
7. Karol, M., and Mateusz, S. (2019, January 19–22). LiDAR Based System for Tracking Loader Crane Operator. Proceedings of the 6th International Scientific-Technical Conference on Advances in Manufacturing II (MANUFACTURING), Poznan, Poland.
8. Karol, M., Miroslaw, P., and Mateusz, S. (2017, January 28–31). Ground Plane Estimation from Sparse LIDAR Data for Loader Crane Sensor Fusion System. Proceedings of the 22nd International Conference on Methods and Models in Automation and Robotics (MMAR), Miedzyzdroje, Poland.
9. Karol, M., Miroslaw, P., and Mateusz, S. (2017, January 3–5). Real-time Ground Filtration Method for a Loader Crane Environment Monitoring System Using Sparse LIDAR Data. Proceedings of the IEEE International Conference on INnovations in Intelligent SysTems and Applications (INISTA), Gdynia, Poland.
10. Zhou, J., Sun, Y., and Ruan, H. (2020). Development on Solid- State Lidar Detector Technology. Infrared, 4.
11. A Survey on LiDAR Scanning Mechanisms10.3390/electronics9050741 ↗
12. A 30-frames/s, 252 × 144 SPAD Flash LiDAR with 1728 Dual-Clock 48.8-ps TDCs, and Pixel-Wise Integrated Histogramming10.1109/JSSC.2018.2883720 ↗
13. Zhang, Z. (1999, January 20–27). Flexible Camera Calibration by Viewing a Plane from Unknown Orientations. Proceedings of the Seventh IEEE International Conference on Computer Vision, Kerkyra, Greece.
14. Cai, H., Pang, W., Chen, X., Wang, Y., and Liang, H. (2020). A Novel Calibration Board and Experiments for 3D LiDAR and Camera Calibration. Sensors, 20.10.3390/s20041130 ↗
15. Geometric Calibration for LiDAR-camera System Fusing 3D-2D and 3D-3D point Correspondences10.1364/OE.381176 ↗
16. 3D LIDAR–camera Intrinsic and Extrinsic Calibration: Identifiability and Analytical Least-squares-based Initialization10.1177/0278364911435689 ↗
17. Glennie, C.L., Kusari, A., and Facchin, A. (2016, January 10–12). Calibration and Stability Analysis of the VLP-16 Laser Scanner. Proceedings of the European Calibration and Orientation Workshop (EuroCOW), Lausanne, Switzerland.10.5194/isprsarchives-XL-3-W4-55-2016 ↗
18. Pless, R., and Zhang, Q. (October, January 28). Extrinsic Calibration of a Camera and Laser Range Finder. Proceedings of the IEEE international conference on intelligent robots and systems, Sendai, Japan.
19. Unnikrishnan, R., and Hebert, M. (2005). Fast Extrinsic Calibration of a Laser Rangefinder to a Camera, Carnegie Mellon University, Rotbotics Institute. Technical Report.
20. Extrinsic Calibration of a 3D Laser Scanner and an Omnidirectional Camera
21. Extrinsic Calibration of a 3D LIDAR and a Camera Using a Trihedron10.1016/j.optlaseng.2012.11.015 ↗
22. Kim, E., and Park, S.Y. (2019). Extrinsic Calibration between Camera and LiDAR Sensors by Matching Multiple 3D Planes. Sensors, 20.10.3390/s20010052 ↗
23. Lipu, Z., Zimo, L., and Michael, K. (2018, January 1–5). Automatic Extrinsic Calibration of a Camera and a 3D LiDAR using Line and Plane Correspondences. Proceedings of the 25th IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), Madrid, Spain.
24. Guindel, C., Beltrán, J., Martín, D., and García, F. (2017). Automatic Extrinsic Calibration for Lidar-Stereo Vehicle Sensor Setups. arXiv.10.1109/ITSC.2017.8317829 ↗
25. Pusztai, Z., and Hajder, L. (2017, January 22–29). Accurate Calibration of LiDAR-Camera Systems using Ordinary Boxes. Proceedings of the 2017 IEEE International Conference on Computer Vision Workshops (ICCVW), Venice, Italy.10.1109/ICCVW.2017.53 ↗
26. Ishikawa, R., Oishi, T., and Ikeuchi, K. (2018). LiDAR and Camera Calibration using Motion Estimated by Sensor Fusion Odometry. arXiv.10.1109/IROS.2018.8593360 ↗
27. Pandey, G., Mcbride, J.R., Savarese, S., and Eustice, R.M. (2012, January 22–26). Automatic Targetless Extrinsic Calibration of a 3D Lidar and Camera by Maximizing Mutual Information. Proceedings of the Twenty-Sixth Conference on Artifificial Intelligence, Academic, Toronto, ON, Canada.10.1609/aaai.v26i1.8379 ↗
28. Automatic Extrinsic Calibration of Vision and Lidar by Maximizing Mutual Information: Automatic Extrinsic Calibration of Vision and Lidar10.1002/rob.21542 ↗
29. Castorena, J., Kamilov, U.S., and Boufounos, P.T. (2016, January 20–25). Autocalibration of Lidar and Optical Cameras via Edge Alignment. Proceedings of the 2016 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), Shanghai, China.10.1109/ICASSP.2016.7472200 ↗
30. Empirical and Theoretical Comparisons of Selected Criterion Functions for Document Clustering10.1023/B:MACH.0000027785.44527.d6 ↗
31. The Levenberg-marquardt Algorithm, Implementation and Theory
32. Calibration between Color Camera and 3D LIDAR Instruments with a Polygonal Planar Board10.3390/s140305333 ↗
33. Joint Calibration of Panoramic Camera and LiDAR Based on Supervised Learning