Enhancing ToF Sensor Precision Using 3D Models and Simulation for Vision Inspection in Industrial Mobile Robots
Source abstract
Abstract
In recent industrial settings, time-of-flight (ToF) cameras have become essential tools in various applications. These cameras provide high-performance 3D measurements without relying on ambient lighting; however, their performance can degrade due to environmental factors such as temperature, humidity, and distance to the target. This study proposes a novel method to enhance the pixel-level sensing accuracy of ToF cameras by obtaining precise depth data labels in real-world environments. By synchronizing 3D simulations with the actual ToF sensor viewpoints, accurate depth values were acquired and utilized to train AI algorithms, thereby improving ToF depth accuracy. This method was validated in industrial environments such as automobile manufacturing, where the introduction of 3D vision systems improved inspection accuracy compared to traditional 2D systems. Additionally, it was confirmed that ToF depth data can be used to correct positional errors in mobile robot manipulators. Experimental results showed that AI-based preprocessing effectively reduced noise and increased the precision of depth data compared to conventional methods. Consequently, ToF camera performance was enhanced, expanding their potential applications in industrial robotics and automated quality inspection. Future research will focus on developing real-time synchronization technology between ToF sensor data and simulation environments, as well as expanding the AI training dataset to achieve even higher accuracy.
Source: crossref · Quality: baseline
Research context
OpenAlex topics: Industrial Vision Systems and Defect Detection · Advanced Optical Sensing Technologies · Surface Roughness and Optical Measurements
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
Affiliations
Department of Electrical and Computer Engineering, Korea University, 145 Anam-ro, Seoul 02841, Republic of Korea
Hyundai Motor Company, 37 Cheoldobangmulgwan-ro, Uiwang 16088, Republic of Korea
Department of Software, Duksung Woman’s University, 33 Samyang-ro 144-gil, Seoul 01369, Republic of Korea
Funding
Hyundai Motor Company
References (20)
Show source-provided references
1. Thoman, P., Hirsch, A., Wippler, M., and Hranitzky, R. (2021, January 20–23). Optimizing Embedded Industrial Safety Systems Based on Time-of-flight Depth Imaging. Proceedings of the 2021 IEEE 17th International Conference on eScience (eScience), Innsbruck, Austria.10.1109/eScience51609.2021.00048 ↗
2. May, S., Werner, B., Surmann, H., and Pervölz, K. (2006, January 9–15). 3D Time-of-Flight Cameras for Mobile Robotics. Proceedings of the 2006 IEEE/RSJ International Conference on Intelligent Robots and Systems, Beijing, China.10.1109/IROS.2006.281670 ↗
3. Buratto, E., Simonetto, A., Agresti, G., Schäfer, H., and Zanuttigh, P. (2021). Deep Learning for Transient Image Reconstruction from ToF Data. Sensors, 21.10.3390/s21061962 ↗
4. Yang, J., Li, S., Wang, Z., Dong, H., Wang, J., and Tang, S. (2020). Using deep learning to detect defects in manufacturing: A comprehensive survey and current challenges. Materials, 13.10.3390/ma13245755 ↗
5. Assessment of Environmental Impact on Time-of-Flight Camera Accuracy
6. Cromo: Enhancing Time-of-Flight Camera Depth Accuracy Under Varied Environmental Conditions
7. Blainder: Addressing Dust Interference in Time-of-Flight Cameras
8. Color Assisted Depth Data Enhancement for RGB-D Cameras
9. Calibrated RGB-D Sensing: Improved Depth Accuracy with RGB Information
10. Local Feature-Based 3D Reconstruction of Complex Objects Using RGB-D Data
11. Real-Time 3D Modeling Using RGB-D Sensors
12. Detection of Outliers through Interquartile Range Method in Statistical Data Analysis
13. Decision Support Systems: Integrating Gaussian Distribution for Enhanced Data Analysis
14. Image Enhancement Using Statistical Outliers Removal
15. Li, J., Bi, Y., Li, K., Wu, L., Cao, J., and Hao, Q. (2023). Improving the Accuracy of TOF LiDAR Based on Balanced Detection Method. Sensors, 23.10.3390/s23084020 ↗
16. Li, X., Yang, B., Xie, X., Li, D., and Xu, L. (2018). Influence of Waveform Characteristics on LiDAR Ranging Accuracy and Precision. Sensors, 18.10.3390/s18041156 ↗
17. U-net: Convolutional networks for biomedical image segmentation
18. Boston Dynamics (2024, March 24). SPOT. Available online: https://dev.bostondynamics.com/.
19. Unity (2024, April 27). Unity Technologies Official Website. Available online: https://unity.com/kr.
20. Yang, C., Kim, J., Kang, D., and Eom, D.-S. (2024). Vision AI System Development for Improved Productivity in Challenging Industrial Environments: A Sustainable and Efficient Approach. Appl. Sci., 14.10.3390/app14072750 ↗