journal article·2026-01-07Open access

A Surface Defect Detection System for Industrial Conveyor Belt Inspection Using Apple’s TrueDepth Camera Technology

Mohammad Siami, Przemysław Dąbek, Hamid Shiri, Tomasz Barszcz, Radosław Zimroz

Applied Sciences· Volume 16· Issue 2

Abstract

Maintaining the structural integrity of conveyor belts is essential for safe and reliable mining operations. However, these belts are susceptible to longitudinal tearing and surface degradation from material impact, fatigue, and deformation. Many computer vision-based inspection methods are inefficient and unreliable in harsh mining environments characterized by dust and variable lighting. This study introduces a smartphone-driven defect detection system for the cost-effective, geometric inspection of conveyor belt surfaces. Using Apple’s iPhone 12 Pro Max (Apple Inc., Cupertino, CA, USA), the system captures 3D point cloud data from a moving belt with induced damage via the integrated TrueDepth camera. A key innovation is a 3D-to-2D projection pipeline that converts point cloud data into structured representations compatible with standard 2D Convolutional Neural Networks (CNNs). We then propose a hybrid deep learning and machine learning model, where features extracted by pre-trained CNNs (VGG16, ResNet50, InceptionV3, Xception) are classified by ensemble methods (Random Forest, XGBoost, LightGBM). The proposed system achieves high detection accuracy exceeding 0.97 F1 score in the case of all proposed model implementations with TrueDepth F1 score over 0.05 higher than RGB approach. Applied cost-effective smartphone-based sensing platform proved to support near-real-time maintenance decisions. Laboratory results demonstrate the method’s reliability, with measurement errors for defect dimensions within 3 mm. This approach shows significant potential to improve conveyor belt management, reduce maintenance costs, and enhance operational safety.
Source: crossref · Quality: baseline

Research context

OpenAlex topics: Belt Conveyor Systems Engineering · Mineral Processing and Grinding · Advanced Surface Polishing Techniques

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

AGH University of Krakow, Faculty of Mechanical Engineering and Robotics, Department of Robotics and Mechatronics, al. A. Mickiewicza 30, 30-059 Krakow, Poland

Faculty of Geoengineering, Mining and Geology, Wrocław University of Science and Technology, Na Grobli 15, 50-421 Wrocław, Poland

National Oceanography Centre, European Way, Southampton SO14 3ZH, UK

References (75)

Show source-provided references
1. Green operations of belt conveyors by means of speed control10.1016/j.apenergy.2016.12.017 ↗
2. Siami, M., Dąbek, P., Shiri, H., Michalak, A., Wodecki, J., Barszcz, T., and Zimroz, R. (2025). Heterogeneous Information Fusion for Robot-Based Automated Monitoring of Bearings in Harsh Environments via Ensemble of Classifiers with Dynamic Weighted Voting. Sensors, 25.10.3390/s25175512 ↗
3. Semantic segmentation of thermal defects in belt conveyor idlers using thermal image augmentation and U-Net-based convolutional neural networks10.1038/s41598-024-55864-2 ↗
4. Siami, M., Barszcz, T., Wodecki, J., and Zimroz, R. (2022). Design of an Infrared Image Processing Pipeline for Robotic Inspection of Conveyor Systems in Opencast Mining Sites. Energies, 15.10.3390/en15186771 ↗
5. Wodecki, J., Shiri, H., Siami, M., and Zimroz, R. (2022, January 12–14). Acoustic-based diagnostics of belt conveyor idlers in real-life mining conditions by mobile inspection robot. Proceedings of the Conference on Noise and Vibration Engineering, ISMA 2022, Leuven, Belgium.
6. Trybała, P., Blachowski, J., Błażej, R., and Zimroz, R. (2021). Damage detection based on 3d point cloud data processing from laser scanning of conveyor belt surface. Remote Sens., 13.10.3390/rs13010055 ↗
7. Examination and assessment of the impact of working conditions on operating parameters of selected conveyor belts
8. Predicting the working time of multi-ply conveyor belt splices in underground mines10.37190/msc243115 ↗
9. Measurement and simulation of impact wear damage to industrial conveyor belts10.1016/j.wear.2016.10.010 ↗
10. Developments of rubber material wear in conveyer belt system10.1016/j.triboint.2017.03.010 ↗
11. PLC based laser scanning system for conveyor belt surface monitoring10.1038/s41598-024-78985-0 ↗
12. Huang, Q., Pan, C., and Liu, H. (2021, January 8–11). A Multi-sensor Fusion Algorithm for Monitoring the Health Condition of Conveyor Belt in Process Industry. Proceedings of the 2021 3rd International Conference on Industrial Artificial Intelligence (IAI), Shenyang, China.10.1109/IAI53119.2021.9619194 ↗
13. A New Roller Conveyor Driven by Linear Motor10.4028/www.scientific.net/AMR.201-203.1517 ↗
14. Research of X-ray nondestructive detector for high-speed running conveyor belt with steel wire ropes
15. A comparison between stereophotogrammetry and smartphone structured light technology for three-dimensional face scanning10.2319/040921-290.1 ↗
16. Optical metrology for digital manufacturing: A review10.1007/s00170-022-09084-5 ↗
17. An innovative framework for incorporating iPhone LiDAR point cloud in digitized documentation of road operations10.1016/j.rineng.2025.103953 ↗
18. Three-axis measurements with a novel system for 3D plantar foot scanning: IPhone X10.1080/19424280.2020.1734867 ↗
19. Carey, N., Werfel, J., and Nagpal, R. (2017, January 27–29). Fast, accurate, small-scale 3D scene capture using a low-cost depth sensor. Proceedings of the 2017 IEEE Winter Conference on Applications of Computer Vision (WACV), Santa Rosa, CA, USA.10.1109/WACV.2017.146 ↗
20. Validation of three-dimensional facial imaging captured with smartphone-based photogrammetry application in comparison to stereophotogrammetry system10.1016/j.heliyon.2023.e15834 ↗
21. Accuracy of 3D facial scans: A comparison of three different scanning system in an in vivo study10.1186/s40510-023-00496-x ↗
22. Yang, J., Lee, C., Ahn, P., Lee, H., Yi, E., and Kim, J. (2020, January 25–29). PBP-Net: Point Projection and Back-Projection Network for 3D Point Cloud Segmentation. Proceedings of the 2020 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), Las Vegas, NV, USA.10.1109/IROS45743.2020.9341776 ↗
23. Ericeira, D.R., Rocha, F., Bianchi, A.G., and Pessin, G. (2020, January 19–24). Early failure detection of belt conveyor idlers by means of ultrasonic sensing. Proceedings of the 2020 International Joint Conference on Neural Networks (IJCNN), Glasgow, UK.10.1109/IJCNN48605.2020.9207646 ↗
24. Innovative diagnostic device for thickness measurement of conveyor belts in horizontal transport10.1038/s41598-022-11148-1 ↗
25. Rzeszowska, A., Jurdziak, L., Błażej, R., and Kirjanów-Błażej, A. (2023, January 13–15). Application of Clustering and SOM Analysis for Identification of Conveyor Belt Damage Based on Data from the Diagbelt+ Magnetic System. Proceedings of the International Conference on Intelligent Systems in Production Engineering and Maintenance, Wrocław, Poland.10.1007/978-3-031-45021-1_35 ↗
26. Siami, M., Barszcz, T., Wodecki, J., and Zimroz, R. (2022). Automated ir image segmentation for identification of overheated idlers in belt conveyor systems based on outlier-detection method. SSRN.10.2139/ssrn.4054247 ↗
27. Siami, M., Barszcz, T., and Zimroz, R. (2024). Advanced Image Analytics for Mobile Robot-Based Condition Monitoring in Hazardous Environments: A Comprehensive Thermal Defect Processing Framework. Sensors, 24.10.2139/ssrn.4776801 ↗
28. Research on the fault analysis method of belt conveyor idlers based on sound and thermal infrared image features10.1016/j.measurement.2021.110177 ↗
29. Bortnowski, P., Gondek, H., Król, R., Marasova, D., and Ozdoba, M. (2023). Detection of Blockages of the Belt Conveyor Transfer Point Using an RGB Camera and CNN Autoencoder. Energies, 16.10.3390/en16041666 ↗
30. An Intelligent Detection Method for Conveyor Belt Deviation State Based on Machine Vision
31. Guo, X., Liu, X., Zhou, H., Stanislawski, R., Królczyk, G., and Li, Z. (2022). Belt tear detection for coal mining conveyors. Micromachines, 13.10.3390/mi13030449 ↗
32. Design of a laboratory scale automatic optical inspection prototype system for scanning of conveyor belt surfaces—A case study10.1016/j.measurement.2023.113342 ↗
33. Skoczylas, A., Stefaniak, P., Anufriiev, S., and Jachnik, B. (2021). Belt conveyors rollers diagnostics based on acoustic signal collected using autonomous legged inspection robot. Appl. Sci., 11.10.3390/app11052299 ↗
34. Fault diagnosis method of belt conveyor idler based on sound signal10.1007/s12206-022-1208-1 ↗
35. Li, X.G., Miao, C.Y., Wang, J., and Zhang, Y. (2011, January 8–10). Automatic defect detection method for the steel cord conveyor belt based on its X-ray images. Proceedings of the 2011 International Conference on Control, Automation and Systems Engineering (CASE), Jeju, Republic of Korea.10.1109/ICCASE.2011.5997624 ↗
36. The use of magnetic sensors in monitoring the condition of the core in steel cord conveyor belts–Tests of the measuring probe and the design of the DiagBelt system10.1016/j.measurement.2018.03.051 ↗
37. Forecast of the remaining lifetime of steel cord conveyor belts based on regression methods in damage analysis identified by subsequent DiagBelt scans10.1016/j.engfailanal.2019.02.039 ↗
38. Selection of measurement parameters using the DiagBelt magnetic system on the test conveyor10.1088/1742-6596/2198/1/012042 ↗
39. Xu, S., Cheng, G., Pang, Y., Jin, Z., and Kang, B. (2021). Identifying and characterizing conveyor belt longitudinal rip by 3D point cloud processing. Sensors, 21.10.3390/s21196650 ↗
40. Real-time detection of multi-wedge belt tooth surface defects based on 3D laser technology10.1088/2631-8695/ade02e ↗
41. LiDAR-based temporal surface damage assessment of bridge infrastructure using efficient scan area planning10.1016/j.autcon.2025.106526 ↗
42. Detecting and analyzing corrosion spots on the hull of large marine vessels using colored 3D lidar point clouds
43. Tan, Y., Li, S., and Wang, Q. (2020). Automated geometric quality inspection of prefabricated housing units using BIM and LiDAR. Remote Sens., 12.10.3390/rs12152492 ↗
44. Mikita, T., Krausková, D., Hrůza, P., Cibulka, M., and Patočka, Z. (2022). Forest road wearing course damage assessment possibilities with different types of laser scanning methods including new iPhone LiDAR scanning apps. Forests, 13.10.3390/f13111763 ↗
45. Jakubiak, J., and Delicat, J. (2024). Fast Detection of Idler Supports Using Density Histograms in Belt Conveyor Inspection with a Mobile Robot. Appl. Sci., 14.10.3390/app142310774 ↗
46. A multi-class support vector machine real-time detection system for surface damage of conveyor belts based on visual saliency10.1016/j.measurement.2019.06.025 ↗
47. Mao, Q., Ma, H., Zhang, X., and Zhang, G. (2018). An improved skewness decision tree svm algorithm for the classification of steel cord conveyor belt defects. Appl. Sci., 8.10.3390/app8122574 ↗
48. Fault diagnosis of belt conveyor based on support vector machine and grey wolf optimization
49. Zhang, M., Zhang, Y., Zhou, M., Jiang, K., Shi, H., Yu, Y., and Hao, N. (2021). Application of lightweight convolutional neural network for damage detection of conveyor belt. Appl. Sci., 11.10.3390/app11167282 ↗
50. Kirjanów-Błażej, A., and Rzeszowska, A. (2021). Conveyor belt damage detection with the use of a two-layer neural network. Appl. Sci., 11.10.3390/app11125480 ↗
51. Netto, G.G., Coelho, B.N., Delabrida, S.E., Sinatora, A., Azpúrua, H., Pessin, G., Oliveira, R.A., and Bianchi, A.G. (2021, January 8–10). Early Defect Detection in Conveyor Belts using Machine Vision. Proceedings of the VISIGRAPP (4: VISAPP), Virtual.10.5220/0010240803030310 ↗
52. Wu, X., Wang, C., Tian, Z., Huang, X., and Wang, Q. (2023). Research on belt deviation fault detection technology of belt conveyors based on machine vision. Machines, 11.10.3390/machines11121039 ↗
53. Belt deviation detection system based on deep learning under complex working conditions
54. A deep learning-based method for deviation status detection in intelligent conveyor belt system10.1016/j.jclepro.2022.132575 ↗
55. Guo, X., Liu, X., Królczyk, G., Sulowicz, M., Glowacz, A., Gardoni, P., and Li, Z. (2022). Damage detection for conveyor belt surface based on conditional cycle generative adversarial network. Sensors, 22.10.3390/s22093485 ↗
56. Damage detection method of mining conveyor belt based on deep learning10.1109/JSEN.2022.3170971 ↗
57. Measurement accuracy and dependence on external influences of the iPhone X TrueDepth sensor
58. Beltrán, N., Álvarez, J., Fernández, A., Álvarez, B.J., and Blanco, D. (2025). Performance analysis of Apple’s TrueDepth sensor for surface reconstruction of regular geometries across varying stand-off distances. Int. J. Adv. Manuf. Technol., 1–9.10.1007/s00170-025-15968-z ↗
59. Vogt, M., Rips, A., and Emmelmann, C. (2021). Comparison of iPad Pro®’s LiDAR and TrueDepth capabilities with an industrial 3D scanning solution. Technologies, 9.10.3390/technologies9020025 ↗
60. Urban, S., Lindemeier, T., Dobbelstein, D., and Haenel, M. (2022). On the Issues of TrueDepth Sensor Data for Computer Vision Tasks Across Different iPad Generations. arXiv.
61. An Efficient and Flexible Solution for Camera Autocalibration from N ≥ 3 Views10.1155/2018/8348340 ↗
62. Convolutional neural networks as a model of the visual system: Past, present, and future10.1162/jocn_a_01544 ↗
63. Siami, M., Barszcz, T., Wodecki, J., and Zimroz, R. (2022). Automated Identification of Overheated Belt Conveyor Idlers in Thermal Images with Complex Backgrounds Using Binary Classification with CNN. Sensors, 22.10.3390/s222410004 ↗
64. Deep learning10.1038/nature14539 ↗
65. Probabilistic uncertainty-aware decision fusion of neural network for bearing fault diagnosis10.36001/phme.2024.v8i1.4010 ↗
66. Deng, J., Dong, W., Socher, R., Li, L.J., Li, K., and Fei-Fei, L. (2009, January 20–25). Imagenet: A large-scale hierarchical image database. Proceedings of the 2009 IEEE Conference on Computer Vision and Pattern Recognition, Miami, FL, USA.10.1109/CVPR.2009.5206848 ↗
67. Simonyan, K., and Zisserman, A. (2014). Very deep convolutional networks for large-scale image recognition. arXiv.
68. He, K., Zhang, X., Ren, S., and Sun, J. (2016, January 27–30). Deep residual learning for image recognition. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Las Vegas, NV, USA.10.1109/CVPR.2016.90 ↗
69. Szegedy, C., Liu, W., Jia, Y., Sermanet, P., Reed, S., Anguelov, D., Erhan, D., Vanhoucke, V., and Rabinovich, A. (2015, January 7–12). Going deeper with convolutions. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Boston, MA, USA.10.1109/CVPR.2015.7298594 ↗
70. Chollet, F. (2017, January 21–26). Xception: Deep learning with depthwise separable convolutions. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Honolulu, HI, USA.10.1109/CVPR.2017.195 ↗
71. Random forests10.1023/A:1010933404324 ↗
72. Chen, T., and Guestrin, C. (2016, January 13–17). Xgboost: A scalable tree boosting system. Proceedings of the 22nd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, San Francisco, CA, USA.10.1145/2939672.2939785 ↗
73. Lightgbm: A highly efficient gradient boosting decision tree
74. Nissen, L., Hübner, J., Klinker, J., Kapsecker, M., Leube, A., Schneckenburger, M., and Jonas, S.M. (2023). Towards Preventing Gaps in Health Care Systems through Smartphone Use: Analysis of ARKit for Accurate Measurement of Facial Distances in Different Angles. Sensors, 23.10.3390/s23094486 ↗
75. Rublee, E., Rabaud, V., Konolige, K., and Bradski, G. (2011, January 6–13). ORB: An efficient alternative to SIFT or SURF. Proceedings of the 2011 International Conference on Computer Vision, Barcelona, Spain.10.1109/ICCV.2011.6126544 ↗