journal article·2024-01-17Open access

Automated Identification and Localization of Rail Internal Defects Based on Object Detection Networks

Sicheng Wang, Bin Yan, Xinyue Xu, Weidong Wang, Jun Peng, Yuzhe Zhang, Xiao Wei, Wenbo Hu

Applied Sciences· Volume 14· Issue 2

Abstract

The timely identification of rail internal defects and the application of corresponding preventive measures would greatly reduce catastrophic failures, such as rail breakage. Ultrasonic rail defect detection is the current mainstream rail defect detection method thanks to its advantages of strong penetration, high accuracy, and ease to deploy. The 2D B-scan image output by ultrasonic detectors contains rich features of defects; however, rail engineers manually identify and localize the defect image, which can be time-consuming, and the image may be subject to missing identification or mistakes. This paper adopted state-of-the-art deep learning algorithms for novel B-scan images for the automatic identification and localization of rail internal tracks. First, through image pre-processing of classification, denoising, and augmentation, four categories of defect image datasets were established, namely crescent-shaped fatigue cracks, fishbolt hole cracks, rail web cracks, and rail base transverse cracks; then, four representatives of deep learning object detection networks, YOLOv8, YOLOv5, DETR, and Faster R-CNN, were trained with the defects dataset and further applied to the testing dataset for defect identification; finally, the performances of the three detection networks were compared and evaluated at the data level, the network structure level, and the interference adaptability level, respectively. The results show that the YOLOv8 network can effectively classify and localize four categories of internal rail defects in B-scan images with a 93.3% mean average precision at three images per second, and the detection time is 58.9%, 376.8%, and 123.2% faster than YOLO v5, DETR, and Faster R-CNN, respectively. The proposed approach could ensure the real-time, accurate, and efficient detection and analysis of internal defects to a rail.
Source: crossref · Quality: baseline

Research context

OpenAlex topics: Infrastructure Maintenance and Monitoring · Non-Destructive Testing Techniques · Railway Engineering and Dynamics

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

School of Civil Engineering, Central South University, Changsha 410075, China

Key Laboratory of Heavy Haul Railway Engineering Structure, Ministry of Education, Changsha 410075, China

Research Center for Intelligent Monitoring of Rail Transit Infrastructure, Central South University, Changsha 410075, China

Department of Civil and Environmental Engineering, The Hong Kong Polytechnic University, Hong Kong 999077, China

National Rail Transit Electrification and Automation Engineering Technology Research Center (Hong Kong Branch), The Hong Kong Polytechnic University, Hong Kong 999077, China

Funding

High-Speed Railway Infrastructure Joint Fund of the National Natural Science Foundation of China · the National Natural Science Foundation of China · National Natural Science Foundation of China · The Hong Kong Polytechnic University Postdoctoral Fellowship Scheme

References (48)

Show source-provided references
1. A Real-Time Visual Inspection System for Discrete Surface Defects of Rail Heads10.1109/TIM.2012.2184959 ↗
2. Development of an inspection system for cracks in a concrete tunnel lining
3. Automatic subway tunnel crack detection system based on line scan camera10.1002/stc.2776 ↗
4. Filter based feature selection for rail defect detection10.1007/s00138-004-0148-3 ↗
5. Maximally Stable Extremal Region Marking-Based Railway Track Surface Defect Sensing10.1109/JSEN.2016.2615333 ↗
6. Automated Visual Inspection of Railroad Tracks10.1109/TITS.2012.2236555 ↗
7. A Visual Detection System for Rail Surface Defects10.1109/TSMCC.2012.2198814 ↗
8. Health monitoring of rail structures using guided waves and three-dimensional diagnostic imaging10.1002/stc.1966 ↗
9. Benaissa, B., Khatir, S., Jouini, M.S., and Riahi, M.K. (2023). Optimal Axial-Probe Design for Foucault-Current Tomography: A Global Optimization Approach Based on Linear Sampling Method. Energies, 16.10.3390/en16052448 ↗
10. Composite aircraft debonding visualization by laser ultrasonic scanning excitation and integrated piezoelectric sensing10.1002/stc.1504 ↗
11. Clarke, R. (1968). Rail Testing—Where We Go from Here, National Railway Historical Society. Sperry Rail Service, Bulletin of the National Railway Historical Society.
12. On-line rail defect diagnostics with differential eddy current probes and specific detection processing10.1051/epjap:2003055 ↗
13. A comparative analysis of the active and residual magnetization methods in the nondestructive testing of rails10.1134/S1061830916030037 ↗
14. Automatic defect classification in long-range ultrasonic rail inspection using a support vector machine-based smart system10.1784/insi.46.6.331.56390 ↗
15. Automatic real time SVM-based ultrasonic rail flaw detection and classification system
16. Li, J. (2018). Research on rail flaw detection based on feature in Time-Frequency-Space. S. China Univ. Technol., 6, (In Chinese).
17. Research on Classification of Rail Defects Based on Image Processing Algorithm
18. Experimental sensitivity analysis of sensor placement based on virtual springs and damage quantification in CFRP composite
19. Ultrasonic Detection and Classification for Internal Defect of Rail Based on Deep Learning
20. Intelligent Detection Method for Rail Flaw Based on Deep Learning
21. Intelligent Rail Flaw Detection System Based on Deep Learning and Support Vector Machine
22. Wang, T.G., Yang, F.F., and Tsui, K.L. (2020). Real-Time Detection of Railway Track Component via One-Stage Deep Learning Networks. Sensors, 20.10.3390/s20154325 ↗
23. Pavement distress detection and classification based on YOLO network10.1080/10298436.2020.1714047 ↗
24. Rail image segmentation based on Otsu threshold method10.3788/OPE.20162407.1772 ↗
25. Sikora, P., Kiac, M., and Dutta, M.K. (2020, January 7–9). Classification of railway level crossing barrier and light signalling system using YOLOv3. Proceedings of the 43rd International Conference on Telecommunications and Signal Processing (TSP), Milan, Italy.10.1109/TSP49548.2020.9163535 ↗
26. Research on deep learning method for rail surface defect detection10.1049/iet-est.2020.0041 ↗
27. Estimation of crack width based on shaped-sensitive kernels and semantic segmentation10.1002/stc.2504 ↗
28. Soukup, D., and Huber-Mörk, R. (2014, January 8–10). Convolutional neural networks for steel surface defect detection from photometric stereo images. Proceedings of the International Symposium on Visual Computing 2014, Las Vegas, NV, USA.10.1007/978-3-319-14249-4_64 ↗
29. Vision-based automated crack detection for bridge inspection10.1111/mice.12141 ↗
30. YOLO-v1 to YOLO-v8, the Rise of YOLO and Its Complementary Nature toward Digital Manufacturing and Industrial Defect Detection10.3390/machines11070677 ↗
31. (2010). Catalogue of Rail Defects. Standard No. TB/T 1778-2010.
32. Train rail defect classification detection and its parameters learning method10.1016/j.measurement.2019.107246 ↗
33. Phillips, P.R. (2012). Ultrasonic Methods for Rail Inspection. [Ph.D. Thesis, UC San Diego]. Available online: https://escholarship.org/uc/item/0c3233q4.
34. A survey of deep learning-based object detection10.1109/ACCESS.2019.2939201 ↗
35. Automatic railroad track components inspection using real-time instance segmentation10.1111/mice.12625 ↗
36. Vehicle Detection Based on YOLO in Real Time
37. Joseph, R., Santosh, D., Ross, G., Redmon, A.F.J., Divvala, S., Girshick, R., and Farhadi, A. (2016, January 27–30). You Only Look Once: Unified, Real-Time Object Detection. Proceedings of the 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Las Vegas, NV, USA.
38. Dai, X., Chen, Y., Yang, J., Zhang, P., Yuan, L., and Zhang, L. (2021, January 11–17). Dynamic detr: End-to-end object detection with dynamic attention. Proceedings of the IEEE/CVF International Conference on Computer Vision, Montreal, BC, Canada.10.1109/ICCV48922.2021.00298 ↗
39. (2023, January 11). Available online: https://blog.roboflow.com/whats-new-in-yolov8/#what-is-yolov8.
40. (2023, January 10). Available online: https://learnopencv.com/ultralytics-yolov8/#YOLOv8-vs-YOLOv5.
41. Wang, X., Gao, H., Jia, Z., and Li, Z. (2023). BL-YOLOv8, An Improved Road Defect Detection Model Based on YOLOv8. Sensors, 23.10.3390/s23208361 ↗
42. Liu, W., Anguelov, D., Erhan, D., Szegedy, C., Reed, S., Fu, C.Y., and Berg, A.C. (2016). SSD: Single Shot Multibox Detector. arXiv, Available online: https://arxiv.org/abs/1512.02325.10.1007/978-3-319-46448-0_2 ↗
43. Karen, S., and Andrew, Z. (2015). Very Deep Convolutional Networks for Large Scale Image Recognition. arXiv, Available online: https://arxiv.org/abs/1409.1556.
44. Ren, S.Q., He, K.M., Girshick, R., and Sun, J. (2016). Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks. arXiv, Available online: https://arxiv.org/abs/1506.01497.
45. He, K.M., Zhang, X.Y., Ren, S.Q., and Sun, J. (2016). Deep residual learning for image recognition. arXiv, Available online: https://arxiv.org/abs/1512.03385.10.1109/CVPR.2016.90 ↗
46. MRSDI-CNN: Multi-Model Rail Surface Defect Inspection System Based on Convolutional Neural Networks10.1109/TITS.2021.3101053 ↗
47. Arya, D., Maeda, H., Ghosh, S.K., Toshniwal, D., Mraz, A., Kashiyama, T., and Sekimoto, Y. (2020). Transfer learning-based road damage detection for multiple countries. arXiv, Available online: https://arxiv.org/abs/2008.13101.10.1016/j.autcon.2021.103935 ↗
48. Yu, J.H., Jiang, Y.N., Wang, Z.Y., Cao, Z.M., and Huang, T. (2016). UnitBox: An Advanced Object Detection Network. arXiv, Available online: https://arxiv.org/abs/1608.01471.10.1145/2964284.2967274 ↗