Rail Surface Defect Detection Based on Improved UPerNet and Connected Component Analysis
Source abstract
Abstract
To guarantee the safety of railway operations, the swift detection of rail surface defects becomes imperative. Traditional methods of manual inspection and conventional nondestructive testing prove inefficient, especially when scaling to extensive railway networks. Moreover, the unpredictable and intricate nature of defect edge shapes further complicates detection efforts. Addressing these challenges, this paper introduces an enhanced Unified Perceptual Parsing for Scene Understanding Network (UPerNet) tailored for rail surface defect detection. Notably, the Swin Transformer Tiny version (Swin-T) network, underpinned by the Transformer architecture, is employed for adept feature extraction. This approach capitalizes on the global information present in the image and sidesteps the issue of inductive preference. The model’s efficiency is further amplified by the window-based self-attention, which minimizes the model’s parameter count. We implement the cross-GPU synchronized batch normalization (SyncBN) for gradient optimization and integrate the Lovász-hinge loss function to leverage pixel dependency relationships. Experimental evaluations underscore the efficacy of our improved UPerNet, with results demonstrating Pixel Accuracy (PA) scores of 91.39% and 93.35%, Intersection over Union (IoU) values of 83.69% and 87.58%, Dice Coefficients of 91.12% and 93.38%, and Precision metrics of 90.85% and 93.41% across two distinct datasets. An increment in detection accuracy was discernible. For further practical applicability, we deploy semantic segmentation of rail surface defects, leveraging connected component processing techniques to distinguish varied defects within the same frame. By computing the actual defect length and area, our deep learning methodology presents results that offer intuitive insights for railway maintenance professionals.
Source: openalex_inverted_index · Quality: baseline
Research context
OpenAlex topics: Infrastructure Maintenance and Monitoring · Railway Engineering and Dynamics · Surface Roughness and Optical Measurements
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
References (37)
Show source-provided references
1. Influence of rail head defect on train operation and countermeasures
2. Deep multitask learning for railway track inspection10.1109/TITS.2016.2568758 ↗
3. A real-time visual inspection system for discrete surface defects of rail heads10.1109/TIM.2012.2184959 ↗
4. Research on rail defects automatic detection technology based on image region partition
5. Research on inverse P-M diffusion-based rail surface defect detection
6. Rail image segmentation based on Otsu threshold method10.3788/OPE.20162407.1772 ↗
7. Rail defect detection with real time image processing technique
8. A vision-based diagnosis approach for multi rail surface faults using fuzzy classificiation in railways
9. Morphological detection and extraction of rail surface defects10.1109/TIM.2020.2975454 ↗
10. Automatic visual detection system of railway surface defects with curvature filter and improved gaussian mixture model10.1109/TIM.2018.2803830 ↗
11. Design of rail surface defect detection system based on machine vision
12. Convolutional neural networks for steel surface defect detection from photometric stereo images
13. Deep convolutional neural networks for detection of rail surface defects
14. Defect detection of rail surface with deep convolutional neural networks
15. A deep convolutional neural network for detection of rail surface defect
16. Deeprail: Automatic visual detection system for railway surface defect using bayesian CNN and attention network
17. Real-time detection system of rail surface defects based on semantic segmentation
18. Rail surface defect detection based on image enhancement and deep learning
19. Rail surface defect detection based on image enhancement and improved Cascade R-CNN
20. Surface defect detection of rails based on convolutional neural network multi-scale-cross fastflow
21. Fracture mechanics in railway applications––An overview10.1016/j.engfracmech.2003.11.010 ↗
22. Attention is all you need
23. Bert: Pre-training of deep bidirectional transformers for language understanding
24. A. Radford, K. Narasimhan, T. Salimans and I. Sutskever, “Improving language understanding by generative pre-training,” 2018. [Online]. Available: https://www.cs.ubc.ca/~amuham01/LING530/papers/radford2018improving.pdf
25. A. Dosovitskiy, L. Beyer, A. Kolesnikov, D. Weissenborn, X. Zhai et al., “An image is worth 16x16 words: Transformers for image recognition at scale,” arXiv preprint arXiv: 2010.11929, 2020.
26. End-to-end object detection with transformers
27. Pre-trained image processing transformer
28. Semi-supervised spatiotemporal transformer networks for semantic segmentation of surgical instrument
29. Unified perceptual parsing for scene understanding
30. Pyramid scene parsing network
31. Swin transformer: Hierarchical vision transformer using shifted windows
32. G. H. Yu, “Research and implementation of image anomaly detection for power grid equipment based on deep learning,” M.S. dissertation, Beijing University of Posts and Telecommunications, China, 2020.
33. S. F. Ji, “Clothing image analysis based on neural network,” M.S. dissertation, Beijing Institute of Fashion Technology, China, 2020.
34. The lovász-softmax loss: A tractable surrogate for the optimization of the intersection-over-union measure in neural networks
35. P. Y. Yuan, W. Y. Hu, X. Q. Wu, J. F. Chen and H. V. Nguyen, “First arrival picking using U-net with lovász loss and nearest point picking method,” arXiv preprint arXiv: 2104.02805v1, 2021.
36. Hierarchical lovász embeddings for proposal-free panoptic segmentation
37. A hierarchical extractor-based visual rail surface inspection system10.1109/JSEN.2017.2761858 ↗