An Unsupervised Anomaly Detection Method for Railway Fasteners Based on Knowledge-Distilled Generative Adversarial Networks
Source abstract
Abstract
The integrity and stability of railway fasteners are of vital importance to railway safety. To address the challenges of limited anomaly samples, irregular defect geometries, and complex operational conditions in rail fastener anomaly detection, this paper proposes an unsupervised anomaly detection method using a knowledge-distilled generative adversarial network. First, the proposed method employs collaborative teacher–student learning to model normal sample distributions, where the student network reconstructs input images as normal outputs while a discriminator identifies anomalies by comparing input and reconstructed images. Second, a multi-scale attention-coupling feature-enhancement mechanism is proposed, effectively integrating hierarchical semantic information with spatial-channel attention to achieve both precise target localization and robust background suppression in the teacher network. Third, an enhanced anomaly discriminator is designed to incorporate an enhanced pyramid upsampling module, through which fine-grained details are preserved via multi-level feature map aggregation, resulting in significantly improved sensitivity for small-sized anomaly detection. Finally, the proposed method achieved an AUC of 94.0%, an ACC of 92.5%, and an F1 score of 91.6% on the MNIST dataset, and an AUC of 94.7%, an ACC of 90.1%, and an F1 score of 87.8% on the railway fastener dataset, which proves the superior anomaly detection ability of this method.
Source: crossref · Quality: baseline
Research context
OpenAlex topics: Anomaly Detection Techniques and Applications · Occupational Health and Safety Research · Infrastructure Maintenance and Monitoring
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
Affiliations
School of Electronic and Electrical Engineering, Shanghai University of Engineering Science, Shanghai 201620, China
College of Information Science and Technology, Donghua University, Shanghai 201620, China
Funding
The National Natural Science Foundation of China
References (48)
Show source-provided references
1. High-Speed Rail Networks, Economic Integration and Regional Specialisation in China and Europe10.1016/j.tbs.2014.07.002 ↗
2. The European High-Speed Train Network: Predicted Effects on Accessibility Patterns10.1016/S0966-6923(96)00033-6 ↗
3. Corridors, Hybrids and Networks: Three Global Development Strategies for High Speed Rail10.1016/j.jtrangeo.2014.07.006 ↗
4. Development and Impact of the Modern High-Speed Train: A Review10.1080/01441640600589319 ↗
5. The History and Future of High-Speed Railways in Japan
6. Design and Implementation of a Coal-Dust Removal Device for Heavy-Haul Railway Tunnels10.1093/tse/tdaa018 ↗
7. Lachowicz, M.B., and Lachowicz, M.M. (2021). Influence of corrosion on fatigue of the fastening bolts. Materials, 14.10.3390/ma14061485 ↗
8. A Real-Time Railway Fastener Inspection Method Using the Lightweight Depth Estimation Network10.1016/j.measurement.2021.110613 ↗
9. A Classification Model of RailwayFasteners Based on Computer Vision10.1007/s00521-019-04337-z ↗
10. Study on Mechanical Behaviours of Rail Fasteners and Effects on Seismic Performance of Urban Rail Viaduct10.1016/j.istruc.2021.06.105 ↗
11. Shang, Z., Li, L., Zheng, S., Mao, Y., and Shi, R. (2024). FIQ: A Fastener Inspection and Quantization Method Based on Mask FRCN. Appl. Sci., 14.10.3390/app14125267 ↗
12. Song, W., Liao, B., Ning, K., and Yan, X. (2024). Improved Real-Time Detection Transformer-Based Rail Fastener Defect Detection Algorithm. Mathematics, 12.10.3390/math12213349 ↗
13. A New Method for Railway Fastener Detection Using the Symmetrical Image and Its EA-HOG Feature10.1142/S021800142055006X ↗
14. Cao, X., Zuo, M., and Chen, G. (2025). Visual Localization Method for Fastener-Nut Disassembly and Assembly Robot Based on Improved Canny and HOG-SED. Appl. Sci., 15.10.20944/preprints202501.0401.v1 ↗
15. Iterative Scale-Invariant Feature Transform for Remote Sensing Image Registration10.1109/TGRS.2020.3008609 ↗
16. Liu, Z., He, Y., Wang, C., and Song, R. (2020). Analysis of the Influence of Foggy Weather Environment on the Detection Effect of Machine Vision Obstacles. Sensors, 20.10.3390/s20020349 ↗
17. Han, Q., Wang, S., Fang, Y., Wang, L., Du, X., Li, H., He, Q., and Feng, Q. (2020). A Rail Fastener Tightness Detection Approach Using Multi-Source Visual Sensor. Sensors, 20.10.3390/s20051367 ↗
18. Deep Face Recognition: A Survey10.1016/j.neucom.2020.10.081 ↗
19. Nemavhola, A., Chibaya, C., and Viriri, S. (2025). A Systematic Review of CNN Architectures, Databases, Performance Metrics, and Applications in Face Recognition. Information, 16.10.3390/info16020107 ↗
20. Classical and Modern Face Recognition Approaches: A Complete Review10.1007/s11042-020-09850-1 ↗
21. Cascaded Detection Method for Surface Defects of Lead Frame Based on High-Resolution Detection Images10.1016/j.jmsy.2023.11.017 ↗
22. Song, J., Tian, Y., and Wan, X. (2024). Multi-Channel Fusion Decision-Making Online Detection Network for Surface Defects in Automotive Pipelines Based on Transfer Learning VGG16 Network. Sensors, 24.10.3390/s24247914 ↗
23. Deep Learning for Anomaly Detection: A Review10.1145/3439950 ↗
24. Cascade Learning Embedded Vision Inspection of Rail Fastener by Using a Fault Detection IoT Vehicle10.1109/JIOT.2021.3126875 ↗
25. A Defect Detection Method for Rail Surface and Fasteners Based on Deep Convolutional Neural Network10.1155/2021/2565500 ↗
26. Rail Fastener Detection of Heavy Railway Based on Deep Learning10.1016/j.hspr.2022.11.001 ↗
27. An Optimized Railway Fastener Detection Method Based on Modified Faster R-CNN10.1016/j.measurement.2021.109742 ↗
28. Hu, J., Qiao, P., Lv, H., Yang, L., Ouyang, A., He, Y., and Liu, Y. (2022). High Speed Railway Fastener Defect Detection by Using Improved YoLoX-Nano Model. Sensors, 22.10.3390/s22218399 ↗
29. Deep Multitask Learning for Railway Track Inspection10.1109/TITS.2016.2568758 ↗
30. Using Support Vector Machine to Detect Desk Illuminance Sensor Blockage for Closed-Loop Daylight Harvesting10.1016/j.enbuild.2022.112443 ↗
31. Unsupervised Fabric Defect Detection Based on Multiscale Image Reconstruction and Structural Similarity Assessment10.1111/cote.12744 ↗
32. Alex, V., Safwan, K.P.M., Chennamsetty, S.S., and Krishnamurthi, G. (2017, January 12–14). Generative Adversarial Networks for Brain Lesion Detection. Proceedings of the 2017 Medical Imaging and Image Processing, Orlando, FA, USA.10.1117/12.2254487 ↗
33. Unsupervised pre-training of imbalanced data for identification of wafer map defect patterns10.1109/ACCESS.2021.3068378 ↗
34. Ronneberger, O., Fischer, P., and Brox, T. (2015, January 5–9). U-net: Convolutional networks for biomedical image segmentation. Proceedings of the 2015 Medical Image Computing and Computer-Assisted Intervention, Munich, Germany.10.1007/978-3-319-24574-4_28 ↗
35. Schlegl, T., Seeböck, P., and Waldstein, S.M. (2017, January 21–24). Unsupervised Anomaly Detection with Generative Adversarial Networks to Guide Marker Discovery. Proceedings of the International Conference on Information Processing in Medical Imaging, Cham, Switzerland.10.1007/978-3-319-59050-9_12 ↗
36. Gong, D., Liu, L., Le, V., Saha, B., Mansour, M.R., Venkatesh, S., and Hengel, A.V.D. (November, January 27). Memorizing Normality to Detect Anomaly: Memory-Augmented Deep Autoencoder for Unsupervised Anomaly Detection. Proceedings of the 2019 IEEE/CVF International Conference on Computer Vision (CVPR), Seoul, Republic of Korea.10.1109/ICCV.2019.00179 ↗
37. Xiang, T., Zhang, Y., Lu, Y., Yuille, A.L., Zhang, C., Cai, W., and Zhou, Z. (2023, January 18–22). SQUID: Deep Feature In-painting for Unsupervised Anomaly Detection. Proceedings of the 2023 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), Vancouver, BC, Canada.10.1109/CVPR52729.2023.02288 ↗
38. Dual residual attention network for image denoising10.1016/j.patcog.2024.110291 ↗
39. DNNAM: Image inpainting algorithm via deep neural networks and attention mechanism10.1016/j.asoc.2024.111392 ↗
40. Dual-path frequency discriminators for few-shot anomaly detection10.1016/j.knosys.2024.112397 ↗
41. SGAD-GAN: Simultaneous generation and anomaly detection for time-series sensor data with generative adversarial networks10.1016/j.ymssp.2024.111141 ↗
42. Zhang, Y., Guo, Z., Wu, J., Liu, Y., and Ding, J. (2022). Real-Time Vehicle Detection Based on Improved YOLOv5. Sustainability, 14.10.3390/su141912274 ↗
43. Wang, Z., Yang, S., Qin, H., Liu, Y., and Ding, J. (2024). CCW-YOLO: A Modified YOLOv5s Network for Pedestrian Detection in Complex Traffic Scenes. Information, 15.10.20944/preprints202410.2326.v1 ↗
44. Li, X., Wang, Q., Yang, X., Wang, K., and Zhang, H. (2023). Track Fastener Defect Detection Model Based on Improved YOLOv5s. Sensors, 23.10.3390/s23146457 ↗
45. Hou, Q., Zhou, D., and Feng, J. (2021, January 19–25). Coordinate Attention for Efficient Mobile Network Design. Proceedings of the 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition, Nashville, TN, USA.10.1109/CVPR46437.2021.01350 ↗
46. Hu, J., Shen, L., and Sun, G. (2018, January 18–22). Squeeze-and-Excitation Networks. Proceedings of the 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), Salt Lake City, UT, USA.10.1109/CVPR.2018.00745 ↗
47. Akcay, S., Atapour-Abargoue, A., and Breckon, T.P. (2018, January 2–6). Ganomaly: Semi-Supervised Anomaly Detection via Adversarial Training. Proceedings of the 14th Asian Conference on Computer Vision (ACCV 2018), Perth, Australia.
48. f-AnoGAN: Fast Unsupervised Anomaly Detection with Generative Adversarial Networks10.1016/j.media.2019.01.010 ↗