DataVXJournal of Nondestructive EvaluationPaper
journal article·2025-09

Transformer Based on Multi-Scale Local Perception and Contrastive Learning for Train Axle Fatigue Crack Acoustic Emission Detection

Li Lin, Liwen Ding, Qingwei Peng

Journal of Nondestructive Evaluation· Volume 44· Issue 3
Publisher page
Bibliographic record

Abstract

No abstract is available for this record. The assistant can identify its topic from the title, but cannot infer the study’s results.

Source: Not provided · Quality: missing

Research context

OpenAlex topics: Non-Destructive Testing Techniques · Ultrasonics and Acoustic Wave Propagation · Structural Integrity and Reliability Analysis

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

References (46)

Show source-provided references
1. Gao, J.-W., Pan, X.-N., Han, J., et al.: Influence of artificial defects on fatigue strength of induction hardened S38C axles. Int. J. Fatigue 139, 105746 (2020). https://doi.org/10.1016/j.ijfatigue.2020.10574610.1016/j.ijfatigue.2020.105746 ↗
2. Zolfaghari, A., Zolfaghari, A., Kolahan, F.: Reliability and sensitivity of magnetic particle nondestructive testing in detecting the surface cracks of welded components. Nondestruct. Test. Eval. 33, 290–300 (2018). https://doi.org/10.1080/10589759.2018.142832210.1080/10589759.2018.1428322 ↗
3. Montinaro, N., Epasto, G., Cerniglia, D., Guglielmino, E.: Laser ultrasonics for defect evaluation on coated railway axles. NDT E Int. 116, 102321 (2020). https://doi.org/10.1016/j.ndteint.2020.10232110.1016/j.ndteint.2020.102321 ↗
4. Li, Y., Xu, M., Wei, Y., Huang, W.: A new rolling bearing fault diagnosis method based on multiscale permutation entropy and improved support vector machine based binary tree. Measurement 77, 80–94 (2016). https://doi.org/10.1016/j.measurement.2015.08.03410.1016/j.measurement.2015.08.034 ↗
5. Chai, M., Zhang, J., Zhang, Z., Duan, Q., Cheng, G.: Acoustic emission studies for char-acterization of fatigue crack growth in 316LN stainless steel and welds. Appl. Acoust. 126, 101–113 (2017). https://doi.org/10.1016/j.apacoust.2017.05.01410.1016/j.apacoust.2017.05.014 ↗
6. Al-Ghamdi, A.M., Zhechkov, D., Mba, D.: The use of acoustic emission for bearing defect identification and estimation of defect size. In: DGZfP Proc. BB. (2004)
7. Yuan, L., Lian, D., Kang, X., et al.: Rolling bearing fault diagnosis based on convolutio-nal neural network and support vector machine. IEEE Access 8, 137395–137406 (2020). https://doi.org/10.1109/ACCESS.2020.301205310.1109/ACCESS.2020.3012053 ↗
8. Rhif, M., Ben Abbes, A., Farah, I.R., et al.: Wavelet transform application for/in non-stationary time-series analysis: A review. Appl. Sci. 9, 1345 (2019). https://doi.org/10.3390/app907134510.3390/app9071345 ↗
9. Zhou, Y., Lin, L., Wang, D., et al.: A new method to classify railway vehicle axle fatigue crack AE signal. Appl. Acoust. 131, 174–185 (2018). https://doi.org/10.1016/j.apacoust.2017.10.02510.1016/j.apacoust.2017.10.025 ↗
10. Younis, R., Zerr, S., Ahmadi, Z.: Multivariate time series analysis: An interpretable CNN-based model. Proc. IEEE Int. Conf. Data Sci. Adv. Anal. (2022). https://doi.org/10.1109/DSAA54385.2022.1003233510.1109/DSAA54385.2022.10032335 ↗
11. Zhang, Q., Lin, J., Song, H., Sheng, G.: Fault identification based on PD ultrasonic signal using RNN, DNN and CNN. Proc. IEEE Conf. Electr. Insul. Dielectr. Phenom. (2018). https://doi.org/10.1109/CMD.2018.853587810.1109/CMD.2018.8535878 ↗
12. Peng, Z., Huang, W., Gu, S., et al.: Conformer: Local features coupling global representations for visual recognition. Proc. IEEE/CVF Int. Conf. Comput. Vis. 367–376 (2021). https://doi.org/10.1109/ICCV48922.2021.0004210.1109/ICCV48922.2021.00042 ↗
13. Liu, W., Wang, S., Yin, Z., Tang, Z.: Structural damage detection of switch rails using deep learning. NDT E Int. 147, 103205 (2024). https://doi.org/10.1016/j.ndteint.2024.10320510.1016/j.ndteint.2024.103205 ↗
14. Du, J., Zeng, J., Wang, H., et al.: Using acoustic emission technique for structural health monitoring of laminate composite: A novel CNN-LSTM framework. Eng. Fract. Mech. 309, 110447 (2024). https://doi.org/10.1016/j.engfracmech.2024.11044710.1016/j.engfracmech.2024.110447 ↗
15. Lu, C., Sonoda, Y.: Application of light-weighted CNN for diagnosis of internal concrete defects using hammering sound. Nondestruct. Test. Eval. 39, 2426–2449 (2024). https://doi.org/10.1080/10589759.2023.230103210.1080/10589759.2023.2301032 ↗
16. Ronneberger, O., Fischer, P., Brox, T.: U-net: Convolutional networks for biomedical image segmentation. Lect. Notes Comput. Sci. 9351, 234–241 (2015). https://doi.org/10.1007/978-3-319-24574-4_2810.1007/978-3-319-24574-4_28 ↗
17. Chen, Z., Liu, Q., Ding, Z., et al.: Automated structural resilience evaluation based on a multi-scale transformer network using field monitoring data. Mech. Syst. Signal Process.. 222, 111813 (2025). https://doi.org/10.1016/j.ymssp.2024.11181310.1016/j.ymssp.2024.111813 ↗
18. Yan, H., Zhang, C., Wu, M.: Lawin transformer: Improving semantic segmentation transformer with multi-scale representations via large window attention. arXiv. (2022) https://arxiv.org/abs/2201.01615
19. Guo, C., Li, M., Xu, J., Bai, L.: Ultrasonic characterization of small defects based on Res-ViT and unsupervised domain adaptation. Ultrasonics 137, 107194 (2024). https://doi.org/10.1016/j.ultras.2023.10719410.1016/j.ultras.2023.107194 ↗
20. Zhang, Y., Liu, H., Hu, Q.: TransFuse: fusing transformers and CNNs for medical image segmentation. Lect. Notes Comput. Sci. 12902, 14–24 (2021). https://doi.org/10.1007/978-3-030-87193-2_210.1007/978-3-030-87193-2_2 ↗
21. Wu, H., Chen, S., Chen, G., et al.: FAT-Net: Feature adaptive transformers for automated skin lesion segmentation. Med. Image Anal. 76, 102327 (2022). https://doi.org/10.1016/j.media.2021.10232710.1016/j.media.2021.102327 ↗
22. Zheng, S., Lu, J., Zhao, H., et al.: Rethinking semantic segmentation from a sequence-to-sequence perspective with transformers. Proc. IEEE/CVF Conf. Comput. Vis. Pattern Recognit. 6877–6886 (2021). https://doi.org/10.1109/CVPR46437.2021.0068110.1109/CVPR46437.2021.00681 ↗
23. Chen, J., Lu, Y., Yu, Q., et al.: TransUNet: Transformers make strong encoders for medical image segmentation. arXiv. (2021). https://doi.org/10.48550/arXiv.2102.0430610.48550/arXiv.2102.04306 ↗
24. Huo, X., Sun, G., Tian, S., et al.: HiFuse: Hierarchical multi-scale feature fusion network for medical image classification. Biomed. Signal Process. Control 87, 105534 (2024). https://doi.org/10.1016/j.bspc.2023.10553410.1016/j.bspc.2023.105534 ↗
25. Bello, I., Zoph, B., Vaswani, A., et al.: Attention augmented convolutional networks. Proc. IEEE/CVF Int. Conf. Comput. Vis. 3286–3295 (2019). https://doi.org/10.1109/ICCV.2019.0033810.1109/ICCV.2019.00338 ↗
26. Liu, Z., Lin, Y., Cao, Y., et al.: Swin transformer: Hierarchical vision transformer using shifted windows. Proc. IEEE/CVF Int. Conf. Comput. Vis. 10012–10022 (2021). https://doi.org/10.1109/ICCV48922.2021.0098610.1109/ICCV48922.2021.00986 ↗
27. Wu, H., Xiao, B., Codella, N., et al.: CVT: Introducing convolutions to vision transformers. Conf. Comput. Vis. 22–31 (2021). https://doi.org/10.1109/ICCV48922.2021.0000910.1109/ICCV48922.2021.00009 ↗
28. Liu, F., Liu, Z., Liu, Z.: Attentive contrast learning network for fine-grained classification. Lect. Notes Comput. Sci. 12922, 92–104 (2021). https://doi.org/10.1007/978-3-030-88004-0_810.1007/978-3-030-88004-0_8 ↗
29. Russell, P., Cosgrave, J., Tomtsis, D., et al.: Extraction of information from acoustic vibration signals using Gabor transform type devices. Meas. Sci. Technol. 9, 1282 (1998). https://doi.org/10.1088/0957-0233/9/8/02210.1088/0957-0233/9/8/022 ↗
30. Lin, L., Tang, X., Zhu, X., et al.: An acoustic emission identification model for train axle fatigue cracks based on deep belief network. Meas. Sci. Technol. 35, 076125 (2024). https://doi.org/10.1088/1361-6501/ad3b3010.1088/1361-6501/ad3b30 ↗
31. Vaswani, A., Shazeer, N., Parmar, N., et al.: Attention is all you need. Adv. Neural Inf. Process. Syst. 30, 5998–6008 (2017). https://doi.org/10.48550/arXiv.1706.0376210.48550/arXiv.1706.03762 ↗
32. Gulati, A., Qin, J., Chiu, C.-C., et al.: Conformer: convolution-augmented transformer for speech recognition. arXiv. (2020). https://doi.org/10.48550/arXiv.2005.0810010.48550/arXiv.2005.08100 ↗
33. Lu, Y., Li, Z., He, D., et al.: Understanding and improving transformer from a multi-particle dynamic system point of view. arXiv. (2019). https://doi.org/10.48550/arXiv.1906.0276210.48550/arXiv.1906.02762 ↗
34. Kendall, A., Gal, Y., Cipolla, R.: Multi-task learning using uncertainty to weigh losses for scene geometry and semantics. Proc. IEEE Conf. Comput. Vis. Pattern Recognit. 7482–7491 (2018). https://doi.org/10.1109/CVPR.2018.0078110.1109/CVPR.2018.00781 ↗
35. Bishop, C.M., Nasrabadi, N.M.: Pattern recognition and machine learning. Springer (2006). https://doi.org/10.1198/jasa.2008.s23610.1198/jasa.2008.s236 ↗
36. Goodfellow, I., Bengio, Y., Courville, A.: Deep learning. MIT Press, Cambridge, MA (2016). https://doi.org/10.7551/mitpress/9780262035613.001.000110.7551/mitpress/9780262035613.001.0001 ↗
37. Zhang, Z., Sabuncu, M.: Generalized cross entropy loss for training deep neural networks with noisy labels. Adv. Neural Inf. Process. Syst. 31, 8792–8802 (2018). https://doi.org/10.48550/arXiv.1805.0783610.48550/arXiv.1805.07836 ↗
38. Elsayed, G., Krishnan, D., Mobahi, H., et al.: Large margin deep networks for classification. Adv. Neural Inf. Process. Syst. 31, (2018). https://doi.org/10.48550/arXiv.1803.0559810.48550/arXiv.1803.05598 ↗
39. Schroff, F., Kalenichenko, D., Philbin, J.: FaceNet: A unified embedding for face recognition and clustering. Proc. IEEE Conf. Comput. Vis. Pattern Recognit. 815–823 (2015). https://doi.org/10.48550/arXiv.1503.0383210.48550/arXiv.1503.03832 ↗
40. Chen, T., Kornblith, S., Norouzi, M., et al.: A simple framework for contrastive learning of visual representations. Proc. Mach. Learn. Res. 119, 1597–1607 (2020). https://doi.org/10.48550/arXiv.2002.0570910.48550/arXiv.2002.05709 ↗
41. Khosla, P., Teterwak, P., Wang, C., et al.: Supervised contrastive learning. Adv. Neural Inf. Process. Syst. 33, 18661–18673 (2020). https://doi.org/10.48550/arXiv.2004.1136210.48550/arXiv.2004.11362 ↗
42. Cheng, X., Qi, H., Wu, Z., et al.: Automated detection of delamination defects in composite laminates from ultrasonic images based on object detection networks. J. Nondestruct. Eval. 43, 94 (2024). https://doi.org/10.1007/s10921-024-01116-210.1007/s10921-024-01116-2 ↗
43. Browne, M.W.: Cross-validation methods. J. Math. Psychol. 44, 108–132 (2000). https://doi.org/10.1006/jmps.1999.127910.1006/jmps.1999.1279 ↗
44. Mooney, C.Z., Duval, R.D., Duvall, R.: Bootstrapping: A nonparametric approach to statistical inference. SAGE Publ. (1993). https://doi.org/10.2307/229096910.2307/2290969 ↗
45. Kim, J.-H.: Estimating classification error rate: Repeated cross-validation, repeated hold-out and bootstrap. Comput. Stat. Data Anal. 53, 3735–3745 (2009). https://doi.org/10.1016/j.csda.2009.04.00910.1016/j.csda.2009.04.009 ↗
46. Lin, X., Yan, Z., Deng, X., et al.: ConvFormer: Plug-and-play CNN-style transformers for improving medical image segmentation. Lect. Notes Comput. Sci. 13607, 642–651 (2023). https://doi.org/10.1007/978-3-031-43901-8_6110.1007/978-3-031-43901-8_61 ↗