Harmonising convolutional networks and Transformer for transfer learning in bearing fault diagnosis
Source abstract
Abstract
Bearings are indispensable components in modern industrial systems, whose operating conditions are commonly monitored using vibration-based non-destructive testing (NDT) techniques. In practical applications, fault diagnosis models face challenges such as the difficulty of simultaneously capturing local and global features, as well as variations across operating conditions and equipment. A novel fault diagnosis approach is proposed, which leverages transfer learning and combines convolution with Transformer architectures. A shallow, learnable aggregator is designed to extract local fault information, where local dot-product operations replace token-based computations to reduce model complexity. A deep aggregator captures global dependencies through token interactions. By combining shallow and deep aggregators, the model achieves comprehensive feature representation of fault signals. Furthermore, the Higher-order Joint Maximum Mean Discrepancy algorithm was proposed by combining first-order and second-order statistics to measure the distance between the source domain and the target domain. The experimental findings indicate that the developed method attains high diagnostic accuracy with low computational complexity across multiple transfer tasks, offering dependable support for vibration-based non-destructive bearing fault diagnosis.
Source: openalex_inverted_index · Quality: baseline
Research context
OpenAlex topics: Machine Fault Diagnosis Techniques · Machine Learning and ELM · Face and Expression Recognition
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
Affiliations
Northeastern University
Northeast Forestry University
Tsinghua University
Funding
National Natural Science Foundation of China · Harbin science and technology innovation talent project
References (49)
Show source-provided references
1. 10.1177/1475921724126192610.1177/14759217241261926 ↗
2. 10.1016/j.aei.2023.10188310.1016/j.aei.2023.101883 ↗
3. 10.1080/10589759.2025.258462810.1080/10589759.2025.2584628 ↗
4. 10.1016/j.eswa.2025.12902310.1016/j.eswa.2025.129023 ↗
5. 10.1109/JIOT.2024.338748110.1109/JIOT.2024.3387481 ↗
6. 10.1016/j.ymssp.2019.10658710.1016/j.ymssp.2019.106587 ↗
7. 10.1080/10589759.2024.240448910.1080/10589759.2024.2404489 ↗
8. 10.1109/ACCESS.2020.297285910.1109/ACCESS.2020.2972859 ↗
9. 10.1080/1058975080237897410.1080/10589750802378974 ↗
10. 10.1080/10589759.2024.244197810.1080/10589759.2024.2441978 ↗
11. 10.1177/1475921725132467110.1177/14759217251324671 ↗
12. 10.37965/jdmd.2023.15210.37965/jdmd.2023.152 ↗
13. 10.1016/j.ymssp.2018.12.05110.1016/j.ymssp.2018.12.051 ↗
14. 10.1016/j.ymssp.2023.11042710.1016/j.ymssp.2023.110427 ↗
15. 10.1080/10589759.2025.251859610.1080/10589759.2025.2518596 ↗
16. 10.1007/s00170-021-07385-910.1007/s00170-021-07385-9 ↗
17. 10.1016/j.jmsy.2021.11.01610.1016/j.jmsy.2021.11.016 ↗
18. 10.1109/TIM.2025.357112210.1109/TIM.2025.3571122 ↗
19. 10.1080/10589759.2025.251769410.1080/10589759.2025.2517694 ↗
20. 10.1080/10589759.2025.247410210.1080/10589759.2025.2474102 ↗
21. 10.1016/j.measurement.2022.11214610.1016/j.measurement.2022.112146 ↗
22. 10.3390/s2309437910.3390/s23094379 ↗
23. Vaswani A, Shazeer N, Parmar N, et al. Attention is all you need. Adv Neural Inf Process Syst. 2017;30:5998–6008.
24. Guo Y, Zheng Y, Tan M, et al. Nat: Neural architecture transformer for accurate and compact architectures. Adv Neural Inf Process Syst. 2019;32:735–747.
25. Zhang S, Zhang S, Wang B, et al. Deep learning algorithms for bearing fault diagnostics-a review[C]. In: IEEE 12th International Symposium on Diagnostics for Electrical Machines, Power Electronics and Drives (SDEMPED), Toulouse, France; 2019. p. 257–263.
26. 10.1016/j.ress.2024.11066710.1016/j.ress.2024.110667 ↗
27. 10.1016/j.ress.2025.11097810.1016/j.ress.2025.110978 ↗
28. 10.1016/j.jmsy.2023.07.01210.1016/j.jmsy.2023.07.012 ↗
29. 10.1109/TMECH.2022.319998510.1109/TMECH.2022.3199985 ↗
30. 10.1016/j.isatra.2022.04.04310.1016/j.isatra.2022.04.043 ↗
31. 10.1109/TR.2024.346244110.1109/TR.2024.3462441 ↗
32. 10.1109/TIM.2024.350282110.1109/TIM.2024.3502821 ↗
33. 10.1109/TIM.2021.311630910.1109/TIM.2021.3116309 ↗
34. Xie E, Wang W, Yu Z, et al. Segformer: simple and efficient design for semantic segmentation with transformers. Adv Neural Inf Process Syst. 2021;34:12077–12090.
35. 10.1016/j.eswa.2024.12517110.1016/j.eswa.2024.125171 ↗
36. Liu Z Luo S Li W et al. Convtransformer: a convolutional transformer network for video frame synthesis. arXiv preprint arXiv:201110185 2020.
37. 10.1016/j.ymssp.2025.11301610.1016/j.ymssp.2025.113016 ↗
38. 10.1016/j.eswa.2023.12133810.1016/j.eswa.2023.121338 ↗
39. 10.3390/app710100410.3390/app7101004 ↗
40. Wei L, Li K. Intelligent diagnosis method for rotating machinery based on feature extraction and particle swarm optimization. J Simul. 2016;4(2):60.
41. 10.3390/sym1412265410.3390/sym14122654 ↗
42. 10.1016/j.neucom.2022.10.05710.1016/j.neucom.2022.10.057 ↗
43. 10.1016/j.apacoust.2024.11019110.1016/j.apacoust.2024.110191 ↗
44. Gulati A Qin J Chiu C-C et al. Conformer: convolution-augmented transformer for speech recognition. arXiv preprint arXiv:200508100 2020.10.21437/Interspeech.2020-3015 ↗
45. Li Y Zhang K Cao J et al. Localvit: bringing locality to vision transformers. arXiv preprint arXiv:210405707 2021.
46. Chen C-FR, Fan Q, Panda R. Crossvit: cross-attention multi-scale vision transformer for image classification[C]. In: Proceedings of the IEEE/CVF international conference on computer vision; 2021. p. 357–366.
47. 10.1109/ICCV48922.2021.0098610.1109/ICCV48922.2021.00986 ↗
48. 10.1016/j.engappai.2025.11041010.1016/j.engappai.2025.110410 ↗
49. 10.1088/1361-6501/ad19c210.1088/1361-6501/ad19c2 ↗