journal article·2026-01-02

A novel few-shot deep regression domain adaptation method with wavelet scattering attention mechanism for fault prognostics

Shujing Chen, Wentao Mao, Yanna Zhang, Zhidan Zhong

Publisher page

Abstract

Deep transfer learning (DTL) has shown substantial potential in fault prognostics. However, most current DTL methods still suffer from insufficient run-to-failure training data in source domain. Moreover, model interpretability is crucial for trustworthy predictions in few-shot scenarios. To address these problems, this paper proposes a novel few-shot deep regression domain adaptation method with wavelet scattering attention (WSA) mechanism. This method adopts domain-adversarial neural network as the baseline architecture. In the feature extractor, the WSA mechanism is designed by introducing wavelet scattering transform (WST) into a deep convolutional neural network. Under different decomposition scales and rotational orientations of WST, WSA obtains a set of deep time-frequency features with frequency-level meanings, each frequency channel of which is dynamically weighted with different significances. Through domain-adversarial training with an LSTM regression prediction and a temporal tendency regulariser, the temporal features with various frequency significances can be extracted to raise a fine-grained representation of degradation information. Experiments on the MNIST handwritten character dataset first visually verify the effectiveness of WSA, while a set of prognostic experiments on two rolling bearing whole-life datasets validate the superiority of the proposed method in prediction accuracy and the frequency-aware interpretation under few-shot setting.
Source: openalex_inverted_index · Quality: baseline

Research context

OpenAlex topics: Image Processing Techniques and Applications · Machine Fault Diagnosis Techniques · Non-Destructive Testing Techniques

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

Henan Normal University

Engineering Lab of Intelligence Business & Internet of Things

Henan University of Science and Technology

Funding

National Natural Science Foundation of China · Key Technologies Research Development Joint Foundation of Henan Province · Natural Science Foundation of Henan Province of China

References (40)

Show source-provided references
1. 10.1016/j.jmsy.2022.05.01010.1016/j.jmsy.2022.05.010 ↗
2. 10.3390/s2303130510.3390/s23031305 ↗
3. 10.1016/j.aei.2024.10306310.1016/j.aei.2024.103063 ↗
4. 10.3390/technologies1102004010.3390/technologies11020040 ↗
5. 10.1109/TMECH.2024.349073310.1109/TMECH.2024.3490733 ↗
6. 10.1109/TIM.2022.315901010.1109/TIM.2022.3159010 ↗
7. 10.1109/CVPR42600.2020.0096610.1109/CVPR42600.2020.00966 ↗
8. 10.1016/j.ress.2022.10859910.1016/j.ress.2022.108599 ↗
9. 10.3390/app812241610.3390/app8122416 ↗
10. 10.1016/j.measurement.2020.10828610.1016/j.measurement.2020.108286 ↗
11. 10.1016/j.ress.2019.10668210.1016/j.ress.2019.106682 ↗
12. 10.1609/aaai.v32i1.1169110.1609/aaai.v32i1.11691 ↗
13. 10.1016/j.neucom.2021.03.09110.1016/j.neucom.2021.03.091 ↗
14. 10.1016/j.ijfatigue.2023.10772210.1016/j.ijfatigue.2023.107722 ↗
15. 10.1016/j.ress.2024.11039910.1016/j.ress.2024.110399 ↗
16. 10.1109/JIOT.2020.300445210.1109/JIOT.2020.3004452 ↗
17. 10.1109/TSMC.2020.304895010.1109/TSMC.2020.3048950 ↗
18. 10.1016/j.isatra.2023.06.02010.1016/j.isatra.2023.06.020 ↗
19. 10.1016/j.apm.2023.05.04210.1016/j.apm.2023.05.042 ↗
20. 10.1109/TIM.2024.337601210.1109/TIM.2024.3376012 ↗
21. 10.1109/TPAMI.2022.316573010.1109/TPAMI.2022.3165730 ↗
22. Ganin Y, Ustinova E, Ajakan H, et al. Domain-adversarial training of neural networks. J Mach Learn Res. 2016;17:1–35.
23. 10.1109/TPAMI.2012.23010.1109/TPAMI.2012.230 ↗
24. Wiatowski T, Tschannen M, Stanic A, et al. Discrete deep feature extraction: a theory and new architectures. In: Proceedings of The 33rd International Conference on Machine Learning New York, NY, USA; 2016. p. 2149–2158.
25. Dziugaite GK Roy DM Ghahramani Z. Training generative neural networks via maximum mean discrepancy optimization. arXiv:1505.03906 2015.
26. Nectoux P, Gouriveau R, Medjaher K, et al. Pronostia: An experimental platform for bearings accelerated degradation tests. In: IEEE International Conference on Prognostics and Health Management Denver, CO, USA, PHM’12, 2012. p. 1–8.
27. 10.1109/TR.2018.288268210.1109/TR.2018.2882682 ↗
28. 10.1109/TIM.2018.280097810.1109/TIM.2018.2800978 ↗
29. Mao W, He J, Zuo M. Predicting remaining useful life of rolling bearings based on deep feature learning and long short-term memory networks. J Intell Manuf. 2017;28(4):775–786.
30. 10.1109/TII.2017.268482110.1109/TII.2017.2684821 ↗
31. 10.1016/j.compind.2019.02.00410.1016/j.compind.2019.02.004 ↗
32. 10.1016/j.ress.2022.10892010.1016/j.ress.2022.108920 ↗
33. 10.1109/TSMC.2017.269784210.1109/TSMC.2017.2697842 ↗
34. 10.1177/168781401881718410.1177/1687814018817184 ↗
35. 10.1109/TIE.2018.284485610.1109/TIE.2018.2844856 ↗
36. Huang J, Gretton A, Borgwardt K, et al. Correcting sample selection bias by unlabeled data. Adv Neural Inf Process Syst. 2006;19 601–608.
37. Fernando B, Habrard A, Sebban M, et al. “Unsupervised visual domain adaptation using subspace alignment In Proc IEEE Int Conf Comput Vis Sydney, Australia; 2013. p. 2960–2967.
38. Gong B, Shi Y, Sha F, et al. Geodesic flow kernel for unsupervised domain adaptation In Proc IEEE Conf Comput Vis Pattern Recognit Providence, RI; 2012. p. 2066–2073.
39. 10.1109/TNN.2010.209128110.1109/TNN.2010.2091281 ↗
40. 10.1016/j.jmsy.2023.04.00210.1016/j.jmsy.2023.04.002 ↗