A novel few-shot deep regression domain adaptation method with wavelet scattering attention mechanism for fault prognostics
Source abstract
Abstract
Deep transfer learning (DTL) has shown substantial potential in fault prognostics. However, most current DTL methods still suffer from insufficient run-to-failure training data in source domain. Moreover, model interpretability is crucial for trustworthy predictions in few-shot scenarios. To address these problems, this paper proposes a novel few-shot deep regression domain adaptation method with wavelet scattering attention (WSA) mechanism. This method adopts domain-adversarial neural network as the baseline architecture. In the feature extractor, the WSA mechanism is designed by introducing wavelet scattering transform (WST) into a deep convolutional neural network. Under different decomposition scales and rotational orientations of WST, WSA obtains a set of deep time-frequency features with frequency-level meanings, each frequency channel of which is dynamically weighted with different significances. Through domain-adversarial training with an LSTM regression prediction and a temporal tendency regulariser, the temporal features with various frequency significances can be extracted to raise a fine-grained representation of degradation information. Experiments on the MNIST handwritten character dataset first visually verify the effectiveness of WSA, while a set of prognostic experiments on two rolling bearing whole-life datasets validate the superiority of the proposed method in prediction accuracy and the frequency-aware interpretation under few-shot setting.
Source: openalex_inverted_index · Quality: baseline
Research context
OpenAlex topics: Image Processing Techniques and Applications · Machine Fault Diagnosis Techniques · Non-Destructive Testing Techniques
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
Affiliations
Henan Normal University
Engineering Lab of Intelligence Business & Internet of Things
Henan University of Science and Technology
Funding
National Natural Science Foundation of China · Key Technologies Research Development Joint Foundation of Henan Province · Natural Science Foundation of Henan Province of China
References (40)
Show source-provided references
1. 10.1016/j.jmsy.2022.05.01010.1016/j.jmsy.2022.05.010 ↗
2. 10.3390/s2303130510.3390/s23031305 ↗
3. 10.1016/j.aei.2024.10306310.1016/j.aei.2024.103063 ↗
4. 10.3390/technologies1102004010.3390/technologies11020040 ↗
5. 10.1109/TMECH.2024.349073310.1109/TMECH.2024.3490733 ↗
6. 10.1109/TIM.2022.315901010.1109/TIM.2022.3159010 ↗
7. 10.1109/CVPR42600.2020.0096610.1109/CVPR42600.2020.00966 ↗
8. 10.1016/j.ress.2022.10859910.1016/j.ress.2022.108599 ↗
9. 10.3390/app812241610.3390/app8122416 ↗
10. 10.1016/j.measurement.2020.10828610.1016/j.measurement.2020.108286 ↗
11. 10.1016/j.ress.2019.10668210.1016/j.ress.2019.106682 ↗
12. 10.1609/aaai.v32i1.1169110.1609/aaai.v32i1.11691 ↗
13. 10.1016/j.neucom.2021.03.09110.1016/j.neucom.2021.03.091 ↗
14. 10.1016/j.ijfatigue.2023.10772210.1016/j.ijfatigue.2023.107722 ↗
15. 10.1016/j.ress.2024.11039910.1016/j.ress.2024.110399 ↗
16. 10.1109/JIOT.2020.300445210.1109/JIOT.2020.3004452 ↗
17. 10.1109/TSMC.2020.304895010.1109/TSMC.2020.3048950 ↗
18. 10.1016/j.isatra.2023.06.02010.1016/j.isatra.2023.06.020 ↗
19. 10.1016/j.apm.2023.05.04210.1016/j.apm.2023.05.042 ↗
20. 10.1109/TIM.2024.337601210.1109/TIM.2024.3376012 ↗
21. 10.1109/TPAMI.2022.316573010.1109/TPAMI.2022.3165730 ↗
22. Ganin Y, Ustinova E, Ajakan H, et al. Domain-adversarial training of neural networks. J Mach Learn Res. 2016;17:1–35.
23. 10.1109/TPAMI.2012.23010.1109/TPAMI.2012.230 ↗
24. Wiatowski T, Tschannen M, Stanic A, et al. Discrete deep feature extraction: a theory and new architectures. In: Proceedings of The 33rd International Conference on Machine Learning New York, NY, USA; 2016. p. 2149–2158.
25. Dziugaite GK Roy DM Ghahramani Z. Training generative neural networks via maximum mean discrepancy optimization. arXiv:1505.03906 2015.
26. Nectoux P, Gouriveau R, Medjaher K, et al. Pronostia: An experimental platform for bearings accelerated degradation tests. In: IEEE International Conference on Prognostics and Health Management Denver, CO, USA, PHM’12, 2012. p. 1–8.
27. 10.1109/TR.2018.288268210.1109/TR.2018.2882682 ↗
28. 10.1109/TIM.2018.280097810.1109/TIM.2018.2800978 ↗
29. Mao W, He J, Zuo M. Predicting remaining useful life of rolling bearings based on deep feature learning and long short-term memory networks. J Intell Manuf. 2017;28(4):775–786.
30. 10.1109/TII.2017.268482110.1109/TII.2017.2684821 ↗
31. 10.1016/j.compind.2019.02.00410.1016/j.compind.2019.02.004 ↗
32. 10.1016/j.ress.2022.10892010.1016/j.ress.2022.108920 ↗
33. 10.1109/TSMC.2017.269784210.1109/TSMC.2017.2697842 ↗
34. 10.1177/168781401881718410.1177/1687814018817184 ↗
35. 10.1109/TIE.2018.284485610.1109/TIE.2018.2844856 ↗
36. Huang J, Gretton A, Borgwardt K, et al. Correcting sample selection bias by unlabeled data. Adv Neural Inf Process Syst. 2006;19 601–608.
37. Fernando B, Habrard A, Sebban M, et al. “Unsupervised visual domain adaptation using subspace alignment In Proc IEEE Int Conf Comput Vis Sydney, Australia; 2013. p. 2960–2967.
38. Gong B, Shi Y, Sha F, et al. Geodesic flow kernel for unsupervised domain adaptation In Proc IEEE Conf Comput Vis Pattern Recognit Providence, RI; 2012. p. 2066–2073.
39. 10.1109/TNN.2010.209128110.1109/TNN.2010.2091281 ↗
40. 10.1016/j.jmsy.2023.04.00210.1016/j.jmsy.2023.04.002 ↗