Selective and Adaptive Incremental Transfer Learning with Multiple Datasets for Machine Fault Diagnosis
Source abstract
Abstract
The visions of Industry 4.0 and 5.0 have reinforced the industrial environment. They have also made artificial intelligence incorporated as a major facilitator. Diagnosing machine faults has become a solid foundation for automatically recognizing machine failure, and thus timely maintenance can ensure safe operations. Transfer learning is a promising solution that can enhance the machine fault diagnosis model by borrowing pre-trained knowledge from the source model and applying it to the target model, which typically involves two datasets. In response to the availability of multiple datasets, this paper proposes using selective and adaptive incremental transfer learning (SA-ITL), which fuses three algorithms, namely, the hybrid selective algorithm, the transferability enhancement algorithm, and the incremental transfer learning algorithm. It is a selective algorithm that enables selecting and ordering appropriate datasets for transfer learning and selecting useful knowledge to avoid negative transfer. The algorithm also adaptively adjusts the portion of training data to balance the learning rate and training time. The proposed algorithm is evaluated and analyzed using ten benchmark datasets. Compared with other algorithms from existing works, SA-ITL improves the accuracy of all datasets. Ablation studies present the accuracy enhancements of the SA-ITL, including the hybrid selective algorithm (1.22%–3.82%), transferability enhancement algorithm (1.91%–4.15%), and incremental transfer learning algorithm (0.605%–2.68%). These also show the benefits of enhancing the target model with heterogeneous image datasets that widen the range of domain selection between source and target domains.
Source: openalex_inverted_index · Quality: baseline
Research context
OpenAlex topics: Machine Learning and ELM · Domain Adaptation and Few-Shot Learning · Anomaly Detection Techniques and Applications
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
References (38)
Show source-provided references
1. A review on fault detection and diagnosis techniques: Basics and beyond10.1007/s10462-020-09934-2 ↗
2. Cross-domain fault diagnosis using knowledge transfer strategy: A review10.1109/ACCESS.2019.2939876 ↗
3. A perspective survey on deep transfer learning for fault diagnosis in industrial scenarios: Theories, applications and challenges10.1016/j.ymssp.2021.108487 ↗
4. A new dynamic model and transfer learning based intelligent fault diagnosis framework for rolling element bearings race faults: Solving the small sample problem10.1016/j.isatra.2021.03.042 ↗
5. Adversarial domain-invariant generalization: A generic domain-regressive framework for bearing fault diagnosis under unseen conditions10.1109/TII.2021.3078712 ↗
6. A novel deep convolution multi-adversarial domain adaptation model for rolling bearing fault diagnosis10.1016/j.measurement.2022.110752 ↗
7. A multi-source information transfer learning method with subdomain adaptation for cross-domain fault diagnosis10.1016/j.knosys.2022.108466 ↗
8. Deep learning-based partial domain adaptation method on intelligent machinery fault diagnostics10.1109/TIE.2020.2984968 ↗
9. A novel sub-label learning mechanism for enhanced cross-domain fault diagnosis of rotating machinery10.1016/j.ress.2022.108589 ↗
10. Research on fault diagnosis of gas turbine rotor based on adversarial discriminative domain adaption transfer learning10.1016/j.measurement.2022.111174 ↗
11. Deep domain generalization combining a priori diagnosis knowledge toward cross-domain fault diagnosis of rolling bearing10.1109/TIM.2021.3126847 ↗
12. Measuring lane-changing trajectories by employing context-based modified dynamic time warping10.1016/j.eswa.2022.119489 ↗
13. Source model selection for deep learning in the time series domain10.1109/ACCESS.2019.2963742 ↗
14. A survey on negative transfer10.1109/JAS.2022.106004 ↗
15. Case Western Reserve University Bearing Data Center, “Bearing data center,” [Online]. Available: https://engineering.case.edu/bearingdatacenter/download-data-file (accessed on 20/07/2023).
16. PRONOSTIA: An experimental platform for bearings accelerated degradation tests
17. Condition monitoring of bearing damage in electromechanical drive systems by using motor current signals of electric motors: A benchmark data set for data-driven classification
18. Society For Machinery Failure Prevention Technology, “Fault data sets,” 2013. [Online]. Available: https://www.mfpt.org/fault-data-sets/ (accessed on 20/07/2023).
19. Robust performance degradation assessment methods for enhanced rolling element bearing prognostics10.1016/j.aei.2004.08.001 ↗
20. The Politecnico di Torino rolling bearing test rig: Description and analysis of open access data10.1016/j.ymssp.2018.10.010 ↗
21. PHM Society, “Data analysis competition,” 2009. [Online]. Available: https://www.phmsociety.org/competition/PHM/09 (accessed on 20/07/2023).
22. Imagenet: A large-scale hierarchical image database
23. Highly accurate machine fault diagnosis using deep transfer learning10.1109/TII.2018.2864759 ↗
24. A. Krizhevsky, “Learning multiple layers of features from tiny images,” Master’s Thesis, University of Toronto, Canada, 2009.
25. Microsoft COCO: Common objects in context
26. A multi-layer spiking neural network-based approach to bearing fault diagnosis10.1016/j.ress.2022.108561 ↗
27. A new ensemble convolutional neural network with diversity regularization for fault diagnosis10.1016/j.jmsy.2020.12.002 ↗
28. J. Yu, Z. Wang, V. Vasudevan, L. Yeung, M. Seyedhosseini et al., “Coca: Contrastive captioners are image-text foundation models,” arXiv preprint arXiv:2205.01917, 2022.
29. Going deeper with image transformers
30. H. Zhang, F. Li, S. Liu, L. Zhang, H. Su et al., “DINO: DETR with improved denoising anchor boxes for end-to-end object detection,” arXiv preprint arXiv:2203.03605, 2022.
31. Intelligent diagnosis using continuous wavelet transform and gauss convolutional deep belief network10.1109/TR.2022.3180273 ↗
32. Fault diagnosis of rotating machinery based on dual convolutional-capsule network (DC-CN)10.1016/j.measurement.2021.110258 ↗
33. An intelligent machinery fault diagnosis method based on GAN and transfer learning under variable working conditions10.3390/s22239175 ↗
34. A systematic review of deep transfer learning for machinery fault diagnosis10.1016/j.neucom.2020.04.045 ↗
35. Intelligent fault diagnosis of rotating machinery using lightweight network with modified tree-structured parzen estimators10.1049/cim2.12055 ↗
36. Intelligent fault diagnosis among different rotating machines using novel stacked transfer auto-encoder optimized by PSO10.1016/j.isatra.2020.05.041 ↗
37. Reactive hybrid model for fault mitigation in real-time cloud computing10.4018/IJCAC.295240 ↗
38. AFTTM: Agent-based fault tolerance trust mechanism in cloud environment10.4018/IJCAC.297105 ↗