journal article·2024-05-23Open access

Enhancing Fault Diagnosis in Industrial Processes through Adversarial Task Augmented Sequential Meta-Learning

Dexin Sun, Yunsheng Fan, Guofeng Wang

Applied Sciences· Volume 14· Issue 11

Abstract

This study introduces the Adversarial Task Augmented Sequential Meta-Learning (ATASML) framework, designed to enhance fault diagnosis in industrial processes. ATASML integrates adversarial learning with sequential task learning to improve the model’s adaptability and robustness, facilitating precise fault identification under varied conditions. Key to ATASML’s approach is its novel use of adversarial examples and data-augmentation techniques, including noise injection and temporal warping, which extend the model’s exposure to diverse operational scenarios and fault manifestations. This enriched training environment significantly boosts the model’s ability to generalize from limited data, a critical advantage in industrial applications where anomaly patterns frequently vary. The framework’s performance was rigorously evaluated on two benchmark datasets: the Tennessee Eastman Process (TEP) and the Skoltech Anomaly Benchmark (SKAB), which are representative of complex industrial systems. The results indicate that ATASML outperforms conventional meta-learning models, particularly in scenarios characterized by few-shot learning requirements. Notably, ATASML demonstrated superior accuracy and F1 scores, validating its effectiveness in enhancing fault-diagnosis capabilities. Furthermore, ATASML’s strategic incorporation of task sequencing and adversarial tasks optimizes the training process, which not only refines learning outcomes but also improves computational efficiency. This study confirms the utility of the ATASML framework in significantly enhancing the accuracy and reliability of fault-diagnosis systems under diverse and challenging conditions prevalent in industrial processes.
Source: crossref · Quality: baseline

Research context

OpenAlex topics: Fault Detection and Control Systems · Industrial Vision Systems and Defect Detection · Anomaly Detection Techniques and Applications

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

College of Marine Electrical Engineering, Dalian Maritime University, Dalian 116026, China

Key Laboratory of Chemical Lasers, Dalian Institute of Chemical Physics, Chinese Academy of Sciences, Dalian 116023, China

Key Laboratory of Technology and System for Intelligent Ships of Liaoning Province, Dalian 116026, China

Funding

National Key Research and Development Program of China · National Natural Science Foundation of China · Pilot Base Construction and Pilot Verification Plan Program of Liaoning Province of China · China Postdoctoral Science Foundation · Liaoning Province Doctor Startup Fund

References (46)

Show source-provided references
1. Angelopoulos, A., Michailidis, E.T., Nomikos, N., Trakadas, P., Hatziefremidis, A., Voliotis, S., and Zahariadis, T. (2019). Tackling faults in the industry 4.0 era—A survey of machine-learning solutions and key aspects. Sensors, 20.10.3390/s20010109 ↗
2. Artificial intelligence, cyber-threats and Industry 4.0: Challenges and opportunities10.1007/s10462-020-09942-2 ↗
3. Review and analysis of fire and explosion accidents in maritime transportation10.1016/j.oceaneng.2018.04.022 ↗
4. One step forward for smart chemical process fault detection and diagnosis10.1016/j.compchemeng.2022.107884 ↗
5. Industrial Internet of Things enabled technologies, challenges, and future directions10.1016/j.compeleceng.2023.108847 ↗
6. The role of big data analytics in industrial Internet of Things10.1016/j.future.2019.04.020 ↗
7. Few-shot GAN: Improving the performance of intelligent fault diagnosis in severe data imbalance
8. Intelligent fault diagnosis of machines with small & imbalanced data: A state-of-the-art review and possible extensions10.1016/j.isatra.2021.02.042 ↗
9. A systematic review on data scarcity problem in deep learning: Solution and applications10.1145/3502287 ↗
10. A survey on deep learning tools dealing with data scarcity: Definitions, challenges, solutions, tips, and applications10.1186/s40537-023-00727-2 ↗
11. Lu, J., Gong, P., Ye, J., and Zhang, C. (2020). Learning from very few samples: A survey. arXiv.
12. Generalizing from a few examples: A survey on few-shot learning
13. Deep transfer learning models for industrial fault diagnosis using vibration and acoustic sensors data: A review10.3390/vibration6010014 ↗
14. A new meta-transfer learning method with freezing operation for few-shot bearing fault diagnosis10.1088/1361-6501/acc67b ↗
15. Prior knowledge-based self-supervised learning for intelligent bearing fault diagnosis with few fault samples10.1088/1361-6501/acddd9 ↗
16. Domain adaptation meta-learning network with discard-supplement module for few-shot cross-domain rotating machinery fault diagnosis10.1016/j.knosys.2023.110484 ↗
17. Liang, X., Zhang, M., Feng, G., Wang, D., Xu, Y., and Gu, F. (2023). Few-Shot Learning Approaches for Fault Diagnosis Using Vibration Data: A Comprehensive Review. Sustainability, 15.10.3390/su152014975 ↗
18. Meta-learning in neural networks: A survey
19. Finn, C., Abbeel, P., and Levine, S. (2017, January 6–11). Model-agnostic meta-learning for fast adaptation of deep networks. Proceedings of the 34th International Conference on Machine Learning, Sydney, Australia.
20. Ravi, S., and Larochelle, H. (2017, January 24–26). Optimization as a model for few-shot learning. Proceedings of the International Conference on Learning Representations, Toulon, France.
21. Generative adversarial network in mechanical fault diagnosis under small sample: A systematic review on applications and future perspectives10.1016/j.isatra.2021.11.040 ↗
22. A small sample focused intelligent fault diagnosis scheme of machines via multimodules learning with gradient penalized generative adversarial networks10.1109/TIE.2020.3028821 ↗
23. A novel method for imbalanced fault diagnosis of rotating machinery based on generative adversarial networks
24. Deep feature generating network: A new method for intelligent fault detection of mechanical systems under class imbalance10.1109/TII.2020.3030967 ↗
25. Data fusion generative adversarial network for multi-class imbalanced fault diagnosis of rotating machinery10.1109/ACCESS.2020.2986356 ↗
26. SASLN: Signals augmented self-taught learning networks for mechanical fault diagnosis under small sample condition
27. Rolling bearing fault diagnosis using variational autoencoding generative adversarial networks with deep regret analysis10.1016/j.measurement.2020.108371 ↗
28. Enhanced generative adversarial network for extremely imbalanced fault diagnosis of rotating machine10.1016/j.measurement.2021.109467 ↗
29. Hybrid attribute conditional adversarial denoising autoencoder for zero-shot classification of mechanical intelligent fault diagnosis10.1016/j.asoc.2020.106577 ↗
30. Imbalanced sample fault diagnosis of rotating machinery using conditional variational auto-encoder generative adversarial network10.1016/j.asoc.2020.106333 ↗
31. Data synthesis using dual discriminator conditional generative adversarial networks for imbalanced fault diagnosis of rolling bearings10.1016/j.measurement.2020.107741 ↗
32. An intelligent diagnosis scheme based on generative adversarial learning deep neural networks and its application to planetary gearbox fault pattern recognition10.1016/j.neucom.2018.05.024 ↗
33. Fault diagnosis of bearing in wind turbine gearbox under actual operating conditions driven by limited data with noise labels10.1109/TIM.2020.2987413 ↗
34. A novel multitask adversarial network via redundant lifting for multicomponent intelligent fault detection under sharp speed variation10.1109/TIM.2021.3127634 ↗
35. Deep learning fault diagnosis method based on global optimization GAN for unbalanced data10.1016/j.knosys.2019.07.008 ↗
36. A perspective view and survey of meta-learning10.1023/A:1019956318069 ↗
37. Meta-learning requires meta-augmentation
38. Task-sequencing meta learning for intelligent few-shot fault diagnosis with limited data10.1109/TII.2021.3112504 ↗
39. Lee, S., Lee, S., and Song, B.C. (2023). Efficient Meta-Learning through Task-Specific Pseudo Labelling. Electronics, 12.10.3390/electronics12132757 ↗
40. Nguyen, C., Do, T.T., and Carneiro, G. (2023). Task Weighting in Meta-learning with Trajectory Optimisation. arXiv.
41. A plant-wide industrial process control problem10.1016/0098-1354(93)80018-I ↗
42. Revision of the Tennessee Eastman Process Model10.1016/j.ifacol.2015.08.199 ↗
43. Simonyan, K., and Zisserman, A. (2014). Very deep convolutional networks for large-scale image recognition. arXiv.
44. He, K., Zhang, X., Ren, S., and Sun, J. (July, January 26). Deep Residual Learning for Image Recognition. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Las Vegas, NV, USA.
45. Sun, D., Fan, Y., and Wang, G. (2023). Gradient-Oriented Prioritization in Meta-Learning for Enhanced Few-Shot Fault Diagnosis in Industrial Systems. Appl. Sci., 14.10.3390/app14010181 ↗
46. Katser, I.D., and Kozitsin, V.O. (2024, February 10). Skoltech Anomaly Benchmark (SKAB). Kaggle. Available online: https://github.com/waico/SKAB.