Memory-Enhanced and Prediction-Assisted Conditional Variational Autoencoder for Unsupervised Fault Detection in Industrial Processes
Source abstract
Abstract
Autoencoders (AEs) have been widely used for industrial process fault detection owing to their ability to learn nonlinear representations from normal operating data. However, conventional AE methods rely heavily on reconstruction errors and may miss weak faults due to overgeneralization. In addition, insufficient modeling of temporal evolution and operating condition variations may reduce their sensitivity to dynamic faults. To address these issues, this study proposes a memory-enhanced and prediction-assisted conditional variational autoencoder named MI-CVAE for unsupervised fault detection. In the proposed framework, statistical features extracted from sliding windows are used as condition information to describe variable operating states. A memory module stores representative normal prototypes to constrain reconstruction and reduce overgeneralization to faulty samples. Meanwhile, an Informer branch captures temporal dependencies and provides complementary prediction residuals. Reconstruction and prediction residuals are fused to construct squared prediction error and squared Mahalanobis distance statistics, with control limits determined by kernel density estimation. The proposed method is validated on the Benchmark Simulation Model No. 1 wastewater treatment benchmark and a real papermaking process dataset. The results show that MI-CVAE outperforms the evaluated comparison methods, particularly in detecting weak and dynamic faults, while maintaining a low false alarm rate.
Source: crossref · Quality: baseline
Research context
OpenAlex topics: Fault Detection and Control Systems · Machine Learning and ELM · Machine Fault Diagnosis Techniques
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
Affiliations
Jiangsu Co-Innovation Center of Efficient Processing and Utilization of Forest Resources, Nanjing Forestry University, Nanjing 210037, China
Funding
Shandong Provincial Natural Science Foundation · Natural Science Foundation of Jiangsu Provincial Universities
References (38)
Show source-provided references
1. A review of process fault detection and diagnosis: Part I: Quantitative model-based methods10.1016/S0098-1354(02)00160-6 ↗
2. Model-based fault-detection and diagnosis—Status and applications10.1016/j.arcontrol.2004.12.002 ↗
3. Survey on data-driven industrial process monitoring and diagnosis10.1016/j.arcontrol.2012.09.004 ↗
4. Principal component analysis, contribution plots and feature weights in the monitoring of sequential process data from a paper machine’s wet end10.1016/S0169-7439(98)00188-9 ↗
5. A fault detection and diagnosis technique for multivariate processes using a PLS-decomposition of the measurement space10.1016/j.chemolab.2013.07.006 ↗
6. Statistical process monitoring with independent component analysis10.1016/j.jprocont.2003.09.004 ↗
7. Fault detection in industrial processes using canonical variate analysis and dynamic principal component analysis10.1016/S0169-7439(00)00058-7 ↗
8. Statistical process control of multivariate processes10.1016/0967-0661(95)00014-L ↗
9. Fault Detection Using the k-Nearest Neighbor Rule for Semiconductor Manufacturing Processes10.1109/TSM.2007.907607 ↗
10. Deep Learning for Anomaly Detection: A Review10.1145/3439950 ↗
11. MoniNet with Concurrent Analytics of Temporal and Spatial Information for Fault Detection in Industrial Processes10.1109/TCYB.2021.3050398 ↗
12. Fault detection in Tennessee Eastman process with temporal deep learning models
13. Fault detection and identification using Bayesian recurrent neural networks10.1016/j.compchemeng.2020.106991 ↗
14. Deep recurrent neural network-based residual control chart for autocorrelated processes10.1002/qre.2551 ↗
15. Recurrent neural network based sensor fault detection and isolation for nonlinear systems: Application in PWR10.1016/j.pnucene.2023.104836 ↗
16. An integrated LSTM-AM and SPRT method for fault early detection of forced-oxidation system in wet flue gas desulfurization10.1016/j.psep.2022.01.062 ↗
17. An explainable artificial intelligence approach for unsupervised fault detection and diagnosis in rotating machinery10.1016/j.ymssp.2021.108105 ↗
18. Dual-attention LSTM autoencoder for fault detection in industrial complex dynamic processes10.1016/j.psep.2024.02.042 ↗
19. Autoencoder-Based fault detection using building automation system data10.1016/j.aei.2024.102810 ↗
20. A review on autoencoder based representation learning for fault detection and diagnosis in industrial processes10.1016/j.chemolab.2022.104711 ↗
21. A deep autoencoder feature learning method for process pattern recognition10.1016/j.jprocont.2019.05.002 ↗
22. Process monitoring using principal component analysis and stacked autoencoder for linear and nonlinear coexisting industrial processes10.1016/j.jtice.2020.06.001 ↗
23. Adaptive slow feature analysis—Sparse autoencoder based fault detection for time-varying processes10.1016/j.jtice.2022.104599 ↗
24. Intelligent sensor validation for sustainable influent quality monitoring in wastewater treatment plants using stacked denoising autoencoders10.1016/j.jwpe.2021.102206 ↗
25. Monitoring of wastewater treatment process based on multi-stage variational autoencoder10.1016/j.eswa.2022.117919 ↗
26. Denoising Autoencoders for Overgeneralization in Neural Networks10.1109/TPAMI.2019.2909876 ↗
27. An Interpretable Fault Detection Approach for Industrial Processes Based on Improved Autoencoder
28. Gong, D., Liu, L., Le, V., Saha, B., Mansour, M.R., Venkatesh, S., and van den Hengel, A. (November, January 27). Memorizing normality to detect anomaly: Memory-augmented deep autoencoder for unsupervised anomaly detection. Proceedings of the IEEE/CVF International Conference on Computer Vision, Seoul, Republic of Korea.
29. MemMambaAD: Memory-augmented state space model for multivariate time series anomaly detection10.1016/j.engappai.2025.111308 ↗
30. A novel dynamic PCA algorithm for dynamic data modeling and process monitoring10.1016/j.jprocont.2017.05.002 ↗
31. Adaptive Multivariate Statistical Process Control for Monitoring Time-Varying Processes10.1021/ie050391w ↗
32. Dynamic Distributed Monitoring Strategy for Large-Scale Nonstationary Processes Subject to Frequently Varying Conditions Under Closed-Loop Control10.1109/TIE.2018.2864703 ↗
33. Perspectives on nonstationary process monitoring in the era of industrial artificial intelligence10.1016/j.jprocont.2022.06.011 ↗
34. Alex, J., Benedetti, L., Copp, J., Gernaey, K., Jeppsson, U., Nopens, I., Pons, M.-N., Rieger, L., Rosen, C., and Steyer, J. (2008). Benchmark Simulation Model No. 1 (BSM1), Lund University. Report by the IWA Taskgroup on benchmarking of control strategies for WWTPs.
35. Kingma, D.P., and Welling, M. (2013). Auto-encoding variational bayes. arXiv.
36. Zhou, H., Zhang, S., Peng, J., Zhang, S., Li, J., Xiong, H., and Zhang, W. (2021, January 2–9). Informer: Beyond efficient transformer for long sequence time-series forecasting. Proceedings of the AAAI Conference on Artificial Intelligence, Virtually.10.1609/aaai.v35i12.17325 ↗
37. Monitoring Nonlinear and Non-Gaussian Processes Using Gaussian Mixture Model-Based Weighted Kernel Independent Component Analysis10.1109/TNNLS.2015.2505086 ↗
38. Two-Step Localized Kernel Principal Component Analysis Based Incipient Fault Diagnosis for Nonlinear Industrial Processes10.1021/acs.iecr.9b06826 ↗