Fault Diagnosis via Neural Ordinary Differential Equations
Source abstract
Abstract
Implementation of model-based fault diagnosis systems can be a difficult task due to the complex dynamics of most systems, an appealing alternative to avoiding modeling is to use machine learning-based techniques for which the implementation is more affordable nowadays. However, the latter approach often requires extensive data processing. In this paper, a hybrid approach using recent developments in neural ordinary differential equations is proposed. This approach enables us to combine a natural deep learning technique with an estimated model of the system, making the training simpler and more efficient. For evaluation of this methodology, a nonlinear benchmark system is used by simulation of faults in actuators, sensors, and process. Simulation results show that the proposed methodology requires less processing for the training in comparison with conventional machine learning approaches since the data-set is directly taken from the measurements and inputs. Furthermore, since the model used in the essay is only a structural approximation of the plant; no advanced modeling is required. This approach can also alleviate some pitfalls of training data-series, such as complicated data augmentation methodologies and the necessity for big amounts of data.
Source: crossref · Quality: baseline
Research context
OpenAlex topics: Fault Detection and Control Systems · Machine Fault Diagnosis Techniques · Hydraulic and Pneumatic Systems
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
Affiliations
Departamento de Ingeniería, Pontificia Universidad Católica del Perú, Avenida Universitaria 1801, San Miguel, Lima 15088, Peru
References (45)
Show source-provided references
1. Ding, S.X. (2013). Model-Based Fault Diagnosis Techniques, Springer. [2nd ed.].10.1007/978-1-4471-4799-2 ↗
2. Pérez-Zuñiga, G., Rivas-Perez, R., Sotomayor-Moriano, J., and Sánchez-Zurita, V. (2020). Fault Detection and Isolation System Based on Structural Analysis of an Industrial Seawater Reverse Osmosis Desalination Plant. Processes, 8.10.3390/pr8091100 ↗
3. An efficient algorithm for finding minimal overconstrained subsystems for model-based diagnosis10.1109/TSMCA.2007.909555 ↗
4. Decentralized diagnosis in a spacecraft attitude determination and control system
5. Disturbance attenuation in fault detection of gas turbine engines: A discrete robust observer design10.1109/TSMCC.2008.2005845 ↗
6. A survey of fault diagnosis and fault-tolerant techniques-part II: Fault diagnosis with knowledge-based and hybrid/active approaches10.1109/TIE.2015.2417501 ↗
7. A linear matrix inequality approach to robust fault detection filter design of linear systems with mixed time-varying delays and nonlinear perturbations10.1016/j.jfranklin.2010.03.004 ↗
8. Liu, C., Jiang, B., and Zhang, K. (2014, January 8–10). Sliding mode observer-based actuator fault detection for a class of linear uncertain systems. Proceedings of the 2014 IEEE Chinese Guidance, Navigation and Control Conference, CGNCC 2014, Yantai, China.10.1109/CGNCC.2014.7007239 ↗
9. Guo, F., Ren, X., Li, Z., and Han, C. (2017, January 26–28). Kalman filter based fault detection of dual motor systems. Proceedings of the Chinese Control Conference, CCC 2017, Dalian, China.
10. Parity relation based fault estimation for nonlinear systems: An LMI approach10.3182/20060829-4-CN-2909.00060 ↗
11. Basri, H.M., Lias, K., Abidin, W.A.W.Z., Tay, K.M., and Zen, H. (2012, January 6–7). Fault Detection Using Dynamic Parity Space Approach H. Proceedings of the 2012 IEEE International PEOCO2012, Melaka, Malaysia.
12. Pérez, C.G., Chanthery, E., Travé-massuyès, L., and Sotomayor, J. Fault-Driven Minimal Structurally Overdetermined Set in a Distributed Context To cite this version: HAL Id: Hal-01392572, In Proceedings of the 27th International Workshop on Principles of Diagnosis: DX-2016, Denver, CO, USA, 4–7 October 2016.
13. Decentralized Diagnosis via Structural Analysis and Integer Programming10.1016/j.ifacol.2018.09.551 ↗
14. Garcia-Alvarez, D. (2009, January 17–19). Fault detection using Principal Component Analysis (PCA) in a Wastewater Treatment Plant (WWTP). Proceedings of the 62-th International Student’s Scientific Conference, San Diego, CA, USA.
15. Nonlinear PCA with the local approach for diesel engine fault detection and diagnosis10.1109/TCST.2007.899744 ↗
16. Ensemble of multiple kernel SVM classifiers
17. Neural network applications in fault diagnosis and detection: An overview of implementations in engineering-related systems10.1007/s00521-018-3911-5 ↗
18. A survey on Deep Learning based bearing fault diagnosis10.1016/j.neucom.2018.06.078 ↗
19. Nuclear Power Plant Thermocouple Sensor-Fault Detection and Classification Using Deep Learning and Generalized Likelihood Ratio Test
20. Liang, T., Wu, S., Duan, W., and Zhang, R. (2018). Bearing fault diagnosis based on improved convolutional deep belief network. IOP Conf. Ser. J. Phys.10.1088/1742-6596/1074/1/012154 ↗
21. Deep neural networks: A promising tool for fault characteristic mining and intelligent diagnosis of rotating machinery with massive data10.1016/j.ymssp.2015.10.025 ↗
22. Bearings Fault Diagnosis Based on Convolutional Neural Networks with 2- D Representation of Vibration Signals as Input
23. Zhang, B., Li, W., Hao, J., Li, X.L., and Zhang, M. (2018). Adversarial adaptive 1-D convolutional neural networks for bearing fault diagnosis under varying working condition. arXiv.
24. A recurrent neural network based health indicator for remaining useful life prediction of bearings10.1016/j.neucom.2017.02.045 ↗
25. A Robust Bearing Fault Detection and Diagnosis Technique for Brushless DC Motors Under Non-stationary Operating Conditions10.1007/s40313-015-0173-7 ↗
26. Zhang, C., Xu, L., Li, X., and Wang, H. (2018, January 26–28). A Method of Fault Diagnosis for Rotary Equipment Based on Deep Learning. Proceedings of the 2018 Prognostics and System Health Management Conference, PHM-Chongqing 2018, Chongqing, China.10.1109/PHM-Chongqing.2018.00171 ↗
27. Frank, S., Heaney, M., Jin, X., Robertson, J., Cheung, H., Elmore, R., and Henze, G.P. (2016, January 21–26). Hybrid Model-Based and Data-Driven Fault Detection and Diagnostics for Commercial Buildings. Proceedings of the ACEEE Summer Study on Energy Efficiency in Buildings, Pacific Grove, CA, USA.
28. Jung, D., Ng, K.Y., Frisk, E., and Krysander, M. (2016, January 7–9). A combined diagnosis system design using model-based and data-driven methods. Proceedings of the Conference on Control and Fault-Tolerant Systems, SysTol, Barcelona, Spain.10.1109/SYSTOL.2016.7739747 ↗
29. Combining model-based diagnosis and data-driven anomaly classifiers for fault isolation10.1016/j.conengprac.2018.08.013 ↗
30. A Combined Data-Driven and Model-Based Residual Selection Algorithm for Fault Detection and Isolation10.1109/TCST.2017.2773514 ↗
31. Graphical temporal semi-supervised deep learning–based principal fault localization in wind turbine systems
32. Recent advances in sensor fault diagnosis: A review10.1016/j.sna.2020.111990 ↗
33. Chen, R.T.Q., Rubanova, Y., Bettencourt, J., and Duvenaud, D. (2018). Neural Ordinary Differential Equations. arXiv.
34. He, K., Zhang, X., Ren, S., and Sun, J. (2016, January 27–30). Deep residual learning for image recognition. Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition, Las Vegas, NV, USA.10.1109/CVPR.2016.90 ↗
35. Deng, Z., Nawhal, M., Meng, L., and Mori, G. (2019). Continuous Graph Flow. arXiv.
36. Greydanus, S., Dzamba, M., and Yosinski, J. (2019). Hamiltonian Neural Networks. arXiv.
37. Tzen, B., and Raginsky, M. (2019). Neural Stochastic Differential Equations: Deep Latent Gaussian Models in the Diffusion Limit. arXiv.
38. Poli, M., Massaroli, S., Park, J., Yamashita, A., Asama, H., and Park, J. (2020, January 6–12). Neural ordinary differential equations. Proceedings of the Advances in Neural Information Processing Systems, Virtual.
39. Deep Neural Networks Motivated by Partial Differential Equations10.1007/s10851-019-00903-1 ↗
40. The quadruple-tank process: A multivariable laboratory process with an adjustable zero10.1109/87.845876 ↗
41. A Virtual Laboratory Environment for Control Design of a Multivariable Process
42. Sánchez-Zurita, V., Pérez-Zúñiga, G., and Sotomayor-Moriano, J. (2019, January 21–22). Reconfigurable Model Predictive Control applied to the Quadruple Tank Process. Proceedings of the 15th European Workshop on Advanced Control and Diagnosis, Palazzo Grassi, Bologna.
43. Jager, G., Zug, S., Brade, T., Dietrich, A., Steup, C., Moewes, C., and Cretu, A.M. (2014, January 5–7). Assessing neural networks for sensor fault detection. Proceedings of the CIVEMSA 2014—2014 IEEE Conference on Computational Intelligence and Virtual Environments for Measurement Systems and Applications, Ottawa, ON, Canada.10.1109/CIVEMSA.2014.6841441 ↗
44. A novel deep autoencoder feature learning method for rotating machinery fault diagnosis10.1016/j.ymssp.2017.03.034 ↗
45. Wen, Q., Sun, L., Song, X., Gao, J., Wang, X., and Xu, H. (2020). Time Series Data Augmentation for Deep Learning: A Survey. arXiv.10.24963/ijcai.2021/631 ↗