journal article·2021-08-11Open access

Adaptable and Explainable Predictive Maintenance: Semi-Supervised Deep Learning for Anomaly Detection and Diagnosis in Press Machine Data

Oscar Serradilla, Ekhi Zugasti, Julian Ramirez de Okariz, Jon Rodriguez, Urko Zurutuza

Applied Sciences· Volume 11· Issue 16

Abstract

Predictive maintenance (PdM) has the potential to reduce industrial costs by anticipating failures and extending the work life of components. Nowadays, factories are monitoring their assets and most collected data belong to correct working conditions. Thereby, semi-supervised data-driven models are relevant to enable PdM application by learning from assets’ data. However, their main challenges for application in industry are achieving high accuracy on anomaly detection, diagnosis of novel failures, and adaptability to changing environmental and operational conditions (EOC). This article aims to tackle these challenges, experimenting with algorithms in press machine data of a production line. Initially, state-of-the-art and classic data-driven anomaly detection model performance is compared, including 2D autoencoder, null-space, principal component analysis (PCA), one-class support vector machines (OC-SVM), and extreme learning machine (ELM) algorithms. Then, diagnosis tools are developed supported on autoencoder’s latent space feature vector, including clustering and projection algorithms to cluster data of synthetic failure types semi-supervised. In addition, explainable artificial intelligence techniques have enabled to track the autoencoder’s loss with input data to detect anomalous signals. Finally, transfer learning is applied to adapt autoencoders to changing EOC data of the same process. The data-driven techniques used in this work can be adapted to address other industrial use cases, helping stakeholders gain trust and thus promote the adoption of data-driven PdM systems in smart factories.
Source: crossref · Quality: baseline

Research context

OpenAlex topics: Fault Detection and Control Systems · Machine Fault Diagnosis Techniques · Reliability and Maintenance Optimization

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

Electronics and Computing Department, Mondragon Unibertsitatea, Loramendi 4, 20500 Mondragon, Spain

Koniker, San Andres Auzoa 20, 20500 Mondragon, Spain

Funding

Provincial Council of Gipuzkoa · European Union’s Horizon 2020 research and innovation programme

References (41)

Show source-provided references
1. Dhillon, B.S. (2002). Engineering Maintenance: A Modern Approach, CRC Press.10.1201/9781420031843 ↗
2. Wang, K., Wang, Y., Strandhagen, J.O., and Yu, T. (2018). How AI Affects the Future Predictive Maintenance: A Primer of Deep Learning. Advanced Manufacturing and Automation VII, Springer.10.1007/978-981-10-5768-7_1 ↗
3. UE Systems (2021, June 15). Understanding the P-F Curve and Its Impact on Reliability Centered Maintenance. Available online: http://www.uesystems.com/news/understanding-the-p-f-curve-and-its-impact-on-reliability-centered-maintenance.
4. Colemen, C., Damodaran, S., Chandramoulin, M., and Deuel, E. (2017). Making Maintenance Smarter, Deloitte University Press.
5. Lavi, Y. (2021, May 28). The Rewards and Challenges of Predictive Maintenance. InfoQ, Available online: https://www.infoq.com/articles/predictive-maintenance-industrial-iot.
6. Jimenez-Cortadi, A., Irigoien, I., Boto, F., Sierra, B., and Rodriguez, G. (2020). Predictive Maintenance on the Machining Process and Machine Tool. Appl. Sci., 10.10.3390/app10010224 ↗
7. Welz, Z.A. (2017). Integrating Disparate Nuclear Data Sources for Improved Predictive Maintenance Modeling: Maintenance-Based Prognostics for Long-Term Equipment Operation. [Ph.D. Thesis, University of Tennessee].
8. A review of process fault detection and diagnosis: Part I: Quantitative model-based methods10.1016/S0098-1354(02)00160-6 ↗
9. Serradilla, O., Zugasti, E., and Zurutuza, U. (2020). Deep learning models for predictive maintenance: A survey, comparison, challenges and prospect. arXiv.
10. Bampoula, X., Siaterlis, G., Nikolakis, N., and Alexopoulos, K. (2021). A Deep Learning Model for Predictive Maintenance in Cyber-Physical Production Systems Using LSTM Autoencoders. Sensors, 21.10.3390/s21030972 ↗
11. Semi-Supervised Bearing Fault Diagnosis and Classification using Variational Autoencoder-Based Deep Generative Models10.1109/JSEN.2020.3040696 ↗
12. Bui, V., Pham, T.L., Nguyen, H., and Jang, Y.M. (2021). Data Augmentation Using Generative Adversarial Network for Automatic Machine Fault Detection Based on Vibration Signals. Appl. Sci., 11.10.3390/app11052166 ↗
13. Kuo, R., and Li, C. (2020, January 7–9). Predicting Remaining Useful Life of Ball Bearing Using an Independent Recurrent Neural Network. Proceedings of the 2020 2nd International Conference on Management Science and Industrial Engineering, Osaka, Japan.10.1145/3396743.3396765 ↗
14. LSTM based prediction and time-temperature varying rate fusion for hydropower plant anomaly detection: A case study10.1007/978-981-13-2375-1_13 ↗
15. A fault mode identification methodology based on self-organizing map10.1007/s00521-019-04692-x ↗
16. Talmoudi, S., Kanada, T., and Hirata, Y. (2020). Tracking and visualizing signs of degradation for an early failure prediction of a rolling bearing. arXiv.
17. A new deep transfer learning based on sparse auto-encoder for fault diagnosis10.1109/TSMC.2017.2754287 ↗
18. Wen, T., and Keyes, R. (2019). Time Series Anomaly Detection Using Convolutional Neural Networks and Transfer Learning. arXiv.
19. Martínez-Arellano, G., and Ratchev, S. (2019, January 11–14). Towards an active learning approach to tool condition monitoring with bayesian deep learning. Proceedings of the ECMS 2019: 33rd International ECMS Conference on Modelling and Simulation, Caserta, Italy.10.7148/2019-0223 ↗
20. Zope, K., Singh, K., Nistala, S., Basak, A., Rathore, P., and Runkana, V. (2019). Anomaly detection and diagnosis in manufacturing systems: A comparative study of statistical, machine learning and deep learning techniques. Annu. Conf. PHM Soc., 11.10.36001/phmconf.2019.v11i1.815 ↗
21. An explainable artificial intelligence approach for unsupervised fault detection and diagnosis in rotating machinery10.1016/j.ymssp.2021.108105 ↗
22. A Study on Deep Learning Application of Vibration Data and Visualization of Defects for Predictive Maintenance of Gravity Acceleration Equipment10.3390/app11041564 ↗
23. Maschler, B., Vietz, H., Jazdi, N., and Weyrich, M. (2020, January 8–11). Continual learning of fault prediction for turbofan engines using deep learning with elastic weight consolidation. Proceedings of the 25th IEEE International Conference on Emerging Technologies and Factory Automation (ETFA), Vienna, Austria.10.1109/ETFA46521.2020.9211903 ↗
24. Deep industrial transfer learning at runtime for image recognition10.1515/auto-2020-0119 ↗
25. Olaizola Alberdi, J. (2020). Soft Sensor-Based Servo Press Monitoring. [Ph.D. Thesis, Mondragon Unibertsitatea].
26. Principal component analysis10.1016/0169-7439(87)80084-9 ↗
27. Extreme learning machine: Theory and applications10.1016/j.neucom.2005.12.126 ↗
28. One-class support vector machines approach to anomaly detection10.1080/08839514.2013.785791 ↗
29. Meire, M., and Karsmakers, P. (2019, January 18–21). Comparison of deep autoencoder architectures for real-time acoustic based anomaly detection in assets. Proceedings of the 10th IEEE International Conference on Intelligent Data Acquisition and Advanced Computing Systems: Technology and Applications (IDAACS), Metz, France.10.1109/IDAACS.2019.8924301 ↗
30. Zugasti, E., Iturbe, M., Garitano, I., and Zurutuza, U. (2018, January 4–7). Null is not always empty: Monitoring the null space for field-level anomaly detection in industrial IoT environments. Proceedings of the 2018 Global Internet of Things Summit (GIoTS), Bilbao, Spain.10.1109/GIOTS.2018.8534574 ↗
31. Visualizing data using t-SNE
32. OPTICS: Ordering points to identify the clustering structure10.1145/304181.304187 ↗
33. Mixture models: Theory, geometry and applications
34. The self-organizing map10.1109/5.58325 ↗
35. Lundberg, S.M., and Lee, S.I. (2017, January 4). A unified approach to interpreting model predictions. Proceedings of the 31st International Conference on Neural Information Processing Systems, Long Beach, CA, USA.
36. Lundberg, S. (2021, June 28). A Game Theoretic Approach to Explain the Output of Any Machine Learning Model. Github, Available online: https://github.com/slundberg/shap.
37. Axiomatic attribution for deep networks
38. Smilkov, D., Thorat, N., Kim, B., Viégas, F., and Wattenberg, M. (2017). Smoothgrad: Removing noise by adding noise. arXiv.
39. Tensorflow (2021, June 28). TensorFlow 2.3 documentation. Available online: https://devdocs.io/tensorflow~2.3/.
40. Scik-it learn (2021, June 28). Scik-it learn 0.23.2 documentation. Available online: https://scikit-learn.org/stable/whats_new/v0.23.html.
41. Vettigli, G. (2021, June 28). Minisom documentation - Minimalistic and NumPy-based implementation of the Self Organizing Map. Available online: https://github.com/JustGlowing/minisom.