journal article·2022-04-22Open access

Prediction of Machine Failure in Industry 4.0: A Hybrid CNN-LSTM Framework

Abdul Wahid, John G. Breslin, Muhammad Ali Intizar

Applied Sciences· Volume 12· Issue 9

Abstract

The proliferation of sensing technologies such as sensors has resulted in vast amounts of time-series data being produced by machines in industrial plants and factories. There is much information available that can be used to predict machine breakdown and degradation in a given factory. The downtime of industrial equipment accounts for heavy losses in revenue that can be reduced by making accurate failure predictions using the sensor data. Internet of Things (IoT) technologies have made it possible to collect sensor data in real time. We found that hybrid modelling can result in efficient predictions as they are capable of capturing the abstract features which facilitate better predictions. In addition, developing effective optimization strategy is difficult because of the complex nature of different sensor data in real time scenarios. This work proposes a method for multivariate time-series forecasting for predictive maintenance (PdM) based on a combination of convolutional neural networks and long short term memory with skip connection (CNN-LSTM). We experiment with CNN, LSTM, and CNN-LSTM forecasting models one by one for the prediction of machine failures. The data used in this experiment are from Microsoft’s case study. The dataset provides information about the failure history, maintenance history, error conditions, and machine features and telemetry, which consists of information such as voltage, pressure, vibration, and rotation sensor values recorded between 2015 and 2016. The proposed hybrid CNN-LSTM framework is a two-stage end-to-end model in which the LSTM is leveraged to analyze the relationships among different time-series data variables through its memory function, and 1-D CNNs are responsible for effective extraction of high-level features from the data. Our method learns the long-term patterns of the time series by extracting the short-term dependency patterns of different time-series variables. In our evaluation, CNN-LSTM provided the most reliable and highest prediction accuracy.
Source: crossref · Quality: baseline

Research context

OpenAlex topics: Industrial Vision Systems and Defect Detection · Currency Recognition and Detection · Anomaly Detection Techniques and Applications

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

Data Science Institute (DSI), National University of Ireland Galway, H91 TK33 Galway, Ireland

School of Electronic Engineering, Dublin City University, D09 W6Y4 Dublin, Ireland

Funding

Science Foundation Ireland

References (40)

Show source-provided references
1. Ran, Y., Zhou, X., Lin, P., Wen, Y., and Deng, R. (2019). A survey of predictive maintenance: Systems, purposes and approaches. arXiv.
2. Wiboonrat, M. (2020, January 27–29). Human Factors Psychology of Data Center Operations and Maintenance. Proceedings of the 2020 6th International Conference on Information Management (ICIM), London, UK.10.1109/ICIM49319.2020.244692 ↗
3. Current-based mechanical fault detection for direct-drive wind turbines via synchronous sampling and impulse detection10.1109/TIE.2014.2363440 ↗
4. The analytic hierarchy process applied to maintenance strategy selection10.1016/S0951-8320(00)00047-8 ↗
5. Sudharsan, B., Salerno, S., Nguyen, D.D., Yahya, M., Wahid, A., Yadav, P., Breslin, J.G., and Ali, M.I. (July, January 14). Tinyml benchmark: Executing fully connected neural networks on commodity microcontrollers. Proceedings of the 2021 IEEE 7th World Forum on Internet of Things (WF-IoT), New Orleans, LA, USA.10.1109/WF-IoT51360.2021.9595024 ↗
6. Applications of maintenance optimization models: A review and analysis10.1016/0951-8320(95)00076-3 ↗
7. Multi-level predictive maintenance for multi-component systems10.1016/j.ress.2015.07.017 ↗
8. Mobley, R.K. (2002). An Introduction to Predictive Maintenance, Elsevier.10.1016/B978-075067531-4/50006-3 ↗
9. Deep learning methods for sensor based predictive maintenance and future perspectives for electrochemical sensors10.1149/1945-7111/ab67a8 ↗
10. Big data analytics in industrial IoT using a concentric computing model10.1109/MCOM.2018.1700632 ↗
11. Deep learning and its applications to machine health monitoring10.1016/j.ymssp.2018.05.050 ↗
12. A review on the application of deep learning in system health management10.1016/j.ymssp.2017.11.024 ↗
13. Remadna, I., Terrissa, S.L., Zemouri, R., and Ayad, S. (2018, January 22–25). An overview on the deep learning based prognostic. Proceedings of the 2018 International Conference on Advanced Systems and Electric Technologies IC_ASET), Hammamet, Tunisia.10.1109/ASET.2018.8379858 ↗
14. A sparse auto-encoder-based deep neural network approach for induction motor faults classification10.1016/j.measurement.2016.04.007 ↗
15. Machine health monitoring using local feature-based gated recurrent unit networks10.1109/TIE.2017.2733438 ↗
16. Remaining useful life estimation of engineered systems using vanilla LSTM neural networks10.1016/j.neucom.2017.05.063 ↗
17. Dasgupta, S., and Osogami, T. (2017, January 4–9). Nonlinear dynamic Boltzmann machines for time-series prediction. Proceedings of the AAAI Conference on Artificial Intelligence, San Francisco, CA, USA.10.1609/aaai.v31i1.10806 ↗
18. Hybrid neural network models for hydrologic time series forecasting10.1016/j.asoc.2006.03.002 ↗
19. Manufacturing analytics and industrial internet of things10.1109/MIS.2017.49 ↗
20. Machine learning approaches to manufacturing10.1016/S0007-8506(18)30216-6 ↗
21. Machine learning in manufacturing: Advantages, challenges, and applications
22. Deep learning for smart manufacturing: Methods and applications10.1016/j.jmsy.2018.01.003 ↗
23. Yahya, M., Shah, J.A., Warsi, A., Kadir, K., Khan, S., and Izani, M. (2018). Real time elbow angle estimation using single RGB camera. arXiv.10.20944/preprints201808.0407.v1 ↗
24. Learning Deep Architectures10.1561/2200000006 ↗
25. Long short-term memory10.1162/neco.1997.9.8.1735 ↗
26. Dyer, C., Ballesteros, M., Ling, W., Matthews, A., and Smith, N.A. (2015). Transition-based dependency parsing with stack long short-term memory. arXiv.10.3115/v1/P15-1033 ↗
27. Tai, K.S., Socher, R., and Manning, C.D. (2015). Improved semantic representations from tree-structured long short-term memory networks. arXiv.10.3115/v1/P15-1150 ↗
28. Short-term residential load forecasting based on LSTM recurrent neural network10.1109/TSG.2017.2753802 ↗
29. Dong, X., Qian, L., and Huang, L. (2017, January 13–16). Short-term load forecasting in smart grid: A combined CNN and K-means clustering approach. Proceedings of the 2017 IEEE international conference on big data and smart computing (BigComp), Jeju, Korea.
30. Vibration-based anomaly detection using LSTM/SVM approaches10.1016/j.ymssp.2021.108752 ↗
31. Bearing fault diagnosis using transfer learning and optimized deep belief network
32. Tagawa, Y., Maskeliūnas, R., and Damaševičius, R. (2021). Acoustic Anomaly Detection of Mechanical Failures in Noisy Real-Life Factory Environments. Electronics, 10.10.3390/electronics10192329 ↗
33. Mabkhot, M.M., Al-Ahmari, A.M., Salah, B., and Alkhalefah, H. (2018). Requirements of the smart factory system: A survey and perspective. Machines, 6.10.3390/machines6020023 ↗
34. Smart factory of industry 4.0: Key technologies, application case, and challenges10.1109/ACCESS.2017.2783682 ↗
35. Yahya, M., Breslin, J.G., and Ali, M.I. (2021). Semantic Web and Knowledge Graphs for Industry 4.0. Appl. Sci., 11.10.3390/app11115110 ↗
36. Gradient-based learning applied to document recognition10.1109/5.726791 ↗
37. Deep learning10.1038/nature14539 ↗
38. Zhu, T., Luo, C., Zhang, Z., Li, J., Ren, S., and Zeng, Y. (2022). Minority oversampling for imbalanced time series classification. Knowl.-Based Syst.10.1016/j.knosys.2022.108764 ↗
39. Fulcher, B.D. (2018). Feature-based time-series analysis. Feature Engineering for Machine Learning and Data Analytics, CRC Press.10.1201/9781315181080-4 ↗
40. Kingma, P.D., and Ba, J. (2014). Adam: A method for stochastic optimization. arXiv.