journal article·2021-12-02Open access

Classifying Multivariate Signals in Rolling Bearing Fault Detection Using Adaptive Wide-Kernel CNNs

Jurgen van den Hoogen, Stefan Bloemheuvel, Martin Atzmueller

Applied Sciences· Volume 11· Issue 23

Abstract

With the developments in improved computation power and the vast amount of (automatic) data collection, industry has become more data-driven. These data-driven approaches for monitoring processes and machinery require different modeling methods focusing on automated learning and deployment. In this context, deep learning provides possibilities for industrial diagnostics to achieve improved performance and efficiency. These deep learning applications can be used to automatically extract features during training, eliminating time-consuming feature engineering and prior understanding of sophisticated (signal) processing techniques. This paper extends on previous work, introducing one-dimensional (1D) CNN architectures that utilize an adaptive wide-kernel layer to improve classification of multivariate signals, e.g., time series classification in fault detection and condition monitoring context. We used multiple prominent benchmark datasets for rolling bearing fault detection to determine the performance of the proposed wide-kernel CNN architectures in different settings. For example, distinctive experimental conditions were tested with deviating amounts of training data. We shed light on the performance of these models compared to traditional machine learning applications and explain different approaches to handle multivariate signals with deep learning. Our proposed models show promising results for classifying different fault conditions of rolling bearing elements and their respective machine condition, while using a fairly straightforward 1D CNN architecture with minimal data preprocessing. Thus, using a 1D CNN with an adaptive wide-kernel layer seems well-suited for fault detection and condition monitoring. In addition, this paper clearly indicates the high potential performance of deep learning compared to traditional machine learning, particularly in complex multivariate and multi-class classification tasks.
Source: crossref · Quality: baseline

Research context

OpenAlex topics: Machine Fault Diagnosis Techniques · Fault Detection and Control Systems · Anomaly Detection Techniques and Applications

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

Department of Cognitive Science and Artificial Intelligence, Tilburg University, 5000 LE Tilburg, The Netherlands

Jheronimus Academy of Data Science, 5211 DA ’s-Hertogenbosch, The Netherlands

Semantic Information Systems Group, Osnabrück University, 49074 Osnabrück, Germany

References (63)

Show source-provided references
2. Big Data Analytics for Proactive Industrial Decision Support10.17560/atp.v58i09.2315 ↗
3. Deep convolutional neural network based planet bearing fault classification10.1016/j.compind.2019.02.001 ↗
4. Deep learning and its applications to machine health monitoring10.1016/j.ymssp.2018.05.050 ↗
5. Kim, S., An, D., and Choi, J.H. (2020). Diagnostics 101: A Tutorial for Fault Diagnostics of Rolling Element Bearing Using Envelope Analysis in MATLAB. Appl. Sci., 10.10.3390/app10207302 ↗
6. Bearing fault model for induction motor with externally induced vibration10.1109/TIE.2012.2213566 ↗
7. An intelligent fault diagnosis method using unsupervised feature learning towards mechanical big data10.1109/TIE.2016.2519325 ↗
8. Lessmeier, C., Kimotho, J.K., Zimmer, D., and Sextro, W. (2016, January 5–8). Condition monitoring of bearing damage in electromechanical drive systems by using motor current signals of electric motors: A benchmark data set for data-driven classification. Proceedings of the PHM Society European Conference, Bilbao, Spain.10.36001/phme.2016.v3i1.1577 ↗
9. A convolutional neural network based feature learning and fault diagnosis method for the condition monitoring of gearbox10.1016/j.measurement.2017.07.017 ↗
10. Zhang, W., Peng, G., Li, C., Chen, Y., and Zhang, Z. (2017). A new deep learning model for fault diagnosis with good anti-noise and domain adaptation ability on raw vibration signals. Sensors, 17.10.20944/preprints201701.0132.v1 ↗
11. van den Hoogen, J., Bloemheuvel, S., and Atzmueller, M. (2020, January 17–20). An Improved Wide-Kernel CNN for Classifying Multivariate Signals in Fault Diagnosis. Proceedings of the 2020 International Conference on Data Mining Workshops (ICDMW), Sorrento, Italy.10.1109/ICDMW51313.2020.00046 ↗
12. Mobley, R.K. (2002). An Introduction to Predictive Maintenance, Elsevier.10.1016/B978-075067531-4/50006-3 ↗
13. The role of maintenance in improving companies’ productivity and profitability10.1016/j.ijpe.2004.06.057 ↗
14. A review on machinery diagnostics and prognostics implementing condition-based maintenance10.1016/j.ymssp.2005.09.012 ↗
15. Arts, J. (2017). Maintenance Modeling and Optimization, TU/e Eindhoven.
16. Vollert, S., Atzmueller, M., and Theissler, A. (2021, January 7–10). Interpretable Machine Learning: A brief survey from the predictive maintenance perspective. Proceedings of the IEEE International Conference on Emerging Technologies and Factory Automation (ETFA 2021), Vasteras, Sweden.10.1109/ETFA45728.2021.9613467 ↗
17. Vollert, S., and Theissler, A. (2021, January 7–10). Challenges of machine learning-based RUL prognosis: A review on NASA’s C-MAPSS data set. Proceedings of the IEEE International Conference on Emerging Technologies and Factory Automation (ETFA 2021), Vasteras, Sweden.10.1109/ETFA45728.2021.9613682 ↗
18. Motor Reliability Working Group (1985). Report of large motor reliability survey of industrial and commercial installations, Part I. IEEE Trans. Ind. Appl., 1, 865–872.10.1109/TIA.1985.349533 ↗
19. Data-based techniques focused on modern industry: An overview10.1109/TIE.2014.2308133 ↗
20. Pandhare, V., Singh, J., and Lee, J. (2019, January 2–5). Convolutional Neural Network Based Rolling-Element Bearing Fault Diagnosis for Naturally Occurring and Progressing Defects Using Time-Frequency Domain Features. Proceedings of the 2019 Prognostics and System Health Management Conference (PHM-Paris), Paris, France.10.1109/PHM-Paris.2019.00061 ↗
21. WPD-PCA-based laser welding process monitoring and defects diagnosis by using FNN and SVM10.1109/TIE.2014.2319216 ↗
22. Guo, S., Yang, T., Gao, W., and Zhang, C. (2018). A novel fault diagnosis method for rotating machinery based on a convolutional neural network. Sensors, 18.10.3390/s18051429 ↗
23. Atzmueller, M., Hayat, N., Schmidt, A., and Klöpper, B. (2017, January 24–26). Explanation-Aware Feature Selection using Symbolic Time Series Abstraction: Approaches and Experiences in a Petro-Chemical Production Context. Proceedings of the IEEE International Conference on Industrial Informatics, Emden, Germany.10.1109/INDIN.2017.8104875 ↗
24. PCA-based feature selection scheme for machine defect classification10.1109/TIM.2004.834070 ↗
25. Zhang, X., Xu, R., Kwan, C., Liang, S.Y., Xie, Q., and Haynes, L. (2005, January 8–10). An integrated approach to bearing fault diagnostics and prognostics. Proceedings of the 2005 IEEE American Control Conference, Portland, OR, USA.
26. Motor bearing fault diagnosis using trace ratio linear discriminant analysis10.1109/TIE.2013.2273471 ↗
27. Jiang, Q., Shen, Y., Li, H., and Xu, F. (2018). New fault recognition method for rotary machinery based on information entropy and a probabilistic neural network. Sensors, 18.10.3390/s18020337 ↗
28. Fault diagnosis of rolling element bearing with intrinsic mode function of acoustic emission data using APF-KNN10.1016/j.eswa.2013.01.033 ↗
29. Fault Detection Using Random Projections and k-Nearest Neighbor Rule for Semiconductor Manufacturing Processes10.1109/TSM.2014.2374339 ↗
30. Support vector machine with genetic algorithm for machinery fault diagnosis of high voltage circuit breaker10.1016/j.measurement.2011.02.017 ↗
31. Bearing fault detection of induction motor using wavelet and Support Vector Machines (SVMs)10.1016/j.asoc.2011.03.014 ↗
32. An SVM-based solution for fault detection in wind turbines10.3390/s150305627 ↗
33. A neural network approach to real-time condition monitoring of induction motors10.1109/41.107100 ↗
34. Robust Diagnosis of Rolling Element Bearings Based on Classification Techniques10.1109/TII.2012.2231084 ↗
35. Fault Diagnosis of a Rolling Bearing Using Wavelet Packet Denoising and Random Forests10.1109/JSEN.2017.2726011 ↗
36. Learning representations by back-propagating errors10.1038/323533a0 ↗
37. Malhotra, P., Ramakrishnan, A., Anand, G., Vig, L., Agarwal, P., and Shroff, G. (2016). LSTM-based encoder-decoder for multi-sensor anomaly detection. arXiv.
38. Yao, P., Yang, S., and Li, P. (2021, January 12–14). Fault Diagnosis Based on RseNet-LSTM for Industrial Process. Proceedings of the 2021 IEEE 5th Advanced Information Technology, Electronic and Automation Control Conference (IAEAC), Chongqing, China.10.1109/IAEAC50856.2021.9391030 ↗
39. Fault diagnosis of rolling bearings with recurrent neural network-based autoencoders10.1016/j.isatra.2018.04.005 ↗
40. Application and comparison of an ANN-based feature selection method and the genetic algorithm in gearbox fault diagnosis10.1016/j.eswa.2011.02.065 ↗
41. Zhang, W., Peng, G., and Li, C. (2017). Rolling element bearings fault intelligent diagnosis based on convolutional neural networks using raw sensing signal. Advances in Intelligent Information Hiding and Multimedia Signal Processing, Springer.10.1007/978-3-319-50212-0_10 ↗
42. Liu, Y., Yan, X., Zhang, C.A., and Liu, W. (2019). An Ensemble Convolutional Neural Networks for Bearing Fault Diagnosis Using Multi-Sensor Data. Sensors, 19.10.3390/s19235300 ↗
43. Intelligent fault diagnosis method of planetary gearboxes based on convolution neural network and discrete wavelet transform10.1016/j.compind.2018.11.003 ↗
44. Real-time motor fault detection by 1-D convolutional neural networks10.1109/TIE.2016.2582729 ↗
45. Limited data rolling bearing fault diagnosis with few-shot learning10.1109/ACCESS.2019.2934233 ↗
46. Simonyan, K., and Zisserman, A. (2014). Very deep convolutional networks for large-scale image recognition. arXiv.
47. LeCun, Y., and Bengio, Y. (1995). Convolutional networks for images, speech, and time series. The Handbook of Brain Theory and Neural Networks, MIT Press.
48. Goodfellow, I., Bengio, Y., and Courville, A. (2016). Deep Learning, MIT Press.
49. Vidaña-Vila, E., Navarro, J., Borda-Fortuny, C., Stowell, D., and Alsina-Pagès, R.M. (2020). Low-Cost Distributed Acoustic Sensor Network for Real-Time Urban Sound Monitoring. Electronics, 9.10.3390/electronics9122119 ↗
50. Rolling element bearing fault diagnosis using convolutional neural network and vibration image10.1016/j.cogsys.2018.03.002 ↗
51. Gulcehre, C., Moczulski, M., Denil, M., and Bengio, Y. (2016, January 20–22). Noisy activation functions. Proceedings of the International Conference on Machine Learning, PMLR, New York, NY, USA.
52. Ioffe, S., and Szegedy, C. (2015). Batch normalization: Accelerating deep network training by reducing internal covariate shift. arXiv.
53. Kingma, D.P., and Ba, J. (2014). Adam: A method for stochastic optimization. arXiv.
54. (2020, January 14). CWRU Dataset; Case Western Reserve University Bearing Data Center. Available online: https://csegroups.case.edu/bearingdatacenter/home.
55. Estimation of the Running Speed and Bearing Defect Frequencies of an Induction Motor from Vibration Data10.1016/S0888-3270(03)00052-9 ↗
56. Bearing Fault Detection and Diagnosis Using Case Western Reserve University Dataset with Deep Learning Approaches: A Review10.1109/ACCESS.2020.2990528 ↗
57. Liu, X., Huang, H., and Xiang, J. (2020). A personalized diagnosis method to detect faults in a bearing based on acceleration sensors and an FEM simulation driving support vector machine. Sensors, 20.10.3390/s20020420 ↗
58. Piltan, F., and Kim, J.M. (2020, January 21–23). SVM-Based Hybrid Robust PIO Fault Diagnosis for Bearing. Proceedings of the International Conference on Intelligent and Fuzzy Systems, Istanbul, Turkey.10.1007/978-3-030-51156-2_99 ↗
59. Tong, Z., Li, W., Zhang, B., and Zhang, M. (2018). Bearing fault diagnosis based on domain adaptation using transferable features under different working conditions. Shock Vib., 2018.10.1155/2018/6714520 ↗
60. Mazilu, S., Calatroni, A., Gazit, E., Roggen, D., Hausdorff, J.M., and Tröster, G. (2013, January 19–25). Feature learning for detection and prediction of freezing of gait in Parkinson’s disease. Proceedings of the International Workshop on Machine Learning and Data Mining in Pattern Recognition, New York, NY, USA.10.1007/978-3-642-39712-7_11 ↗
61. Masiala, S., Huijbers, W., and Atzmueller, M. (2019). Feature-Set-Engineering for Detecting Freezing of Gait in Parkinson’s Disease using Deep Recurrent Neural Networks. arXiv.
62. Tang, Y., Xu, J., Matsumoto, K., and Ono, C. (2016, January 12–15). Sequence-to-Sequence Model with Attention for Time Series Classification. Proceedings of the 2016 IEEE 16th International Conference on Data Mining Workshops (ICDMW), Barcelona, Spain.10.1109/ICDMW.2016.0078 ↗
63. Du, Q., Gu, W., Zhang, L., and Huang, S.L. (2018, January 4–7). Attention-based LSTM-CNNs for time-series classification. Proceedings of the 16th ACM Conference on Embedded Networked Sensor Systems, Shenzhen, China.10.1145/3274783.3275208 ↗