journal article·2024-06-05Open access

An Efficient Approach for Automatic Fault Classification Based on Data Balance and One-Dimensional Deep Learning

Ugur Ileri, Yusuf Altun, Ali Narin

Applied Sciences· Volume 14· Issue 11

Abstract

Predictive maintenance (PdM) is implemented to efficiently manage maintenance schedules of machinery and equipment in manufacturing by predicting potential faults with advanced technologies such as sensors, data analysis, and machine learning algorithms. This paper introduces a study of different methodologies for automatically classifying the failures in PdM data. We first present the performance evaluation of fault classification performed by shallow machine learning (SML) methods such as Decision Trees, Support Vector Machines, k-Nearest Neighbors, and one-dimensional deep learning (DL) techniques like 1D-LeNet, 1D-AlexNet, and 1D-VGG16. Then, we apply normalization, which is a scaling technique in which features are shifted and rescaled in the dataset. We reapply classification algorithms to the normalized dataset and present the performance tables in comparison with the first results we obtained. Moreover, in contrast to existing studies in the literature, we generate balanced dataset groups by randomly selecting normal data and all faulty data for all fault types from the original dataset. The dataset groups are generated with 100 different repetitions, recording performance scores for each one and presenting the maximum scores. All methods utilized in the study are similarly employed on these groups. From these scores, the use of 1D-LeNet deep learning classifiers and feature normalization resulted in achieving the highest overall accuracy and F1-score performance of 98.50% and 98.32%, respectively. As a result, the goal of this study was to develop an efficient approach for automatic fault classification, leveraging data balance, and additionally, to provide an analysis of one-dimensional deep learning and shallow machine learning-based classification methods. In light of the experimentation and comparative analysis, this study successfully achieves its stated goal by demonstrating that one-dimensional deep learning and data balance collectively emerge as the optimal approach, offering good prediction accuracy.
Source: crossref · Quality: baseline

Research context

OpenAlex topics: Anomaly Detection Techniques and Applications · Imbalanced Data Classification Techniques · Machine Fault Diagnosis Techniques

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

Department of Electrical-Electronics and Computer Engineering, Institute of Science, Duzce University, Duzce 81620, Turkey

Department of Computer Engineering, Engineering Faculty, Duzce University, Duzce 81620, Turkey

Department of Electrical and Electronics Engineering, Engineering Faculty, Zonguldak Bulent Ecevit University, Zonguldak 67100, Turkey

References (59)

Show source-provided references
1. Vermesan, O., and Friess, P. (2013). Internet of Things: Converging Technologies for Smart Environments and Integrated Ecosystems, River Publishers.
2. Characteristics and Skills of Leadership in the Context of Industry 4.010.1016/j.promfg.2020.02.167 ↗
3. KSPMI: A knowledge-based system for predictive maintenance in industry 4.010.1016/j.rcim.2021.102281 ↗
4. Li, Z. (2018). Deep Learning Driven Approaches for Predictive Maintenance: A Framework of Intelligent Fault Diagnosis and Prognosis in the Industry 4.0 Era. [Ph.D. Thesis, Norwegian University of Science and Technology].
5. Levitt, J. (2003). Complete Guide to Preventive and Predictive Maintenance, Industrial Press Inc.
6. Achouch, M., Dimitrova, M., Dhouib, R., Ibrahim, H., Adda, M., Sattarpanah Karganroudi, S., Ziane, K., and Aminzadeh, A. (2023). Predictive Maintenance and Fault Monitoring Enabled by Machine Learning: Experimental Analysis of a TA-48 Multistage Centrifugal Plant Compressor. Appl. Sci., 13.10.3390/app13031790 ↗
7. Maintenance strategy selection and its impact in maintenance function: A conceptual framework10.1108/IJOPM-01-2014-0028 ↗
8. Initiating predictive maintenance for a conveyor motor in a bottling plant using industry 4.0 concepts10.1007/s00170-018-2093-8 ↗
9. Machine performance monitoring and proactive maintenance in computer-integrated manufacturing: Review and perspective10.1080/09511929508944664 ↗
10. Human-centred dissemination of data, information and knowledge in industry 4.010.1016/j.procir.2019.04.261 ↗
11. SVM practical industrial application for mechanical faults diagnostic10.1016/j.eswa.2010.12.017 ↗
12. Fault diagnosis and prognosis using wavelet packet decomposition, Fourier transform and artificial neural network10.1007/s10845-012-0657-2 ↗
13. Divisional fault diagnosis of large-scale power systems based on radial basis function neural network and fuzzy integral10.1016/j.epsr.2013.07.005 ↗
14. Feature extraction using wavelets and classification through decision tree algorithm for fault diagnosis of mono-block centrifugal pump10.1016/j.measurement.2012.07.007 ↗
15. Classifying machinery condition using oil samples and binary logistic regression10.1016/j.ymssp.2014.12.020 ↗
16. Bearing fault detection of induction motor using wavelet and Support Vector Machines (SVMs)10.1016/j.asoc.2011.03.014 ↗
17. Intelligent bearing performance degradation assessment and remaining useful life prediction based on self-organising map and support vector regression10.1177/0954406217700180 ↗
18. Orrù, P.F., Zoccheddu, A., Sassu, L., Mattia, C., Cozza, R., and Arena, S. (2020). Machine Learning Approach Using MLP and SVM Algorithms for the Fault Prediction of a Centrifugal Pump in the Oil and Gas Industry. Sustainability, 12.10.3390/su12114776 ↗
19. Vibration analysis in bearings for failure prevention using CNN10.1007/s40430-020-02711-w ↗
20. Application of BP Neural Network and Convolutional Neural Network (CNN) in Bearing Fault Diagnosis
21. Fault diagnosis for building chillers based on data self-production and deep convolutional neural network10.1016/j.jobe.2020.102043 ↗
22. Dynamic Ensemble Selection Based Improved Random Forests for Fault Classification in Industrial Processes10.1016/j.ifacsc.2022.100189 ↗
23. Matzka, S. (2020, January 21–23). Explainable artificial intelligence for predictive maintenance applications. Proceedings of the Third International Conference on Artificial Intelligence for Industries, Irvine, CA, USA.10.1109/AI4I49448.2020.00023 ↗
24. Matzka, S. (2021, December 22). AI4I 2020 Predictive Maintenance Dataset. UCI Machine Learning Repository. Available online: www.explorate.ai/dataset/predictiveMaintenanceDataset.csv.
25. Azeri, N., Hioual, O., and Hioual, O. (2022, January 12–13). Towards an Approach for Modeling and Architecting of Self-Adaptive Cyber-Physical Systems. Proceedings of the 2022 4th International Conference on Pattern Analysis and Intelligent Systems (PAIS), Oum El Bouaghi, Algeria.10.1109/PAIS56586.2022.9946921 ↗
26. Han, J., Kamber, M., and Pei, J. (2011). Data Mining: Concepts and Techniques, Morgan Kaufmann Publisher. [3rd ed.].
27. Bhanja, S., and Das, A. (2018). Impact of Data Normalization on Deep Neural Network for Time Series Forecasting. arXiv.
28. Quinlan, J.R. (2014). C4. 5: Programs for Machine Learning, Elsevier.
29. Data mining to improve personnel selection and enhance human capital: A case study in high-technology industry10.1016/j.eswa.2006.09.003 ↗
30. An overview of statistical learning theory10.1109/72.788640 ↗
31. Nearest Neighbor pattern classification10.1109/TIT.1967.1053964 ↗
32. Convolutional Neural Network for Monocular Vision-based Multi-target Tracking10.1007/s12555-018-0134-6 ↗
33. Real-time Depth Estimation Using Recurrent CNN with Sparse Depth Cues for SLAM System10.1007/s12555-019-0350-8 ↗
34. Deep Learning: Methods and Applications10.1561/2000000039 ↗
35. Song, H.A., and Lee, S.Y. (2013). International Conference on Neural Information Processing, Springer.
36. Fault detection and severity identification of ball bearings by online condition monitoring10.1109/TIE.2018.2886789 ↗
37. Handwritten digit recognition: Applications of neural network chips and automatic learning10.1109/35.41400 ↗
38. Imagenet classification with deep convolutional neural networks10.1145/3065386 ↗
39. Simonyan, K., and Zisserman, A. (2014). Very deep convolutional networks for large-scale image recognition. arXiv.
40. Wu, Y., Yang, F., Liu, Y., Zha, X., and Yuan, S. (2018). A comparison of 1-D and 2-D deep convolutional neural networks in ECG classification. arXiv.
41. Application of a new one-dimensional deep convolutional neural network for intelligent fault diagnosis of rolling bearings10.1177/0036850420951394 ↗
42. Gradient-based learning applied to document recognition10.1109/5.726791 ↗
43. Bearing fault detection by one-dimensional convolutional neural networks10.1155/2017/8617315 ↗
44. Local Binary Patterns10.4249/scholarpedia.9775 ↗
45. Sensitivity Analysis of k-Fold Cross Validation in Prediction Error Estimation10.1109/TPAMI.2009.187 ↗
46. A study of the behavior of several methods for balancing machine learning training data10.1145/1007730.1007735 ↗
47. A review on evaluation metrics for data classification evaluations10.5121/ijdkp.2015.5201 ↗
48. Pastorino, J., and Biswas, A.K. (2021, January 1–3). Data-Blind ML: Building privacy-aware machine learning models without direct data access. Proceedings of the IEEE Fourth International Conference on Artificial Intelligence and Knowledge Engineering, Laguna Hills, CA, USA.10.1109/AIKE52691.2021.00020 ↗
49. Torcianti, A., and Matzka, S. (2021, January 20–22). Explainable Artificial Intelligence for Predictive Maintenance Applications using a Local Surrogate Model. Proceedings of the 4th International Conference on Artificial Intelligence for Industries, Laguna Hills, CA, USA.10.1109/AI4I51902.2021.00029 ↗
50. Mota, B., Faria, P., and Ramos, C. (2022, January 5–7). Predictive Maintenance for Maintenance-Effective Manufacturing Using Machine Learning Approaches. Proceedings of the 17th International Conference on Soft Computing Models in Industrial and Environmental Applications, Salamanca, Spain. Lecture Notes in Networks and Systems.10.1007/978-3-031-18050-7_2 ↗
51. Vandereycken, B., and Voorhaar, R. (2022). TTML: Tensor trains for general supervised machine learning. arXiv.
52. Chen, C.-H., Tsung, C.-K., and Yu, S.-S. (2022). Designing a Hybrid Equipment-Failure Diagnosis Mechanism under Mixed-Type Data with Limited Failure Samples. Appl. Sci., 12.10.3390/app12189286 ↗
53. Vuttipittayamongkol, P., and Arreeras, T. (2022, January 7–10). Data-driven Industrial Machine Failure Detection in Imbalanced Environments. Proceedings of the IEEE International Conference on Industrial Engineering and Engineering Management, Kuala Lumpur, Malaysia.10.1109/IEEM55944.2022.9989673 ↗
54. Equipment Activity Recognition and Early Fault Detection in Automated Construction through a Hybrid Machine Learning Framework10.1111/mice.12848 ↗
55. Sharma, N., Sidana, T., Singhal, S., and Jindal, S. (2022, January 19–20). Predictive Maintenance: Comparative Study of Machine Learning Algorithms for Fault Diagnosis. Proceedings of the Proceedings of the International Conference on Innovative Computing & Communication (ICICC), Delhi, India.10.2139/ssrn.4143868 ↗
56. Iantovics, L.B., and Enăchescu, C. (2022). Method for Data Quality Assessment of Synthetic Industrial Data. Sensors, 22.10.3390/s22041608 ↗
57. Clustering by Constructing Hyper-Planes10.1109/ACCESS.2021.3078584 ↗
58. EFNC-Exp: An evolving fuzzy neural classifier integrating expert rules and uncertainty10.1016/j.fss.2022.11.009 ↗
59. A Simplified Approach for Data Filling in Incomplete Soft Sets10.1016/j.eswa.2022.119248 ↗