journal article·2024-04-15Open access

Impacts of Feature Selection on Predicting Machine Failures by Machine Learning Algorithms

Francisco Elânio Bezerra, Geraldo Cardoso de Oliveira Neto, Gabriel Magalhães Cervi, Rafaella Francesconi Mazetto, Aline Mariane de Faria, Marcos Vido, Gustavo Araujo Lima, Sidnei Alves de Araújo, Mauro Sampaio, Marlene Amorim

Applied Sciences· Volume 14· Issue 8

Abstract

In the context of Industry 4.0, managing large amounts of data is essential to ensure informed decision-making in intelligent production environments. It enables, for example, predictive maintenance, which is essential for anticipating and identifying causes of failures in machines and equipment, optimizing processes, and promoting proactive management of human, financial, and material resources. However, generating accurate information for decision-making requires adopting suitable data preprocessing and analysis techniques. This study explores the identification of machine failures based on synthetic industrial data. Initially, we applied the feature selection techniques Principal Component Analysis (PCA), Minimum Redundancy Maximum Relevance (mRMR), Neighborhood Component Analysis (NCA), and Denoising Autoencoder (DAE) to the collected data and compared their results. In the sequence, a comparison among three widely known machine learning classifiers, namely Random Forest (RF), Support Vector Machine (SVM), and Multilayer Perceptron neural network (MLP), was conducted, with and without considering feature selection. The results showed that PCA and RF were superior to the other techniques, allowing the classification of failures with rates of 0.98, 0.97, and 0.98 for the accuracy, precision, and recall metrics, respectively. Thus, this work contributes by solving an industrial problem and detailing techniques to identify the most relevant variables and machine learning algorithms for predicting machine failures that negatively impact production planning. The findings provided by this study can assist industries in giving preference to employing sensors and collecting data that can contribute more effectively to machine failure predictions.
Source: crossref · Quality: baseline

Research context

OpenAlex topics: Industrial Vision Systems and Defect Detection · Spectroscopy and Chemometric Analyses · Fault Detection and Control Systems

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

Department of Energy Engineering and Electrical Automation, Polytechnic School, University of São Paulo (USP), 158 Prof. Luciano Gualberto Avenue, São Paulo 05508-010, Brazil

Industrial Engineering Post Graduation Program, Federal University of ABC, Alameda da Universidade, s/nº Bairro Anchieta, São Bernardo do Campo, São Paulo 09606-045, Brazil

Business Administration Post-Graduation Program, FEI University, Tamandaré Street 688, 5 Floor, São Paulo 01525-000, Brazil

Industrial Engineering Post-Graduation Program, Nove de Julho University (UNINOVE), Vergueiro Street 235/249, São Paulo 01504-001, Brazil

Informatics and Knowledge Management Post-Graduation Program, Nove de Julho University (UNINOVE), Vergueiro Street 235/249, São Paulo 01504-001, Brazil

Industrial Engineering Post-Graduation Program, FEI University, Avenue Humberto de Alencar Castelo Branco 3972-B, São Bernardo do Campo, Assunção 09850-901, Brazil

GOVCOPP-DEGEIT, University of Aveiro, 3810-193 Aveiro, Portugal

Funding

FCT—Fundação para a Ciência e a Tecnologia · CNPq Conselho Nacional de Desenvolvimento Científico e Tecnológico–Research funding in Productivity

References (34)

Show source-provided references
1. Significance of sensors for industry 4.0: Roles, capabilities, and applications10.1016/j.sintl.2021.100110 ↗
2. Effects of data set features on the performances of classification algorithms10.1016/j.eswa.2012.09.017 ↗
3. Business Intelligence Through Big Data Analytics, Data Mining and Machine Learning
4. Predictive maintenance in the Industry 4.0: A systematic literature review10.1016/j.cie.2020.106889 ↗
5. Pech, M., Vrchota, J., and Bednář, J. (2021). Predictive Maintenance and Intelligent Sensors in Smart Factory: Review. Sensors, 21.10.3390/s21041470 ↗
6. Natanael, D., and Sutanto, H. (2022). Machine Learning Application Using Cost-Effective Components for Predictive Maintenance in Industry: A Tube Filling Machine Case Study. J. Manuf. Mater. Process., 6.10.3390/jmmp6050108 ↗
7. An industry maturity model for implementing Machine Learning operations in manufacturing10.4995/ijpme.2023.19138 ↗
8. Tang, J., Alelyani, S., and Liu, H. (2014). Data Classification: Algorithms and Applications, CRC Press.
9. Bearing fault diagnosis using multiclass support vector machine with efficient feature selection methods
10. Dissecting a data-driven prognostic pipeline: A powertrain use case10.1016/j.eswa.2021.115109 ↗
11. A hybrid intelligent approach for classification of incipient faults in transmission network10.1109/TPWRD.2019.2924840 ↗
12. Jemai, J., and Zarrad, A. (2023). Feature Selection Engineering for Credit Risk Assessment in Retail Banking. Information, 14.10.3390/info14030200 ↗
13. Feature Selection for Classification using Principal Component Analysis and Information Gain10.1016/j.eswa.2021.114765 ↗
14. A review of feature selection techniques in bioinformatics10.1093/bioinformatics/btm344 ↗
15. Khalid, S., Khalil, T., and Nasreen, S. (2014, January 27–29). A Survey of Feature Selection and Feature Extraction Techniques in Machine Learning. Proceedings of the 2014 Science and Information Conference, London, UK.10.1109/SAI.2014.6918213 ↗
16. Feature selection based on mutual information: Criteria of max-dependency, max-relevance, and min-redundancy10.1109/TPAMI.2005.159 ↗
17. Dimensionality Reduction of Data with Neighbourhood Components Analysis
18. On lines and planes of closest fit to systems of points in space10.1080/14786440109462720 ↗
19. A PCA-based variable ranking and selection approach for electric energy load forecasting10.1108/IJESM-12-2019-0009 ↗
20. Disease spreading in complex networks: A numerical study with principal component analysis10.1016/j.eswa.2017.12.021 ↗
21. Vincent, P., Larochelle, H., Bengio, Y., and Manzagol, P.-A. (2008, January 5–9). Extracting and Composing Robust Features with Denoising Autoencoders. Proceedings of the 25th International Conference on Machine Learning (ICML′08), Helsinki, Finland.10.1145/1390156.1390294 ↗
22. Lei, Y., and Liu, H. (2003, January 21–24). Feature selection for high-dimensional data: A fast correlation-based filter solution. Proceedings of the 20th International Conference on Machine Learning (ICML-03), Washington, DC, USA.
23. Internet of Things (IoT)
24. Logistic-ELM: A novel fault diagnosis method for rolling bearings10.1007/s40430-022-03837-9 ↗
25. An SVM-based classifier for estimating the state of various rotating components in agro-industrial machinery with a vibration signal acquired from a single point on the machine chassis10.3390/s141120713 ↗
26. Prediction model of the failure mode of beam-column joints using machine learning methods10.1016/j.engfailanal.2020.105072 ↗
27. Predicting Forced Blower Failures Using Machine Learning Algorithms and Vibration Data for Effective Maintenance Strategies10.1007/s11668-023-01765-x ↗
28. Machine failure prediction using joint reserve intelligence with feature selection technique
29. Lee, X.Y., Kumar, A., Vidyaratne, L., Rao, A.R., Farahat, A., and Gupta, C. (2023, January 5–7). An ensemble of convolution-based methods for fault detection using vibration signals. Proceedings of the 2023 IEEE International Conference on Prognostics and Health Management (ICPHM), Montreal, QC, Canada.10.1109/ICPHM57936.2023.10194112 ↗
30. Hybrid feature selection and support vector machine framework for predicting maintenance failures10.35784/acs-2023-18 ↗
31. A methodological approach for detecting multiple faults in wind turbine blades based on vibration signals and machine learning10.1515/cls-2022-0214 ↗
32. Matzka, S. (2020, January 21–23). Explainable artificial intelligence for predictive maintenance applications. Proceedings of the 2020 Third International Conference on Artificial Intelligence for Industries (AI4I), Irvine, CA, USA.10.1109/AI4I49448.2020.00023 ↗
33. Random Forests10.1023/A:1010933404324 ↗
34. Novel Approach in Determining Neural Networks Architecture to Classify Data with Large Number of Attributes10.1109/ACCESS.2020.3036853 ↗