Random Forest-Based Machine Failure Prediction: A Performance Comparison
Source abstract
Abstract
Predictive maintenance is widely used in modern industrial systems. It helps improve the working life of machines. It also reduces risk and lowers overall operating costs. Many current approaches still face problems when handling both fast processing and balanced performance across different measurements. In this research, twelve machine learning models are tested. These include standard algorithms and deep learning-based solutions. Two manufacturing datasets are used. One has more samples, while the other shows uneven class labels. Important features are selected by applying strict screening. Model parameters are fine-tuned to obtain stable results. To measure how each model performs, several metrics are used—accuracy, precision, recall, F1-score, and ROC AUC. Among all tested models, random forest shows the best results. It reaches a classification accuracy of 99.5%. At the same time, it keeps a good balance between recall and precision. This model works well when data from sensors is imbalanced. It is also strong in handling patterns that do not follow a clear rule. The system is potentially suitable for real-time deployment in industrial machines with rotating parts, as demonstrated on two representative manufacturing datasets. However, broader validation across diverse equipment types is recommended before large-scale adoption.
Source: crossref · Quality: baseline
Research context
OpenAlex topics: Quality and Safety in Healthcare · Industrial Vision Systems and Defect Detection · Machine Fault Diagnosis Techniques
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
Affiliations
School of Computer Science, University of Nottingham Ningbo China, Ningbo 315104, China
Funding
National Natural Science Foundation of China · Natural Science Foundation of Sichuan Province
References (69)
Show source-provided references
1. Machine learning for predictive maintenance: A multiple classifier approach10.1109/TII.2014.2349359 ↗
2. Remaining useful life estimation—A review on the statistical data driven approaches10.1016/j.ejor.2010.11.018 ↗
3. Applications of machine learning to machine fault diagnosis: A review and roadmap10.1016/j.ymssp.2019.106587 ↗
4. A review on machinery diagnostics and prognostics implementing condition-based maintenance10.1016/j.ymssp.2005.09.012 ↗
5. Calculation of reliability function and remaining useful life for a Markov failure model
6. Pham, H. (2011). System Software Reliability, Springer.
7. Regression models and life-tables10.1111/j.2517-6161.1972.tb00899.x ↗
8. Box, G.E.P., Jenkins, G.M., Reinsel, G.C., and Ljung, G.M. (2015). Time Series Analysis: Forecasting and Control, Wiley. [5th ed.].
9. Lütkepohl, H. (2005). New Introduction to Multiple Time Series Analysis, Springer.10.1007/978-3-540-27752-1 ↗
10. Deep learning and its applications to machine health monitoring10.1016/j.ymssp.2018.05.050 ↗
11. Condition-based maintenance of machines using hidden Markov models10.1006/mssp.2000.1309 ↗
12. A tutorial on hidden Markov models and selected applications in speech recognition10.1109/5.18626 ↗
13. What is a hidden Markov model?10.1038/nbt1004-1315 ↗
14. Support-vector networks10.1023/A:1022627411411 ↗
15. Support vector machine in machine condition monitoring and fault diagnosis10.1016/j.ymssp.2006.12.007 ↗
16. Veropoulos, K., Campbell, C., and Cristianini, N. (1999, January 31). Controlling the Sensitivity of Support Vector Machines. Proceedings of the International Joint Conference Artificial Intelligence, Stockholm, Sweden.
17. Nearest neighbor pattern classification10.1109/TIT.1967.1053964 ↗
18. Fault diagnosis for rotating machinery using multiple sensors and convolutional neural networks10.1109/TMECH.2017.2728371 ↗
19. Hosmer, D.W., and Lemeshow, S. (2000). Applied Logistic Regression, Wiley. [2nd ed.].10.1002/0471722146 ↗
20. The optimality of naive Bayes
21. Random forests10.1023/A:1010933404324 ↗
22. Chen, T., and Guestrin, C. (2016, January 13–17). XGBoost: A scalable tree boosting system. Proceedings of the 22nd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, San Francisco, CA, USA.10.1145/2939672.2939785 ↗
23. Classification and regression by randomForest
24. Greedy function approximation: A gradient boosting machine10.1214/aos/1013203451 ↗
25. Gradient-based learning applied to document recognition10.1109/5.726791 ↗
26. Long short-term memory10.1162/neco.1997.9.8.1735 ↗
27. Random forest in remote sensing: A review of applications and future directions10.1016/j.isprsjprs.2016.01.011 ↗
28. A decision-theoretic generalization of on-line learning and an application to boosting10.1006/jcss.1997.1504 ↗
29. Molnar, C. (2020). Interpretable Machine Learning: A Guide for Making Black Box Models Explainable, Leanpub.
30. Deep learning for smart manufacturing: Methods and applications10.1016/j.jmsy.2018.01.003 ↗
31. Attention is all you need
32. A unified approach to interpreting model predictions
33. SMOTE: Synthetic minority over-sampling technique10.1613/jair.953 ↗
34. Learning from imbalanced data10.1109/TKDE.2008.239 ↗
35. Ribeiro, M.T., Singh, S., and Guestrin, C. (2016, January 13–17). “Why should I trust you?”: Explaining the predictions of any classifier. Proceedings of the 22nd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, San Francisco, CA, USA.10.1145/2939672.2939778 ↗
36. Large scale distributed deep networks
37. Industrial big data analytics for predictive maintenance: Opportunities and challenges
38. Boehmke, B., and Greenwell, B. (2019). Hands-on Machine Learning with R, CRC Press.10.1201/9780367816377 ↗
39. A systematic literature review of machine learning methods applied to predictive maintenance10.1016/j.cie.2019.106024 ↗
40. Scikit-learn: Machine learning in Python
41. PyTorch: An imperative style, high-performance deep learning library
42. Fernández, A., García, S., Galar, M., Prati, R.C., Krawczyk, B., and Herrera, F. (2018). Learning from Imbalanced Data Sets, Springer.10.1007/978-3-319-98074-4 ↗
43. Robust Regression and Outlier Detection10.2307/2982847 ↗
44. Recursive feature elimination with random forest for PTR-MS analysis of agroindustrial products10.1016/j.chemolab.2006.01.007 ↗
45. An introduction to variable and feature selection
46. Ensemble methods in machine learning
47. Hampel, F.R., Ronchetti, E.M., Rousseeuw, P.J., and Stahel, W.A. (2005). Robust Statistics: The Approach Based on Influence Functions, Wiley.10.1002/9781118186435 ↗
48. Hsu, C.W., Chang, C.C., and Lin, C.J. (2003). A Practical Guide to Support Vector Classification, National Taiwan University. Technical Report.
49. A study of cross-validation and bootstrap for accuracy estimation and model selection
50. A survey of cross-validation procedures for model selection10.1214/09-SS054 ↗
51. Random search for hyper-parameter optimization
52. Hyperparameters and tuning strategies for random forest10.1002/widm.1301 ↗
53. Goodfellow, I., Bengio, Y., and Courville, A. (2016). Deep Learning, MIT Press.
54. Evaluation: From precision, recall and F-measure to ROC, informedness, markedness and correlation
55. An introduction to ROC analysis10.1016/j.patrec.2005.10.010 ↗
56. The use of the area under the ROC curve in the evaluation of machine learning algorithms10.1016/S0031-3203(96)00142-2 ↗
57. Menze, B.H., Kelm, B.M., Masuch, R., Himmelreich, U., Bachert, P., Petrich, W., and Hamprecht, F.A. (2009). A comparison of random forest and its Gini importance with standard chemometric methods for the feature selection and classification of spectral data. BMC Bioinform., 10.10.1186/1471-2105-10-213 ↗
58. Data-driven smart manufacturing10.1016/j.jmsy.2018.01.006 ↗
59. Data-driven methods for predictive maintenance of industrial equipment: A survey10.1109/JSYST.2019.2905565 ↗
60. Internet of Things (IoT): A vision, architectural elements, and future directions10.1016/j.future.2013.01.010 ↗
61. Bonomi, F., Milito, R., Zhu, J., and Addepalli, S. (2012, January 17). Fog computing and its role in the Internet of Things. Proceedings of the First Edition of the MCC Workshop on Mobile Cloud Computing, Helsinki, Finland.10.1145/2342509.2342513 ↗
62. A survey on concept drift adaptation10.1145/2523813 ↗
63. Edge computing: Vision and challenges10.1109/JIOT.2016.2579198 ↗
64. Jardine, A.K.S., and Tsang, A.H.C. (2013). Maintenance, Replacement, and Reliability: Theory and Applications, CRC Press. [2nd ed.].10.1201/b14937 ↗
65. Hastie, T., Tibshirani, R., and Friedman, J. (2009). The Elements of Statistical Learning: Data Mining, Inference, and Prediction, Springer. [2nd ed.].10.1007/978-0-387-84858-7 ↗
66. Interpretable machine learning for predictive maintenance in Industry 4.0
67. Apache Spark: A unified engine for big data processing10.1145/2934664 ↗
68. The mythos of model interpretability10.1145/3236386.3241340 ↗
69. Explainable machine-learning predictions for the prevention of hypoxaemia during surgery10.1038/s41551-018-0304-0 ↗