A Unified Approach for Ensemble Function and Threshold Optimization in Anomaly-Based Failure Forecasting
Source abstract
Abstract
This paper introduces a novel approach to anomaly-based failure forecasting that jointly optimizes both the ensemble function and the anomaly threshold used for decision making. Unlike conventional methods that apply fixed or classifier-defined thresholds, the proposed framework simultaneously tunes the threshold of the failure probability or anomaly score and the parameters of an ensemble function that integrates multiple machine learning models—specifically, Random Forest and Isolation Forest classifiers trained under diverse preprocessing configurations. The distinctive contribution of this work lies in introducing a weighted mean ensemble function, whose coefficients are co-optimized with the anomaly threshold using a global optimization algorithm, enabling adaptive, data-driven decision boundaries. The method is designed for predictive maintenance applications and validated using sensor data from three industrial domains: aluminum anode production, plastic injection molding, and automotive manufacturing. The experimental results demonstrate that the proposed combined optimization significantly enhances forecasting reliability, improving the Matthews Correlation Coefficient by up to 6.5 percentage units compared to previous approaches. Beyond its empirical gains, this work establishes a scalable and computationally efficient framework for integrating threshold and ensemble optimization in real-world, cross-industry predictive maintenance systems.
Source: crossref · Quality: baseline
Research context
OpenAlex topics: Reliability and Maintenance Optimization · Machine Fault Diagnosis Techniques · Forecasting Techniques and Applications
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
Affiliations
Centre for Research and Technology Hellas, Information Technologies Institute, 57001 Thessaloniki, Greece
Funding
European Commission
References (54)
Show source-provided references
1. Kolokas, N., Vafeiadis, T., Ioannidis, D., and Tzovaras, D. (2018, January 3–5). Forecasting faults of industrial equipment using machine learning classifiers. Proceedings of the International Conference on Innovations in Intelligent Systems and Applications (INISTA), Thessaloniki, Greece.10.1109/INISTA.2018.8466309 ↗
2. Kolokas, N., Tatsis, V., Zacharaki, A., Ioannidis, D., and Tzovaras, D. (2024, January 4–6). Improved Outlier Detection for Failure Forecasting using Anomaly Score Threshold Optimization and Ensemble Methods. Proceedings of the International Conference on Innovations in Intelligent Systems and Applications (INISTA), Craiova, Romania.10.1109/INISTA62901.2024.10683866 ↗
3. Kolokas, N., Vafeiadis, T., Ioannidis, D., and Tzovaras, D. (2019, January 3–5). Anomaly Detection in Aluminium Production with Unsupervised Machine Learning Classifiers. Proceedings of the International Conference on Innovations in Intelligent Systems and Applications (INISTA), Sofia, Bulgaria.10.1109/INISTA.2019.8778419 ↗
4. Kolokas, N., Vafeiadis, T., Ioannidis, D., and Tzovaras, D. (2020). A generic fault prognostics algorithm for manufacturing industries using unsupervised machine learning classifiers. Simul. Modell. Pract. Theory, 103.10.1016/j.simpat.2020.102109 ↗
5. Statistical-based or condition-based preventive maintenance?10.1108/13552519510083156 ↗
6. Intelligent predictive decision support systems for condition-based maintenance10.1007/s001700170173 ↗
7. Hancock, J., Johnson, J.M., and Khoshgoftaa, T.M. (2022, January 14–16). A comparative approach to threshold optimization for classifying imbalanced data. Proceedings of the IEEE 8th International Conference on Collaboration and Internet Computing (CIC), Atlanta, GA, USA.10.1109/CIC56439.2022.00028 ↗
8. Sun, X., Zhang, X., Xia, Z., and Bertino, E. (2021). Anomaly detection based on isolated forests. Advances in Artificial Intelligence and Security, Springer.10.1007/978-3-030-78618-2 ↗
9. Liu, T., Ting, K.M., and Zhou, Z.-H. (2008, January 15–19). Isolation Forest. Proceedings of the Eighth IEEE International Conference on Data Mining, Pisa, Italy.10.1109/ICDM.2008.17 ↗
10. Wang, H., Liang, Q., Hancock, J.T., and Khoshgoftaar, T.M. (2024). Feature selection strategies: A comparative analysis of shap-value and importance-based methods. J. Big Data, 11.10.1186/s40537-024-00905-w ↗
11. Evaluating the isolation forest method for anomaly detection in software-defined networking security10.52783/jes.639 ↗
12. Vávra, J., Hromada, M., Lukáš, L., and Dworzecki, J. (2021). Adaptive anomaly detection system based on machine learning algorithms in an industrial control environment. Int. J. Crit. Infrastruct. Prot., 34.10.1016/j.ijcip.2021.100446 ↗
13. Cao, C., Chicco, D., and Hoffman, M.M. (2020). The MCC-F1 curve: A performance evaluation technique for binary classification. arXiv.
14. Lipton, Z.C., Elkan, C., and Narayanaswamy, B. (2014). Thresholding Classifiers to Maximize F1 Score. arXiv.10.1007/978-3-662-44851-9_15 ↗
15. Hundman, K., Constantinou, V., Laporte, C., Colwell, I., and Soderstrom, T. (2018, January 19–23). Detecting Spacecraft Anomalies Using LSTMs and Nonparametric Dynamic Thresholding. Proceedings of the 24th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining, London, UK.10.1145/3219819.3219845 ↗
16. Yan, B., Koyejo, S., Zhong, K., and Ravikumar, P. (2018, January 10–15). Binary Classification with Karmic, Threshold-Quasi-Concave Metrics. Proceedings of the 35th International Conference on Machine Learning, Stockholm, Sweden.
17. Bougaham, A., and Frénay, B. (2025). Towards a Trustworthy Anomaly Detection for Critical Applications through Approximated Partial AUC Loss. arXiv.
18. Lau, M., Seck, I., Meliopoulos, A.P., Lee, W., and Ndiaye, E.H. (2023). Revisiting Non-separable Binary Classification and its Applications in Anomaly Detection. arXiv.
19. Varalakshmi, S., Premnath, S., Yogalakshmi, V., Kavitha, V.R., and Vimalarani, G. (2021, January 11–13). Design of IoT Network using Deep Learning-based Model for Anomaly Detection. Proceedings of the Fifth International Conference on I-SMAC (IoT In Social, Mobile, Analytics and Cloud) (I-SMAC), Palladam, India.10.1109/I-SMAC52330.2021.9640700 ↗
20. An In-Depth Study and Improvement of Isolation Forest10.1109/ACCESS.2022.3144425 ↗
21. Sound Event Detection of Weakly Labelled Data with CNN-Transformer and Automatic Threshold Optimization10.1109/TASLP.2020.3014737 ↗
22. Seman, L.O., Aquino, L.S., Stefenon, S.F., Yow, K.-C., Mariani, V.C., and Coehlo, L.d.S. (2025). Simultaneously anomaly detection and forecasting for predictive maintenance using a zero-cost differentiable architecture search-based network. Comput. Ind. Eng., 208.10.1016/j.cie.2025.111412 ↗
23. Zhou, Z.-H. (2025). Ensemble Methods: Foundations and Algorithms, CRC Press.10.1201/9781003587774 ↗
24. Xin, R., Liu, H., Chen, P., and Zhao, Z. (2023). Robust and accurate performance anomaly detection and prediction for cloud applications: A novel ensemble learning-based framework. J. Cloud Comput., 12.10.1186/s13677-022-00383-6 ↗
25. A hybrid machine-learning ensemble for anomaly detection in real-time industry 4.0 systems10.1109/ACCESS.2022.3188102 ↗
26. Chohra, A., Shirani, P., Karbab, E.B., and Debbabi, M. (2022). Chameleon: Optimized feature selection using particle swarm optimization and ensemble methods for network anomaly detection. Comput. Secur., 117.10.1016/j.cose.2022.102684 ↗
27. Diop, A., Emad, N., Winter, T., and Hilia, M. (2024, May 14). Design of an Ensemble Learning Behavior Anomaly Detection Framework. Available online: https://hal.science/hal-04194528/.
28. Super ensemble learning for daily streamflow forecasting: Large-scale demonstration and comparison with multiple machine learning algorithms10.1007/s00521-020-05172-3 ↗
29. An enhanced anomaly detection in web traffic using a stack of classifier ensemble10.1109/ACCESS.2020.2969428 ↗
30. Ensemble and deep-learning methods for two-class and multi-attack anomaly intrusion detection: An empirical study
31. Imbalanced fault diagnosis based on semi-supervised ensemble learning10.1007/s10845-022-01985-2 ↗
32. Chawla, N.V., Lazarevic, A., Hall, L.O., and Bowyer, K.W. (2003, January 22–26). SMOTEBoost: Improving prediction of the minority class in boosting. Proceedings of the European Conference on Principles of Data Mining and Knowledge Discovery, Cavtat-Dubrovnik, Croatia.10.1007/978-3-540-39804-2_12 ↗
33. A survey of multiple classifier systems as hybrid systems10.1016/j.inffus.2013.04.006 ↗
34. Salehi, M., Leckie, C.A., Moshtaghi, M., and Vaithianathan, T. (2014, January 13–16). A Relevance Weighted Ensemble Model for Anomaly Detection in Switching Data Streams. Proceedings of the Advances in Knowledge Discovery and Data Mining: 18th Pacific-Asia Conference (PAKDD), Tainan, Taiwan.10.1007/978-3-319-06605-9_38 ↗
35. Ensemble methods for anomaly detection and distributed intrusion detection in Mobile Ad-Hoc Networks10.1016/j.inffus.2007.03.001 ↗
36. Zhong, Y., Chen, W., Wang, Z., Chen, Y., Wang, K., Li, Y., Yin, X., Shi, X., Yang, J., and Li, K. (2020). HELAD: A novel network anomaly detection model based on heterogeneous ensemble learning. Comput. Netw., 169.10.1016/j.comnet.2019.107049 ↗
37. A weighted framework for unsupervised ensemble learning based on internal quality measures10.1007/s10479-017-2716-8 ↗
38. Ensemble learning algorithms based on easyensemble sampling for financial distress prediction10.1007/s10479-025-06494-y ↗
39. Support-vector networks10.1023/A:1022627411411 ↗
40. A Fast Algorithm for the Minimum Covariance Determinant Estimator10.1080/00401706.1999.10485670 ↗
41. Breunig, M.M., Kriegel, H.-P., Ng, R.T., and Sander, J. (2000, January 15–18). LOF: Identifying Density-based Local Outliers. Proceedings of the ACM SIGMOD International Conference on Management of Data, Dallas, TX, USA.10.1145/342009.335388 ↗
42. Differential evolution—A simple and efficient heuristic for global optimization over continuous spaces10.1023/A:1008202821328 ↗
43. Mezura-Montes, E., Velázquez-Reyes, J., and Coello Coello, C.A. (2006, January 8–12). A comparative study of differential evolution variants for global optimization. Proceedings of the 8th Annual Conference on Genetic and Evolutionary Computation (GECCO), Seattle, WA, USA.10.1145/1143997.1144086 ↗
44. A hybrid particle swarm-gradient algorithm for global structural optimization
45. Abbas, Q., Ahmad, J., and Jabeen, H. (2015). A novel tournament selection based differential evolution variant for continuous optimization problems. Math. Probl. Eng., 2015.10.1155/2015/205709 ↗
46. Charalampakis, A.E., and Tsiatas, G.C. (2019). Critical evaluation of metaheuristic algorithms for weight minimization of truss structures. Front. Built Environ., 5.10.3389/fbuil.2019.00113 ↗
47. Global Optimization by Basin-Hopping and the Lowest Energy Structures of Lennard-Jones Clusters Containing up to 110 Atoms10.1021/jp970984n ↗
48. Generalized Simulated Annealing Algorithm and Its Application to the Thomson Model10.1016/S0375-9601(97)00474-X ↗
49. A simplicial homology algorithm for Lipschitz optimisation10.1007/s10898-018-0645-y ↗
50. Optimization of Characteristics for a Stochastic Agent-Based Model of Goods Exchange with the Use of Parallel Hybrid Genetic Algorithm
51. A Hybrid Multi-Swarm Particle Swarm Optimization Algorithm for Solving Agent-Based Epidemiological Model
52. Particle swarm optimizer with crossover operation10.1016/j.engappai.2018.01.009 ↗
53. MBHGA: A Matrix-Based Hybrid Genetic Algorithm for Solving an Agent-Based Model of Controlled Trade Interactions10.1109/ACCESS.2025.3539460 ↗
54. Empirical evaluation of distributed Differential Evolution on standard benchmarks