journal article·2026-02-05Open access

A Dual-Branch Ensemble Learning Method for Industrial Anomaly Detection: Fusion and Optimization of Scattering and PCA Features

Jing Cai, Zhuo Wu, Runan Hua, Shaohua Mao, Yulun Zhang, Ran Guo, Ke Lin

Applied Sciences· Volume 16· Issue 3

Abstract

Industrial visual anomaly detection remains challenging because practical inspection systems must achieve high detection accuracy while operating under highly imbalanced data, diverse defect patterns, limited computational resources, and increasing demands for interpretability. This work aims to develop a lightweight yet effective and explainable anomaly detection framework for industrial images in settings where a limited number of labeled anomalous samples are available. We propose a dual-branch feature-based supervised ensemble method that integrates complementary representations: a PCA branch to capture linear global structure and a scattering branch to model multi-scale textures. A heterogeneous pool of classical learners (SVM, RF, ET, XGBoost, and LightGBM) is trained on each feature branch, and stable probability outputs are obtained via stratified K-fold out-of-fold training, probability calibration, and a quantile-based threshold search. Decision-level fusion is then performed by stacking, where logistic regression, XGBoost, and LightGBM serve as meta-learners over the out-of-fold probabilities of the selected top-K base learners. Experiments on two public benchmarks (MVTec AD and BTAD) show that the proposed method substantially improves the best PCA-based single model, achieving relative F1_score gains of approximately 31% (MVTec AD) and 26% (BTAD), with maximum AUC values of about 0.91 and 0.96, respectively, under comparable inference complexity. Overall, the results demonstrate that combining high-quality handcrafted features with supervised ensemble fusion provides a practical and interpretable alternative/complement to heavier deep models for resource-constrained industrial anomaly detection, and future work will explore more category-adaptive decision strategies to further enhance robustness on challenging classes.
Source: crossref · Quality: baseline

Research context

OpenAlex topics: Anomaly Detection Techniques and Applications · Domain Adaptation and Few-Shot Learning · Machine Learning and Data Classification

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

School of Economics and Management, China University of Geosciences, Wuhan 430074, China

Key Laboratory of Geological Survey and Evaluation of Ministry of Education, China University of Geosciences, Wuhan 430074, China

Wuhan Second Ship Design and Research Institute, Wuhan 430205, China

Faculty of Engineering, China University of Geosciences, Wuhan 430074, China

School of Mechanical Engineering and Electronic Information, China University of Geosciences, Wuhan 430074, China

Funding

National Natural Science Foundation of China · Natural Science Foundation project of Hubei Province · Postdoctoral Fellowship Program of CPSF · China Postdoctoral Science Foundation · Postdoctoral Project of Hubei Province · “CUG Scholar” Scientific Research Funds at China University of Geosciences · Fundamental Research Funds for the Central University, China University of Geosciences

References (44)

Show source-provided references
1. Unsupervised machine learning techniques for detecting PLC process control anomalies10.3390/jcp2020012 ↗
2. Anomaly detection for a water treatment system based on one-class neural network10.1109/ACCESS.2022.3218624 ↗
3. Kagermann, H., and Wahlster, W. (2022). Ten years of Industrie 4.0. Science, 4.10.3390/sci4030026 ↗
4. Jeffrey, N., Tan, Q., and Villar, J.R. (2024). Using ensemble learning for anomaly detection in cyber–physical systems. Electronics, 13.10.3390/electronics13071391 ↗
5. A survey on RGB, 3D, and multimodal approaches for unsupervised industrial image anomaly detection10.1016/j.inffus.2025.103139 ↗
6. Machine learning for anomaly detection: A systematic review10.1109/ACCESS.2021.3083060 ↗
7. Deep learning for anomaly detection: A review10.1145/3439950 ↗
8. Plastic card fraud detection using peer group analysis10.1007/s11634-008-0021-8 ↗
9. A comprehensive survey of anomaly detection algorithms
10. Improving security using SVM-based anomaly detection: Issues and challenges
11. Primartha, R., and Tama, B.A. (2017, January 1–2). Anomaly detection using random forest: A performance revisited. Proceedings of the 2017 International Conference on Data and Software Engineering (ICoDSE), Palembang, Indonesia.10.1109/ICODSE.2017.8285847 ↗
12. Generalized isolation forest for anomaly detection10.1016/j.patrec.2021.05.022 ↗
13. An improved KNN-based efficient log anomaly detection method with automatically labeled samples10.1145/3441448 ↗
14. Anomaly detection model based on data stream clustering10.1007/s10586-017-1066-2 ↗
15. Principal component analysis10.1002/wics.101 ↗
16. The MVTec anomaly detection dataset: A comprehensive real-world dataset for unsupervised anomaly detection10.1007/s11263-020-01400-4 ↗
17. Li, C.-L., Sohn, K., Yoon, J., and Pfister, T. (2021, January 20–25). Cutpaste: Self-supervised learning for anomaly detection and localization. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, Nashville, TN, USA.10.1109/CVPR46437.2021.00954 ↗
18. Yu, J., Zheng, Y., Wang, X., Li, W., Wu, Y., Zhao, R., and Wu, L. (2021). Fastflow: Unsupervised anomaly detection and localization via 2d normalizing flows. arXiv.
19. Defard, T., Setkov, A., Loesch, A., and Audigier, R. (2021, January 10–15). Padim: A patch distribution modeling framework for anomaly detection and localization. Proceedings of the International Conference on Pattern Recognition, Virtual.10.1007/978-3-030-68799-1_35 ↗
20. Roth, K., Pemula, L., Zepeda, J., Schölkopf, B., Brox, T., and Gehler, P. (2022, January 18–24). Towards total recall in industrial anomaly detection. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, New Orleans, LA, USA.10.1109/CVPR52688.2022.01392 ↗
21. Deep learning in the industrial internet of things: Potentials, challenges, and emerging applications10.1109/JIOT.2021.3051414 ↗
22. Le, Q., Miralles-Pechuán, L., Kulkarni, S., Su, J., and Boydell, O. (2020). An overview of deep learning in industry. Data Anal. AI, 65–98.10.1201/9781003019855-5 ↗
23. Mjahad, A., and Rosado-Muñoz, A. (2025). Robust Industrial Surface Defect Detection Using Statistical Feature Extraction and Capsule Network Architectures. Sensors, 25.10.3390/s25196063 ↗
24. Rolih, B., Ameln, D., Vaidya, A., and Akcay, S. (2024, January 17–18). Divide and conquer: High-resolution industrial anomaly detection via memory efficient tiled ensemble. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, Seattle, WA, USA.10.1109/CVPRW63382.2024.00391 ↗
25. A survey of intrusion detection systems based on ensemble and hybrid classifiers10.1016/j.cose.2016.11.004 ↗
26. Dasari, A.K., Biswas, S.K., Thounaojam, D.M., Devi, D., and Purkayastha, B. (2023, January 24–25). Ensemble learning techniques and their applications: An overview. Proceedings of the International Conference on Communications and Cyber Physical Engineering 2018, Hyderabad, India.10.1007/978-981-19-8086-2_85 ↗
27. A review on ensembles for the class imbalance problem: Bagging-, boosting-, and hybrid-based approaches10.1109/TSMCC.2011.2161285 ↗
28. Shirley, J.J., and Priya, M. (2023, January 13–14). A comprehensive survey on ensemble machine learning approaches for detection of intrusion in iot networks. Proceedings of the 2023 International Conference on Innovations in Engineering and Technology (ICIET), Muvattupuzha, India.10.1109/ICIET57285.2023.10220795 ↗
29. Enhancing anomaly detection in IoT-driven factories using Logistic Boosting, Random Forest, and SVM: A comparative machine learning approach10.1038/s41598-025-08436-x ↗
30. Enhancing ML-based anomaly detection in data management for security through integration of IoT, cloud, and edge computing10.1016/j.eswa.2025.128700 ↗
31. Selective ensemble method for anomaly detection based on parallel learning10.1038/s41598-024-51849-3 ↗
32. Bergmann, P., Fauser, M., Sattlegger, D., and Steger, C. (2019, January 15–20). MVTec AD--A comprehensive real-world dataset for unsupervised anomaly detection. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, Long Beach, CA, USA.10.1109/CVPR.2019.00982 ↗
33. A unified theory of diversity in ensemble learning
34. Predictive modelling for solar thermal energy systems: A comparison of support vector regression, random forest, extra trees and regression trees10.1016/j.jclepro.2018.08.207 ↗
35. Łoś, H., Mendes, G.S., Cordeiro, D., Grosso, N., Costa, H., Benevides, P., and Caetano, M. (2021, January 11–16). Evaluation of XGBoost and LGBM performance in tree species classification with sentinel-2 data. Proceedings of the 2021 IEEE International Geoscience and Remote Sensing Symposium IGARSS, Brussels, Belgium.10.1109/IGARSS47720.2021.9553031 ↗
36. Evolutionary bagging for ensemble learning10.1016/j.neucom.2022.08.055 ↗
37. Dietterich, T.G. (2000, January 21–23). Ensemble methods in machine learning. Proceedings of the International Workshop on Multiple Classifier Systems, Cagliari, Italy.10.1007/3-540-45014-9_1 ↗
38. Hybrid and ensemble methods in machine learning J. UCS special issue
39. Invariant scattering convolution networks10.1109/TPAMI.2012.230 ↗
40. Mishra, P., Verk, R., Fornasier, D., Piciarelli, C., and Foresti, G.L. (2021, January 20–23). VT-ADL: A vision transformer network for image anomaly detection and localization. Proceedings of the 2021 IEEE 30th International Symposium on Industrial Electronics (ISIE), Kyoto, Japan.10.1109/ISIE45552.2021.9576231 ↗
41. Group invariant scattering10.1002/cpa.21413 ↗
42. Graph regularization methods in soft detector fusion10.1109/ACCESS.2023.3344776 ↗
43. Optimal ROC-based classification and performance analysis under Bayesian uncertainty models10.1109/TCBB.2015.2465966 ↗
44. Klein, A., Falkner, S., Springenberg, J.T., and Hutter, F. (2017, January 24–26). Learning curve prediction with Bayesian neural networks. Proceedings of the International Conference on Learning Representations, Toulon, France.