journal article·2024-02-27Open access

High-Dimensional Ensemble Learning Classification: An Ensemble Learning Classification Algorithm Based on High-Dimensional Feature Space Reconstruction

Miao Zhao, Ning Ye

Applied Sciences· Volume 14· Issue 5

Abstract

When performing classification tasks on high-dimensional data, traditional machine learning algorithms often fail to filter out valid information in the features adequately, leading to low levels of classification accuracy. Therefore, this paper explores the high-dimensional data from both the data feature dimension and the model ensemble dimension. We propose a high-dimensional ensemble learning classification algorithm focusing on feature space reconstruction and classifier ensemble, called the HDELC algorithm. First, the algorithm considers feature space reconstruction and then generates a feature space reconstruction matrix. It effectively achieves feature selection and reconstruction for high-dimensional data. An optimal feature space is generated for the subsequent ensemble of the classifier, which enhances the representativeness of the feature space. Second, we recursively determine the number of classifiers and the number of feature subspaces in the ensemble model. Different classifiers in the ensemble system are assigned mutually exclusive non-intersecting feature subspaces for model training. The experimental results show that the HDELC algorithm has advantages compared with most high-dimensional datasets due to its more efficient feature space ensemble capability and relatively reliable ensemble operation performance. The HDELC algorithm makes it possible to solve the classification problem for high-dimensional data effectively and has vital research and application value.
Source: crossref · Quality: baseline

Research context

OpenAlex topics: Machine Learning and Data Classification · Face and Expression Recognition · Anomaly Detection Techniques and Applications

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

College of Information Science and Technology, Nanjing Forestry University, Nanjing 210037, China

Funding

National key research and development plan of China

References (39)

Show source-provided references
1. Modulation in gene expression and enzyme activity suggested the roles of monodehydroascorbate reductase in development and stress response in bread wheat10.1016/j.plantsci.2023.111902 ↗
2. Analysis of the Syar’u Man Qablana Theory and its Application in Sharia Financial Institutions
3. An intelligent Medical Cyber–Physical System to support heart valve disease screening and diagnosis10.1016/j.eswa.2023.121772 ↗
4. Analyst monitoring and information asymmetry reduction: US evidence on environmental investment10.1016/j.igd.2023.100098 ↗
5. Lee, K., Laskin, M., Srinivas, A., and Abbeel, P. (2021, January 18–24). Sunrise: A simple unified framework for ensemble learning in deep reinforcement learning. Proceedings of the International Conference on Machine Learning, Online.
6. Aggregation models in ensemble learning: A large-scale comparison10.1016/j.inffus.2022.09.015 ↗
7. Dynamic ensemble learning for multi-label classification10.1016/j.ins.2022.12.022 ↗
8. Prediction of asphalt binder elastic recovery using tree-based ensemble bagging and boosting models10.1016/j.conbuildmat.2023.134154 ↗
9. An improved random forest based on the classification accuracy and correlation measurement of decision trees10.1016/j.eswa.2023.121549 ↗
10. Dynamic incremental ensemble fuzzy classifier for data streams in green internet of things10.1109/TGCN.2022.3151716 ↗
11. Evolving multi-user fuzzy classifier system with advanced explainability and interpretability aspects10.1016/j.inffus.2022.10.027 ↗
12. An ensemble-based convolutional neural network model powered by a genetic algorithm for melanoma diagnosis10.1007/s00521-021-06655-7 ↗
13. Deb, S.D., Jha, R.K., Jha, K., and Tripathi, P.S. (2022). A multi model ensemble based deep convolution neural network structure for detection of COVID-19. Biomed. Signal Process. Control., 71.10.1016/j.bspc.2021.103126 ↗
14. Adaboost-based SVDD for anomaly detection with dictionary learning10.1016/j.eswa.2023.121770 ↗
15. Kedia, V., and Chakraborty, D. (2023, January 13–16). Randomized Subspace Identification for LTI Systems. Proceedings of the 2023 European Control Conference (ECC), Bucharest, Romania.10.23919/ECC57647.2023.10178256 ↗
16. Emergent layer stacking arrangements in c-axis confined MoTe210.1038/s41467-023-40528-y ↗
17. Canonical correlation analysis of dimension reduced degradation feature space for machinery condition monitoring10.1016/j.ymssp.2022.109603 ↗
18. Priyadarshini, J., Premalatha, M., Čep, R., Jayasudha, M., and Kalita, K. (2023). Analyzing physics-inspired metaheuristic algorithms in feature selection with K-nearest-neighbor. Appl. Sci., 13.10.3390/app13020906 ↗
19. A novel dimension reduction and dictionary learning framework for high-dimensional data classification10.1016/j.patcog.2020.107793 ↗
20. An efficient random forests algorithm for high dimensional data classification10.1007/s11634-018-0318-1 ↗
21. Uddin, K.M.M., Biswas, N., Rikta, S.T., and Dey, S.K. (2023). Machine learning-based diagnosis of breast cancer utilizing feature optimization technique. Comput. Methods Programs Biomed. Update, 3.10.1016/j.cmpbup.2023.100098 ↗
22. Optimizing the early glaucoma detection from visual fields by combining preprocessing techniques and ensemble classifier with selection strategies10.1016/j.eswa.2021.115975 ↗
23. A Genetic Algorithm-based sequential instance selection framework for ensemble learning10.1016/j.eswa.2023.121269 ↗
24. Kurutach, T., Clavera, I., Duan, Y., Tamar, A., and Abbeel, P. (2018). Model-ensemble trust-region policy optimization. arXiv.
25. Multi-model ensemble predictions of precipitation and temperature using machine learning algorithms10.1016/j.atmosres.2019.104806 ↗
26. HELAD: A novel network anomaly detection model based on heterogeneous ensemble learning10.1016/j.comnet.2019.107049 ↗
27. Output-weighted and relative entropy loss functions for deep learning precursors of extreme events10.1016/j.physd.2022.133570 ↗
28. A Fast and Scalable Computational Framework for Large-Scale High-Dimensional Bayesian Optimal Experimental Design10.1137/21M1466499 ↗
29. Discrete Boltzmann modeling of Rayleigh-Taylor instability: Effects of interfacial tension, viscosity, and heat conductivity10.1103/PhysRevE.106.015102 ↗
30. Estimating quantum mutual information through a quantum neural network10.1007/s11128-023-04253-1 ↗
31. Du, L., Liu, H., Zhang, L., Lu, Y., Li, M., Hu, Y., and Zhang, Y. (2023). Deep ensemble learning for accurate retinal vessel segmentation. Comput. Biol. Med., 158.10.1016/j.compbiomed.2023.106829 ↗
32. A class of stealthy attacks on remote state estimation with intermittent observation10.1016/j.ins.2023.118964 ↗
33. Dua, D., and Graff, C. (2019). UCI Machine Learning Repository, University of California, School of Information and Computer Science. Available online: http://archive.ics.uci.edu/ml.
34. An Efficient Marine Predators Algorithm for Feature Selection10.1109/ACCESS.2021.3073261 ↗
35. A joint multiobjective optimization of feature selection and classifier design for high-dimensional data classification10.1016/j.ins.2023.01.069 ↗
36. Ibrahim, S., Nazir, S., and Velastin, S.A. (2021). Feature selection using correlation analysis and principal component analysis for accurate breast cancer diagnosis. J. Imaging, 7.10.3390/jimaging7110225 ↗
37. Classification framework for faulty-software using enhanced exploratory whale optimizer-based feature selection scheme and random forest ensemble learning10.1007/s10489-022-04427-x ↗
38. LightTS: Lightweight Time Series Classification with Adaptive Ensemble Distillation10.1145/3589316 ↗
39. AERF: Adaptive ensemble random fuzzy algorithm for anomaly detection in cloud computing10.1016/j.comcom.2023.01.004 ↗