SCChOA: Hybrid Sine-Cosine Chimp Optimization Algorithm for Feature Selection
Source abstract
Abstract
Feature Selection (FS) is an important problem that involves selecting the most informative subset of features from a dataset to improve classification accuracy. However, due to the high dimensionality and complexity of the dataset, most optimization algorithms for feature selection suffer from a balance issue during the search process. Therefore, the present paper proposes a hybrid Sine-Cosine Chimp Optimization Algorithm (SCChOA) to address the feature selection problem. In this approach, firstly, a multi-cycle iterative strategy is designed to better combine the SineCosine Algorithm (SCA) and the Chimp Optimization Algorithm (ChOA), enabling a more effective search in the objective space. Secondly, an S-shaped transfer function is introduced to perform binary transformation on SCChOA. Finally, the binary SCChOA is combined with the K-Nearest Neighbor (KNN) classifier to form a novel binary hybrid wrapper feature selection method. To evaluate the performance of the proposed method, 16 datasets from different dimensions of the UCI repository along with four evaluation metrics of average fitness value, average classification accuracy, average feature selection number, and average running time are considered. Meanwhile, seven state-of-the-art metaheuristic algorithms for solving the feature selection problem are chosen for comparison. Experimental results demonstrate that the proposed method outperforms other compared algorithms in solving the feature selection problem. It is capable of maximizing the reduction in the number of selected features while maintaining a high classification accuracy. Furthermore, the results of statistical tests also confirm the significant effectiveness of this method.
Source: openalex_inverted_index · Quality: baseline
Research context
OpenAlex topics: Metaheuristic Optimization Algorithms Research · Artificial Immune Systems Applications · Machine Learning and Data Classification
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
References (43)
Show source-provided references
1. A survey on multi-label feature selection from perspectives of label fusion10.1016/j.inffus.2023.101948 ↗
2. Feature selection methods on gene expression microarray data for cancer classification: A systematic review10.1016/j.compbiomed.2021.105051 ↗
3. A comprehensive survey on recent metaheuristics for feature selection10.1016/j.neucom.2022.04.083 ↗
4. SemiACO: A semi-supervised feature selection based on ant colony optimization10.1016/j.eswa.2022.119130 ↗
5. Novel approach to evaluate classification algorithms and feature selection filter algorithms using medical data10.47852/bonviewJCCE2202238 ↗
6. Wrapper-based optimized feature selection using nature-inspired algorithms10.1007/s00521-023-08383-6 ↗
7. An embedded feature selection method for imbalanced data classification10.1109/JAS.2019.1911447 ↗
8. Ensemble feature selection in medical datasets: Combining filter, wrapper, and embedded feature selection results10.1111/exsy.12553 ↗
9. Feature selection for classification10.3233/IDA-1997-1302 ↗
10. A survey on evolutionary computation approaches to feature selection10.1109/TEVC.2015.2504420 ↗
11. A survey on new generation metaheuristic algorithms10.1016/j.cie.2019.106040 ↗
12. Genetic algorithm-A literature review
13. Particle swarm optimization
14. Ant colony optimization: A new meta-heuristic
15. The whale optimization algorithm10.1016/j.advengsoft.2016.01.008 ↗
16. Beluga whale optimization: A novel nature-inspired metaheuristic algorithm10.1016/j.knosys.2022.109215 ↗
17. Artificial rabbits optimization: A new bio-inspired meta-heuristic algorithm for solving engineering optimization problems10.1016/j.engappai.2022.105082 ↗
18. Optimization by simulated annealing10.1126/science.220.4598.671 ↗
19. Equilibrium optimizer: A novel optimization algorithm10.1016/j.knosys.2019.105190 ↗
20. Teaching-learning-based optimization: A novel method for constrained mechanical design optimization problems10.1016/j.cad.2010.12.015 ↗
21. Imperialist competitive algorithm: An algorithm for optimization inspired by imperialistic competition
22. Chimp optimization algorithm10.1016/j.eswa.2020.113338 ↗
23. SSC: A hybrid nature-inspired meta-heuristic optimization algorithm for engineering applications10.1016/j.knosys.2021.106926 ↗
24. An enhanced chimp optimization algorithm for continuous optimization domains10.1007/s40747-021-00346-5 ↗
25. An enhanced chimp optimization algorithm for optimal degree reduction of Said-Ball curves10.1016/j.matcom.2022.01.018 ↗
26. SCA: A sine cosine algorithm for solving optimization problems10.1016/j.knosys.2015.12.022 ↗
27. Feature subset selection using a genetic algorithm10.1109/5254.671091 ↗
28. A discrete binary version of the particle swarm algorithm
29. A fast hybrid feature selection based on correlation-guided clustering and particle swarm optimization for high-dimensional data10.1109/TCYB.2021.3061152 ↗
30. Feature selection using bare-bones particle swarm optimization with mutual information10.1016/j.patcog.2020.107804 ↗
31. Multiobjective particle swarm optimization for feature selection with fuzzy cost10.1109/TCYB.2020.3015756 ↗
32. Whale optimization approaches for wrapper feature selection10.1016/j.asoc.2017.11.006 ↗
33. BMPA-TVSinV: A binary marine predators algorithm using time-varying sine and V-shaped transfer functions for wrapper-based feature selection10.1016/j.knosys.2022.109446 ↗
34. Binary optimization using hybrid grey wolf optimization for feature selection10.1109/ACCESS.2019.2906757 ↗
35. A novel method based on nonlinear binary grasshopper whale optimization algorithm for feature selection10.1007/s42235-022-00253-6 ↗
36. Hybrid dipper throated and grey wolf optimization for feature selection applied to life benchmark datasets10.32604/cmc.2023.033042 ↗
37. Improved whale optimization with local-search method for feature selection10.32604/cmc.2023.033509 ↗
38. A novel feature selection using binary hybrid improved whale optimization algorithm10.1007/s11227-023-05067-9 ↗
39. Hybrid binary COOT algorithm with simulated annealing for feature selection in high-dimensional microarray data10.1007/s00521-022-07780-7 ↗
40. No free lunch theorems for optimization10.1109/4235.585893 ↗
41. A. Frank, “UCI machine learning repository,” 2010. [Online]. Available: http://archive. ics. uci. edu/ml (accessed on 01/10/2022)
42. Thaher · Evolutionary Machine Learning Techniques: Algorithms and Applications · 2020 · 251
43. Feature selection via a novel chaotic crow search algorithm10.1007/s00521-017-2988-6 ↗