journal article·2023Open access

Improved Whale Optimization with Local-Search Method for燜eature燬election

Malek Alzaqebah, Mutasem K. Alsmadi, Sana Jawarneh, Jehad Saad Alqurni, Mohammed Tayfour, Ibrahim Almarashdeh, Rami Mustafa A. Mohammad, Fahad A. Alghamdi, Nahier Aldhafferi, Abdullah Alqahtani, Khalid A. Alissa, Bashar A. Aldeeb, Usama A. Badawi, Maram Alwohaibi, Hayat Alfagham

Computers, Materials & Continua· Volume 75· Issue 1

Abstract

Various feature selection algorithms are usually employed to improve classification models’ overall performance. Optimization algorithms typically accompany such algorithms to select the optimal set of features. Among the most currently attractive trends within optimization algorithms are hybrid metaheuristics. The present paper presents two Stages of Local Search models for feature selection based on WOA (Whale Optimization Algorithm) and Great Deluge (GD). GD Algorithm is integrated with the WOA algorithm to improve exploitation by identifying the most promising regions during the search. Another version is employed using the best solution found by the WOA algorithm and exploited by the GD algorithm. In addition, disruptive selection (DS) is employed to select the solutions from the population for local search. DS is chosen to maintain the diversity of the population via enhancing low and high-quality solutions. Fifteen (15) standard benchmark datasets provided by the University of California Irvine (UCI) repository were used in evaluating the proposed approaches’ performance. Next, a comparison was made with four population-based algorithms as wrapper feature selection methods from the literature. The proposed techniques have proved their efficiency in enhancing classification accuracy compared to other wrapper methods. Hence, the WOA can search effectively in the feature space and choose the most relevant attributes for classification tasks.
Source: openalex_inverted_index · Quality: baseline

Research context

OpenAlex topics: Metaheuristic Optimization Algorithms Research · Machine Learning and Data Classification · Water Quality Monitoring Technologies

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

References (67)

Show source-provided references
1. J. Han, M. Kamber and J. Pei, Data mining: Concepts and techniques, 3rd ed., San Francisco, CA, USA: Morgan Kaufmann Publishers Inc., pp. 111–118, 2011.
2. The impact of preprocessing on data mining: An evaluation of classifier sensitivity in direct marketing10.1016/j.ejor.2005.07.023 ↗
3. Liu · The Springer International Series in Engineering and Computer Science · 2012 · 454 · 151
4. Wrapper–filter feature selection algorithm using a memetic framework10.1109/TSMCB.2006.883267 ↗
5. Wrappers for feature subset selection10.1016/S0004-3702(97)00043-X ↗
6. Toward integrating feature selection algorithms for classification and clustering10.1109/TKDE.2005.66 ↗
7. Binary coordinate ascent: An efficient optimization technique for feature subset selection for machine learning10.1016/j.knosys.2016.07.026 ↗
8. A novel population-based local search for nurse rostering problem
9. Hybrid brain storm optimization algorithm and late acceptance hill climbing to solve the flexible job-shop scheduling problem10.1016/j.jksuci.2020.09.004 ↗
10. Talbi · Metaheuristics: From Design to Implementation · 2009 · 74 · 23
11. An introduction to variable and feature selection
12. A hybrid approach of differential evolution and artificial bee colony for feature selection10.1016/j.eswa.2016.06.004 ↗
13. Tabu search for attribute reduction in rough set theory10.1007/s00500-007-0260-1 ↗
14. Semantics-preserving dimensionality reduction: Rough and fuzzy-rough-based approaches10.1109/TKDE.2004.96 ↗
15. A fuzzy record-to-record travel algorithm for solving rough set attribute reduction10.1080/00207721.2013.791000 ↗
16. Record-to-record travel algorithm for attribute reduction in rough set theory
17. A new local search based hybrid genetic algorithm for feature selection10.1016/j.neucom.2011.03.034 ↗
18. A survey on fish classification techniques
19. Content-based image retrieval using color, shape and texture descriptors and features10.1007/s13369-020-04384-y ↗
20. Two-step particle swarm optimization to solve the feature selection problem
21. An enhanced particle swarm optimization for itc2021 sports timetabling10.32604/cmc.2022.025077 ↗
22. An hybrid particle swarm optimization with crow search algorithm for feature selection10.1016/j.mlwa.2021.100108 ↗
23. An advanced ACO algorithm for feature subset selection10.1016/j.neucom.2014.06.067 ↗
24. A real time IDSs based on artificial bee colony-support vector machine algorithm
25. New optimization heuristics10.1006/jcph.1993.1010 ↗
26. The whale optimization algorithm10.1016/j.advengsoft.2016.01.008 ↗
27. Study of the economic dispatch problem on IEEE 30-bus system using whale optimization algorithm10.15282/ijets.5.2016.1.2.1041 ↗
28. Enhanced whale optimization algorithm for sizing optimization of skeletal structures10.1080/15397734.2016.1213639 ↗
29. A whale optimization algorithm approach for unit commitment problem solution
30. A taxonomy of hybrid metaheuristics10.1023/A:1016540724870 ↗
31. Hybrid genetic algorithms for feature selection10.1109/TPAMI.2004.105 ↗
32. Combining simulated annealing with local search heuristics10.1007/BF02601639 ↗
33. Hybrid tabu search-simulated annealing method to solve optimal reactive power problem10.1016/j.ijepes.2016.03.007 ↗
34. Developing a dynamic neighborhood structure for an adaptive hybrid simulated annealing–tabu search algorithm to solve the symmetrical traveling salesman problem10.1016/j.asoc.2016.08.036 ↗
35. Investigating memetic algorithm in solving rough set attribute reduction10.1504/IJCAT.2013.056915 ↗
36. A hybrid GA and SA algorithms for feature selection in recognition of hand-printed farsi characters
37. A novel hybrid genetic algorithm and simulated annealing for feature selection and kernel optimization in support vector regression
38. Hybrid soft computing techniques for feature selection and parameter optimization in power quality data mining10.1016/j.asoc.2011.05.010 ↗
39. Hybrid whale optimization algorithm with simulated annealing for feature selection10.1016/j.neucom.2017.04.053 ↗
40. Hybrid metaheuristic feature extraction technique for solving timetabling problem
41. T. W. Chin, “Feature selection for the fuzzy artmap neural network using a hybrid genetic algorithm and tabu search,” Master’s Dissertation, Universiti Sains Malaysia, Malaysia, 2007.
42. Fuzzy population-based meta-heuristic approaches for attribute reduction in rough set theory
43. A hybrid particle swarm optimization for feature subset selection by integrating a novel local search strategy10.1016/j.asoc.2016.01.044 ↗
44. Comparison of population based metaheuristics for feature selection: Application to microarray data classification
45. Feature selection of unreliable data using an improved multi-objective PSO algorithm10.1016/j.neucom.2015.07.057 ↗
46. A hybrid swarm optimization approach for feature set reduction in digital mammograms
47. A novel hybrid ACO-GA algorithm for text feature selection
48. Feature dimensionality reduction using a dual level metaheuristic algorithm
49. Ant-cuckoo colony optimization for feature selection in digital mammogram10.3923/pjbs.2014.266.271 ↗
50. Hybrid harmony search combined with stochastic local search for feature selection10.1007/s11063-015-9450-5 ↗
51. A survey on optimization metaheuristics10.1016/j.ins.2013.02.041 ↗
52. A survey on feature selection methods10.1016/j.compeleceng.2013.11.024 ↗
53. Metaheuristic algorithms on feature selection: A survey of one decade of research (2009–2019)10.1109/ACCESS.2021.3056407 ↗
54. A hybrid multi-stage learning technique based on brain storming optimization algorithm for breast cancer recurrence prediction10.1016/j.jksuci.2021.05.004 ↗
55. A review of the modification strategies of the nature inspired algorithms for feature selection problem10.3390/math10030464 ↗
56. A binary metaheuristic algorithm for wrapper feature selection
57. A wrapper-filter feature selection technique based on ant colony optimization10.1007/s00521-019-04171-3 ↗
58. An extended great deluge approach to the examination timetabling problem
59. Talbi · Metaheuristics: From Design to Implementation · 200910.1002/9780470496916 ↗
60. Comparison on the selection strategies in the artificial bee colony algorithm for examination timetabling problem
61. An introduction to kernel and nearest-neighbor nonparametric regression10.1080/00031305.1992.10475879 ↗
62. New optimization heuristics: The great deluge algorithm and the record-to-record travel10.1006/jcph.1993.1010 ↗
63. Using disruptive selection to maintain diversity in genetic algorithms10.1023/A:1008276600101 ↗
64. Binary ant lion approaches for feature selection10.1016/j.neucom.2016.03.101 ↗
65. Dua · UCI Machine Learning Repository · 2019
66. Hastie · The Elements of Statistical Learning · 2009 · 21910.1007/978-0-387-84858-7_7 ↗
67. Binary optimization using hybrid grey wolf optimization for feature selection10.1109/ACCESS.2019.2906757 ↗