journal article·2022-12-31Open access

Binary Starling Murmuration Optimizer Algorithm to Select Effective Features from Medical Data

Mohammad H. Nadimi-Shahraki, Zahra Asghari Varzaneh, Hoda Zamani, Seyedali Mirjalili

Applied Sciences· Volume 13· Issue 1

Abstract

Feature selection is an NP-hard problem to remove irrelevant and redundant features with no predictive information to increase the performance of machine learning algorithms. Many wrapper-based methods using metaheuristic algorithms have been proposed to select effective features. However, they achieve differently on medical data, and most of them cannot find those effective features that may fulfill the required accuracy in diagnosing important diseases such as Diabetes, Heart problems, Hepatitis, and Coronavirus, which are targeted datasets in this study. To tackle this drawback, an algorithm is needed that can strike a balance between local and global search strategies in selecting effective features from medical datasets. In this paper, a new binary optimizer algorithm named BSMO is proposed. It is based on the newly proposed starling murmuration optimizer (SMO) that has a high ability to solve different complex and engineering problems, and it is expected that BSMO can also effectively find an optimal subset of features. Two distinct approaches are utilized by the BSMO algorithm when searching medical datasets to find effective features. Each dimension in a continuous solution generated by SMO is simply mapped to 0 or 1 using a variable threshold in the second approach, whereas in the first, binary versions of BSMO are developed using several S-shaped and V-shaped transfer functions. The performance of the proposed BSMO was evaluated using four targeted medical datasets, and results were compared with well-known binary metaheuristic algorithms in terms of different metrics, including fitness, accuracy, sensitivity, specificity, precision, and error. Finally, the superiority of the proposed BSMO algorithm was statistically analyzed using Friedman non-parametric test. The statistical and experimental tests proved that the proposed BSMO attains better performance in comparison to the competitive algorithms such as ACO, BBA, bGWO, and BWOA for selecting effective features from the medical datasets targeted in this study.
Source: crossref · Quality: baseline

Research context

OpenAlex topics: Metaheuristic Optimization Algorithms Research · Machine Learning and Data Classification · Artificial Intelligence in Healthcare

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

Faculty of Computer Engineering, Najafabad Branch, Islamic Azad University, Najafabad 8514143131, Iran

Big Data Research Center, Najafabad Branch, Islamic Azad University, Najafabad 8514143131, Iran

Centre for Artificial Intelligence Research and Optimisation, Torrens University Australia, Brisbane, QLD 4006, Australia

Department of Computer Science, Faculty of Mathematics and Computer, Shahid Bahonar University of Kerman, Kerman 7616914111, Iran

Yonsei Frontier Lab, Yonsei University, Seoul 03722, Republic of Korea

References (100+)

Show source-provided references
1. An analytical method for diseases prediction using machine learning techniques10.1016/j.compchemeng.2017.06.011 ↗
2. Harmony search: Current studies and uses on healthcare systems10.1016/j.artmed.2022.102348 ↗
3. An improved deep convolutional neural network by using hybrid optimization algorithms to detect and classify brain tumor using augmented MRI images10.1007/s11042-022-13260-w ↗
4. Intelligent mining of large-scale bio-data: Bioinformatics applications10.1080/13102818.2017.1364977 ↗
5. Staged reflexive artificial intelligence driven testing algorithms for early diagnosis of pituitary disorders10.1016/j.clinbiochem.2021.08.005 ↗
6. Heart Disease Prediction using Machine Learning Techniques10.1007/s42979-020-00365-y ↗
7. Artificial plant optimization algorithm to detect heart rate & presence of heart disease using machine learning10.1016/j.artmed.2019.101752 ↗
8. Forecasting of COVID-19 cases using deep learning models: Is it reliable and practically significant?10.1016/j.rinp.2021.103817 ↗
9. A review of feature selection methods in medical applications10.1016/j.compbiomed.2019.103375 ↗
10. An optimized feature selection based on genetic approach and support vector machine for heart disease10.1007/s10586-018-2416-4 ↗
11. A Hybrid Feature Selection With Ensemble Classification for Imbalanced Healthcare Data: A Case Study for Brain Tumor Diagnosis10.1109/ACCESS.2016.2647238 ↗
12. A survey on evolutionary computation approaches to feature selection10.1109/TEVC.2015.2504420 ↗
13. High-dimensional feature selection via feature grouping: A Variable Neighborhood Search approach10.1016/j.ins.2015.07.041 ↗
14. Yu, L., and Liu, H. (2003, January 21–24). Feature selection for high-dimensional data: A fast correlation-based filter solution. Proceedings of the 20th International Conference on Machine Learning (ICML-03), Washington, DC, USA.
15. An introduction to variable and feature selection
16. Literature review on feature selection methods for high-dimensional data
17. Wrappers for feature subset selection10.1016/S0004-3702(97)00043-X ↗
18. Feature Subset Selection Problem using Wrapper Approach in Supervised Learning
19. A new local search based hybrid genetic algorithm for feature selection10.1016/j.neucom.2011.03.034 ↗
20. Tran, B., Xue, B., and Zhang, M. (2019, January 13–17). Adaptive multi-subswarm optimisation for feature selection on high-dimensional classification. Proceedings of the Genetic and Evolutionary Computation Conference, Boston, MA, USA.10.1145/3321707.3321713 ↗
21. CCSA: Conscious Neighborhood-based Crow Search Algorithm for Solving Global Optimization Problems10.1016/j.asoc.2019.105583 ↗
22. Discrete farmland fertility optimization algorithm with metropolis acceptance criterion for traveling salesman problems10.1002/int.22342 ↗
23. An Area-Optimized Chip of Ant Colony Algorithm Design in Hardware Platform Using the Address-Based Method
24. Firefly-inspired algorithm for discrete optimization problems: An application to manufacturing cell formation10.1016/j.jmsy.2012.06.004 ↗
25. Gharehchopogh, F.S., Nadimi-Shahraki, M.H., Barshandeh, S., Abdollahzadeh, B., and Zamani, H. (2022). CQFFA: A Chaotic Quasi-oppositional Farmland Fertility Algorithm for Solving Engineering Optimization Problems. J. Bionic Eng., 1–26.10.1007/s42235-022-00255-4 ↗
26. Nadimi-Shahraki, M.H., Fatahi, A., Zamani, H., Mirjalili, S., and Oliva, D. (2022). Hybridizing of Whale and Moth-Flame Optimization Algorithms to Solve Diverse Scales of Optimal Power Flow Problem. Electronics, 11.10.3390/electronics11050831 ↗
27. Eberhart, R., and Kennedy, J. (1995, January 4–6). A new optimizer using particle swarm theory. Proceedings of the MHS’95 Proceedings of the sixth International Symposium on Micro Machine and Human Science, Nagoya, Japan.
28. Dorigo, M., and Di Caro, G. (1999, January 6–9). Ant colony optimization: A new meta-heuristic. Proceedings of the 1999 Congress on Evolutionary Computation-CEC99 (Cat No 99TH8406), Washington, DC, USA.
29. Differential evolution–a simple and efficient heuristic for global optimization over continuous spaces10.1023/A:1008202821328 ↗
30. Cuckoo optimization algorithm10.1016/j.asoc.2011.05.008 ↗
31. Krill herd: A new bio-inspired optimization algorithm10.1016/j.cnsns.2012.05.010 ↗
32. A social spider algorithm for global optimization10.1016/j.asoc.2015.02.014 ↗
33. A novel metaheuristic method for solving constrained engineering optimization problems: Crow search algorithm10.1016/j.compstruc.2016.03.001 ↗
34. Grasshopper optimisation algorithm: Theory and application10.1016/j.advengsoft.2017.01.004 ↗
35. QANA: Quantum-based avian navigation optimizer algorithm10.1016/j.engappai.2021.104314 ↗
36. African vultures optimization algorithm: A new nature-inspired metaheuristic algorithm for global optimization problems10.1016/j.cie.2021.107408 ↗
37. An intelligent feature selection approach based on moth flame optimization for medical diagnosis
38. A novel optimal feature selection technique for medical data classification using ANOVA based whale optimization10.1007/s12652-020-02592-w ↗
39. Feature selection based on whale optimization algorithm for diseases diagnosis
40. Enhanced whale optimization algorithm for medical feature selection: A COVID-19 case study10.1016/j.compbiomed.2022.105858 ↗
41. Starling murmuration optimizer: A novel bio-inspired algorithm for global and engineering optimization10.1016/j.cma.2022.114616 ↗
42. Binary bat algorithm10.1007/s00521-013-1525-5 ↗
43. Binary grey wolf optimization approaches for feature selection10.1016/j.neucom.2015.06.083 ↗
44. Using semi-independent variables to enhance optimization search10.1016/j.eswa.2018.11.031 ↗
45. Kira, K., and Rendell, L.A. (1992). A practical approach to feature selection. Machine Learning Proceedings, Elsevier.10.1016/B978-1-55860-247-2.50037-1 ↗
46. Feature selection: A data perspective
47. A review of feature selection methods on synthetic data10.1007/s10115-012-0487-8 ↗
48. Brezočnik, L., Fister Jr, I., and Podgorelec, V. (2018). Swarm intelligence algorithms for feature selection: A review. Appl. Sci., 8.10.3390/app8091521 ↗
49. A review of unsupervised feature selection methods10.1007/s10462-019-09682-y ↗
50. Anomaly-based intrusion detection system through feature selection analysis and building hybrid efficient model10.1016/j.jocs.2017.03.006 ↗
51. Building an Intrusion Detection System Using a Filter-Based Feature Selection Algorithm10.1109/TC.2016.2519914 ↗
52. Khater, B., Wahab, A.A., Idris, M., Hussain, M., Ibrahim, A., Amin, M., and Shehadeh, H. (2021). Classifier Performance Evaluation for Lightweight IDS Using Fog Computing in IoT Security. Electronics, 10.10.3390/electronics10141633 ↗
53. A Feature Selection Based on the Farmland Fertility Algorithm for Improved Intrusion Detection Systems10.1007/s10922-022-09653-9 ↗
54. Feature Selection with Binary Symbiotic Organisms Search Algorithm for Email Spam Detection10.1142/S0219622020500546 ↗
55. Binary PSO with mutation operator for feature selection using decision tree applied to spam detection10.1016/j.knosys.2014.03.015 ↗
56. Novel feature selection methods to financial distress prediction10.1016/j.eswa.2013.09.047 ↗
57. Input feature selection for classification problems10.1109/72.977291 ↗
58. A hybrid machine learning technique for feature optimization in object-based classification of debris-covered glaciers10.1016/j.asej.2022.101809 ↗
59. Particle Swarm Optimization for Feature Selection in Classification: A Multi-Objective Approach10.1109/TSMCB.2012.2227469 ↗
60. Plant intelligence based metaheuristic optimization algorithms10.1007/s10462-016-9486-6 ↗
61. Chaotic bee colony algorithms for global numerical optimization10.1016/j.eswa.2010.02.042 ↗
62. Comparative Assessment Of Light-based Intelligent Search And Optimization Algorithms10.33383/2019-029 ↗
63. Mafarja, M., Eleyan, D., Abdullah, S., and Mirjalili, S. (2017, January 19–20). S-shaped vs. V-shaped transfer functions for ant lion optimization algorithm in feature selection problem. Proceedings of the International Conference on Future Networks and Distributed Systems, Cambridge, UK.10.1145/3102304.3102325 ↗
64. BGSA: Binary gravitational search algorithm10.1007/s11047-009-9175-3 ↗
65. De Souza, R.C.T., dos Santos Coelho, L., De Macedo, C.A., and Pierezan, J. (2018, January 8–13). A V-shaped binary crow search algorithm for feature selection. Proceedings of the 2018 IEEE Congress on Evolutionary Computation (CEC), Rio de Janeiro, Brazil.10.1109/CEC.2018.8477975 ↗
66. Binary dragonfly optimization for feature selection using time-varying transfer functions10.1016/j.knosys.2018.08.003 ↗
67. Mirjalili, S., Zhang, H., Mirjalili, S., Chalup, S., and Noman, N. (2020). A Novel U-Shaped Transfer Function for Binary Particle Swarm Optimisation. Soft Computing for Problem Solving 2019, Springer.10.1007/978-981-15-3290-0_19 ↗
68. AIEOU: Automata-based improved equilibrium optimizer with U-shaped transfer function for feature selection10.1016/j.knosys.2021.107283 ↗
69. Binary social mimic optimization algorithm with X-shaped transfer function for feature selection10.1109/ACCESS.2020.2996611 ↗
70. Z-Shaped Transfer Functions for Binary Particle Swarm Optimization Algorithm10.1155/2020/8846021 ↗
71. Ramasamy, A., Mondry, A., Holmes, C., and Altman, D.G. (2008). Key Issues in Conducting a Meta-Analysis of Gene Expression Microarray Datasets. PLOS Med., 5.10.1371/journal.pmed.0050184 ↗
72. Heuristic filter feature selection methods for medical datasets10.1016/j.ygeno.2019.07.002 ↗
73. A new COVID-19 intubation prediction strategy using an intelligent feature selection and K-NN method10.1016/j.imu.2021.100825 ↗
74. An efficient binary chimp optimization algorithm for feature selection in biomedical data classification10.1007/s00521-021-06775-0 ↗
75. Nadimi-Shahraki, M.H., Fatahi, A., Zamani, H., and Mirjalili, S. (2022). Binary Approaches of Quantum-Based Avian Navigation Optimizer to Select Effective Features from High-Dimensional Medical Data. Mathematics, 10.10.3390/math10152770 ↗
76. Coronavirus herd immunity optimizer with greedy crossover for feature selection in medical diagnosis10.1016/j.knosys.2021.107629 ↗
77. Feature selection strategy based on hybrid crow search optimization algorithm integrated with chaos theory and fuzzy c-means algorithm for medical diagnosis problems10.1007/s00500-019-03988-3 ↗
78. A hybrid ensemble-filter wrapper feature selection approach for medical data classification10.1016/j.chemolab.2021.104396 ↗
79. Binary atom search optimisation approaches for feature selection10.1080/09540091.2020.1741515 ↗
80. Improved Reptile Search Optimization Algorithm using Chaotic map and Simulated Annealing for Feature Selection in Medical Filed10.1109/ACCESS.2022.3174854 ↗
81. Binary ant lion approaches for feature selection10.1016/j.neucom.2016.03.101 ↗
82. A return-cost-based binary firefly algorithm for feature selection10.1016/j.ins.2017.08.047 ↗
83. Chaotic dragonfly algorithm: An improved metaheuristic algorithm for feature selection10.1007/s10489-018-1261-8 ↗
84. Binary Chimp Optimization Algorithm (BChOA): A New Binary Meta-heuristic for Solving Optimization Problems10.1007/s12559-021-09933-7 ↗
85. AltWOA: Altruistic Whale Optimization Algorithm for feature selection on microarray datasets10.1016/j.compbiomed.2022.105349 ↗
86. S-shaped and V-shaped binary African vulture optimization algorithm for feature selection10.1111/exsy.13079 ↗
87. A hybrid binary dwarf mongoose optimization algorithm with simulated annealing for feature selection on high dimensional multi-class datasets10.1038/s41598-022-18993-0 ↗
88. A GA-based feature selection and parameters optimizationfor support vector machines10.1016/j.eswa.2005.09.024 ↗
89. S-shaped versus V-shaped transfer functions for binary Particle Swarm Optimization10.1016/j.swevo.2012.09.002 ↗
90. Kennedy, J., and Eberhart, R.C. (1997, January 12–15). A discrete binary version of the particle swarm algorithm. Proceedings of the 1997 IEEE International Conference on Systems, man, and Cybernetics Computational Cybernetics and Simulation, Orlando, FL, USA.
91. Blake, C. (2021, July 22). UCI repository of machine learning databases. Available online: http://www.ics.uci.edu/~mlearn/MLRepository-html-1998.
92. COVID-19 patient health prediction using boosted random forest algorithm10.3389/fpubh.2020.00357 ↗
93. Guo, G., Wang, H., Bell, D., Bi, Y., and Greer, K. (2003, January 22–26). KNN model-based approach in classification. Proceedings of the OTM Confederated International Conferences on the Move to Meaningful Internet Systems, Rhodes, Greece.10.1007/978-3-540-39964-3_62 ↗
94. Learning k for knn classification
95. Efficient kNN Classification With Different Numbers of Nearest Neighbors10.1109/TNNLS.2017.2673241 ↗
96. A study of statistical techniques and performance measures for genetics-based machine learning: Accuracy and interpretability10.1007/s00500-008-0392-y ↗
97. A systematic analysis of performance measures for classification tasks10.1016/j.ipm.2009.03.002 ↗
98. The diagnostic odds ratio: A single indicator of test performance10.1016/S0895-4356(03)00177-X ↗
99. The COVID-19 pandemic10.1080/10408363.2020.1783198 ↗
100. COVID-19 outbreak: Migration, effects on society, global environment and prevention10.1016/j.scitotenv.2020.138882 ↗