journal article·2026-03-05Open access

Bioinspired Optimization for Feature Selection in Post-Compliance Risk Prediction

Álex Paz, Broderick Crawford, Eric Monfroy, Eduardo Rodriguez-Tello, José Barrera-García, Felipe Cisternas-Caneo, Benjamín López Cortés, Yoslandy Lazo, Andrés Yáñez, Álvaro Peña Fritz, Ricardo Soto

Biomimetics· Volume 11· Issue 3

Abstract

Bio-inspired metaheuristic optimization offers flexible search mechanisms for high-dimensional predictive problems under operational constraints. In administrative risk prediction settings, class imbalance and feature redundancy challenge conventional learning pipelines. This study evaluates a wrapper-based metaheuristic feature selection framework for post-compliance income declaration prediction using real longitudinal administrative records. The proposed approach integrates swarm-inspired optimization with supervised classifiers under a weighted objective function jointly prioritizing minority-class recall and subset compactness. Robustness is assessed through 31 independent stochastic runs per configuration. The empirical results indicate that performance effects are learner-dependent. For variance-prone classifiers, substantial minority-class recall gains are observed, with recall increasing from 0.284 to 0.849 for k-nearest neighbors and from 0.471 to 0.932 for Random Forest under optimized configurations. For LightGBM, optimized models maintain high recall levels (0.935–0.943 on average) with low dispersion, suggesting representational stabilization and dimensional compression rather than large absolute recall improvements. Optimized subsets retain approximately 16–33 features on average from the original 76-variable space. Within the evaluated experimental protocol, the findings show that metaheuristic-driven wrapper feature selection can reshape predictive representations under class imbalance, enabling simultaneous control of minority-class performance and feature dimensionality. Formal institutional deployment and cross-domain generalization remain subjects for future investigation.
Source: crossref · Quality: baseline

Research context

OpenAlex topics: Imbalanced Data Classification Techniques · Machine Learning and Data Classification · Explainable Artificial Intelligence (XAI)

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

Escuela de Ingeniería en Construcción y Transporte, Pontificia Universidad Católica de Valparaíso, Avenida Brasil 2147, Valparaíso 2362804, Chile

Laboratoire d’Étude et de Recherche en Informatique d’Angers (LERIA), Université d’ Angers, UFR Sciences, 2 Bd de Lavoisier, 49000 Angers, France

Escuela de Ingeniería Informática, Pontificia Universidad Católica de Valparaíso, Avenida Brasil 2241, Valparaíso 2362807, Chile

Cinvestav Unidad Tamaulipas, Km. 5.5 Carretera Victoria-Soto La Marina, Victoria 87130, Tamaulipas, Mexico

Department of Computer Science, Universidad de Alcalá, Alcalá de Henares, 28805 Madrid, Spain

References (38)

Show source-provided references
1. A Comprehensive Survey on Metaheuristic Algorithm for Feature Selection Techniques10.1016/j.matpr.2022.04.803 ↗
2. A comprehensive survey on recent metaheuristics for feature selection10.1016/j.neucom.2022.04.083 ↗
3. Abu Khurma, R., Aljarah, I., Sharieh, A., Abd Elaziz, M., Damaševičius, R., and Krilavičius, T. (2022). A Review of the Modification Strategies of the Nature Inspired Algorithms for Feature Selection Problem. Mathematics, 10.10.3390/math10030464 ↗
4. A Meta-Analysis Survey on the Usage of Meta-Heuristic Algorithms for Feature Selection on High-Dimensional Datasets10.1109/ACCESS.2022.3221194 ↗
5. Learning from Imbalanced Data10.1109/TKDE.2008.239 ↗
6. Torralba, A., and Efros, A.A. (2011). Unbiased look at dataset bias. Proceedings of the CVPR 2011, IEEE.10.1109/CVPR.2011.5995347 ↗
7. Recht, B., Roelofs, R., Schmidt, L., and Shankar, V. (2019, January 9–15). Do imagenet classifiers generalize to imagenet?. Proceedings of the International Conference on Machine Learning, Long Beach, CA, USA.
8. Multiclass feature selection with metaheuristic optimization algorithms: A review10.1007/s00521-022-07705-4 ↗
9. A systematic review of emerging feature selection optimization methods for optimal text classification: The present state and prospective opportunities10.1007/s00521-021-06406-8 ↗
10. Metaheuristic Algorithms on Feature Selection: A Survey of One Decade of Research (2009-2019)10.1109/ACCESS.2021.3056407 ↗
11. Approaches to Multi-Objective Feature Selection: A Systematic Literature Review10.1109/ACCESS.2020.3007291 ↗
12. Learning from imbalanced data: Open challenges and future directions10.1007/s13748-016-0094-0 ↗
13. Learning from class-imbalanced data: Review of methods and applications10.1016/j.eswa.2016.12.035 ↗
14. Putting continuous metaheuristics to work in binary search spaces10.1155/2017/8404231 ↗
15. Barrera-García, J., Cisternas-Caneo, F., Crawford, B., Gómez Sánchez, M., and Soto, R. (2023). Feature Selection Problem and Metaheuristics: A Systematic Literature Review about Its Formulation, Evaluation and Applications. Biomimetics, 9.10.3390/biomimetics9010009 ↗
16. A Review on Ensembles for the Class Imbalance Problem: Bagging-, Boosting-, and Hybrid-Based Approaches10.1109/TSMCC.2011.2161285 ↗
17. Paz, Á., Crawford, B., Monfroy, E., Barrera-García, J., Peña Fritz, Á., Soto, R., Cisternas-Caneo, F., and Yáñez, A. (2025). Machine Learning and Metaheuristics Approach for Individual Credit Risk Assessment: A Systematic Literature Review. Biomimetics, 10.10.3390/biomimetics10050326 ↗
18. A discrete binary version of the particle swarm algorithm10.1109/ICSMC.1997.637339 ↗
19. Binary grey wolf optimization approaches for feature selection10.1016/j.neucom.2015.06.083 ↗
20. Liu, W., Guo, Z., Jiang, F., Liu, G., Wang, D., and Ni, Z. (2022). Improved WOA and its application in feature selection. PLoS ONE, 17.10.1371/journal.pone.0267041 ↗
21. BOLDBERG, D. (1989). Genetic algorithms in search. Optimization and Machine Learning, Addison-Wesley Publishing Company, Inc.
22. Ant colony optimization10.1109/MCI.2006.329691 ↗
23. Improved binary particle swarm optimization for feature selection with new initialization and search space reduction strategies10.1016/j.asoc.2021.107302 ↗
24. An enhanced particle swarm optimization with position update for optimal feature selection10.1016/j.eswa.2024.123337 ↗
25. Improved Binary Grey Wolf Optimizer and Its application for feature selection10.1016/j.knosys.2020.105746 ↗
26. Multiple strategies based Grey Wolf Optimizer for feature selection in performance evaluation of open-ended funds10.1016/j.swevo.2024.101518 ↗
27. Hussien, A.G., Oliva, D., Houssein, E.H., Juan, A.A., and Yu, X. (2020). Binary whale optimization algorithm for dimensionality reduction. Mathematics, 8.10.3390/math8101821 ↗
28. Enhancing IoT (Internet of Things) feature selection: A two-stage approach via an improved whale optimization algorithm10.1016/j.eswa.2024.124936 ↗
29. The foundations of cost-sensitive learning
30. MEALPY: An open-source library for latest meta-heuristic algorithms in Python10.1016/j.sysarc.2023.102871 ↗
31. Scikit-learn: Machine Learning in Python
32. Lightgbm: A highly efficient gradient boosting decision tree
33. Analyzing the effects of binarization techniques when solving the set covering problem through swarm optimization10.1016/j.eswa.2016.10.054 ↗
34. Winkler, R.L., and Hays, W.L. (1975). Statistics: Probability, Inference, and Decision, Holt, Rinehart and Winston.
35. Cisternas-Caneo, F., Santamera-Lastras, M., Barrera-Garcia, J., Crawford, B., Soto, R., Brante-Aguilera, C., Garcés-Jiménez, A., Rodriguez-Puyol, D., and Gómez-Pulido, J.M. (2025). Application of Metaheuristics for Optimizing Predictive Models in iHealth: A Case Study on Hypotension Prediction in Dialysis Patients. Biomimetics, 10.10.3390/biomimetics10050314 ↗
36. Biblioteca del Congreso Nacional de Chile (2025, October 16). Ley 19.287. Modifica Ley 18.591 y Establece Normas Sobre Fondos Solidarios de Crédito Universitario Ministerio de Hacienda; Subsecretaría de Hacienda. Available online: https://www.bcn.cl/leychile/navegar?idNorma=30654.
37. Biblioteca del Congreso Nacional de Chile (2025, October 16). Decreto N° 225. Aprueba Reglamento de los Artículos 8° Inciso Quinto, 9° Inciso 1°, 19° y 3° Transitorio de la Ley N° 19.287, que Establece Normas Sobre Fondos Solidarios de Crédito Universitario. Ministerio de Educación Pública. Available online: https://www.bcn.cl/leychile/navegar?idNorma=11245.
38. Pontificia Universidad Católica de Valparaíso (2025, October 16). Fondo Solidario de Crédtio Universitario. Available online: https://estudiantespucv.cl/fscu/.