Cost-Sensitive Metaheuristic Optimization-Based Neural Network with Ensemble Learning for Financial Distress Prediction
Source abstract
Abstract
Financial distress prediction is crucial in the financial domain because of its implications for banks, businesses, and corporations. Serious financial losses may occur because of poor financial distress prediction. As a result, significant efforts have been made to develop prediction models that can assist decision-makers to anticipate events before they occur and avoid bankruptcy, thereby helping to improve the quality of such tasks. Because of the usual highly imbalanced distribution of data, financial distress prediction is a challenging task. Hence, a wide range of methods and algorithms have been developed over recent decades to address the classification of imbalanced datasets. Metaheuristic optimization-based artificial neural networks have shown exciting results in a variety of applications, as well as classification problems. However, less consideration has been paid to using a cost sensitivity fitness function in metaheuristic optimization-based artificial neural networks to solve the financial distress prediction problem. In this work, we propose ENS_PSONNcost and ENS_CSONNcost: metaheuristic optimization-based artificial neural networks that utilize a particle swarm optimizer and a competitive swarm optimizer and five cost sensitivity fitness functions as the base learners in a majority voting ensemble learning paradigm. Three extremely imbalanced datasets from Spanish, Taiwanese, and Polish companies were considered to avoid dataset bias. The results showed significant improvements in the g-mean (the geometric mean of sensitivity and specificity) metric and the F1 score (the harmonic mean of precision and sensitivity) while maintaining adequately high accuracy.
Source: crossref · Quality: baseline
Research context
OpenAlex topics: Financial Distress and Bankruptcy Prediction · Imbalanced Data Classification Techniques · Brain Tumor Detection and Classification
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
Affiliations
Department of Computer Architecture and Technology, ETSIIT-CITIC, University of Granada, 18011 Granada, Spain
King Abdullah II School for Information Technology, The University of Jordan, Amman 11942, Jordan
Research Centre for Information and Communications Technologies of the University of Granada (CITIC-UGR), University of Granada, 18011 Granada, Spain
Funding
Ministerio Español de Ciencia e Innovación
References (55)
Show source-provided references
1. Insolvency prediction model of the company: The case of the Republic of Serbia
2. Altman, E.I., and Hotchkiss, E. (2010). Corporate Financial Distress and Bankruptcy: Predict and Avoid Bankruptcy, Analyze and Invest in Distressed Debt, John Wiley & Sons.
3. Towards augmented kernel extreme learning models for bankruptcy prediction: Algorithmic behavior and comprehensive analysis10.1016/j.neucom.2020.10.038 ↗
4. An overview of classification algorithms for imbalanced datasets
5. Khurma, R.A., Aljarah, I., Sharieh, A., and Mirjalili, S. (2020). Evolopy-fs: An open-source nature-inspired optimization framework in python for feature selection. Evolutionary Machine Learning Techniques, Springer.10.1007/978-981-32-9990-0_8 ↗
6. A competitive swarm optimizer for large scale optimization10.1109/TCYB.2014.2322602 ↗
7. Tuning of the structure and parameters of a neural network using an improved genetic algorithm10.1109/TNN.2002.804317 ↗
8. Evolving multilayer perceptrons10.1023/A:1009684907680 ↗
9. G-Prop: Global optimization of multilayer perceptrons using GAs10.1016/S0925-2312(00)00302-7 ↗
10. Statistical analysis of the parameters of a neuro-genetic algorithm10.1109/TNN.2002.804281 ↗
11. COVNET: A cooperative coevolutionary model for evolving artificial neural networks10.1109/TNN.2003.810618 ↗
12. A cooperative constructive method for neural networks for pattern recognition10.1016/j.patcog.2006.06.024 ↗
13. Evolving artificial neural networks10.1109/5.784219 ↗
14. Review of meta-heuristic optimization based artificial neural networks and its applications10.1088/1742-6596/1362/1/012074 ↗
15. Particle swarm optimization (PSO). A tutorial10.1016/j.chemolab.2015.08.020 ↗
16. cPSO-CNN: An efficient PSO-based algorithm for fine-tuning hyper-parameters of convolutional neural networks10.1016/j.swevo.2019.06.002 ↗
17. A hybrid CBO–PSO algorithm for optimal design of truss structures with dynamic constraints10.1016/j.asoc.2015.05.010 ↗
18. Density-weighted support vector machines for binary class imbalance learning10.1007/s00521-020-05240-8 ↗
19. Comparing the performance of deep learning methods to predict companies’ financial failure10.1109/ACCESS.2021.3093461 ↗
20. Selective oversampling approach for strongly imbalanced data10.7717/peerj-cs.604 ↗
21. Performance analysis of cost-sensitive learning methods with application to imbalanced medical data10.1016/j.imu.2021.100690 ↗
22. Business Failure Prediction Based on a Cost-Sensitive Extreme Gradient Boosting Machine10.1109/ACCESS.2022.3168857 ↗
23. Montana, D.J., and Davis, L. (1989, January 20–25). Training feedforward neural networks using genetic algorithms. Proceedings of the IJCAI, Detroit, MI, USA.
24. A hybrid metaheuristic method in training artificial neural network for bankruptcy prediction10.1109/ACCESS.2020.3026529 ↗
25. Neuro-evolutionary models for imbalanced classification problems
26. Mahendru, K., Garg, G., Sharma, A., and Srivastava, R. (2021). Evolutionary Methods for Bankruptcy Prediction: A Study on Indian Firms. Soft Computing for Problem Solving, Springer.10.1007/978-981-16-2709-5_23 ↗
27. The Study of the Predictive Power of Meta-heuristic Algorithms to Provide a Model for Bankruptcy prediction
28. Mousavirad, S.J., Schaefer, G., Jalali, S.M.J., and Korovin, I. (2020, January 8–12). A benchmark of recent population-based metaheuristic algorithms for multi-layer neural network training. Proceedings of the 2020 Genetic And Evolutionary Computation Conference Companion, Cancun, Mexico.10.1145/3377929.3398144 ↗
29. A Novel Method for Credit Scoring Based on Cost-Sensitive Neural Network Ensemble10.1109/ACCESS.2021.3083490 ↗
30. Pisula, T. (2020). An ensemble classifier-based scoring model for predicting bankruptcy of polish companies in the Podkarpackie Voivodeship. J. Risk Financ. Manag., 13.10.3390/jrfm13020037 ↗
31. Hellinger distance weighted ensemble for imbalanced data stream classification10.1016/j.jocs.2021.101314 ↗
32. Eberhart, R., and Kennedy, J. (1995, January 4–6). A New Optimizer Using Particle Swarm Theory. Proceedings of the MHS’95. Sixth International Symposium on Micro Machine and Human Science, Nagoya, Japan.
33. Román, I., Gómez, M., la Torre, J., Merelo, J., and Mora, A. (2006, January 22–24). Predicting financial distress: Relationship between continued losses and legal bankrupcy. Proceedings of the 27th Annual Congress European Accounting Association, Dublin, Ireland.
34. Improving financial bankruptcy prediction in a highly imbalanced class distribution using oversampling and ensemble learning: A case from the Spanish market10.1007/s13748-019-00197-9 ↗
35. Financial ratios and corporate governance indicators in bankruptcy prediction: A comprehensive study10.1016/j.ejor.2016.01.012 ↗
36. Ensemble boosted trees with synthetic features generation in application to bankruptcy prediction10.1016/j.eswa.2016.04.001 ↗
37. A hybrid genetic-neural architecture for stock indexes forecasting10.1016/j.ins.2003.03.023 ↗
38. Time-series forecasting using flexible neural tree model10.1016/j.ins.2004.10.005 ↗
39. Recent advances in evolutionary computation10.1007/s11390-006-0001-4 ↗
40. On model-based evolutionary computation10.1007/s005000050055 ↗
41. Designing artificial neural networks using particle swarm optimization algorithms10.1155/2015/369298 ↗
42. Gómez, J.C., Hernández, F., Coello, C.A.C., Ronquillo, G., and Trejo, A. (2013, January 24–30). Flame classification through the use of an artificial neural network trained with a genetic algorithm. Proceedings of the Mexican International Conference on Artificial Intelligence, Mexico City, Mexico.10.1007/978-3-642-45111-9_15 ↗
43. Ensemble learning: A survey10.1002/widm.1249 ↗
44. Zhang, C., and Ma, Y. (2012). Ensemble Machine Learning: Methods and Applications, Springer.10.1007/978-1-4419-9326-7 ↗
45. Zhou, Z.H. (2021). Ensemble learning. Machine Learning, Springer.10.1007/978-981-15-1967-3_8 ↗
46. Zhang, C., and Ma, Y. (2012). Ensemble Learning. Ensemble Machine Learning: Methods and Applications, Springer.10.1007/978-1-4419-9326-7 ↗
47. Han, J., Pei, J., and Kamber, M. (2011). Data Mining: Concepts Tech., Elsevier.
48. Optimizing the learning process of feedforward neural networks using lightning search algorithm10.1142/S0218213016500330 ↗
49. Building a Hybrid Prediction Model to Evaluation of Financial Distress Corporate10.4028/www.scientific.net/AMM.651-653.1543 ↗
50. Bankruptcy prediction using extreme learning machine and financial expertise10.1016/j.neucom.2013.01.063 ↗
51. An insight into the experimental design for credit risk and corporate bankruptcy prediction systems10.1007/s10844-014-0333-4 ↗
52. Reviewing ensemble classification methods in breast cancer10.1016/j.cmpb.2019.05.019 ↗
53. Powers, D.M. (2020). Evaluation: From precision, recall and F-measure to ROC, informedness, markedness and correlation. arXiv.
54. Fernández, A., García, S., Galar, M., Prati, R.C., Krawczyk, B., and Herrera, F. (2018). Learning From Imbalanced Data Sets, Springer.10.1007/978-3-319-98074-4 ↗
55. Li, Y., Wang, Z., Xie, Y., Ding, B., Zeng, K., and Zhang, C. (2021, January 1–5). Automl: From methodology to application. Proceedings of the 30th ACM International Conference on Information &Knowledge Management, Online.10.1145/3459637.3483279 ↗