Hyperband-Optimized CNN-BiLSTM with Attention Mechanism for Corporate Financial Distress Prediction
Source abstract
Abstract
In the context of new quality productive forces, enterprises must leverage technological innovation and intelligent management to enhance financial risk resilience. This article proposes a financial distress prediction model based on deep learning, combined with a CNN, BiLSTM, and attention mechanism, using SMOTE for sample imbalance and Hyperband for hyperparameter optimization. Among four CNN-BiLSTM-AT model structures and seven mainstream models (CNN, BiLSTM, CNN-BiLSTM, CNN-AT, BiLSTM-AT, CNN-GRU, and Transformer), the 1CNN-1BiLSTM-AT model achieved the highest validation accuracy and relatively faster training speed. We conducted 100 repeated experiments using data from two companies, with validation on 2025 data, confirming the model’s stability and effectiveness in real-world scenarios. This article lays a solid empirical foundation for further optimization of financial distress warning models.
Source: crossref · Quality: baseline
Research context
OpenAlex topics: Imbalanced Data Classification Techniques · Financial Distress and Bankruptcy Prediction · Stock Market Forecasting Methods
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
Affiliations
Department of Mathematics, Mahasarakham University, Maha Sarakham 44150, Thailand
School of Computer Science and Engineering, Guangzhou Institute of Science and Technology, Guangzhou 510540, China
Funding
Mahasarakham University · Guangdong Philosophy and Social Science Foundation Project
References (24)
Show source-provided references
1. Self-taught learning of a deep invariant representation for visual tracking via temporal slowness principle10.1016/j.patcog.2015.02.012 ↗
2. Empirical asset pricing via machine learning10.1093/rfs/hhaa009 ↗
3. Bankruptcy prediction using imaged financial ratios and convolutional neural networks10.1016/j.eswa.2018.09.039 ↗
4. Forecasting the equity premium: Do deep neural network models work?10.61351/mf.v1i1.2 ↗
5. Research on Enterprise Financial Crisis Warning Model Based on Deep Learning Neural Network
6. Aslam, S., Rasool, A., Jiang, Q., and Qu, Q. (2021, January 15–19). LSTM based model for real-time stock market prediction on unexpected incidents. Proceedings of the 2021 IEEE International Conference on Real-Time Computing and Robotics (RCAR), Xining, China.10.1109/RCAR52367.2021.9517625 ↗
7. Siami-Namini, S., Tavakoli, N., and Namin, A.S. (2019, January 9–12). The performance of LSTM and BiLSTM in forecasting time series. Proceedings of the 2019 IEEE International Conference on Big Data (Big Data), Los Angeles, CA, USA.10.1109/BigData47090.2019.9005997 ↗
8. Tao, L.H. (2022). Research on the Early Warning of Enterprise Financial Crisis Based on Transformer. [Master’s Thesis, Hunan University of Science and Technology].
9. Systemic financial risk early warning of financial market in China using Attention-LSTM model10.1016/j.najef.2021.101383 ↗
10. Design of a corporate financial crisis prediction model based on improved ABC-RNN+ Bi-LSTM algorithm in the context of sustainable development10.7717/peerj-cs.1287 ↗
11. Enhancing Financial Risk Prediction Using TG-LSTM Model: An Innovative Approach with Applications to Public Health Emergencies10.1007/s13132-024-02081-x ↗
12. A CNN-BiLSTM-AM method for stock price prediction10.1007/s00521-020-05532-z ↗
13. A CNN-BiLSTM model with attention mechanism for earthquake prediction10.1007/s11227-023-05369-y ↗
14. MFB: A generalized multimodal fusion approach for bitcoin price prediction using time-lagged sentiment and indicator features10.1016/j.eswa.2024.125515 ↗
15. A study on stock price prediction based on Hyperband-LSTM model
16. Neocognitron: A self-organizing neural network model for a mechanism of pattern recognition unaffected by shift in position10.1007/BF00344251 ↗
17. Gradient-based learning applied to document recognition10.1109/5.726791 ↗
18. Learning to forget: Continual prediction with LSTM10.1162/089976600300015015 ↗
19. Long short-term memory10.1162/neco.1997.9.8.1735 ↗
20. Bahdanau, D., Cho, K., and Bengio, Y. (2014). Neural machine translation by jointly learning to align and translate. arXiv.
21. Hyperband: A novel bandit-based approach to hyperparameter optimization
22. SMOTE: Synthetic minority over-sampling technique10.1613/jair.953 ↗
23. A comparison of alternative tests of significance for the problem of m rankings10.1214/aoms/1177731944 ↗
24. Multiple comparisons using rank sums10.1080/00401706.1964.10490181 ↗