Ensemble Deep Learning Models for Multi-Class DNA Sequence Classification: A Comparative Study of CNN, BiLSTM, and GRU Architectures
Source abstract
Abstract
DNA sequence classification is a fundamental problem in bioinformatics, playing an indispensable role in gene annotation and disease prediction. Whereas most deep learning models, such as CNNs, BiLSTM networks, and GRUs, have been found individually optimal, each of these methods excels in modeling a specific aspect of sequence data: local motifs, long-range dependencies, and efficient temporal modeling of the sequences. Here, we present and evaluate an ensemble model that integrates CNN, BiLSTM, and GRU architectures via a majority voting combination scheme so that their complementary strengths can be harnessed. We trained and evaluated each standalone and the integrated model on a DNA dataset comprising 4380 sequences falling under five functional categories. The ensemble model achieved a classification accuracy of 90.6% with precision, recall, and F1 score equal to 0.91, thereby outperforming the state-of-the-art techniques by large margins. Although previous studies have tried analyzing each Deep Learning method individually for DNA classification tasks, none have attempted a systematic combination of CNN, BiLSTM, and GRU based on their ability to extract features simultaneously. The current research aims at presenting a novel method that combines these architectures based on a Majority Voting strategy and proves how their combination is better at extracting local patterns and long dependency information when compared individually. In particular, the proposed ensemble model smoothed the high recall of BiLSTM with the high precision of CNN, leading to more robust and reliable classification. The experiments involved a publicly available DNA sequence data set of 4380 sequences distributed over 5 classes. Our results emphasized the prospect of hybrid ensemble deep learning as a strong approach for complex genomic data analysis, opening ways toward more accurate and interpretable bioinformatics research.
Source: crossref · Quality: baseline
Research context
OpenAlex topics: Machine Learning in Bioinformatics · Fractal and DNA sequence analysis · Genomics and Phylogenetic Studies
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
Affiliations
Department of Information Systems, University of South Africa, Johannesburg 1709, South Africa
Centre for Augmented Intelligence and Data Science (CAIDS), Science Campus, University of South Africa, Florida 1709, South Africa
Department of Electrical and Smart Systems Engineering, University of South Africa, Johannesburg 1709, South Africa
Funding
School of Computing · ROI Research Output incentive
References (31)
Show source-provided references
1. Enriching word vectors with subword information
2. Cho, K., Van Merriënboer, B., Gulcehre, C., Bahdanau, D., Bougares, F., Schwenk, H., and Bengio, Y. (2014, January 25–29). Learning phrase representations using an RNN encoder-decoder for statistical machine translation. Proceedings of the 2014 Conference on Empirical Methods in Natural Language Processing, Doha, Qatar.10.3115/v1/D14-1179 ↗
3. Chung, J., Gulcehre, C., Cho, K., and Bengio, Y. (2014). Empirical evaluation of gated recurrent neural networks on sequence modeling. arXiv.
4. Dietterich, T.G. (2000). Ensemble methods in machine learning. Multiple Classifier Systems, Proceedings of the First International Workshop, MCS 2000, Cagliari, Italy, 21–23 June 2000, Springer.10.1007/3-540-45014-9_1 ↗
5. DNA sequencing using a machine learning algorithm10.55248/gengpi.5.0524.1434 ↗
6. Dixit, P., and Prajapati, I.G. (2015, January 21–22). Machine Learning in Bioinformatics: A Novel Approach for DNA Sequencing. Proceedings of the 2015 Fifth International Conference on Advanced Computing & Communication Technologies, Haryana, India.10.1109/ACCT.2015.73 ↗
7. Diversity in Genomic Studies: A Roadmap to Address the Imbalance10.1038/s41591-021-01672-4 ↗
8. Deep Learning Models for DNA Sequence Classification: Applications and Challenges
9. Hastie, T., Tibshirani, R., and Friedman, J.H. (2022). The Elements of Statistical Learning: Data Mining, Inference, and Prediction, Springer. [2nd ed.].
10. Long short-term memory10.1162/neco.1997.9.8.1735 ↗
11. Hossain, P.S., Kim, K., Uddin, J., Samad, A., and Choi, K. (2023). Enhancing Taxonomic Categorization of DNA Sequences with Deep Learning: A Multi-Label Approach. Bioengineering, 10.10.3390/bioengineering10111293 ↗
12. Optimizing classification efficiency with machine learning techniques for pattern matching10.1186/s40537-023-00804-6 ↗
13. A Deep Learning Model for DNA Enhancer Prediction based on Nucleotide Position Aware Feature Encoding10.1016/j.isci.2024.110030 ↗
14. Application of GRU networks for predicting protein secondary structure
15. A Survey of Machine Learning Models for DNA Sequence Classification
16. BiLSTM network-based deep learning model for human activity recognition
17. A novel deep learning model for the classification of gene sequences using convolutional neural networks
18. Miah, J., Ayon, E.H.A., Ghosh, B.P.G., Mia, T., Sarker, S.U.S., and Islam, T. (2024, January 11). Enhancing Viral DNA Sequence Classification Using Hybrid Deep Learning Models and Genetic Algorithm Optimization. Available online: https://ssrn.com/abstract=4692259.
19. Machine learning empowered next-generation DNA sequencing: Perspective and prospectus10.1039/D4SC01714E ↗
20. A comprehensive tool for rapid and accurate prediction of disease using a DNA sequence classifier10.1007/s12652-022-04099-y ↗
21. Challenges and Opportunities in DNA Sequence Pattern Recognition: A Survey
22. O’Reilly, K., and Jones, D. (2023, January 23–27). Innovations in DNA Sequence Analysis: Addressing Gaps in Geometric and Correlation-Based Approaches. Proceedings of the 2023 European Conference on Bioinformatics (ECBio), Lyon, France.
23. Ashraf, S., Ahmad, M., and Aslam, N. (2021). Analysis of DNA sequence classification using CNN and hybrid models. BMC Bioinform., 22.10.1155/2021/1835056 ↗
24. Kaur, H., Singh, A., and Malhotra, P. (2024). Comparison of deep learning approaches for DNA-binding protein classification using CNN and hybrid models. Proceedings of the International Conference on Machine Intelligence and Data Science Applications, Springer. Available online: https://link.springer.com/chapter/10.1007/978-981-99-5881-8_7.
25. SaPt-CNN-LSTM-AR-EA: A hybrid ensemble learning framework for time series-based multivariate DNA sequence prediction
26. Li, Z., Subasri, V., Shen, Y., Li, D., Zhao, Y., Stan, G.-B., and Shan, C. (2025). Omni-DNA: A Unified Genomic Foundation Model for Cross-Modal and Multi-Task Learning. arXiv.
27. Duan, Q., Huang, B., Song, Z., Lehmann, I., Gu, L., Eils, R., and Wild, B. (2025). JanusDNA: A Powerful Bi-directional Hybrid DNA Foundation Model. arXiv.
28. Awasthi, R., Mend Mend Arachchige, G.S., and Zhu, X. (2025). Unsupervised Evaluation of Pre-Trained DNA Language Model Embeddings. BMC Genom., 26.10.1186/s12864-025-11913-2 ↗
29. A DNA Language Model Based on Multispecies Alignment Predicts the Effects of Genome-Wide Variants10.1038/s41587-024-02511-w ↗
30. Graph neural network–driven text classification for fire-door defect inspection in pre-completion construction10.1038/s41598-025-28120-4 ↗
31. Dynamic building defect categorization through enhanced unsupervised text classification with domain-specific corpus embedding methods10.1016/j.autcon.2023.105182 ↗