journal article·2026-03-18Open access

A CNN-ViT Hybrid Architecture Res101-MViT-Ens for Accurate and Lightweight Automated Ocular Disease Diagnosis

Hao Wang, Ting Ke, Hui Lv

Applied Sciences· Volume 16· Issue 6

Abstract

Automated ocular disease diagnosis faces critical challenges including insufficient diagnostic precision, local–global feature imbalance, rigid feature fusion, weak cross-domain generalization, and difficult lightweight deployment. This study aims to develop a high-performance, generalizable, and deployable hybrid deep learning architecture for accurate multi-class ocular disease diagnosis. We propose the Res101-MViT-Ens hybrid architecture, which fuses ResNet101 for local fine-grained feature extraction and MobileViT-XXS for global contextual modeling via an end-to-end dynamic learnable weight fusion mechanism, with class-balanced sampling and medically adaptive augmentation for data preprocessing. The model is validated on the ODIR-5K dataset and cross-evaluated on three heterogeneous datasets (MESSIDOR-2, Kaggle DR, EyePACS). It achieves 99.44% accuracy, a 99.41% F1-score, and 99.32% Kappa on ODIR-5K, with a 99.46% average cross-dataset accuracy, outperforming state-of-the-art models. With 54 M parameters and 42.6 ms per-image inference latency on the Snapdragon 8 Gen2 edge module (Qualcomm Technologies, Inc., San Diego, CA, USA), it outperforms mainstream edge architectures. This proposed architecture achieves state-of-the-art diagnostic precision; balances accuracy, generalization and practicality; and is suitable for lightweight grassroots deployment in ocular disease screening.
Source: crossref · Quality: baseline

Research context

OpenAlex topics: Retinal Imaging and Analysis · Advanced Neural Network Applications · COVID-19 diagnosis using AI

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

College of Artificial Intelligence, Tianjin University of Science & Technology, Tianjin 300457, China

College of Sciences, Tianjin University of Science & Technology, Tianjin 300457, China

Funding

Tianjin University Student Innovation and Entrepreneurship Training Program

References (30)

Show source-provided references
1. Artificial Intelligence with Optimal Deep Learning Enabled Automated Retinal Fundus Image Classification Model10.1111/exsy.13028 ↗
2. Wolf, F., and Gao, W. (2021). A Benchmark of Ocular Disease Intelligent Recognition: One Shot for Multi-Disease Detection, Springer International Publishing.
3. Thinh, P.L.D., Kiet, D.A., Binh, N.T., Mai, A., Phuong, N.T.M., and Anh, N.T. (2025). Doctor AI: A Hybrid Model for Clinical Ocular Disease Classification. Proceedings of the International Conference on Computational Intelligence in Engineering Science, Springer.10.1007/978-3-031-98161-6_6 ↗
4. HybridVisionNet: An Advanced Hybrid Deep Learning Framework for Automated Multi-Class Ocular Disease Diagnosis Using Fundus Imaging10.1016/j.asej.2025.103594 ↗
5. Pantelaios, D., Theofilou, P.-A., Tzouveli, P., and Kollias, S. (2024). Hybrid CNN-ViT Models for Medical Image Classification. Proceedings of the 2024 IEEE International Symposium on Biomedical Imaging (ISBI), IEEE.10.1109/ISBI56570.2024.10635205 ↗
6. Deep Learning10.1038/nature14539 ↗
7. Development and Validation of a Deep Learning Algorithm for Detection of Diabetic Retinopathy in Retinal Fundus Photographs10.1001/jama.2016.17216 ↗
8. He, K., Zhang, X., Ren, S., and Sun, J. (2016). Deep Residual Learning for Image Recognition. Proceedings of the 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), IEEE.10.1109/CVPR.2016.90 ↗
9. Dosovitskiy, A., Beyer, L., Kolesnikov, A., Weissenborn, D., Zhai, X., Unterthiner, T., Dehghani, M., Minderer, M., Heigold, G., and Gelly, S. (2020). An Image is Worth 16x16 Words: Transformers for Image Recognition at Scale. arXiv.
10. ViResGF-Net: Gated Multi-Scale Hybrid Vision Transformer for Robust Fundus Image Multi-Label Classification
11. Herrera-Chavez, A.I., Rodríguez-Martínez, E.A., Flores-Fuentes, W., Rodgíruez-Quiñonez, J.C., García-Gallegos, J.C., Montiel-Ross, O.H., Gonzàalez-Navarro, F.F., and Sergiyenko, O. (2024). Multi-Label Image Classification for Ocular Disease Diagnosis Using K-Fold Cross-Validation on the ODIR-5K Dataset. Proceedings of the 2024 IEEE 33rd International Symposium on Industrial Electronics (ISIE), IEEE.10.1109/ISIE54533.2024.10595740 ↗
12. A Hybrid Transformer-CNN Framework for Uncertainty-Guided Semi-Supervised Multiclass Eye Disease Classification with Enhanced Interpretability10.1016/j.compmedimag.2026.102701 ↗
13. Khan, I.A., Uzzaman, A., and Fattah, S.A. (2020). An Automatic Ocular Disease Detection Scheme from Enhanced Fundus Images Based on Ensembling Deep CNN Networks. Proceedings of the 2020 11th International Conference on Electrical and Computer Engineering (ICECE), IEEE.10.1109/ICECE51571.2020.9393050 ↗
14. Rasappan, S., Nishath, S.A., Kumaravel, S.K., Murugesan, R., Mohan, K.R., and Nagaram, N.B. (2025). Deep Learning for Ocular Disease Classification: A Study on ODIR-5K Dataset. Proceedings of the 2025 International Conference for Artificial Intelligence, Applications, Innovation and Ethics (AI2E), IEEE.10.1109/AI2E64943.2025.10983793 ↗
15. Vision Transformers in Medical Computer Vision—A Contemplative Retrospection10.1016/j.engappai.2023.106126 ↗
16. ViT-Based Multi-Scale Classification Using Digital Signal Processing and Image Transformation10.1109/ACCESS.2024.3389808 ↗
17. MaxGlaViT: A Novel Lightweight Vision Transformer-Based Approach for Early Diagnosis of Glaucoma Stages From Fundus Images10.1002/ima.70159 ↗
18. Yassine, B., and Rasool, G. (2021). Scopeformer: N-CNN-ViT Hybrid Model for Intracranial Hemorrhage Classification. arXiv.
19. PolSAR Image Classification Via a Multigranularity Hybrid CNN-ViT Model With External Tokens and Cross-Attention10.1109/JSTARS.2024.3384420 ↗
20. Abdullah, A.A., Aldhahab, A., and Al Abboodi, H.M. (2024). Detection and Classification of Eye Diseases Using Hybrid Deep Features with Decision Tree Algorithm. Proceedings of the 2024 3rd International Conference on Advances in Engineering Science and Technology (AEST), IEEE.10.1109/AEST63017.2024.10960200 ↗
21. Chibuike, O., and Yang, X. (2024). Convolutional Neural Network–Vision Transformer Architecture with Gated Control Mechanism and Multi-Scale Fusion for Enhanced Pulmonary Disease Classification. Diagnostics, 14.10.3390/diagnostics14242790 ↗
22. Automatic Cataract Grading Methods Based on Deep Learning10.1016/j.cmpb.2019.07.006 ↗
23. Multi-Class Multi-Label Ophthalmological Disease Detection Using Transfer Learning Based Convolutional Neural Network10.1016/j.bspc.2020.102329 ↗
24. Huo, G., Lin, Z., Wang, Z., Dai, R., and Tang, H. (2025). DMS-Net: Dual-Modal Multi-Scale Siamese Network for Binocular Fundus Image Classification. arXiv.
25. A Novel Deep Learning Framework for Retinal Disease Detection Leveraging Contextual and Local Features Cues from Retinal Images10.1007/s11517-025-03314-0 ↗
26. Ray, R., Jena, S., Dash, L., and Biswal, S.K. (2025). An Efficient CNN Based Hybrid Model for Cataract Classification on ODIR Dataset. Intelligent Computing Techniques and Applications, CRC Press. Available online: https://www.taylorfrancis.com/chapters/edit/10.1201/9781003658221-62/efficient-cnn-based-hybrid-model-cataract-classification-odir-dataset-rahul-ray-sudarson-jena-laxminarayan-dash-sangita-kumari-biswal.10.1201/9781003658221-62 ↗
27. Hussain, M.T., Faraz, M., Aziz, S., Iqtidar, K., Khan, M.U., and Montes, G.A. (2024). Detection of Ophthalmic Disorders Through Deep Feature Fusion. Proceedings of the 2024 International Conference on Engineering & Computing Technologies (ICECT), IEEE.10.1109/ICECT61618.2024.10581061 ↗
28. Asare, A., Agyemanh, D., Gookyi, D., Boateng, D., and Wulnye, F. (2025). Deploying and Evaluating Multiple Deep Learning Models on Edge Devices for Diabetic Retinopathy Detection. arXiv.
29. Adversarial Domain Adaptation for Robust Glaucoma Classification
30. Gurthula, R., Vanukuru, C., Chiluka, V., and Sumalata, M.S.G.L. (2024). Detection of Diabetic and Hypertensive Retinopathy Using Deep Learning Models. Proceedings of the 2024 3rd International Conference on Applied Artificial Intelligence and Computing (ICAAIC), IEEE.10.1109/ICAAIC60222.2024.10575049 ↗