Comparative Evaluation of Fusion Strategies Using Multi-Pretrained Deep Learning Fusion-Based (MPDLF) Model for Histopathology Image Classification
Source abstract
Abstract
Histopathological image analysis remains the cornerstone of cancer diagnosis; however, manual assessment is challenged by stain variability, differences in imaging magnification, and complex morphological patterns. The proposed multi-pretrained deep learning fusion (MPDLF) approach combines two widely used CNN architectures: ResNet50, which captures deeper semantic representations, and VGG16, which extracts fine-grained details. This work differs from previous fusion studies by providing a controlled evaluation of early, intermediate, and late fusion for integrating two pretrained CNN backbones (ResNet50 and VGG16) under single-modality histopathology constraints. To isolate the fusion effect, identical training settings are used across three public H&E datasets. Early fusion achieved the best test performance for the two primary tasks reported here: breast cancer binary classification (accuracy = 0.9070, 95% CI: 0.8742–0.9404; AUC = 0.9707, 95% CI: 0.9541–0.9844) and renal clear cell carcinoma (RCCC) five-class grading (accuracy = 0.8792, 95% CI: 0.8529–0.9041; AUC (OvR, macro) = 0.9895, 95% CI: 0.9859–0.9927). Future work will extend these experiments to additional magnification levels (100×, 200×, and 400×) for breast cancer histopathology images and explore advanced hybrid fusion strategies across different histopathology datasets.
Source: crossref · Quality: baseline
Research context
OpenAlex topics: AI in cancer detection · Advanced Neural Network Applications · Radiomics and Machine Learning in Medical Imaging
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
Affiliations
Department of Computer Science, College of Science, Sultan Qaboos University, Muscat 123, Oman
References (79)
Show source-provided references
1. (2025, August 10). American Cancer Society The Global Cancer Burden|American Cancer Society. Available online: https://www.cancer.org/about-us/our-global-health-work/global-cancer-burden.html.
2. (2025, August 10). WHO Cancer. Available online: https://www.who.int/news-room/fact-sheets/detail/cancer.
3. Dattani, S., Samborska, V., Ritchie, H., and Roser, M. (2025, August 10). Cancer—Our World in Data. Available online: https://ourworldindata.org/cancer.
4. (2025, August 10). WHO Global Cancer Burden Growing, Amidst Mounting Need for Services. Available online: https://www.who.int/news/item/01-02-2024-global-cancer-burden-growing--amidst-mounting-need-for-services.
5. The Need for Evidence-Based, Outcome-Focused Medical Imaging Research for Cancer Management10.1038/s44303-024-00067-7 ↗
6. Imaging and Cancer: A Review10.1016/j.molonc.2008.04.001 ↗
7. Multimodal Medical Image Fusion towards Future Research: A Review
8. Combining Diagnostic Imaging and Pathology for Improving Diagnosis and Prognosis of Cancer10.1155/2019/9429761 ↗
9. Histopathological Image Based Breast Cancer Diagnosis Using Deep Learning and Bio Inspired Optimization10.1038/s41598-025-04136-8 ↗
10. Liquid Biopsy in Cancer Current: Status, Challenges and Future Prospects10.1038/s41392-024-02021-w ↗
11. Mallick, I. (2025, August 10). An Overview of Histopathology. Available online: https://www.verywellhealth.com/histopathology-2252152.
12. Histopathological Image Analysis: A Review10.1109/RBME.2009.2034865 ↗
13. HEAL: An Automated Deep Learning Framework for Cancer Histopathology Image Analysis10.1093/bioinformatics/btab380 ↗
14. Bülent, Y. (2024). Histopathology Image Classi Fi Cation: Highlighting the Gap between Manual Analysis and AI Automation. Front. Oncol., 13.10.3389/fonc.2023.1325271 ↗
15. To the Clinic
16. Mezei, T., Kolcs, M., and Gurzu, S. (2024). Image Analysis in Histopathology and Cytopathology: From Early Days to Current Perspectives. J. Imaging, 10.10.3390/jimaging10100252 ↗
17. Artificial Intelligence in Lymphoma Histopathology: Systematic Review10.2196/62851 ↗
18. Digital Pathology As an Innovative Tool for Improving Cancer Diagnosis and Treatment10.15407/exp-oncology.2024.04.289 ↗
19. Optimal Deep Learning Model for Classification of Lung Cancer on CT Images10.1016/j.future.2018.10.009 ↗
20. Deep Learning for Lung Cancer Nodules Detection and Classification in CT Scans10.3390/ai1010003 ↗
21. Golatkar, A., Anand, D., and Sethi, A. (2018, January 27–29). Classification of Breast Cancer Histology Using Deep Learning. Proceedings of the Image Analysis and Recognition: 15th International Conference, ICIAR 2018, Póvoa de Varzim, Portugal.
22. A Deep Learning Method for Breast Cancer Classification in the Pathology Images10.1109/JBHI.2022.3187765 ↗
23. Saleh, A., Sukaik, R., and Abu-Naser, S.S. (2020, January 28–29). Brain Tumor Classification Using Deep Learning. Proceedings of the 2020 International Conference on Assistive and Rehabilitation Technologies (iCareTech), Gaza, Palestine.10.1109/iCareTech49914.2020.00032 ↗
24. Classification Using Deep Learning Neural Networks for Brain Tumors10.1016/j.fcij.2017.12.001 ↗
25. A Survey on Artificial Intelligence in Histopathology Image Analysis10.1002/widm.1474 ↗
26. Imran, M.T., Shafi, I., Ahmad, J., Fasih, M., Butt, U., and Villar, S.G. (2024). Virtual Histopathology Methods in Medical Imaging—A Systematic Review. BMC Med. Imaging, 24.10.1186/s12880-024-01498-9 ↗
27. Move from Traditional Histopathology to Digital and Computational Pathology: Are We Ready?10.4103/ijn.IJN_508_20 ↗
28. Pressman, C. (2024). Realizing the Potential of Digital Pathology. [Ph.D. Thesis, University of Texas Health Science Center].
29. Deep Learning Applications in Clinical10.1016/j.mcpdig.2025.100253 ↗
30. Review of Deep Learning-Based Pathological Image Classification: From Task-Specific Models to Foundation Models10.1016/j.future.2024.107578 ↗
31. Deep Learning Methods for Improving the Accuracy and Ef Fi Ciency of Pathological Image Analysis10.1177/00368504241306830 ↗
32. AI in Histopathology Explorer for Comprehensive Analysis of the Evolving AI Landscape in Histopathology10.1038/s41746-025-01524-2 ↗
33. Deep Learning in Cancer Genomics and Histopathology10.1186/s13073-024-01315-6 ↗
34. Noori Mirtaheri, P., Akhbari, M., Najafi, F., Mehrabi, H., Babapour, A., Rahimian, Z., Rigi, A., Rahbarbaghbani, S., Mobaraki, H., and Masoumi, S. (2025). Performance of Deep Learning Models for Automatic Histopathological Grading of Meningiomas: A Systematic Review and Meta-Analysis. Front. Neurol., 16.10.3389/fneur.2025.1536751 ↗
35. Ramamoorthy, P., Reddy, B., Reddy, R., Askar, S., and Abouhawwash, M. (2024). Histopathology-Based Breast Cancer Prediction Using Deep Learning Methods for Healthcare Applications. Front. Oncol., 14.10.3389/fonc.2024.1300997 ↗
36. Couture, H. (2022). Deep Learning-Based Prediction of Molecular Tumor Biomarkers from H & E: A Practical Review. J. Pers. Med., 12.10.3390/jpm12122022 ↗
37. The Current Landscape of Artificial Intelligence in Computational Histopathology for Cancer Diagnosis10.1007/s12672-025-02212-z ↗
38. Machine Learning in Computational Histopathology: Challenges and Opportunities10.1002/gcc.23177 ↗
39. Computational Pathology: A Comprehensive Review of Recent Developments in Digital and Intelligent Pathology10.1016/j.intonc.2025.03.004 ↗
40. Machine Learning Methods for Histopathological Image Analysis: Updates in 202410.1016/j.csbj.2024.12.033 ↗
41. Ensemble Learning Approach for Detecting Breast Invasive Ductal Carcinoma from Histopathological Images10.1016/j.prp.2025.156041 ↗
42. Comparative Analysis of Transfer Learning Models for Breast Cancer Detection: Leveraging Pre-Trained Networks for Enhanced Diagnostic Accuracy10.13005/bpj/3172 ↗
43. Generalized Deep Learning for Histopathology Image Classification Using Supervised Contrastive Learning10.1016/j.jare.2024.11.013 ↗
44. A Review of Deep Learning-Based Information Fusion Techniques for Multimodal Medical Image Classification10.1016/j.compbiomed.2024.108635 ↗
45. AI-Driven Ensemble Deep Learning Framework for Automated Neurological Disorder Diagnosis from MRI Scans10.52783/jns.v14.2222 ↗
46. Transfer Learning-Based Hybrid VGG16-Machine Learning Approach for Heart Disease Detection with Explainable Artificial Intelligence10.3389/frai.2025.1504281 ↗
47. Enhanced Multi-Model Deep Learning for Rapid and Precise Diagnosis of Pulmonary Diseases Using Chest X-Ray Imaging10.3390/diagnostics15030248 ↗
48. Informatics in Medicine Unlocked Deep-Learning-Enabled Multimodal Data Fusion for Lung Disease Classification10.1016/j.imu.2023.101367 ↗
49. Dermoscopic Images Classification Using Pretrained VGG-16 and ResNet-50 Models
50. Artificial Intelligence for Multimodal Data Integration in Oncology10.1016/j.ccell.2022.09.012 ↗
51. Multimodal Data Fusion for Cancer Biomarker Discovery with Deep Learning10.1038/s42256-023-00633-5 ↗
52. Multimodal Deep Learning Approaches for Precision Oncology: A Comprehensive Review10.1093/bib/bbae699 ↗
53. A Comprehensive Investigation of Multimodal Deep Learning Fusion Strategies for Breast Cancer Classification10.1007/s10462-024-10984-z ↗
54. Multimodal Fusion with Deep Neural Networks for Leveraging CT Imaging and Electronic Health Record: A Case-Study in Pulmonary Embolism Detection10.1038/s41598-020-78888-w ↗
55. Guarrasi, V., Mogensen, K., Tassinari, S., Qvarlander, S., and Soda, P. (2025). Timing Is Everything: Finding the Optimal Fusion Points in Multimodal Medical Imaging. Proceedings of the International Joint Conference on Neural Networks (IJCNN), Rome, Italy, 30 June–5 July 2025, IEEE.10.1109/IJCNN64981.2025.11227201 ↗
56. A Systematic Review of Intermediate Fusion in Multimodal Deep Learning for Biomedical Applications10.1016/j.imavis.2025.105509 ↗
57. Multimodal Ensemble Fusion Deep Learning Using Histopathological Images and Clinical Data for Glioma Subtype Classification10.1109/ACCESS.2025.3556713 ↗
58. Steyaert, S., Qiu, Y.L., Zheng, Y., Mukherjee, P., and Vogel, H. (2022). Multimodal Data Fusion of Adult and Pediatric Brain Tumors with Deep Learning. medRxiv.10.1101/2022.09.21.22280223 ↗
59. Multimodal Fusion Models for Pulmonary Embolism Mortality Prediction10.1038/s41598-023-34303-8 ↗
60. Application of Transfer Learning and Ensemble Learning in Image-Level Classification for Breast Histopathology10.1016/j.imed.2022.05.004 ↗
61. Multi-Class Breast Cancer Classification Using CNN Features Hybridization10.1007/s44196-024-00593-7 ↗
62. Li, J. (2025). Fusion Feature-Based Hybrid Methods for Diagnosing Oral Squamous Cell Carcinoma in Histopathological Images. Front. Oncol., 15.10.3389/fonc.2025.1551876 ↗
63. HMDFF-Net: Hierarchical Multi-Scale Dilated Feature Fusion Network for Accurate Multiclass Diagnosis of Brain Tumors10.1016/j.eswa.2025.128272 ↗
64. Quantitative Analysis of Deep Learning Frameworks with Integrated Feature Fusion for Cervical Cancer Classification and Detection
65. LPIF-Based Image Enhancement and Hybrid Ensemble Models for Brain Tumor Detection10.1080/09540091.2025.2518983 ↗
66. Gao, R., Yang, Z., Yuan, X., Wang, Y., and Xia, Y. (2025). Features Fusion or Not: Harnessing Multiple Pathological Foundation Models Using Meta-Encoder for Downstream Tasks Fine-Tuning. bioRxiv.10.1101/2025.06.05.657960 ↗
67. Pereira, M. (2024, June 19). BreakHis—Breast Cancer Histopathological Database. Available online: https://data.mendeley.com/datasets/jxwvdwhpc2/1.
68. A Novel Convolution Transformer-Based Network for Histopathology-Image Classification Using Adaptive Convolution and Dynamic Attention10.1016/j.engappai.2024.108824 ↗
69. Chowdhury, A.A., Mahmud, S.M.H., Uddin, P., Kadry, S., Kim, J., and Nam, Y. (2025). Nuclei Segmentation and Classification from Histopathology Images Using Federated Learning for End-Edge Platform. PLoS ONE, 20.10.1371/journal.pone.0322749 ↗
70. Interpretable Deep Learning Method to Predict Wound Healing Progress Based on Collagen Fibers in Wound Tissue10.1016/j.compbiomed.2025.110110 ↗
71. Breast Cancer Classification With Enhanced Interpretability: DALAResNet50 and DT Grad-CAM10.1109/ACCESS.2024.3520608 ↗
72. Wang, D., Guo, L., Zhong, J., Yu, H., Tang, Y., Peng, L., Cai, Q., Qi, Y., and Zhang, D. (2024). A Novel Deep-Learning Based Weighted Feature Fusion Architecture for Precise Classi Fi Cation of Pressure Injury. Front. Physiol., 15.10.3389/fphys.2024.1304829 ↗
73. Improved Classification of Cancerous Histopathology Images Using Color Channel Separation and Deep Learning10.33851/JMIS.2021.8.3.175 ↗
74. Multimodal Deep Learning for Biomedical Data Fusion: A Review10.1093/bib/bbab569 ↗
75. A Comprehensive Survey on Deep Learning Multi-Modal Fusion: Methods, Technologies and Applications
76. Manzoor, F., Gupta, V., Pinky, L., and Wang, Z. (2025). A Systematic Review of Multimodal Deep Learning and Machine Learning Fusion Techniques for Prostate Cancer Classification. medRxiv.10.1101/2025.08.07.25333235 ↗
77. A Machine Learning Approach for Multimodal Data Fusion for Survival Prediction in Cancer Patients10.1038/s41698-025-00917-6 ↗
78. Large Language Models in Evaluating Hidradenitis Suppurativa from Clinical Images10.1111/jdv.20861 ↗
79. Diagnostic Performance of GPT-4o and Gemini Flash 2.0 in Acne and Rosacea10.1111/ijd.17729 ↗