journal article·2022-11-09Open access

Impact of Image Preprocessing Methods and Deep Learning Models for Classifying Histopathological Breast Cancer Images

David Murcia-Gómez, Ignacio Rojas-Valenzuela, Olga Valenzuela

Applied Sciences· Volume 12· Issue 22

Abstract

Early diagnosis of cancer is very important as it significantly increases the chances of appropriate treatment and survival. To this end, Deep Learning models are increasingly used in the classification and segmentation of histopathological images, as they obtain high accuracy index and can help specialists. In most cases, images need to be preprocessed for these models to work correctly. In this paper, a comparative study of different preprocessing methods and deep learning models for a set of breast cancer images is presented. For this purpose, the statistical test ANOVA with data obtained from the performance of five different deep learning models is analyzed. An important conclusion from this test can be obtained; from the point of view of the accuracy of the system, the main repercussion is the deep learning models used, however, the filter used for the preprocessing of the image, has no statistical significance for the behavior of the system.
Source: crossref · Quality: baseline

Research context

OpenAlex topics: AI in cancer detection · Radiomics and Machine Learning in Medical Imaging · Smart Systems and Machine Learning

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

School of Technology and Telecommunications Engineering, University of Granada, 18071 Granada, Spain

Department of Applied Mathematics, University of Granada, 18071 Granada, Spain

Funding

Spanish Ministry of Sciences, Innovation, and Universities · Government of Andalusia

References (80)

Show source-provided references
1. Deep learning as a tool for increased accuracy and efficiency of histopathological diagnosis10.1038/srep26286 ↗
2. Machine Learning Methods for Histopathological Image Analysis10.1016/j.csbj.2018.01.001 ↗
3. Lerousseau, M., Vakalopoulou, M., Classe, M., Adam, J., Battistella, E., Carré, A., Estienne, T., Henry, T., Deutsch, E., and Paragios, N. (2020). Weakly supervised multiple instance learning histopathological tumor segmentation. International Conference on Medical Image Computing and Computer-Assisted Intervention, Springer.10.1007/978-3-030-59722-1_45 ↗
4. Histopathological Image Analysis: A Review10.1109/RBME.2009.2034865 ↗
5. Image analysis and machine learning in digital pathology: Challenges and opportunities10.1016/j.media.2016.06.037 ↗
6. Breast Cancer Histopathology Image Analysis: A Review10.1109/TBME.2014.2303852 ↗
7. Mobark, N., Hamad, S., and Rida, S.Z. (2022). CoroNet: Deep Neural Network-Based End-to-End Training for Breast Cancer Diagnosis. Appl. Sci., 12.10.3390/app12147080 ↗
8. Global, regional, and national cancer incidence, mortality, years of life lost, years lived with disability, and disability-adjusted life-years for 29 cancer groups, 1990 to 2017: A systematic analysis for the global burden of disease study10.1001/jamaoncol.2019.2996 ↗
9. World-Health-Organization (2022). Estimated number of new cases from 2020 to 2040, Incidence, Both sexes, age [0–85+]. Int. Agency Res. Cancer, 18, 4473.
10. Histopathological image recognition of breast cancer based on three-channel reconstructed color slice feature fusion10.1016/j.bbrc.2022.06.004 ↗
11. Computer-aided diagnosis system combining FCN and Bi-LSTM model for efficient breast cancer detection from histopathological images10.1016/j.asoc.2019.105765 ↗
12. Global cancer statistics 2018: GLOBOCAN estimates of incidence and mortality worldwide for 36 cancers in 185 countries10.3322/caac.21492 ↗
13. Cancer statistics, 202210.3322/caac.21708 ↗
14. Proportion of U.S. Trends in Breast Cancer Incidence Attributable to Long-term Changes in Risk Factor Distributions10.1158/1055-9965.EPI-18-0098 ↗
15. Twenty-Year Follow-up of a Randomized Trial Comparing Total Mastectomy, Lumpectomy, and Lumpectomy plus Irradiation for the Treatment of Invasive Breast Cancer10.1056/NEJMoa022152 ↗
16. Circulating Tumor Cells, Disease Progression, and Survival in Metastatic Breast Cancer10.1056/NEJMoa040766 ↗
17. Deep learning systems detect dysplasia with human-like accuracy using histopathology and probe-based confocal laser endomicroscopy10.1038/s41598-021-84510-4 ↗
18. Deep transfer learning techniques with hybrid optimization in early prediction and diagnosis of different types of oral cancer
19. Identification of misdiagnosis by deep neural networks on a histopathologic review of breast cancer lymph node metastases10.1038/s41598-022-17606-0 ↗
20. Locality Sensitive Deep Learning for Detection and Classification of Nuclei in Routine Colon Cancer Histology Images10.1109/TMI.2016.2525803 ↗
21. Classification of Hematoxylin and Eosin-Stained Breast Cancer Histology Microscopy Images Using Transfer Learning with EfficientNets10.1155/2021/5580914 ↗
22. Araújo, T., Aresta, G., Castro, E., Rouco, J., Aguiar, P., Eloy, C., Polónia, A., and Campilho, A. (2017). Classification of breast cancer histology images using Convolutional Neural Networks. PLoS ONE, 12.10.1371/journal.pone.0177544 ↗
23. Deep Learning in Mammography10.1097/RLI.0000000000000358 ↗
24. Breast cancer detection using artificial intelligence techniques: A systematic literature review10.1016/j.artmed.2022.102276 ↗
25. Breast Cancer Multi-classification from Histopathological Images with Structured Deep Learning Model10.1038/s41598-017-04075-z ↗
26. Multiple instance learning for histopathological breast cancer image classification10.1016/j.eswa.2018.09.049 ↗
27. Deep learning in mammography and breast histology, an overview and future trends10.1016/j.media.2018.03.006 ↗
28. Wang, X., Ahmad, I., Javeed, D., Zaidi, S.A., Alotaibi, F.M., Ghoneim, M.E., Daradkeh, Y.I., Asghar, J., and Eldin, E.T. (2022). Intelligent Hybrid Deep Learning Model for Breast Cancer Detection. Electronics, 11.10.3390/electronics11172767 ↗
29. Breast cancer classification from histopathological images using patch-based deep learning modeling10.1109/ACCESS.2021.3056516 ↗
30. Classification of breast cancer histology images using multi-size and discriminative patches based on deep learning10.1109/ACCESS.2019.2898044 ↗
31. Neuner, C., Coras, R., Blümcke, I., Popp, A., Schlaffer, S.M., Wirries, A., Buchfelder, M., and Jabari, S. (2021). A Whole-Slide Image Managing Library Based on Fastai for Deep Learning in the Context of Histopathology: Two Use-Cases Explained. Appl. Sci., 12.10.20944/preprints202110.0359.v2 ↗
32. Lo, C.M., Wu, Y.H., Li, Y.C.J., and Lee, C.C. (2020). Computer-Aided Bacillus Detection in Whole-Slide Pathological Images Using a Deep Convolutional Neural Network. Appl. Sci., 10.10.3390/app10124059 ↗
33. H2G-Net: A multi-resolution refinement approach for segmentation of breast cancer region in gigapixel histopathological images10.3389/fmed.2022.971873 ↗
34. Fisher, R.A. (1950). Contribution to Mathematical Statistics, John Wiley and Sons.
35. Rutherford, A. (2001). Introducing ANOVA and ANCOVA: A GLM Approach, John Wiley & Sons. Introducing Statistical Methods Series.
36. Turner, J., and Thayer, J. (2001). Introduction to Analysis of Variance: Design, Analyis & Interpretation, Sage.10.4135/9781412984621 ↗
37. Montgomery, D.C. (1984). Design and Analysis of Experiments, Wiley.
38. A survey on graph-based deep learning for computational histopathology
39. Predicting endometrial cancer subtypes and molecular features from histopathology images using multi-resolution deep learning models10.1016/j.xcrm.2021.100400 ↗
40. Pathology image analysis using segmentation deep learning algorithms10.1016/j.ajpath.2019.05.007 ↗
41. Hybrid Convolution Neural Network in Classification of Cancer in Histopathology Images10.1007/s10278-021-00541-3 ↗
42. Bnouni, N., Amor, H.B., Rekik, I., Rhim, M.S., Solaiman, B., and Amara, N.E.B. (2021, January 22–25). Boosting CNN Learning by Ensemble Image Preprocessing Methods for Cervical Cancer Segmentation. Proceedings of the 2021 18th International Multi-Conference on Systems, Signals & Devices (SSD), Monastir, Tunisia.10.1109/SSD52085.2021.9429422 ↗
43. Swathi, C., Anoop, B., Dhas, D.A.S., and Sanker, S.P. (2017, January 3–4). Comparison of different image preprocessing methods used for retinal fundus images. Proceedings of the 2017 Conference on Emerging Devices and Smart Systems (ICEDSS), Tiruchengode, India.10.1109/ICEDSS.2017.8073677 ↗
44. Deep Learning and Its Applications in Computational Pathology10.3390/biomedinformatics2010010 ↗
45. Davri, A., Birbas, E., Kanavos, T., Ntritsos, G., Giannakeas, N., Tzallas, A.T., and Batistatou, A. (2022). Deep Learning on Histopathological Images for Colorectal Cancer Diagnosis: A Systematic Review. Diagnostics, 12.10.3390/diagnostics12040837 ↗
46. Deep Learning for Whole Slide Image Analysis: An Overview10.3389/fmed.2019.00264 ↗
47. Saednia, K., Tran, W.T., and Sadeghi-Naini, A. (2022, January 11–15). A Cascaded Deep Learning Framework for Segmentation of Nuclei in Digital Histology Images. Proceedings of the Annual International Conference of the IEEE Engineering in Medicine and Biology Society, Glasgow, UK.10.1109/EMBC48229.2022.9871996 ↗
48. Umer, M.J., Sharif, M., Kadry, S., and Alharbi, A. (2022). Multi-Class Classification of Breast Cancer Using 6B-Net with Deep Feature Fusion and Selection Method. J. Pers. Med., 12.10.3390/jpm12050683 ↗
49. (2022, September 29). Breast Cancer Dataset. Available online: https://www.kaggle.com/datasets/paultimothymooney/breast-histopathology-images.
50. Effects of Histopathological Image Pre-processing on Convolutional Neural Networks10.1016/j.procs.2018.05.166 ↗
51. The impact of pre- and post-image processing techniques on deep learning frameworks: A comprehensive review for digital pathology image analysis10.1016/j.compbiomed.2020.104129 ↗
52. Danelljan, M., Robinson, A., Khan, F.S., and Felsberg, M. (2016). Beyond Correlation Filters: Learning Continuous Convolution Operators for Visual Tracking. Computer Vision – ECCV 2016, Springer International Publishing.10.1007/978-3-319-46454-1_29 ↗
53. Chaki, J., and Dey, N. (2018). A Beginner’s Guide to Image Preprocessing Techniques, CRC Press.10.1201/9780429441134 ↗
54. (2022, September 29). Pillow Library. Available online: https://pillow.readthedocs.io/en/stable/.
55. Bhuiyan, M.R., and Abdullah, J. (2022). Detection on Cell Cancer Using the Deep Transfer Learning and Histogram Based Image Focus Quality Assessment. Sensors, 22.10.3390/s22187007 ↗
56. Celebi, T., Shayea, I., El-Saleh, A.A., Ali, S., and Roslee, M. (2021, January 1–2). Histogram Equalization for Grayscale Images and Comparison with OpenCV Library. Proceedings of the 2021 IEEE 15th Malaysia International Conference on Communication (MICC), Malaysia.10.1109/MICC53484.2021.9642082 ↗
57. Image contrast enhancement based sub-histogram equalization technique without over-equalization noise
58. Brightness preserving dynamic fuzzy histogram equalization10.1109/TCE.2010.5681130 ↗
59. Fuzzy logic-based histogram equalization for image contrast enhancement10.1155/2013/891864 ↗
60. Vuong, N. (2022, September 29). Available online: https://www.kaggle.com/code/nguyenvlm/fuzzy-logic-image-contrast-enhancement.
61. Simonyan, K., and Zisserman, A. (2014). Very deep convolutional networks for large-scale image recognition. arXiv.
62. Howard, A.G., Zhu, M., Chen, B., Kalenichenko, D., Wang, W., Weyand, T., Andreetto, M., and Adam, H. (2017). Mobilenets: Efficient convolutional neural networks for mobile vision applications. arXiv.
63. He, K., Zhang, X., Ren, S., and Sun, J. (2016, January 27–30). Deep Residual Learning for Image Recognition. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, CVPR, Seattle, WA, USA.10.1109/CVPR.2016.90 ↗
64. Huang, G., Liu, Z., Van Der Maaten, L., and Weinberger, K.Q. (2017, January 21–26). Densely Connected Convolutional Networks. Proceedings of the 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Honolulu, HI, USA.10.1109/CVPR.2017.243 ↗
65. Automated classification of histopathology images using transfer learning10.1016/j.artmed.2019.101743 ↗
66. An experimental study on classification of thyroid histopathology images using transfer learning10.1016/j.patrec.2020.09.020 ↗
67. Hameed, Z., Zahia, S., Garcia-Zapirain, B., Aguirre, J.J., and Vanegas, A.M. (2020). Breast Cancer Histopathology Image Classification Using an Ensemble of Deep Learning Models. Sensors, 20.10.3390/s20164373 ↗
68. Deep neural network models for computational histopathology: A survey10.1016/j.media.2020.101813 ↗
69. Deep transfer learning based model for colorectal cancer histopathology segmentation: A comparative study of deep pre-trained models10.1016/j.ijmedinf.2021.104669 ↗
70. Multiclass classification of breast cancer histopathology images using multilevel features of deep convolutional neural network10.1038/s41598-022-19278-2 ↗
71. Classification of Breast Tumors Based on Histopathology Images Using Deep Features and Ensemble of Gradient Boosting Methods10.1016/j.compeleceng.2022.108382 ↗
72. Srinivasu, P.N., SivaSai, J.G., Ijaz, M.F., Bhoi, A.K., Kim, W., and Kang, J.J. (2021). Classification of Skin Disease Using Deep Learning Neural Networks with MobileNet V2 and LSTM. Sensors, 21.10.3390/s21082852 ↗
73. A Novel Image Classification Approach via Dense-MobileNet Models
74. A transfer convolutional neural network for fault diagnosis based on ResNet-5010.1007/s00521-019-04097-w ↗
75. Encoder and decoder network with ResNet-50 and global average feature pooling for local change detection10.1016/j.cviu.2022.103501 ↗
76. An automatic plant leaf disease identification using DenseNet-121 architecture with a mutation-based henry gas solubility optimization algorithm10.1007/s00521-021-06714-z ↗
77. Deep Convolutional Neural Networks for Computer-Aided Detection: CNN Architectures, Dataset Characteristics and Transfer Learning10.1109/TMI.2016.2528162 ↗
78. Deep Convolutional Neural Networks for Image Classification: A Comprehensive Review10.1162/neco_a_00990 ↗
79. A Comprehensive Survey on Transfer Learning10.1109/JPROC.2020.3004555 ↗
80. Understanding auc-roc curve