journal article·2023-03-29Open access

Automatic Tumor Identification from Scans of Histopathological Tissues

Mantas Kundrotas, Edita Mažonienė, Dmitrij Šešok

Applied Sciences· Volume 13· Issue 7

Abstract

Latest progress in development of artificial intelligence (AI), especially machine learning (ML), allows to develop automated technologies that can eliminate or at least reduce human errors in analyzing health data. Due to the ethics of usage of AI in pathology and laboratory medicine, to the present day, pathologists analyze slides of histopathologic tissues that are stained with hematoxylin and eosin under the microscope; by law it cannot be substituted and must go under visual observation, as pathologists are fully accountable for the result. However, a profuse number of automated systems could solve complex problems that require an extremely fast response, accuracy, or take place on tasks that require both a fast and accurate response at the same time. Such systems that are based on ML algorithms can be adapted to work with medical imaging data, for instance whole slide images (WSIs) that allow clinicians to review a much larger number of health cases in a shorter time and give the ability to identify the preliminary stages of cancer or other diseases improving health monitoring strategies. Moreover, the increased opportunity to forecast and take control of the spread of global diseases could help to create a preliminary analysis and viable solutions. Accurate identification of a tumor, especially at an early stage, requires extensive expert knowledge, so often the cancerous tissue is identified only after experiencing its side effects. The main goal of our study was to expand the ability to find more accurate ML methods and techniques that can lead to detecting tumor damaged tissues in histopathological WSIs. According to the experiments that we conducted, there was a 1% AUC difference between the training and test datasets. Over several training iterations, the U-Net model was able to reduce the model size by almost twice while also improving accuracy from 0.95491 to 0.95515 AUC. Convolutional models worked well on groups of different sizes when properly trained. With the TTA (test time augmentation) method the result improved to 0.96870, and with the addition of the multi-model ensemble, it improved to 0.96977. We found out that flaws in the models can be found and fixed by using specialized analysis techniques. A correction of the image processing parameters was sufficient to raise the AUC by almost 0.3%. The result of the individual model increased to 0.96664 AUC (a more than 1% better result than the previous best model) after additional training data preparation. This is an arduous task due to certain factors: using such systems’ applications globally needs to achieve maximum accuracy and improvement in the ethics of Al usage in medicine; furthermore if hospitals could give scientific inquiry validation, while retaining patient data anonymity with clinical information that could be systemically analyzed and improved by scientists, thereby proving Al benefits.
Source: crossref · Quality: baseline

Research context

OpenAlex topics: AI in cancer detection · Radiomics and Machine Learning in Medical Imaging · Artificial Intelligence in Healthcare and Education

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

Department of Information Technologies, Vilnius Gediminas Technical University, Sauletekio Al. 11, LT-10223 Vilnius, Lithuania

References (80)

Show source-provided references
1. Ahmed, S., Shaikh, A., Alshahrani, H., Alghamdi, A., Alrizq, M., Baber, J., and Bakhtyar, M. (2021). Transfer learning approach for classification of histopathology whole slide images. Sensors, 21.10.3390/s21165361 ↗
2. American Telemedicine Association clinical guidelines for telepathology10.4103/2153-3539.143329 ↗
3. Optimized JPEG 2000 compression for efficient storage of histopathological whole-slide images10.4103/jpi.jpi_69_17 ↗
4. Kim, I., Kang, K., Song, Y., and Kim, T.J. (2022). Application of Artificial Intelligence in Pathology: Trends and Challenges. Diagnostics, 12.10.3390/diagnostics12112794 ↗
5. Deep learning in histopathology: The path to the clinic10.1038/s41591-021-01343-4 ↗
6. Journal of Infection and Public Health. 13 Recent advancement in cancer detection using machine learning: Systematic survey of decades, comparisons, and challenges10.1016/j.jiph.2020.06.033 ↗
7. Lansdowne, L.E. (2021, October 01). Tumor Biology. Cancer Research from Technology Networks. Accessed August 16, 2022. Available online: http://www.technologynetworks.com/cancer-research/infographics/tumor-biology-359548.
8. Tumor detection in medical imaging: A survey
9. Díaz-Pernas, F.J., Martínez-Zarzuela, M., Antón-Rodríguez, M., and González-Ortega, D. (2021). A deep learning approach for brain tumor classification and segmentation using a multiscale convolutional neural network. Healthcare, 9.10.3390/healthcare9020153 ↗
10. Global cancer statistics 2020: GLOBOCAN estimates of incidence and mortality worldwide for 36 cancers in 185 countries
11. Deep learning as a tool for increased accuracy and efficiency of histopathological diagnosis10.1038/srep26286 ↗
12. Histology image analysis for carcinoma detection and grading10.1016/j.cmpb.2011.12.007 ↗
13. Identification and classification of cancer cells using capsule network with pathological images
14. Diagnostic Assessment of Deep Learning Algorithms for Detection of Lymph Node Metastases in Women With Breast Cancer10.1001/jama.2017.14585 ↗
15. Benchmarking of machine learning for anomaly based intrusion detection systems in the CICIDS2017 dataset10.1109/ACCESS.2021.3056614 ↗
16. Improved classification of breast cancer data using hybrid techniques
17. Jiang, P., Peng, J., Zhang, G., Cheng, E., Megalooikonomou, V., and Ling, H. (2012, January 2–5). Learning-based automatic breast tumor detection and segmentation in ultrasound images. Proceedings of the 2012 9th IEEE International Symposium on Biomedical Imaging (ISBI), Barcelona, Spain.10.1109/ISBI.2012.6235878 ↗
18. A Survey on Detection and Classification of Brain Tumor from MRI Brain Images using Image Processing Techniques
19. Jayade, S., Ingole, D.T., and Ingole, M.D. (2019, January 27–28). MRI brain tumor classification using hybrid classifier. Proceedings of the 2019 International Conference on Innovative Trends and Advances in Engineering and Technology (ICITAET), Shegoaon, India.10.1109/ICITAET47105.2019.9170147 ↗
20. A quantitative symmetry-based analysis of hyperacute ischemic stroke lesions in noncontrast computed tomography10.1002/mp.12015 ↗
21. Brain tumor classification using convolutional neural networks10.13005/bpj/1511 ↗
22. Contrast-enhanced computed tomography radiomics and multilayer perceptron network classifier: An approach for predicting CD20+ B cells in patients with pancreatic ductal adenocarcinoma10.1007/s00261-021-03285-4 ↗
23. Machine learning for medical imaging10.1148/rg.2017160130 ↗
24. A comparison of deep reinforcement learning and deep learning for complex image analysis10.33851/JMIS.2020.7.1.1 ↗
25. Tyagi, A.K., and Chahal, P. (2022). Research Anthology on Machine Learning Techniques, Methods, and Applications, IGI Global.
26. Machine learning: Algorithms, real-world applications and research directions10.1007/s42979-021-00592-x ↗
27. Methods for interpreting and understanding deep neural networks10.1016/j.dsp.2017.10.011 ↗
28. Functional Multi-Layer Perceptron: A Nonlinear Tool for Functional Data Analysis10.1016/j.neunet.2004.07.001 ↗
29. Multifaceted fused-CNN based scoring of breast cancer whole-slide histopathology images10.1016/j.asoc.2020.106808 ↗
30. Zainudin, Z., Shamsuddin, S.M., and Hasan, S. (2019). International Conference on Advanced Machine Learning Technologies and Applications, Springer.
31. Cancer diagnosis in histopathological image: CNN based approach10.1016/j.imu.2019.100231 ↗
32. Graziani, M., Lompech, T., Müller, H., and Andrearczyk, V. (2021, January 2–9). Evaluation and comparison of CNN visual explanations for histopathology. Proceedings of the 35th AAAI Conference on Artificial Intelligence, Virtual Event.
33. Rapid histology of laryngeal squamous cell carcinoma with deep-learning based stimulated Raman scattering microscopy10.7150/thno.32655 ↗
34. He, K., Zhang, X., Ren, S., and Sun, J. (2016, January 27–30). Deep residual learning for image recognition. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Las Vegas, NV, USA.10.1109/CVPR.2016.90 ↗
35. Lauande, M.G.M., Teles, A.M., da Silva, L.L., Matos, C.E.F., Junior, G.B., de Paiva, A.C., de Almeida, J.S., Oliveira, R., Brito, H., and Nascimento, A. (2022, January 6–8). Classification of Histopathological Images of Penile Cancer using DenseNet and Transfer Learning. Proceedings of the 17th International Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications—Volume 4: VISAPP, Online.10.5220/0010893500003124 ↗
36. Breast cancer histopathological image classification using augmentation based on optimized deep ResNet-152 structure
37. Wang, C.-W., Lee, Y.-C., Chang, C.-C., Lin, Y.-J., Liou, Y.-A., Hsu, P.-C., Chang, C.-C., Sai, A.-K., Wang, C.-H., and Chao, T.-K. (2022). A weakly supervised deep learning method for guiding ovarian cancer treatment and identifying an effective biomarker. Cancers, 14.10.3390/cancers14071651 ↗
38. Samee, N.A., Atteia, G., Meshoul, S., Al-antari, M.A., and Kadah, Y.M. (2022). Deep Learning Cascaded Feature Selection Framework for Breast Cancer Classification: Hybrid CNN with Univariate-Based Approach. Mathematics, 10.10.3390/math10193631 ↗
39. Allegra, A., Tonacci, A., Sciaccotta, R., Genovese, S., Musolino, C., Pioggia, G., and Gangemi, S. (2022). Machine learning and deep learning applications in multiple myeloma diagnosis, prognosis, and treatment selection. Cancers, 14.10.3390/cancers14030606 ↗
40. Deep convolutional neural network-based classification of cancer cells on cytological pleural effusion images10.1038/s41379-021-00987-4 ↗
41. Gadermayr, M., Koller, L., Tschuchnig, M., Stangassinger, L.M., Kreutzer, C., Couillard-Despres, S., Oostingh, J.G., and Hittmair, A. (2022). MixUp-MIL: Novel Data Augmentation for Multiple Instance Learning and a Study on Thyroid Cancer Diagnosis. arXiv.
42. Jimenez-del-Toro, O., Otálora, S., Andersson, M., Eurén, K., Hedlund, M., Rousson, M., Müller, H., and Atzori, M. (2017). Biomedical Texture Analysis, Academic Press.
43. Machine learning methods for histopathological image analysis10.1016/j.csbj.2018.01.001 ↗
44. Unsupervised machine learning for identifying important visual features through bag-of-words using histopathology data from chronic kidney disease10.1038/s41598-022-08974-8 ↗
45. Ahamed, S.B., Shamsudheen, S., and Balobaid, A.S. (2023). Applications of Machine Learning and Deep Learning on Biological Data, Taylor & Francis.
46. Role of AI and digital pathology for colorectal immuno-oncology10.1038/s41416-022-01986-1 ↗
47. Deep learning in histopathology: A review10.1002/widm.1439 ↗
48. Deep-learning–based characterization of tumor-infiltrating lymphocytes in breast cancers from histopathology images and multiomics data10.1200/CCI.19.00126 ↗
49. Improving diagnosis through digital pathology: Proof-of-concept implementation using smart contracts and decentralized file storage10.2196/34207 ↗
50. Breast cancer multi-classification from histopathological images with structured deep learning model10.1038/s41598-017-04075-z ↗
51. A survey on graph-based deep learning for computational histopathology10.1016/j.compmedimag.2021.102027 ↗
52. Deep learning–based segmentation and quantification in experimental kidney histopathology10.1681/ASN.2020050597 ↗
53. Classification and mutation prediction based on histopathology H&E images in liver cancer using deep learning10.1038/s41698-020-0120-3 ↗
54. Deep learning-based retrieval system for gigapixel histopathology cases and the open access literature10.4103/jpi.jpi_88_18 ↗
55. Deep learning classification of lung cancer histology using CT images10.1038/s41598-021-84630-x ↗
56. Machine learning algorithms-a review
57. Unsupervised feature extraction via deep learning for histopathological classification of colon tissue images10.1109/TMI.2018.2879369 ↗
58. Software-assisted decision support in digital histopathology10.1002/path.5388 ↗
59. Self supervised contrastive learning for digital histopathology
60. Breast mass segmentation in ultrasound with selective kernel U-Net convolutional neural network10.1016/j.bspc.2020.102027 ↗
61. A semi-supervised learning approach with consistency regularization for tumor histopathological images analysis
62. Nugroho, A., and Suhartanto, H. (2020, January 24–25). Hyper-parameter tuning based on random search for densenet optimization. Proceedings of the 2020 7th International Conference on Information Technology, Computer, and Electrical Engineering (ICITACEE), Semarang, Indonesia.10.1109/ICITACEE50144.2020.9239164 ↗
63. A comparison of machine learning algorithms for diabetes prediction10.1016/j.icte.2021.02.004 ↗
64. Li, Y., Wei, C., and Ma, T. (2019, January 8–14). Towards explaining the regularization effect of initial large learning rate in training neural networks. Proceedings of the NIPS’19: Proceedings of the 33rd International Conference on Neural Information Processing Systems, Vancouver, BC, Canada.
65. Weakly supervised segmentation on neural compressed histopathology with self-equivariant regularization10.1016/j.media.2022.102482 ↗
66. An experimental study on classification of thyroid histopathology images using transfer learning10.1016/j.patrec.2020.09.020 ↗
67. Kumar, S.K. (2017). On weight initialization in deep neural networks. arXiv.
68. Necessary conditions for convergence of CNNs and initialization of convolution kernels10.1016/j.dsp.2022.103397 ↗
69. Solving multi-objective optimization problem of convolutional neural network using fast forward quantum optimization algorithm: Application in digital image classification10.1016/j.advengsoft.2022.103370 ↗
70. Srikantamurthy, M.M., Rallabandi, V.P., Dudekula, D.B., Natarajan, S., and Park, J. (2023). Classification of benign and malignant subtypes of breast cancer histopathology imaging using hybrid CNN-LSTM based transfer learning. BMC Med. Imaging, 23.10.1186/s12880-023-00964-0 ↗
71. Gour, M., Jain, S., and Shankar, U. (2022). Computer Vision and Image Processing: 6th International Conference, CVIP 2021, Rupnagar, India, December 3–5, 2021, Revised Selected Papers, Part I, Springer International Publishing.
72. Krishna, S., Krishnamoorthy, S., and Bhavsar, A. (2022). Stain normalized breast histopathology image recognition using convolutional neural networks for cancer detection. arXiv.
73. Uthatham, A., Yodrabum, N., Sinmaroeng, C., and Titijaroonroj, T. (2022, January 18–19). Automatic Lymph Node Classification with Convolutional Neural Network. Proceedings of the 2022 14th International Conference on Information Technology and Electrical Engineering (ICITEE), Yogyakarta, Indonesia.10.1109/ICITEE56407.2022.9954045 ↗
74. Improving feature extraction from histopathological images through a fine-tuning ImageNet model10.1016/j.jpi.2022.100115 ↗
75. Revisiting alloy design of low-modulus biomedical β-Ti alloys using an artificial neural network10.1016/j.mtla.2021.101313 ↗
76. Wright, L., and Demeure, N. (2021). Ranger21: A synergistic deep learning optimizer. arXiv.
77. Histopathological image classification based on cross-domain deep transferred feature fusion10.1016/j.bspc.2021.102705 ↗
78. Akossi, A., Wang, F., Teodoro, G., and Kong, J. (2021, January 13–16). Image registration with optimal regularization parameter selection by learned auto encoder features. Proceedings of the 2021 IEEE 18th International Symposium on Biomedical Imaging (ISBI), Nice, France.10.1109/ISBI48211.2021.9434161 ↗
79. Test-time augmentation for deep learning-based cell segmentation on microscopy images10.1038/s41598-020-61808-3 ↗
80. Nguyen, C.P., Vo, A.H., and Nguyen, B.T. (2019, January 25–27). Breast cancer histology image classification using deep learning. Proceedings of the 2019 19th International Symposium on Communications and Information Technologies (ISCIT), Ho Chi Minh City, Vietnam.10.1109/ISCIT.2019.8905196 ↗