Breast Cancer Detection in Thermography Using Convolutional Neural Networks (CNNs) with Deep Attention Mechanisms
Source abstract
Abstract
Breast cancer is one of the most common types of cancer among women. Accurate diagnosis at an early stage can reduce the mortality associated with this disease. Governments and health organizations stress the importance of early detection of breast cancer as it is related to an increase in the number of available treatment options and increased survival. Early detection gives patients the best chance of receiving effective treatment. Different types of images and imaging modalities are used in the detection and diagnosis of breast cancer. One of the imaging types is “infrared thermal” breast imaging, where a screening instrument is used to measure the temperature distribution of breast tissue. Although it has not been used often, compared to mammograms, it showed promising results when used for early detection. It also has many advantages as it is non-invasive, safe, painless, and inexpensive. The literature has indicated that the use of thermal images with deep neural networks improves the accuracy of early diagnosis of breast malformation. Therefore, in this paper, we aim to investigate to what extent convolutional neural networks (CNNs) with attention mechanisms (AMs) can provide satisfactory detection results in thermal breast cancer images. We present a model for breast cancer detection based on deep neural networks with AMs using thermal images from the Database for Research Mastology with Infrared Image (DMR-IR). The model will be evaluated in terms of accuracy, sensitivity and specificity, and will be compared against state-of-the-art breast cancer detection methods. The AMs with the CNN model achieved encouraging test accuracy rates of 99.46%, 99.37%, and 99.30% on the breast thermal dataset. The test accuracy of CNNs without AMs was 92.32%, whereas CNNs with AMs achieved an improvement in accuracy of 7%. Moreover, the proposed models outperformed previous models that were reviewed in the literature.
Source: crossref · Quality: baseline
Research context
OpenAlex topics: Infrared Thermography in Medicine · Thermography and Photoacoustic Techniques
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
Affiliations
College of Computer and Information Sciences, King Saud University, Riyadh 11451, Saudi Arabia
Funding
King Saud University
References (37)
Show source-provided references
1. Rajinikanth, V., Kadry, S., Taniar, D., Damaševičius, R., and Rauf, H.T. (2021, January 25–27). Breast-Cancer Detection Using Thermal Images with Marine-Predators-Algorithm Selected Features. Proceedings of the 2021 Seventh International Conference on Bio Signals, Images, and Instrumentation (ICBSII), Chennai, India.10.1109/ICBSII51839.2021.9445166 ↗
2. Role of Image Thermography in Early Breast Cancer Detection- Past, Present and Future10.1016/j.cmpb.2019.105074 ↗
3. Parisky, Y.R., Skinner, K.A., Cothren, R., DeWittey, R.L., Birbeck, J.S., Conti, P.S., Rich, J.K., and Dougherty, W.R. (1998, January 1). Computerized Thermal Breast Imaging Revisited: An Adjunctive Tool to Mammography. Proceedings of the 20th Annual International Conference of the IEEE Engineering in Medicine and Biology Society, Hong Kong, China.
4. Wu, P., Qu, H., Yi, J., Huang, Q., Chen, C., and Metaxas, D. (2019, January 8–11). Deep Attentive Feature Learning for Histopathology Image Classification. Proceedings of the 2019 IEEE 16th International Symposium on Biomedical Imaging (ISBI 2019), Venice, Italy.10.1109/ISBI.2019.8759267 ↗
5. Melekoodappattu, J.G., and Subbian, P.S. (2020). Automated Breast Cancer Detection Using Hybrid Extreme Learning Machine Classifier. J. Ambient. Intell. Hum. Comput.10.1007/s12652-020-02359-3 ↗
6. Chapter Five—Reinforcement Learning and Tourette Syndrome10.1016/B978-0-12-411546-0.00005-6 ↗
7. Almajalid, R., Shan, J., Du, Y., and Zhang, M. (2018, January 17–20). Development of a Deep-Learning-Based Method for Breast Ultrasound Image Segmentation. Proceedings of the 2018 17th IEEE International Conference on Machine Learning and Applications (ICMLA), Orlando, FL, USA.10.1109/ICMLA.2018.00179 ↗
8. Convolutional Neural Networks: An Overview and Application in Radiology10.1007/s13244-018-0639-9 ↗
9. A Deep Learning Framework under Attention Mechanism for Wheat Yield Estimation Using Remotely Sensed Indices in the Guanzhong Plain, PR China
10. Shen, T., Zhou, T., Long, G., Jiang, J., Wang, S., and Zhang, C. (2018, January 13–19). Reinforced Self-Attention Network: A Hybrid of Hard and Soft Attention for Sequence Modeling. Proceedings of the Twenty-Seventh International Joint Conference on Artificial Intelligence, Stockholm, Sweden.10.24963/ijcai.2018/604 ↗
11. de Correia, A.S., and Colombini, E.L. (2021). Attention, Please! A Survey of Neural Attention Models in Deep Learning. arXiv.
12. Histopathological Breast Cancer Image Classification by Deep Neural Network Techniques Guided by Local Clustering10.1155/2018/2362108 ↗
13. Rashed, E., and El Seoud, M.S.A. (2019, January 9). Deep Learning Approach for Breast Cancer Diagnosis. Proceedings of the 2019 8th International Conference on Software and Information Engineering, Cairo, Egypt.10.1145/3328833.3328867 ↗
14. Arslan, A.K., Yaşar, Ş., and Çolak, C. (2019, January 11–13). Breast Cancer Classification Using a Constructed Convolutional Neural Network on the Basis of the Histopathological Images by an Interactive Web-Based Interface. Proceedings of the 2019 3rd International Symposium on Multidisciplinary Studies and Innovative Technologies (ISMSIT), Ankara, Turkey.10.1109/ISMSIT.2019.8932942 ↗
15. Platania, R., Shams, S., Yang, S., Zhang, J., Lee, K., and Park, S.-J. (2017, January 20). Automated Breast Cancer Diagnosis Using Deep Learning and Region of Interest Detection (BC-DROID). Proceedings of the 8th ACM International Conference on Bioinformatics, Computational Biology, and Health Informatics, Boston, MA, USA.10.1145/3107411.3107484 ↗
16. Automated Mammogram Breast Cancer Detection Using the Optimized Combination of Convolutional and Recurrent Neural Network10.1007/s12065-020-00403-x ↗
17. Breast Cancer Diagnosis Based on Mammary Thermography and Extreme Learning Machines10.1590/2446-4740.05217 ↗
18. Gogoi, U.R., Bhowmik, M.K., Ghosh, A.K., Bhattacharjee, D., and Majumdar, G. (2017, January 6–7). Discriminative Feature Selection for Breast Abnormality Detection and Accurate Classification of Thermograms. Proceedings of the 2017 International Conference on Innovations in Electronics, Signal Processing and Communication (IESC), Shillong, India.10.1109/IESPC.2017.8071861 ↗
19. Breast Cancer Diagnosis Using Thermography and Convolutional Neural Networks10.1016/j.mehy.2019.109542 ↗
20. Mishra, S., Prakash, A., Roy, S.K., Sharan, P., and Mathur, N. (2020, January 12–14). Breast Cancer Detection Using Thermal Images and Deep Learning. Proceedings of the 2020 7th International Conference on Computing for Sustainable Global Development (INDIACom), Bvicam, New Delhi.10.23919/INDIACom49435.2020.9083722 ↗
21. Mambou, S.J., Maresova, P., Krejcar, O., Selamat, A., and Kuca, K. (2018). Breast Cancer Detection Using Infrared Thermal Imaging and a Deep Learning Model. Sensors, 18.10.3390/s18092799 ↗
22. Data Mining Technique for Breast Cancer Detection in Thermograms Using Hybrid Feature Extraction Strategy10.1080/17686733.2012.738788 ↗
23. Breast Cancer Identification via Thermography Image Segmentation with a Gradient Vector Flow and a Convolutional Neural Network
24. Multi-Input Convolutional Neural Network for Breast Cancer Detection Using Thermal Images and Clinical Data10.1016/j.cmpb.2021.106045 ↗
25. de Freitas Oliveira Baffa, M., and Grassano Lattari, L. (November, January 29). Convolutional Neural Networks for Static and Dynamic Breast Infrared Imaging Classification. Proceedings of the 2018 31st SIBGRAPI Conference on Graphics, Patterns and Images (SIBGRAPI), Paraná, Brazil.10.1109/SIBGRAPI.2018.00029 ↗
26. Yao, H., Zhang, X., Zhou, X., and Liu, S. (2019). Parallel Structure Deep Neural Network Using CNN and RNN with an Attention Mechanism for Breast Cancer Histology Image Classification. Cancers, 11.10.3390/cancers11121901 ↗
27. BreastNet: A Novel Convolutional Neural Network Model through Histopathological Images for the Diagnosis of Breast Cancer10.1016/j.physa.2019.123592 ↗
28. Fan, M., Chakraborti, T., Chang, E.I.-C., Xu, Y., and Rittscher, J. (2020, January 3–7). Fine-Grained Multi-Instance Classification in Microscopy Through Deep Attention. Proceedings of the 2020 IEEE 17th International Symposium on Biomedical Imaging (ISBI), Iowa City, IA, USA.10.1109/ISBI45749.2020.9098704 ↗
29. Attention by Selection: A Deep Selective Attention Approach to Breast Cancer Classification10.1109/TMI.2019.2962013 ↗
30. Sharma, M.K., Dhaka, V.S., Perumal, T., Dey, N., and Tavares, J.M.R.S. (2021). DAN: Breast Cancer Classification from High-Resolution Histology Images Using Deep Attention Network. Proceedings of the Innovations in Computational Intelligence and Computer Vision, Springer.10.1007/978-981-15-6067-5 ↗
31. Classification of Breast Density Categories Based on SE-Attention Neural Networks10.1016/j.cmpb.2020.105489 ↗
32. Rojas, I., Valenzuela, O., Rojas, F., and Ortuño, F. (2019). Classifying Breast Cancer Histopathological Images Using a Robust Artificial Neural Network Architecture. Proceedings of the Bioinformatics and Biomedical Engineering, Springer International Publishing.
33. CyberZHG (2021). Keras-Self-Attention: Attention Mechanism for Processing Sequential Data That Considers the Context for Each Timestamp, GitHub, Inc.
34. (2022, December 12). Soft & Hard Attention. Available online: https://jhui.github.io/2017/03/15/Soft-and-hard-attention/.
35. A New Database for Breast Research with Infrared Image10.1166/jmihi.2014.1226 ↗
36. E-DiCoNet: Extreme Learning Machine Based Classifier for Diagnosis of COVID-19 Using Deep Convolutional Network10.1007/s12652-020-02688-3 ↗
37. Interrater Reliability: The Kappa Statistic10.11613/BM.2012.031 ↗