Pattern Classification Approaches for Breast Cancer Identification via MRI: State-Of-The-Art and Vision for the Future
Source abstract
Abstract
Mining algorithms for Dynamic Contrast Enhanced Magnetic Resonance Imaging (DCE-MRI) of breast tissue are discussed. The algorithms are based on recent advances in multi-dimensional signal processing and aim to advance current state-of-the-art computer-aided detection and analysis of breast tumours when these are observed at various states of development. The topics discussed include image feature extraction, information fusion using radiomics, multi-parametric computer-aided classification and diagnosis using information fusion of tensorial datasets as well as Clifford algebra based classification approaches and convolutional neural network deep learning methodologies. The discussion also extends to semi-supervised deep learning and self-supervised strategies as well as generative adversarial networks and algorithms using generated confrontational learning approaches. In order to address the problem of weakly labelled tumour images, generative adversarial deep learning strategies are considered for the classification of different tumour types. The proposed data fusion approaches provide a novel Artificial Intelligence (AI) based framework for more robust image registration that can potentially advance the early identification of heterogeneous tumour types, even when the associated imaged organs are registered as separate entities embedded in more complex geometric spaces. Finally, the general structure of a high-dimensional medical imaging analysis platform that is based on multi-task detection and learning is proposed as a way forward. The proposed algorithm makes use of novel loss functions that form the building blocks for a generated confrontation learning methodology that can be used for tensorial DCE-MRI. Since some of the approaches discussed are also based on time-lapse imaging, conclusions on the rate of proliferation of the disease can be made possible. The proposed framework can potentially reduce the costs associated with the interpretation of medical images by providing automated, faster and more consistent diagnosis.
Source: crossref · Quality: baseline
Research context
OpenAlex topics: AI in cancer detection · Radiomics and Machine Learning in Medical Imaging · MRI in cancer diagnosis
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
Affiliations
Cyberspace Institute of Advanced Technology, Guangzhou University, Guangzhou 510006, China
Department of Biomedical Engineering, School of Biological Sciences, The University of Reading, Reading RG6 6AY, UK
References (100+)
Show source-provided references
1. Breast imaging reporting and data system(BI-RADS)10.1016/S0033-8389(01)00017-3 ↗
2. Mammographic density and the risk and detection of breast cancer10.1056/NEJMoa062790 ↗
3. Benign breast disease, mammographic breast density, and the risk of breast cancer10.1093/jnci/djt124 ↗
4. Background parenchymal enhancement at breast MR imaging and breast cancer risk10.1016/j.breastdis.2012.04.002 ↗
5. Association between background parenchymal enhancement and pathologic complete Remission throughout the neoadjuvant chemotherapy in breast cancer patients10.1016/j.tranon.2017.07.005 ↗
6. Radiomics: Images are more than pictures, they are data10.1148/radiol.2015151169 ↗
7. Skandalakis, J.E. (2009). Embryology and Anatomy of the Breast, Springer.
8. The Applications of Radiomics in Precision Diagnosis and Treatment of Oncology: Opportunities and Challenges10.7150/thno.30309 ↗
9. Involvement of Machine Learning for Breast Cancer Image Classification: A Survey10.1155/2017/3781951 ↗
10. Breast imaging and reporting data system(BIRADS): Magnetic resonance imaging10.1016/j.ejrad.2006.08.036 ↗
11. Vision20/20: Mammographic breast density and its clinical applications10.1118/1.4935141 ↗
12. ACR (1998). Breast Imaging Reporting and Data System® (BI-RADS®), American College of Radiology. [3rd ed.].
13. Background parenchymal enhancement: Is it just an innocent effect of estrogen on the breast?10.5152/dir.2017.17048 ↗
14. Are Qualitative Assessments of Background Parenchymal Enhancement, Amount of Fibroglandular Tissue on MR Images, and Mammographic Density Associated with Breast Cancer Risk?10.1148/radiol.2015142304 ↗
15. Radiomics: Extracting more information from medical images using advanced feature analysis10.1016/j.ejca.2011.11.036 ↗
16. Myocardial Radiomics in Cardiac MRI10.2214/AJR.19.21986 ↗
17. Relationship between DCE-MRI morphological and functional features and histopathological characteristics of breast cancer10.1007/s00330-006-0505-x ↗
18. Characterization of tumour and adjacent peritumoural stroma in patients with breast Cancer using high-resolution diffusion-weighted imaging: Correlation with pathologic biomarkers10.1016/j.ejrad.2016.02.017 ↗
19. Breast cancer subtype intertumour heterogeneity: MRI-based features Predict results of a genomic assay10.1002/jmri.24890 ↗
20. Computer-Aided diagnosis of breast DCE-MRI using pharmacokinetic model and 3-D morphology analysis10.1016/j.mri.2013.12.002 ↗
21. A novel supervised approach for segmentation of lung parenchyma from chest CT for computer-aided diagnosis10.1007/s10278-012-9539-6 ↗
22. Toward understanding the size dependence of shape features for predicting spiculation in lung nodules for computer-aided diagnosis10.1007/s10278-015-9774-8 ↗
23. Lavanya, R., Nagarajan, N., and Devi, M.N. (2015). Computer-Aided diagnosis of breast cancer by hybrid fusion of ultrasound and mammogram features. Artificial Intelligence and Evolutionary Algorithms in Engineering Systems, Springer.10.1007/978-81-322-2135-7_43 ↗
24. Chen, Y., Wang, Y., Kao, M., and Chuang, Y. (2018, January 18–23). Deep photo enhancer: Unpaired learning for image enhancement from photographs with gans. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Salt Lake City, UT, USA.10.1109/CVPR.2018.00660 ↗
25. Automatic photo adjustment using deep neural networks10.1145/2790296 ↗
26. Tumor characterization with dynamic contrast–enhanced MRI using mr contrast agents of various molecular weights10.1002/mrm.1910390213 ↗
27. Multilevel analysis of spatiotemporal association features for differentiation of tumour enhancement patterns in breast DCE-MRI10.1118/1.3446799 ↗
28. Computer-Aided detection and analysis ofpulmonary nodule from CT images: A survey10.4103/0256-4602.101306 ↗
29. Computer-Aided detection (CADe) and diagnosis (CADx) system for lung cancer with likelihood of malignancy10.1186/s12938-015-0120-7 ↗
30. Sun, T., Zhang, R., Wang, J., Li, X., and Guo, X. (2013). Computer-Aided diagnosis for early-stage lung cancer based on longitudinal and balanced data. PLoS ONE, 8.10.1371/journal.pone.0063559 ↗
31. A new computationally efficient CAD system for pulmonary nodule detection in CT imagery10.1016/j.media.2010.02.004 ↗
32. Solid, part-solid, or non-solid? Classification of pulmonary nodules in low-dose chest computed tomography by a computer-aided diagnosis system10.1097/RLI.0000000000000121 ↗
33. Computer-Aided diagnosis of malignant mammograms using Zernike moments and SVM10.1007/s10278-014-9719-7 ↗
34. Kooi, T., and Karssemeijer, N. (2014). Boosting classification performance in computer aided diagnosis of breast masses in raw full-field digital mammography using processed and screen film images. Medical Imaging 2014: Computer-Aided Diagnosis, SPIE.10.1117/12.2042863 ↗
35. Application of the mutual information criterion for feature selection in computer-aided diagnosis10.1118/1.1418724 ↗
36. Computer-Aided detection of breast masses depicted on full-field digital mammograms: A performance assessment10.1259/bjr/51461617 ↗
37. An immune-inspired semi-supervised algorithm for breast cancer diagnosis10.1016/j.cmpb.2016.07.020 ↗
38. Contrast agents in dynamic contrast-enhanced magnetic resonance imaging10.18632/oncotarget.16482 ↗
39. Selection of diagnostic features on breast MRI to differentiate between malignant and benign lesions using computer-aided diagnosis10.1007/s00330-009-1616-y ↗
40. Computer-aided diagnosis of breast DCE-MRI images using bilateral asymmetry of contrast enhancement between two breasts10.1007/s10278-013-9617-4 ↗
41. A computerized global MR image feature analysis scheme to assist diagnosis of breast cancer: A preliminary assessment10.1016/j.ejrad.2014.03.014 ↗
42. Foundation and methodologies in computer-aided diagnosis systems for breast cancer detection
43. Breast cancer detection using MRF-based probable texture feature and decision-level fusion-based classification using HMM on thermography images10.1016/j.patcog.2015.09.009 ↗
44. Benign and malignant breast tumours classification based on region growing and CNN segmentation10.1016/j.eswa.2014.09.020 ↗
45. Unenhanced breast MRI: Could it replace dynamic breast MRI in detecting and characterizing breast lesions?10.1186/s43055-019-0103-y ↗
46. Performance analysis of support vector machines classifiers in breast cancer mammography recognition10.1007/s00521-012-1324-4 ↗
47. Pawlovsky, A.P., and Nagahashi, M. (2014, January 1–4). A method to select a good setting for the kNN algorithm when using it for breast cancer prognosis. Proceedings of the 2014 IEEE-EMBS International Conference on Biomedical and Health Informatics (BHI), Valencia, Spain.10.1109/BHI.2014.6864336 ↗
48. Naive Bayes Classifiers: A Probabilistic Detection Model for Breast Cancer
49. Yang, S.-N., Li, F.J., Chen, J.M., Zhang, G., Liao, Y.H., and Huang, T.C. (2016). Kinetic Curve Type Assessment for Classification of Breast Lesions Using Dynamic Contrast-Enhanced MR Imaging. PLoS ONE, 11.10.1371/journal.pone.0152827 ↗
50. Ultrafast Bilateral DCE-MRI of the Breast with Conventional Fourier Sampling: Preliminary Evaluation of Semi-Quantitative Analysis10.1016/j.acra.2016.04.008 ↗
51. Exploiting sparsity and low-rank structure for the recovery of multi-slice breast MRIs with reduced sampling error10.1007/s11517-012-0920-x ↗
52. Yin, X.-X., Hadjiloucas, S., Chen, J.H., Zhang, Y., Wu, J.-L., and Su, M.-Y. (2017). Tensor based multichannel reconstruction for breast tumours identified from DCE-MRIs. PLoS ONE, 12.10.1371/journal.pone.0176133 ↗
53. Automated breast cancer lesion detection on breast MRI using artificial intelligence10.1200/JCO.2019.37.15_suppl.e14612 ↗
54. Deep Generative Adversarial Neural Networks for Compressive Sensing MRI10.1109/TMI.2018.2858752 ↗
55. Dong, C., Loy, C.C., and Tang, X. (2016). Accelerating the super-resolution convolutional neural network. European Conference on Computer Vision, Springer.10.1007/978-3-319-46475-6_25 ↗
56. Yin, X.-X., Hadjiloucas, S., and Zhang, Y. (2017). Pattern Classification of Medical Images: Computer Aided Diagnosis, Springer.10.1007/978-3-319-57027-3 ↗
57. Exploring the complementarity of THz pulse imaging and DCE-MRIs: Toward a unified multi-channel classification and a deep learning framework10.1016/j.cmpb.2016.08.026 ↗
58. Clifford Algebras and Geometric Algebra10.1007/BF03041220 ↗
59. Some mathematical notes on three-mode factor analysis10.1007/BF02289464 ↗
60. Efficient MATLAB computations with sparse and factored tensors10.1137/060676489 ↗
61. Tensor decompositions and applications10.1137/07070111X ↗
62. Cichocki, A., Zdunek, R., Phan, A.H., and Amari, S. (2009). Nonnegative Matrix and Tensor Factorizations: Applications to Exploratory Multi-Way Data Analysis and Blind Source Separation, John Wiley and Sons, Ltd.10.1002/9780470747278 ↗
63. Deep bilateral learning for real-time image enhancement10.1145/3072959.3073592 ↗
64. Ignatov, A., Kobyshev, N., Timofte, R., Vanhoey, K., and Vangool, L. (2017, January 22–29). DSLR-quality photos on mobile devices with deep convolutional networks. Proceedings of the IEEE International Conference on Computer Vision, Venice, Italy.10.1109/ICCV.2017.355 ↗
65. Sun, L., Fan, Z., Huang, Y., Ding, X., and Paisley, J. (2018). A deep information sharing network for multi-contrast compressed sensing MRI reconstruction. arXiv.10.1109/TIP.2019.2925288 ↗
66. Olut, S., Sahin, Y.H., Demir, U., and Unal, G. (2018). Generative adversarial training for MRA image synthesis using multi-contrast MRI. arXiv.10.1007/978-3-030-00320-3_18 ↗
67. Deep learning in medical image analysis10.1146/annurev-bioeng-071516-044442 ↗
68. Wu, H.Q. (2015, January 21–24). Improving Emotion Classification on Chinese Microblog Texts with Auxiliary Coss-Domain Data. Proceedings of the 2015 International Conference on Affective Computing and Intelligent Interaction (ACII), Xi’an, China.10.1109/ACII.2015.7344668 ↗
69. Early Diagnosis of Alzheimer’s Disease by Ensemble Deep Learning Using FDG-PET, IScIDE 201810.1007/978-3-030-02698-1_53 ↗
70. Szegedy, C., Liu, W., Jia, Y., Sermanet, P., Reed, S., Anguelov, D., and Vanhoucke, A. (2015, January 7–12). Rabinovich, Going deeper with convolutions. Proceedings of the 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Boston, MA, USA.10.1109/CVPR.2015.7298594 ↗
71. Li, J., Fang, F., Mei, K., and Zhang, G. (2018, January 8–14). Multi-scale Residual Network for Image Super-Resolution. Proceedings of the European Conference on Computer Vision, Munich, Germany.10.1007/978-3-030-01237-3_32 ↗
72. Breast Cancer Multi-classification from Histopathological Images with Structured Deep Learning Model10.1038/s41598-017-04075-z ↗
73. Breast cancer diagnosis in DCE-MRI using mixture ensemble of convolutional neural networks10.1016/j.patcog.2017.08.004 ↗
74. Indications for breast MRI in the patient with newly diagnosed breast cancer10.6004/jnccn.2009.0013 ↗
75. An overview of deep learning in medical imaging focusing on MRI10.1016/j.zemedi.2018.11.002 ↗
76. Sommer, G., and Zeevi, Y.Y. (2005). Geometric neural networks, visual and motor signal neurocomputation. Algebraic Frames for the Perception-Action Cycle, Springer.
77. Characteristic-Based Clustering for Time Series Data10.1007/s10618-005-0039-x ↗
78. Nonstationary time series analysis by temporal clustering10.1109/3477.836381 ↗
79. Recent Techniques of Clustering of Time Series Data: A Survey
80. A Supervoxel-Based Method for Groupwise Whole Brain Parcellation with Resting-State fMRI Data10.3389/fnhum.2016.00659 ↗
81. Saraswathi, S., and Allirani, A. (2013, January 21–22). Survey on image segmentation via clustering. Proceedings of the 2013 International Conference on Information Communication and Embedded Systems (ICICES), Chennai, India.10.1109/ICICES.2013.6508376 ↗
82. Wavelet based local tomographic image using terahertz techniques10.1016/j.dsp.2008.06.009 ↗
83. 2-D wavelet segmentation in 3-D T-ray tomography10.1109/JSEN.2006.890159 ↗
84. Lin, N., Jiang, J., Guo, S., and Xiong, M. (2015). Functional Principal Component Analysis and Randomized Sparse Clustering Algorithm for Medical Image Analysis. PLoS ONE, 10.10.1371/journal.pone.0132945 ↗
85. A supervoxel-based spectro-spatial approach for 3D urban point cloud labelling10.1080/01431161.2016.1211348 ↗
86. Discrete Wavelet Transform Based Medical Image Fusion using Spatial frequency Technique
87. AdaSLIC: Adaptive supervoxel generation for volumetric medical images10.1007/s11042-017-5563-3 ↗
88. An image segmentation framework for extracting tumours from breast magnetic resonance images10.1142/S1793545818500141 ↗
89. Zhu, X., and Goldberg, A.B. (2009). Introduction to semi-supervised learning. Synthesis Lectures on Artificial Intelligence and Machine Learning, Morgan & Claypool Publishers.10.1007/978-3-031-01548-9 ↗
90. Not-so-supervised: A survey of semi-supervised, multi-instance, and transfer learning in medical image analysis10.1016/j.media.2019.03.009 ↗
91. Chapelle, O., Scholkopf, B., and Zien, A. (2006). Semi-Supervised Learning, MIT Press.10.7551/mitpress/9780262033589.001.0001 ↗
92. The helpfulness of category labels in semi-supervised learning depends on category structure10.3758/s13423-015-0857-9 ↗
93. Self-supervised learning for medical image analysis using image context restoration10.1016/j.media.2019.101539 ↗
94. Shen, D. (2019). Self-supervised Feature Learning for 3D Medical Images by Playing a Rubik’s Cube. Medical Image Computing and Computer Assisted Intervention—MICCAI 2019. MICCAI 2019. Lecture Notes in Computer Science, Springer.10.1007/978-3-030-32248-9_98 ↗
95. Xu, T., Zhang, P., Huang, Q., Zhang, H., Gan, Z., Huang, X., and He, X. (2017). Attngan: Fine-grained text to image generation with attentional generative adversarial networks. arXiv.10.1109/CVPR.2018.00143 ↗
96. Ledig, C., Theis, L., Huszar, F., Caballero, J., Cunningham, A., Acosta, A., Aitken, A., Tejani, A., Totz, J., and Wang, Z. (2017). Photo-realistic single image super-resolution using a generative adversarial network. arXiv.10.1109/CVPR.2017.19 ↗
97. Zhu, J.Y., Park, T., Isola, P., and Efros, A.A. (2017). Unpaired image-to-image translation using cycle-consistent adversarial networks. arXiv.10.1109/ICCV.2017.244 ↗
98. Generative adversarial network in medical imaging: A review10.1016/j.media.2019.101552 ↗
99. Simard, P.Y., Steinkraus, D., and Platt, J.C. (2003, January 6). Best practices for convolutional neural networks applied to visual document analysis. Proceedings of the Seventh International Conference on Document Analysis and Recognition, Edinburgh, UK.
100. Zhang, Q., Wang, H., Lu, H., Won, D., and Yoon, S.W. (2018, January 4–7). Medical Image Synthesis with Generative Adversarial Networks for Tissue Recognition. Proceedings of the 2018 IEEE International Conference on Healthcare Informatics (ICHI), New York, NY, USA.10.1109/ICHI.2018.00030 ↗