journal article·2024-12-12Open access

Three-Dimensional Automated Breast Ultrasound (ABUS) Tumor Classification Using a 2D-Input Network: Soft Voting or Hard Voting?

Shaode Yu, Xiaoyu Liang, Songnan Zhao, Yaoqin Xie, Qiurui Sun

Applied Sciences· Volume 14· Issue 24

Abstract

Breast cancer is a global threat to women’s health. Three-dimensional (3D) automated breast ultrasound (ABUS) offers reproducible high-resolution imaging for breast cancer diagnosis. However, 3D-input deep networks are challenged by high time costs, a lack of sufficient training samples, and the complexity of hyper-parameter optimization. For efficient ABUS tumor classification, this study explores 2D-input networks, and soft voting (SV) is proposed as a post-processing step to enhance diagnosis effectiveness. Specifically, based on the preliminary predictions made by a 2D-input network, SV employs voxel-based weighting, and hard voting (HV) utilizes slice-based weighting. Experimental results on 100 ABUS cases show a substantial improvement in classification performance. The diagnosis metric values are increased from ResNet34 (accuracy, 0.865; sensitivity, 0.942; specificity, 0.757; area under the curve (AUC), 0.936) to ResNet34 + HV (accuracy, 0.907; sensitivity, 0.990; specificity, 0.864; AUC, 0.907) and to ResNet34 + SV (accuracy, 0.986; sensitivity, 0.990; specificity, 0.963; AUC, 0.986). Notably, ResNet34 + SV achieves the state-of-the-art result on the database. The proposed SV strategy enhances ABUS tumor classification with minimal computational overhead, while its integration with 2D-input networks to improve prediction performance of other 3D object recognition tasks requires further investigation.
Source: crossref · Quality: baseline

Research context

OpenAlex topics: AI in cancer detection · Radiomics and Machine Learning in Medical Imaging · Brain Tumor Detection and Classification

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

School of Information and Communication Engineering, Communication University of China, Beijing 100024, China

Shenzhen Institutes of Advanced Technology, Chinese Academy of Sciences, Shenzhen 518055, China

Center of Information & Network Technology, Beijing Normal University, Beijing 100875, China

Funding

National Key Research and Develop Program of China · National Natural Science Foundation of China · China-Central Eastern European Countries High Education Joint Education Project · Medium- and Long-term Technology Plan for Radio, Television and Online Audiovisual · Architecture Design and Implementation of Building Common Business Services based on Rapid Development Platform

References (48)

Show source-provided references
1. Global cancer statistics 2020: GLOBOCAN estimates of incidence and mortality worldwide for 36 cancers in 185 countries10.3322/caac.21660 ↗
2. Cancer statistics, 202210.3322/caac.21708 ↗
3. Breast cancer statistics, 202210.3322/caac.21754 ↗
4. Incidence, mortality, survival, and disease burden of breast cancer in China compared to other developed countries10.1111/ajco.13958 ↗
5. A technical review of convolutional neural network-based mammographic breast cancer diagnosis10.1155/2019/6509357 ↗
6. Estimating breast cancer overdiagnosis after screening mammography among older women in the United States10.7326/M23-0133 ↗
7. Performance and reading time of automated breast US with or without computer-aided detection10.1148/radiol.2019181816 ↗
8. Breast tomographic ultrasound: The spectrum from current dense breast cancer screenings to future theranostic treatments10.3390/tomography10040044 ↗
9. Yu, S., Wu, S., Zhuang, L., Wei, X., Sak, M., Neb, D., Hu, J., and Xie, Y. (2017). Efficient segmentation of a breast in B-mode ultrasound tomography using three-dimensional GrabCut (GC3D). Sensors, 17.10.3390/s17081827 ↗
10. Automated breast ultrasound: Technical aspects, impact on breast screening, and future perspectives10.1007/s12609-021-00423-1 ↗
11. Boca, I., Ciurea, A.I., Ciortea, C.A., and Dudea, S.M. (2021). Pros and cons for automated breast ultrasound (ABUS): A narrative review. J. Pers. Med., 11.10.3390/jpm11080703 ↗
12. The performance of 3D ABUS versus HHUS in the visualisation and BI-RADS characterisation of breast lesions in a large cohort of 1,886 women10.1007/s00330-017-5011-9 ↗
13. Diagnostic performance of 3D automated breast ultrasound (3D-ABUS) in a clinical screening setting—A retrospective study10.1007/s00330-023-10568-5 ↗
14. Automated breast ultrasound provides comparable diagnostic performance in opportunistic screening and diagnostic assessment10.1016/j.ultrasmedbio.2023.09.011 ↗
15. Recent advancements in artificial intelligence for breast cancer: Image augmentation, segmentation, diagnosis, and prognosis approaches10.1016/j.semcancer.2023.09.001 ↗
16. Transition of traditional method to deep learning based computer-aided system for breast cancer using automated breast ultrasound system (ABUS) images: A review10.1007/s10462-023-10511-6 ↗
17. Computer-aided lesion diagnosis in automated 3-D breast ultrasound using coronal spiculation10.1109/TMI.2012.2184549 ↗
18. Breast cancer classification in automated breast ultrasound using multiview convolutional neural network with transfer learning10.1016/j.ultrasmedbio.2020.01.001 ↗
19. 3-D Res-CapsNet convolutional neural network on automated breast ultrasound tumor diagnosis10.1016/j.ejrad.2021.109608 ↗
20. Multi-task learning for segmentation and classification of tumors in 3D automated breast ultrasound images10.1016/j.media.2020.101918 ↗
21. Performance of novel deep learning network with the incorporation of the automatic segmentation network for diagnosis of breast cancer in automated breast ultrasound10.1007/s00330-022-08836-x ↗
22. Multi-view stereoscopic attention network for 3D tumor classification in automated breast ultrasound10.1016/j.eswa.2023.120969 ↗
23. 3D breast ultrasound image classification using 2.5 D deep learning
24. Deep learning with noisy labels: Exploring techniques and remedies in medical image analysis10.1016/j.media.2020.101759 ↗
25. Image classification with deep learning in the presence of noisy labels: A survey10.1016/j.knosys.2021.106771 ↗
26. Yu, S., Chen, M., Zhang, E., Wu, J., Yu, H., Yang, Z., Ma, L., Gu, X., and Lu, W. (2020). Robustness study of noisy annotation in deep learning based medical image segmentation. Phys. Med. Biol., 65.10.1088/1361-6560/ab99e5 ↗
27. Bianchessi, T., Tampu, I.E., Blystad, I., Lundberg, P., Nyman, P., Eklund, A., and Haj-Hosseini, N. (2023). Pediatric brain tumor type classification using deep learning on MR images from the children’s brain tumor network. medRxiv.10.1101/2023.05.12.23289829 ↗
28. Yue, Y., and Li, Z. (2016, January 27–30). Deep residual learning for image recognition. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Las Vegas, NV, USA.
29. Manzari, O.N., Ahmadabadi, H., Kashiani, H., Shokouhi, S.B., and Ayatollahi, A. (2023). MedViT: A robust vision transformer for generalized medical image classification. Comput. Biol. Med., 157.10.1016/j.compbiomed.2023.106791 ↗
30. Huo, X., Sun, G., Tian, S., Wang, Y., Yu, L., Long, J., Zhang, W., and Li, A. (2024). HiFuse: Hierarchical multi-scale feature fusion network for medical image classification. Biomed. Signal Process. Control, 87.10.1016/j.bspc.2023.105534 ↗
31. Yue, Y., and Li, Z. (2023). Medmamba: Vision mamba for medical image classification. arXiv.
32. Jang, J., and Hwang, D. (2022, January 19–20). M3T: Three-dimensional Medical image classifier using Multi-plane and Multi-slice Transformer. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, New Orleans, LA, USA.10.1109/CVPR52688.2022.02006 ↗
33. Wang, X., Yi, J., and Li, Y. (2022, January 14–16). Application of fusion model of 3D-ResNeXt and Bi-LSTM network in Alzheimer’s disease classification. Proceedings of the 2022 6th International Conference on Communication and Information Systems, Chongqing, China.10.1109/ICCIS56375.2022.9998141 ↗
34. Hippocampus analysis by combination of 3-D DenseNet and shapes for Alzheimer’s disease diagnosis10.1109/JBHI.2018.2882392 ↗
35. Tran, D., Wang, H., Torresani, L., Ray, J., LeCun, Y., and Paluri, M. (2018, January 18–22). A closer look at spatiotemporal convolutions for action recognition. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Salt Lake City, UT, USA.10.1109/CVPR.2018.00675 ↗
36. Shafiq, M., and Gu, Z. (2022). Deep residual learning for image recognition: A survey. Appl. Sci., 12.10.3390/app12188972 ↗
37. Dosovitskiy, A., Beyer, L., Kolesnikov, A., Weissenborn, D., Zhai, X., Unterthiner, T., Dehghani, M., Minderer, M., Heigold, G., and Gelly, S. (May, January 26). An image is worth 16x16 words: Transformers for image recognition at scale. Proceedings of the International Conference on Learning Representations, Virtual.
38. Vaswani, A., Shazeer, N., Parmar, N., Uszkoreit, J., Jones, L., Gomez, A.N., Kaiser, L., and Polosukhin, I. (2017, January 4–9). Attention is all you need. Proceedings of the 31st Conference on Neural Information Processing Systems, Long Beach, CA, USA.
39. Xie, S., Girshick, R., Dollár, P., Tu, Z., and He, K. (2017, January 21–26). Aggregated residual transformations for deep neural networks. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Honolulu, HI, USA.10.1109/CVPR.2017.634 ↗
40. Zhang, S., Zheng, D., Hu, X., and Yang, M. (November, January 30). Bidirectional long short-term memory networks for relation classification. Proceedings of the Pacific Asia Conference on Language, Information and Computation, Shanghai, China.
41. Visualizing data using t-SNE
42. A survey on ensemble learning under the era of deep learning10.1007/s10462-022-10283-5 ↗
43. Mahajan, P., Uddin, S., Hajati, F., and Moni, M.A. (2023). Ensemble learning for disease prediction: A review. Healthcare, 11.10.3390/healthcare11121808 ↗
44. Xiao, T., Liu, L., Li, K., Qin, W., Yu, S., and Li, Z. (2018). Comparison of transferred deep neural networks in ultrasonic breast masses discrimination. BioMed Res. Int., 1.10.1155/2018/4605191 ↗
45. A statistical deformation model-based data augmentation method for volumetric medical image segmentation10.1016/j.media.2023.102984 ↗
46. Transferring deep neural networks for the differentiation of mammographic breast lesions10.1007/s11431-017-9317-3 ↗
47. Dual domain distribution disruption with semantics preservation: Unsupervised domain adaptation for medical image segmentation10.1016/j.media.2024.103275 ↗
48. Representation learning: A review and new perspectives10.1109/TPAMI.2013.50 ↗