SARFNet: Selective Layer and Axial Receptive Field Network for Multimodal Brain Tumor Segmentation
Source abstract
Abstract
Efficient magnetic resonance imaging (MRI) segmentation, which is helpful for treatment planning, is essential for identifying brain tumors from detailed images. In recent years, various convolutional neural network (CNN) structures have been introduced for brain tumor segmentation tasks and have performed well. However, the downsampling blocks of most existing methods are typically used only for processing the variation in image sizes and lack sufficient capacity for further extraction features. We, therefore, propose SARFNet, a method based on UNet architecture, which consists of the proposed SLiRF module and advanced AAM module. The SLiRF downsampling module can extract feature information and prevent the loss of important information while reducing the image size. The AAM block, incorporated into the bottleneck layer, captures more contextual information. The Channel Attention Module (CAM) is introduced into skip connections to enhance the connections between channel features to improve accuracy and produce better feature expression. Ultimately, deep supervision is utilized in the decoder layer to avoid vanishing gradients and generate better feature representations. Many experiments were performed to validate the effectiveness of our model on the BraTS2018 dataset. SARFNet achieved Dice coefficient scores of 90.40, 85.54, and 82.15 for the whole tumor (WT), tumor core (TC), and enhancing tumor (ET), respectively. The results show that the proposed model achieves state-of-the-art performance compared with twelve or more benchmarks.
Source: crossref · Quality: baseline
Research context
OpenAlex topics: Brain Tumor Detection and Classification · Advanced Neural Network Applications · Medical Image Segmentation Techniques
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
Affiliations
College of Information Science and Engineering, Hohai University, Nanjing 210098, China
College of Computer and Information Engineering, Xinjiang Agricultural University, Urumqi 830052, China
Funding
National Natural Science Foundation of China
References (69)
Show source-provided references
1. The developmental biology of brain tumors10.1146/annurev.neuro.24.1.385 ↗
2. Brain tumor epidemiology: Consensus from the Brain Tumor Epidemiology Consortium10.1002/cncr.23741 ↗
3. Primary brain tumors in adults
4. Resection of invasive pulmonary aspergillosis in immunocompromised patients10.1007/s10434-000-0312-6 ↗
5. The 2016 World Health Organization Classification of tumors of the central nervous system: A summary10.1007/s00401-016-1545-1 ↗
6. Different aetiology of familial low-grade and high-grade glioma? A nationwide cohort study of familial glioma10.1159/000065528 ↗
7. Cho, H.H., and Park, H. (2017, January 11–15). Classification of low-grade and high-grade glioma using multi-modal image radiomics features. Proceedings of the 2017 39th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC), Jeju, Republic of Korea.10.1109/EMBC.2017.8037508 ↗
8. Modern brain tumor imaging10.14791/btrt.2015.3.1.8 ↗
9. A comparative study of medical imaging techniques
10. Suneetha, B., and JhansiRani, A. (2017, January 16–18). A survey on image processing techniques for brain tumor detection using magnetic resonance imaging. Proceedings of the 2017 International Conference on Innovations in Green Energy and Healthcare Technologies (IGEHT), Coimbatore, India.10.1109/IGEHT.2017.8094064 ↗
11. MRI based medical image analysis: Survey on brain tumor grade classification10.1016/j.bspc.2017.07.007 ↗
12. Bauer, S., Wiest, R., Nolte, L.P., and Reyes, M. (2013). A survey of MRI-based medical image analysis for brain tumor studies. Phys. Med. Biol., 58.10.1088/0031-9155/58/13/R97 ↗
13. A survey of MRI-based brain tumor segmentation methods10.1109/TST.2014.6961028 ↗
14. Functional diffusion map: A noninvasive MRI biomarker for early stratification of clinical brain tumor response10.1073/pnas.0501532102 ↗
15. Blystad, I., Warntjes, J.M., Smedby, Ö., Lundberg, P., Larsson, E.M., and Tisell, A. (2017). Quantitative MRI for analysis of peritumoral edema in malignant gliomas. PLoS ONE, 12.10.1371/journal.pone.0177135 ↗
16. Image-guided procedures: A review
17. Review of artificial intelligence techniques in imaging data acquisition, segmentation, and diagnosis for COVID-1910.1109/RBME.2020.2987975 ↗
18. Brain tumor target volume determination for radiation treatment planning through automated MRI segmentation10.1016/j.ijrobp.2004.01.026 ↗
19. Deep learning for brain tumor classification
20. Evolution of image segmentation using deep convolutional neural network: A survey10.1016/j.knosys.2020.106062 ↗
21. CNN-G: Convolutional neural network combined with graph for image segmentation with theoretical analysis10.1109/TCDS.2020.2998497 ↗
22. SAR image segmentation based on convolutional-wavelet neural network and Markov random field10.1016/j.patcog.2016.11.015 ↗
23. Visual saliency detection based on multiscale deep CNN features10.1109/TIP.2016.2602079 ↗
24. ImageNet classification with deep convolutional neural networks10.1145/3065386 ↗
25. Simonyan, K., and Zisserman, A. (2014). Very deep convolutional networks for large-scale image recognition. arXiv.
26. Szegedy, C., Liu, W., Jia, Y., Sermanet, P., Reed, S., Anguelov, D., Erhan, D., Vanhoucke, V., and Rabinovich, A. (2015, January 7–12). Going deeper with convolutions. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Boston, MA, USA.10.1109/CVPR.2015.7298594 ↗
27. Mask-R-FCN: A deep fusion network for semantic segmentation10.1109/ACCESS.2020.3012701 ↗
28. Integrated pixel-level CNN-FCN crack detection via photogrammetric 3D texture map of concrete structures10.1016/j.autcon.2022.104388 ↗
29. U-net and its variants for medical image segmentation: A review of theory and applications10.1109/ACCESS.2021.3086020 ↗
30. Rehman, M.U., Cho, S., Kim, J.H., and Chong, K.T. (2020). Bu-net: Brain tumor segmentation using modified u-net architecture. Electronics, 9.10.3390/electronics9122203 ↗
31. Crack detection for nuclear containments based on multi-feature fused semantic segmentation10.1016/j.conbuildmat.2022.127137 ↗
32. Theory of deep convolutional neural networks: Downsampling10.1016/j.neunet.2020.01.018 ↗
33. LANet: Local attention embedding to improve the semantic segmentation of remote sensing images10.1109/TGRS.2020.2994150 ↗
34. DGFAU-Net: Global feature attention upsampling network for medical image segmentation10.1007/s00521-021-05908-9 ↗
35. Res2-Unet, a new deep architecture for building detection from high spatial resolution images10.1109/JSTARS.2022.3146430 ↗
36. Learnable fourier features for multi-dimensional spatial positional encoding
37. Transattunet: Multi-level attention-guided u-net with transformer for medical image segmentation10.1109/TETCI.2023.3309626 ↗
38. Liu, X., Song, L., Liu, S., and Zhang, Y. (2021). A review of deep-learning-based medical image segmentation methods. Sustainability, 13.10.3390/su13031224 ↗
39. Classification of mass and normal breast tissue: A convolution neural network classifier with spatial domain and texture images10.1109/42.538937 ↗
40. Çiçek, Ö., Abdulkadir, A., Lienkamp, S.S., Brox, T., and Ronneberger, O. (2016, January 17–21). 3D U-Net: Learning dense volumetric segmentation from sparse annotation. Proceedings of the Medical Image Computing and Computer-Assisted Intervention–MICCAI 2016: 19th International Conference, Athens, Greece.10.1007/978-3-319-46723-8_49 ↗
41. Zhou, Z., Rahman Siddiquee, M.M., Tajbakhsh, N., and Liang, J. (2018, January 20). Unet++: A nested u-net architecture for medical image segmentation. Proceedings of the Deep Learning in Medical Image Analysis and Multimodal Learning for Clinical Decision Support: 4th International Workshop, Granada, Spain.10.1007/978-3-030-00889-5_1 ↗
42. Milletari, F., Navab, N., and Ahmadi, S.A. (2016, January 25–28). V-net: Fully convolutional neural networks for volumetric medical image segmentation. Proceedings of the 2016 Fourth International Conference on 3D Vision (3DV), Stanford, CA, USA.10.1109/3DV.2016.79 ↗
43. Chen, C., Liu, X., Ding, M., Zheng, J., and Li, J. (2019, January 13–17). 3D dilated multi-fiber network for real-time brain tumor segmentation in MRI. Proceedings of the Medical Image Computing and Computer Assisted Intervention–MICCAI 2019, Shenzhen, China.10.1007/978-3-030-32248-9_21 ↗
44. Cao, Y., Zhou, W., Zang, M., An, D., Feng, Y., and Yu, B. (2023). MBANet: A 3D convolutional neural network with multi-branch attention for brain tumor segmentation from MRI images. Biomed. Signal Process. Control, 80.10.1016/j.bspc.2022.104296 ↗
45. Zhang, R., Jia, S., Adamu, M.J., Nie, W., Li, Q., and Wu, T. (2023). HMNet: Hierarchical multi-scale brain tumor segmentation network. J. Clin. Med., 12.10.3390/jcm12020538 ↗
46. SGEResU-Net for brain tumor segmentation10.3934/mbe.2022261 ↗
47. Tian, W., Li, D., Lv, M., and Huang, P. (2022). Axial attention convolutional neural network for brain tumor segmentation with multi-modality MRI scans. Brain Sci., 13.10.3390/brainsci13010012 ↗
48. A 3D cross-modality feature interaction network with volumetric feature alignment for brain tumor and tissue segmentation10.1109/JBHI.2022.3214999 ↗
49. Kuang, H., Yang, D., Wang, S., Wang, X., and Zhang, L. (2023, January 4–10). Towards simultaneous segmentation of liver tumors and intrahepatic vessels via cross-attention mechanism. Proceedings of the ICASSP 2023—2023 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), Rhodes Island, Greece.10.1109/ICASSP49357.2023.10095689 ↗
50. Yang, L., Zhai, C., Liu, Y., and Yu, H. (2023). CFHA-Net: A polyp segmentation method with cross-scale fusion strategy and hybrid attention. Comput. Biol. Med., 164.10.1016/j.compbiomed.2023.107301 ↗
51. Wang, R., Liu, H., Zhou, Z., Gou, S., Wang, J., and Jiao, L. (2023). ASF-LKUNet: Adjacent-Scale Fusion U-Net with Large-kernel for Medical Image Segmentation. Authorea Prepr.10.36227/techrxiv.22794728 ↗
52. Li, H., Qi, M., Du, B., Li, Q., Gao, H., Yu, J., Bi, C., Yu, H., Liang, M., and Ye, G. (2023). Maize Disease Classification System Design Based on Improved ConvNeXt. Sustainability, 15.10.3390/su152014858 ↗
53. Dosovitskiy, A., Beyer, L., Kolesnikov, A., Weissenborn, D., Zhai, X., Unterthiner, T., Dehghani, M., Minderer, M., Heigold, G., and Gelly, S. (2020). An image is worth 16x16 words: Transformers for image recognition at scale. arXiv.
54. Chen, J., Lu, Y., Yu, Q., Luo, X., Adeli, E., Wang, Y., Lu, L., Yuille, A., and Zhou, Y. (2021). Transunet: Transformers make strong encoders for medical image segmentation. arXiv.
55. Zhang, Y., He, N., Yang, J., Li, Y., Wei, D., Huang, Y., Zhang, Y., He, Z., and Zheng, Y. (2022, January 18–22). mmformer: Multimodal medical transformer for incomplete multimodal learning of brain tumor segmentation. Proceedings of the International Conference on Medical Image Computing and Computer-Assisted Intervention, Singapore.10.1007/978-3-031-16443-9_11 ↗
56. Lu, Y., Chang, Y., Zheng, Z., Sun, Y., Zhao, M., Yu, B., Tian, C., and Zhang, Y. (2023). GMetaNet: Multi-scale ghost convolutional neural network with auxiliary MetaFormer decoding path for brain tumor segmentation. Biomed. Signal Process. Control, 83.10.1016/j.bspc.2023.104694 ↗
57. Zhang, W., Chen, S., Ma, Y., Liu, Y., and Cao, X. (2024). ETUNet: Exploring efficient transformer enhanced UNet for 3D brain tumor segmentation. Comput. Biol. Med., 171.10.1016/j.compbiomed.2024.108005 ↗
58. Channel-attention U-Net: Channel attention mechanism for semantic segmentation of esophagus and esophageal cancer10.1109/ACCESS.2020.3007719 ↗
59. Zhang, X., Liu, C., Yang, D., Song, T., Ye, Y., Li, K., and Song, Y. (2023). Rfaconv: Innovating spatital attention and standard convolutional operation. arXiv.
60. Ho, J., Kalchbrenner, N., Weissenborn, D., and Salimans, T. (2019). Axial attention in multidimensional transformers. arXiv.
61. Deeplab: Semantic image segmentation with deep convolutional nets, atrous convolution, and fully connected crfs10.1109/TPAMI.2017.2699184 ↗
62. The multimodal brain tumor image segmentation benchmark (BRATS)10.1109/TMI.2014.2377694 ↗
63. Advancing the cancer genome atlas glioma MRI collections with expert segmentation labels and radiomic features10.1038/sdata.2017.117 ↗
64. Bakas, S., Reyes, M., Jakab, A., Bauer, S., Rempfler, M., Crimi, A., Shinohara, R.T., Berger, C., Ha, S.M., and Rozycki, M. (2018). Identifying the best machine learning algorithms for brain tumor segmentation, progression assessment, and overall survival prediction in the BRATS challenge. arXiv.
65. Bakas, S., Akbari, H., Sotiras, A., Bilello, M., Rozycki, M., Kirby, J., Freymann, J., Farahani, K., and Davatzikos, C. (2017). Segmentation labels and radiomic features for the pre-operative scans of the TCGA-LGG collection. Cancer Imaging Arch., 286.
66. Segmentation labels and radiomic features for the pre-operative scans of the TCGA-GBM collection
67. Jiao, C., Yang, T., Yan, Y., and Yang, A. (2023). RFTNet: Region–Attention Fusion Network Combined with Dual-Branch Vision Transformer for Multimodal Brain Tumor Image Segmentation. Electronics, 13.10.3390/electronics13010077 ↗
68. A deep convolutional neural network for the automatic segmentation of glioblastoma brain tumor: Joint spatial pyramid module and attention mechanism network10.1016/j.artmed.2024.102776 ↗
69. Baid, U., Ghodasara, S., Mohan, S., Bilello, M., Calabrese, E., Colak, E., Farahani, K., Kalpathy-Cramer, J., Kitamura, F.C., and Pati, S. (2021). The rsna-asnr-miccai brats 2021 benchmark on brain tumor segmentation and radiogenomic classification. arXiv.