journal article·2024-06-06Open access

New Approach for Brain Tumor Segmentation Based on Gabor Convolution and Attention Mechanism

Yuan Cao, Yinglei Song

Applied Sciences· Volume 14· Issue 11

Abstract

In the treatment process of brain tumors, it is of great importance to develop a set of MRI image segmentation methods with high accuracy and low cost. In order to extract the feature information for each region of the brain tumor more effectively, this paper proposes a new model Ga-U-Net based on Gabor convolution and an attention mechanism. Based on 3D U-Net, Gabor convolution is added at the shallow layer of the encoder, which is able to learn the local structure and texture information of the tumor better. After that, the CBAM attention mechanism is added after the output of each layer of the encoder, which not only enhances the network’s ability to perceive the brain tumor boundary information but also reduces some redundant information by allocating the attention to the two dimensions of space and channel. Experimental results show that the model performs well for multiple tumor regions (WT, TC, ET) on the brain tumor dataset BraTS 2021, with Dice coefficients of 0.910, 0.897, and 0.856, respectively, which are improved by 0.3%, 2%, and 1.7% compared to the base network, the U-Net network, with an average Dice of 0.887 and an average Hausdorff distance of 9.12, all of which are better than a few other state-of-the-art deep models for biomedical image segmentation.
Source: crossref · Quality: baseline

Research context

OpenAlex topics: Brain Tumor Detection and Classification · Medical Image Segmentation Techniques · Advanced Neural Network Applications

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

School of Automation, Jiangsu University of Science and Technology, Zhenjiang 212100, China

Funding

Jiangsu University of Science and Technology

References (30)

Show source-provided references
1. Cancer statistics, 201510.3322/caac.21254 ↗
2. Zhang, T. (2022). Research on MRI Brain Tumor Classification and Segmentation Method Based on Deep Learning. [Master’s Thesis, Yanshan University].
3. Review on brain tumor segmentation of MRI images10.1016/j.mri.2019.05.043 ↗
4. Deep learning based brain tumor segmentation: A survey10.1007/s40747-022-00815-5 ↗
5. Medical image segmentation: A review
6. Shi, J., Chan, T.T., Pan, H., and Lok, T.M. (2023, January 14–17). Reconfigurable intelligent surface assisted semantic communication systems. Proceedings of the 2023 IEEE International Conference on Signal Processing, Communications and Computing (ICSPCC), Zhengzhou, China.10.1109/ICSPCC59353.2023.10400366 ↗
7. A deep learning framework with visualisation for uncovering students’ learning progression and learning bottlenecks10.1177/07356331231200600 ↗
8. Fully convolutional networks for semantic segmentation
9. Shen, H., Zhang, J., and Zheng, W. (2017, January 17–20). Efficient symmetry-driven fully convolutional network for multimodal brain tumor segmentation. Proceedings of the IEEE International Conference on Image Processing (ICIP), Beijing, China.10.1109/ICIP.2017.8297006 ↗
10. Ronneberger, O., Fischer, P., and Brox, T. (2015, January 5–9). U-net: Convolutional networks for biomedical image segmentation. Proceedings of the 18th International Conference on Medical Image Computing and Computer-Assisted Intervention—MICCAI 2015, Munich, Germany.10.1007/978-3-319-24574-4_28 ↗
11. Liu, D., Zhang, H., Zhao, M., Yu, X., Yao, S., and Zhou, W. (2018, January 13–15). Brain tumor segmention based on dilated convolution refine networks. Proceedings of the IEEE 16th International Conference on Software Engineering Research, Management and Applications (SERA), Kunming, China.10.1109/SERA.2018.8477213 ↗
12. Attention U-Net based magnetic resonance image segmentation of brain tumor
13. Jun, W., Haoxiang, X., and Wang, Z. (2020, January 4–8). Brain tumor segmentation using dual-path attention U-net in 3D MRI Images. Proceedings of the International Medical Image Computing and Computer Assisted Intervention Brainlesion Workshop, Lima, Peru.10.1007/978-3-030-72084-1_17 ↗
14. Maji, D., Sigedar, P., and Singh, M. (2022). Attention Res-UNet with guided decoder for semantic segmentation of brain tumors. Biomed. Signal Process. Control, 71.10.1016/j.bspc.2021.103077 ↗
15. Xiao, X., Lian, S., Luo, Z., and Li, S. (2018, January 19–21). Weighted Res-UNet for high-quality retina vessel segmentation. Proceedings of the 2018 9th International Conference on Information Technology in Medicine and Education, Hangzhou, China.10.1109/ITME.2018.00080 ↗
16. RDAU-Net: Based on A residual convolutional neural network with DFP and CBAM for brain tumor segmentation10.3389/fonc.2022.805263 ↗
17. Fusion based on attention mechanism and context constraint for multi-modal brain tumor segmentation10.1016/j.compmedimag.2020.101811 ↗
18. Jiang, Z., Ding, C., Liu, M., and Tao, D. (2019, January 13––17). Two-stage cascaded U-Net:1st place solution to BraTS challenge 2019 segmentation task. Proceedings of the International Medical Image Computing and Computer Assisted Intervention Brainlesion Workshop, Shenzhen, China.10.1007/978-3-030-46640-4_22 ↗
19. Theory of communication. Part 1: The analysis of information
20. Two-dimensional spectral analysis of cortical receptive field profiles10.1016/0042-6989(80)90065-6 ↗
21. Complete discrete 2-D Gabor transforms by neural networks for image analysis and compression10.1109/29.1644 ↗
22. The generalized Gabor scheme of image representation in biological and machine vision10.1109/34.3910 ↗
23. Rai, M., and Rivas, P. (2020, January 16–18). A review of convolutional neural networks and gabor filters in object recognition. Proceedings of the 2020 International Conference on Computational Science and Computational Intelligence (CSCI), Las Vegas, NV, USA.10.1109/CSCI51800.2020.00289 ↗
24. Woo, S., Park, J., Lee, J.Y., and Kweon, S. (2018, January 8–14). Cbam: Convolutional block attention module. Proceedings of the 2018 European Conference on Computer Vision (ECCV), Munich, Germany.10.1007/978-3-030-01234-2_1 ↗
25. Baid, U., Ghodasara, S., Mohan, S., Bilello, M., Calabrese, E., Colak, E., Farahani, K., Kalpathy-Cramer, J., Kitamura, F.C., and Pati, S. (2021). The rsna-asnr-miccai brats 2021 benchmark on brain tumor segmentation and radiogenomic classification. arXiv.
26. Peiris, H., Hayat, M., Chen, Z., Egan, G., and Harandi, M. (2022, January 18–22). A robust volumetric transformer for accurate 3D tumor segmentation. Proceedings of the 25th Conference on Medical Image Computing and ComputerAssisted Intervention (MICCAI), Singapore.10.1007/978-3-031-16443-9_16 ↗
27. Jiang, Y., Zhang, Y., Lin, X., Dong, J., Cheng, T., and Liang, J. (2022). A method for 3D multimodal brain tumor segmentation using Swin transformer. Brain Sci., 12.10.3390/brainsci12060797 ↗
28. Roth, J., Keller, J., Franke, S., Neumuth, T., and Schneider, D. (2021, January 27). Multi-plane UNet++ ensemble for glioblastoma segmentation. Proceedings of the 24th Medical Image Computing and Computer Assisted Intervention Brainlesion Workshop, Strasbourg, Germany.10.1007/978-3-031-08999-2_23 ↗
29. Andrade-Miranda, G., Jaouen, V., Bourbonne, V., Lucia, F., Visvikis, D., and Conze, P.-H. (2022, January 16–19). Pure versus hybrid transformers for multi-modal brain tumor segmentation: A comparative study. Proceedings of the 29th International Conference on Image Processing. (ICIP), Bordeaux, France.10.1109/ICIP46576.2022.9897658 ↗
30. Shi, Y., Micklisch, C., Mushtaq, E., Avestimehr, S., Yan, Y., and Zhang, X. (2022, January 18–22). An ensemble approach to automatic brain tumor segmentation. Proceedings of the 25th Medical Image Computing and Computer Assisted Intervention Brainlesion Workshop, Brainlesion: Glioma, Multiple Sclerosis, Stroke and Traumatic Brain Injuries, Singapore.10.1007/978-3-031-09002-8_13 ↗