MIU-Net: MIX-Attention and Inception U-Net for Histopathology Image Nuclei Segmentation
Source abstract
Abstract
In the medical field, hematoxylin and eosin (H&E)-stained histopathology images of cell nuclei analysis represent an important measure for cancer diagnosis. The most valuable aspect of the nuclei analysis is the segmentation of the different nuclei morphologies of different organs and subsequent diagnosis of the type and severity of the disease based on pathology. In recent years, deep learning techniques have been widely used in digital histopathology analysis. Automated nuclear segmentation technology enables the rapid and efficient segmentation of tens of thousands of complex and variable nuclei in histopathology images. However, a challenging problem during nuclei segmentation is the blocking of cell nuclei, overlapping, and background complexity of the tissue fraction. To address this challenge, we present MIU-net, an efficient deep learning network structure for the nuclei segmentation of histopathology images. Our proposed structure includes two blocks with modified inception module and attention module. The advantage of the modified inception module is to balance the computation and network performance of the deeper layers of the network, combined with the convolutional layer using different sizes of kernels to learn effective features in a fast and efficient manner to complete kernel segmentation. The attention module allows us to extract small and fine irregular boundary features from the images, which can better segment cancer cells that appear disorganized and fragmented. We test our methodology on public kumar datasets and achieve the highest AUC score of 0.92. The experimental results show that the proposed method achieves better performance than other state-of-the-art methods.
Source: crossref · Quality: baseline
Research context
OpenAlex topics: AI in cancer detection · Digital Imaging for Blood Diseases · Medical Imaging and Analysis
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
Affiliations
College of Mathematical Sciences, Bohai University, Jinzhou 121000, China
Department of Control Science and Engineering, Harbin Institute of Technology, Harbin 150001, China
Funding
Young Scientist Studio of Harbin Institute of Technology
References (34)
Show source-provided references
1. Robust nuclei segmentation in histopathology using ASPPU-Net and boundary refinement10.1016/j.neucom.2019.08.103 ↗
2. Valanarasu, J.M.J., and Patel, V.M. (2022). UNeXt: MLP-based Rapid Medical Image Segmentation Network. arXiv.10.1007/978-3-031-16443-9_3 ↗
3. Szegedy, C., Ioffe, S., Vanhoucke, V., and Alemi, A.A. (2017, January 4–9). Inception-v4, inception-resnet and the impact of residual connections on learning. Proceedings of the Thirty-First AAAI Conference on Artificial Intelligence, San Francisco, CA, USA.10.1609/aaai.v31i1.11231 ↗
4. Lightweight attention convolutional neural network for retinal vessel image segmentation10.1109/TII.2020.2993842 ↗
5. Multi-tissue and multi-scale approach for nuclei segmentation in H&E stained images10.1186/s12938-018-0518-0 ↗
6. Spatial statistics for segmenting histological structures in H&E stained tissue images10.1109/TMI.2017.2681519 ↗
7. Fast unsupervised nuclear segmentation and classification scheme for automatic allred cancer scoring in immunohistochemical breast tissue images10.1016/j.cmpb.2018.08.005 ↗
8. Robust nuclei segmentation in cyto-histopathological images using statistical level set approach with topology preserving constraint
9. Petushi, S., Garcia, F.U., Haber, M.M., Katsinis, C., and Tozeren, A. (2006). Large-scale computations on histology images reveal grade-differentiating parameters for breast cancer. BMC Med. Imaging, 6.10.1186/1471-2342-6-14 ↗
10. Veta, M., Van Diest, P.J., Kornegoor, R., Huisman, A., Viergever, M.A., and Pluim, J.P. (2013). Automatic nuclei segmentation in H&E stained breast cancer histopathology images. PLoS ONE, 8.10.1371/journal.pone.0070221 ↗
11. Naik, S., Doyle, S., Agner, S., Madabhushi, A., Feldman, M., and Tomaszewski, J. (2008, January 14–17). Automated gland and nuclei segmentation for grading of prostate and breast cancer histopathology. Proceedings of the 2008 5th IEEE International Symposium on Biomedical Imaging: From Nano to Macro, Paris, France.10.1109/ISBI.2008.4540988 ↗
12. Cell segmentation based on FOPSO combined with shape information improved intuitionistic FCM10.1109/JBHI.2018.2803020 ↗
13. Training nuclei detection algorithms with simple annotations10.4103/jpi.jpi_3_17 ↗
14. Ronneberger, O., Fischer, P., and Brox, T. (2015, January 5–9). U-net: Convolutional networks for biomedical image segmentation. Proceedings of the International Conference on Medical Image Computing and Computer-Assisted Intervention, Munich, Germany.10.1007/978-3-319-24574-4_28 ↗
15. Zhou, Z., Rahman Siddiquee, M.M., Tajbakhsh, N., and Liang, J. (2018). Deep Learning In Medical Image Analysis and Multimodal Learning for Clinical Decision Support, Springer.
16. Hu, J., Shen, L., and Sun, G. (2018, January 18–23). Squeeze-and-excitation networks. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Salt Lake City, UT, USA.10.1109/CVPR.2018.00745 ↗
17. Jaderberg, M., Simonyan, K., Zisserman, A., and Kavukcuoglu, K. (2015). Spatial transformer networks. Adv. Neural Inf. Process. Syst., 28.
18. Oktay, O., Schlemper, J., Folgoc, L.L., Lee, M., Heinrich, M., Misawa, K., Mori, K., McDonagh, S., Hammerla, N.Y., and Kainz, B. (2018). Attention u-net: Learning where to look for the pancreas. arXiv.
19. Alom, M.Z., Hasan, M., Yakopcic, C., Taha, T.M., and Asari, V.K. (2018). Recurrent residual convolutional neural network based on u-net (r2u-net) for medical image segmentation. arXiv.10.1109/NAECON.2018.8556686 ↗
20. U2-Net: Going deeper with nested U-structure for salient object detection10.1016/j.patcog.2020.107404 ↗
21. Ce-net: Context encoder network for 2d medical image segmentation10.1109/TMI.2019.2903562 ↗
22. Hover-net: Simultaneous segmentation and classification of nuclei in multi-tissue histology images10.1016/j.media.2019.101563 ↗
23. DCAN: Deep contour-aware networks for object instance segmentation from histology images10.1016/j.media.2016.11.004 ↗
24. RAGCN: Region Aggregation Graph Convolutional Network for Bone Age Assessment From X-Ray Images
25. Lesion-attention pyramid network for diabetic retinopathy grading10.1016/j.artmed.2022.102259 ↗
26. Li, X., Jiang, Y., Li, M., Zhang, J., Yin, S., and Luo, H. (2022). MSFR-Net: Multi-modality and single-modality feature recalibration network for brain tumor segmentation. Med. Phys.10.1002/mp.15933 ↗
27. A dataset and a technique for generalized nuclear segmentation for computational pathology10.1109/TMI.2017.2677499 ↗
28. Azzuni, H., Ridzuan, M., Xu, M., and Yaqub, M. (2022). Color Space-based HoVer-Net for Nuclei Instance Segmentation and Classification. arXiv.10.1109/ISBIC56247.2022.9854725 ↗
29. Yıldırım, Z., Hançer, E., Samet, R., Mali, M.T., and Nemati, N. (2022, January 15–18). Effect of Color Normalization on Nuclei Segmentation Problem in H&E Stained Histopathology Images. Proceedings of the 2022 30th Signal Processing and Communications Applications Conference (SIU), Safranbolu, Turkey.10.1109/SIU55565.2022.9864814 ↗
30. Wang, H., Xie, S., Lin, L., Iwamoto, Y., Han, X.H., Chen, Y.W., and Tong, R. (2022, January 23–27). Mixed transformer u-net for medical image segmentation. Proceedings of the ICASSP 2022–2022 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), Singapore.10.1109/ICASSP43922.2022.9746172 ↗
31. Bu, Z. (2022). Multi-structure segmentation for renal cancer treatment with modified nn-UNet. arXiv.
32. Chen, J., Lu, Y., Yu, Q., Luo, X., Adeli, E., Wang, Y., Lu, L., Yuille, A.L., and Zhou, Y. (2021). Transunet: Transformers make strong encoders for medical image segmentation. arXiv.
33. Valanarasu, J.M.J., Oza, P., Hacihaliloglu, I., and Patel, V.M. (October, January 27). Medical transformer: Gated axial-attention for medical image segmentation. Proceedings of the International Conference on Medical Image Computing and Computer-Assisted Intervention, Strasbourg, France.
34. Wang, W., Chen, C., Ding, M., Yu, H., Zha, S., and Li, J. (October, January 27). Transbts: Multimodal brain tumor segmentation using transformer. Proceedings of the International Conference on Medical Image Computing and Computer-Assisted Intervention, Strasbourg, France.