Semi-Supervised Nuclei Instance Segmentation with Category-Adaptive Sampling and Region-Adaptive Attention
Source abstract
Abstract
Cell nuclei instance segmentation plays a critical role in pathological image analysis. In recent years, fully supervised methods for cell nuclei instance segmentation have achieved significant results. However, in practical medical image processing, annotating dense cell nuclei at the instance level is often costly and time-consuming, making it challenging to acquire large-scale labeled datasets. This challenge has motivated researchers to explore ways to further enhance segmentation performance under limited labeling conditions. To address this issue, this paper proposes a network based on category-adaptive sampling and attention mechanisms for semi-supervised nuclei instance segmentation. Specifically, we design a category-adaptive sampling method that forces the model to focus on rare categories and dynamically adapt to different data distributions. By dynamically adjusting the sampling strategy, the balance of samples across different cell types is improved. Additionally, we propose a strong–weak contrast consistency method that significantly expands the perturbation space. Strong perturbations enhance the model’s ability to discriminate key nuclei features, while weak perturbations improve its robustness against noise and interference. Furthermore, we introduce a region-adaptive attention mechanism that dynamically assigns higher weights to key regions, guiding the model to prioritize learning discriminative features in challenging areas such as blurred or ambiguous cell boundaries. This improves the morphological accuracy of the segmentation masks. Our method effectively leverages the potential information in unlabeled data, thereby reducing reliance on large-scale, high-quality labeled datasets. Experimental results on public datasets demonstrate the effectiveness of our approach.
Source: crossref · Quality: baseline
Research context
OpenAlex topics: Nuclear Physics and Applications · Particle physics theoretical and experimental studies
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
Affiliations
School of Computer Science, Hubei University of Technology, Wuhan 430068, China
Hubei Provincial Key Laboratory of Green Intelligent Computing Power Network, Hubei University of Technology, Wuhan 430068, China
Faculty of Engineering Sciences, University College London, London WC1E 6BT, UK
Funding
National Natural Science Foundation of China
References (44)
Show source-provided references
1. SFCN-OPI: Detection and fine-grained classification of nuclei using sibling FCN with objectness prior interaction
2. Locality sensitive deep learning for detection and classification of nuclei in routine colon cancer histology images10.1109/TMI.2016.2525803 ↗
3. Automated segmentation, classification, and tracking of cancer cell nuclei in time-lapse microscopy10.1109/TBME.2006.870201 ↗
4. BenTaieb, A., and Hamarneh, G. (2019). Deep learning models for digital pathology. arXiv.
5. Chen, X.X. (2024). Research on Medical Image Segmentation Method Based on CNN and Transformer. [Master’s Thesis, Anhui University].
6. Multi-receptive-field CNN for semantic segmentation of medical images10.1109/JBHI.2020.3016306 ↗
7. Ronneberger, O., Fischer, P., and Brox, T. (2015). U-Net: Convolutional networks for biomedical image segmentation. Medical Image Computing and Computer-Assisted Intervention, Springer.10.1007/978-3-319-24574-4_28 ↗
8. M-DDC: MRI based demyelinative diseases classification with U-Net segmentation and convolutional network10.1016/j.neunet.2023.10.010 ↗
9. Zhou, Z., Rahman Siddiquee, M.M., Tajbakhsh, N., and Liang, J. (2018). UNet++: A nested U-Net architecture for medical image segmentation. Deep Learning in Medical Image Analysis, Springer.10.1007/978-3-030-00889-5_1 ↗
10. Huang, H., Lin, L., Tong, R., Hu, H., Zhang, Q., Iwamoto, Y., Han, X., Wang, Y., Chen, Y., and Wu, J. (2020, January 4–8). UNet 3+: A full-scale connected UNet for medical image segmentation. Proceedings of the IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), Barcelona, Spain.10.1109/ICASSP40776.2020.9053405 ↗
11. Ji, Y., Zhang, R., Wang, H., Li, Z., Wu, L., Zhang, S., and Luo, P. (October, January 27). Multi-compound transformer for accurate biomedical image segmentation. Proceedings of the Medical Image Computing and Computer-Assisted Intervention (MICCAI), Strasbourg, France.
12. Hover-Net: Simultaneous segmentation and classification of nuclei in multi-tissue histology images10.1016/j.media.2019.101563 ↗
13. Zhou, Y., Onder, O.F., Dou, Q., Tsougenis, E., Chen, H., and Heng, P.-A. (2019, January 2–7). CIA-Net: Robust nuclei instance segmentation with contour-aware information aggregation. Proceedings of the Information Processing in Medical Imaging (IPMI), Hong Kong, China.10.1007/978-3-030-20351-1_53 ↗
14. Yao, K., Huang, K., Sun, J., Hussain, A., and Jude, C. (2021). PointNU-Net: Simultaneous multi-tissue histology nuclei segmentation and classification in the clinical wild. arXiv.
15. Mean teachers are better role models: Weight-averaged consistency targets improve semi-supervised deep learning results
16. FixMatch: Simplifying semi-supervised learning with consistency and confidence
17. Chen, X., Yuan, Y., Zeng, G., and Wang, J. (2021, January 19–25). Semi-supervised semantic segmentation with cross pseudo supervision. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), Virtual.10.1109/CVPR46437.2021.00264 ↗
18. SegAN: Adversarial network with multi-scale L1 loss for medical image segmentation10.1007/s12021-018-9377-x ↗
19. A dataset and a technique for generalized nuclear segmentation for computational pathology10.1109/TMI.2017.2677499 ↗
20. Lee, D.H. (2013, January 16–21). Pseudo-label: The simple and efficient semi-supervised learning method for deep neural networks. Proceedings of the ICML Workshop on Representation Learning, Atlanta, GA, USA.
21. Feng, Z., Zhou, Q., Cheng, G., Xin, T., Shi, J., and Ma, L. (2020). Semi-supervised semantic segmentation via dynamic self-training and class-balanced curriculum. arXiv.
22. Yu, L., Wang, S., Li, X., Fu, C.-W., and Heng, P.-A. (2019, January 13–17). Uncertainty-aware self-ensembling model for semi-supervised 3D left atrium segmentation. Proceedings of the Medical Image Computing and Computer-Assisted Intervention (MICCAI), Shenzhen, China.10.1007/978-3-030-32245-8_67 ↗
23. Xie, Q., Luong, M.-T., Hovy, E., and Le, Q.V. (2020, January 14–19). Self-training with noisy student improves ImageNet classification. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), Virtual.10.1109/CVPR42600.2020.01070 ↗
24. Mutual learning with reliable pseudo label for semi-supervised medical image segmentation10.1016/j.media.2024.103111 ↗
25. Yang, L., Qi, L., Feng, L., Zhang, W., and Shi, Y. (2023, January 18–22). Revisiting weak-to-strong consistency in semi-supervised semantic segmentation. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), Vancouver, BC, Canada.10.1109/CVPR52729.2023.00699 ↗
26. Laine, S., and Aila, T. (2016). Temporal ensembling for semi-supervised learning. arXiv.
27. Semi-supervised cell segmentation algorithm based on self-consistent regularization constraint
28. Transformation-consistent self-ensembling model for semi-supervised medical image segmentation10.1109/TNNLS.2020.2995319 ↗
29. Wu, Y., Xu, M., Ge, Z., Cai, J., and Zhang, L. (October, January 27). Semi-supervised left atrium segmentation with mutual consistency training. Proceedings of the Medical Image Computing and Computer-Assisted Intervention (MICCAI), Strasbourg, France.
30. Mutual consistency learning for semi-supervised medical image segmentation10.1016/j.media.2022.102530 ↗
31. Liu, Y., Tian, Y., Chen, Y., Li, W., Wang, H., Zhang, S., Yang, Z., Huang, J., Zhao, R., and Lin, X. (2022, January 19–24). Perturbed and strict mean teachers for semi-supervised semantic segmentation. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), New Orleans, LA, USA.10.1109/CVPR52688.2022.00422 ↗
32. Li, C., and Liu, H. (2021, January 13–16). Generative adversarial semi-supervised network for medical image segmentation. Proceedings of the IEEE International Symposium on Biomedical Imaging (ISBI), Nice, France.10.1109/ISBI48211.2021.9434135 ↗
33. Peiris, H., Chen, Z., Egan, G., and Harandi, M. (October, January 27). Duo-SegNet: Adversarial dual-views for semi-supervised medical image segmentation. Proceedings of the Medical Image Computing and Computer-Assisted Intervention (MICCAI), Strasbourg, France.
34. Zhao, F., Chen, Y., Huang, K., He, X., Chen, X., and Hou, Y. (2023, January 18–21). Semi-bgSegNet: A semi-supervised boundary-guided breast tumor segmentation network. Proceedings of the IEEE International Symposium on Biomedical Imaging (ISBI), Cartagena, Colombia.10.1109/ISBI53787.2023.10230428 ↗
35. Cross-domain block contrastive semi-supervised nuclear segmentation with virtual adversarial training
36. Chen, L.C., Papandreou, G., Schroff, F., and Adam, H. (2017). Rethinking atrous convolution for semantic image segmentation. arXiv.
37. Hybrid deep learning based attack detection for imbalanced data classification10.32604/iasc.2023.026799 ↗
38. Yun, S., Han, D., Oh, S.J., Chun, S., Choe, J., and Yoo, Y. (2019). CutMix: Regularization strategy to train strong classifiers with localizable features. arXiv.10.1109/ICCV.2019.00612 ↗
39. Unsupervised data augmentation for consistency training
40. Virtual adversarial training: A regularization method for supervised and semi-supervised learning10.1109/TPAMI.2018.2858821 ↗
41. Attention is all you need
42. Mei, M., Wei, Z., Hu, B., Zhang, Y., Li, X., Wang, J., Chen, L., Liu, Q., Yang, H., and Zhou, Y. (2024). DAT-Net: Deep aggregation transformer network for automatic nuclear segmentation. Biomed. Signal Process. Control, 98.10.1016/j.bspc.2024.106764 ↗
43. Gamper, J., Koohbanani, N.A., Benes, K., Graham, S., Jahanifar, M., Khurram, S.A., Azam, A., Hewitt, K., and Rajpoot, N. (2020). Pannuke dataset extension, insights and baselines. arXiv.
44. Graham, S., Jahanifar, M., Vu, Q.D., Hadjigeorghiou, G., Leech, T., Snead, D., Raza, S.E.A., Minhas, F., and Rajpoot, N. (2021). Conic: Colon nuclei identification and counting challenge 2022. arXiv.