ENSeg: A Novel Dataset and Method for the Segmentation of Enteric Neuron Cells on Microscopy Images
Source abstract
Abstract
The Enteric Nervous System (ENS) is a dynamic field of study where researchers devise sophisticated methodologies to comprehend the impact of chronic degenerative diseases on Enteric Neuron Cells (ENCs). These investigations demand labor-intensive effort, requiring manual selection and segmentation of each well-defined cell to conduct morphometric and quantitative analyses. However, the scarcity of labeled data and the unique characteristics of such data limit the applicability of existing solutions in the literature. To address this, we introduce a novel dataset featuring expert-labeled ENC called ENSeg, which comprises 187 images and 9709 individually annotated cells. We also introduce an approach that combines automatic instance segmentation models with Segment Anything Model (SAM) architectures, enabling human interaction while maintaining high efficiency. We employed YOLOv8, YOLOv9, and YOLOv11 models to generate segmentation candidates, which were then integrated with SAM architectures through a fusion protocol. Our best result achieved a mean DICE score (mDICE) of 0.7877, using YOLOv8 (candidate selection), SAM, and a fusion protocol that enhanced the input point prompts. The resulting combination protocols, demonstrated after our work, exhibit superior segmentation performance compared to the standalone segmentation models. The dataset comes as a contribution to this work and is available to the research community.
Source: crossref · Quality: baseline
Research context
OpenAlex topics: Image Processing Techniques and Applications
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
Affiliations
Department of Informatics, State University of Maringá, Maringá 87020-900, Brazil
Department of Information Engineering, University of Padova, 35131 Padova, Italy
Department of Morphological Sciences, State University of Maringá, Maringá 87020-900, Brazil
Funding
Programa de Doutorado Sanduíche no Exterior (PDSE)
References (70)
Show source-provided references
1. Furness, J.B. (2007). The Enteric Nervous System, Blackwell Publishing.10.1002/9780470988756 ↗
2. Emerging roles for enteric glia in gastrointestinal disorders10.1172/JCI76303 ↗
3. Protective effects of quercetin-loaded microcapsules on the enteric nervous system of diabetic rats10.1016/j.autneu.2020.102759 ↗
4. Quercetin increases bioavailability of nitric oxide in the jejunum of euglycemic and diabetic rats and induces neuronal plasticity in the myenteric plexus10.1016/j.autneu.2020.102675 ↗
5. Anti- and pro-oxidant effects of quercetin stabilized by microencapsulation on interstitial cells of Cajal, nitrergic neurons and M2-like macrophages in the jejunum of diabetic rats10.1016/j.neuro.2020.01.011 ↗
6. Does the rheumatoid arthritis affect the enteric nervous system?10.1590/s0004-2803.201900000-24 ↗
7. Rheumatoid arthritis induces enteric neurodegeneration and jejunal inflammation, and quercetin promotes neuroprotective and anti-inflammatory actions10.1016/j.lfs.2019.116956 ↗
8. L-glutathione 1reduces the oxidative stress in the jejunum of rats with Walker-256-bearing tumor10.1111/nmo.14688 ↗
9. Does l-glutamine-supplemented diet extenuate NO-mediated damage on myenteric plexus of Walker 256 tumor-bearing rats?10.1016/j.foodres.2017.08.054 ↗
10. Cancer-induced morphological changes in enteric glial cells in the jejunum of Walker-256 tumor-bearing rats10.1016/j.acthis.2024.152146 ↗
11. Supplementation with L-glutamine prevents tumor growth and cancer-induced cachexia as well as restores cell proliferation of intestinal mucosa of Walker-256 tumor-bearing rats10.1007/s00726-016-2313-1 ↗
12. Automatic chronic degenerative diseases identification using enteric nervous system images10.1007/s00521-021-06164-7 ↗
13. Cancer Identification in Enteric Nervous System Preclinical Images Using Handcrafted and Automatic Learned Features10.1007/s11063-022-11114-y ↗
14. Jocher, G., Chaurasia, A., and Qiu, J. (2024, December 09). Ultralytics YOLOv8. Available online: https://github.com/ultralytics/ultralytics.
15. Kirillov, A., Mintun, E., Ravi, N., Mao, H., Rolland, C., Gustafson, L., Xiao, T., Whitehead, S., Berg, A.C., and Lo, W.Y. (2023). Segment Anything. arXiv.10.1109/ICCV51070.2023.00371 ↗
16. Ravi, N., Gabeur, V., Hu, Y.T., Hu, R., Ryali, C., Ma, T., Khedr, H., Rädle, R., Rolland, C., and Gustafson, L. (2024). SAM 2: Segment Anything in Images and Videos. arXiv.
17. U-Net: Convolutional Networks for Biomedical Image Segmentation
18. U-Net—Deep Learning for Cell Counting, Detection, and Morphometry10.1038/s41592-018-0261-2 ↗
19. Oktay, O., Schlemper, J., Folgoc, L.L., Lee, M., Heinrich, M., Misawa, K., Mori, K., McDonagh, S., Hammerla, N.Y., and Kainz, B. (2018). Attention u-net: Learning where to look for the pancreas. arXiv.
20. Zhou, Z., Rahman Siddiquee, M.M., Tajbakhsh, N., and Liang, J. (2018). Unet++: A nested u-net architecture for medical image segmentation. Deep Learning in Medical Image Analysis and Multimodal Learning for Clinical Decision Support, Proceedings of the 4th International Workshop, DLMIA 2018, and 8th International Workshop, ML-CDS 2018, Held in Conjunction with MICCAI 2018, Granada, Spain, 20 September 2018, Springer. Proceedings 4.10.1007/978-3-030-00889-5_1 ↗
21. Road extraction by deep residual u-net10.1109/LGRS.2018.2802944 ↗
22. Jha, D., Smedsrud, P.H., Riegler, M.A., Johansen, D., De Lange, T., Halvorsen, P., and Johansen, H.D. (2019, January 9–11). Resunet++: An advanced architecture for medical image segmentation. Proceedings of the 2019 IEEE International Symposium on Multimedia (ISM), San Diego, CA, USA.10.1109/ISM46123.2019.00049 ↗
23. Bartoli, A., and Fusiello, A. (2020, January 23–28). DoubleU-Net: Colorectal Cancer Diagnosis and Gland Instance Segmentation with Text-Guided Feature Control. Proceedings of the Computer Vision—ECCV 2020 Workshops, Glasgow, UK.
24. Akbas, C.E., and Kozubek, M. (2020, January 3–7). Condensed U-Net (Cu-Net): An Improved U-Net Architecture for Cell Segmentation Powered by 4 × 4 Max-Pooling Layers. Proceedings of the 2020 IEEE 17th International Symposium on Biomedical Imaging (ISBI), Iowa City, IA, USA.10.1109/ISBI45749.2020.9098351 ↗
25. Saha, S., Dutta, S., Goswami, B., and Nandi, D. (2023). ADU-Net: An Attention Dense U-Net based deep supervised DNN for automated lesion segmentation of COVID-19 from chest CT images. Biomed. Signal Process. Control., 85.10.1016/j.bspc.2023.104974 ↗
26. Guyon, I., Luxburg, U.V., Bengio, S., Wallach, H., Fergus, R., Vishwanathan, S., and Garnett, R. (2017). Attention is All you Need. Advances in Neural Information Processing Systems, Proceedings of the 31st International Conference on Neural Information Processing Systems, Long Beach, CA, USA, 4–9 December 2017, Curran Associates, Inc.
27. Chen, J., Lu, Y., Yu, Q., Luo, X., Adeli, E., Wang, Y., Lu, L., Yuille, A.L., and Zhou, Y. (2021). TransUNet: Transformers Make Strong Encoders for Medical Image Segmentation. arXiv.
28. Wang, W., Xie, E., Li, X., Fan, D.P., Song, K., Liang, D., Lu, T., Luo, P., and Shao, L. (2021, January 11–17). Pyramid vision transformer: A versatile backbone for dense prediction without convolutions. Proceedings of the IEEE/CVF International Conference on Computer Vision, Montreal, BC, Canada.10.1109/ICCV48922.2021.00061 ↗
29. Pvt v2: Improved baselines with pyramid vision transformer10.1007/s41095-022-0274-8 ↗
30. Dong, B., Wang, W., Fan, D.P., Li, J., Fu, H., and Shao, L. (2021). Polyp-pvt: Polyp segmentation with pyramid vision transformers. arXiv.
31. Zheng, L., Fang, J., Tang, X., Li, H., Fan, J., Wang, T., Zhou, R., and Yan, Z. (2022, January 23–27). PVT-COV19D: COVID-19 Detection Through Medical Image Classification Based on Pyramid Vision Transformer. Proceedings of the Computer Vision—ECCV 2022 Workshops, Tel Aviv, Israel. Proceedings, Part VII.10.1007/978-3-031-25082-8_35 ↗
32. CAFE-Net: Cross-Attention and Feature Exploration Network for polyp segmentation10.1016/j.eswa.2023.121754 ↗
33. Rahman, M.M., and Marculescu, R. (2023, January 2–7). Medical Image Segmentation via Cascaded Attention Decoding. Proceedings of the 2023 IEEE/CVF Winter Conference on Applications of Computer Vision (WACV), Waikoloa, HI, USA.10.1109/WACV56688.2023.00616 ↗
34. A Comprehensive Systematic Review of YOLO for Medical Object Detection (2018 to 2023)
35. Redmon, J., Divvala, S., Girshick, R., and Farhadi, A. (2016, January 27–30). You only look once: Unified, real-time object detection. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Las Vegas, NV, USA.10.1109/CVPR.2016.91 ↗
36. Wang, C.Y., Yeh, I.H., and Liao, H.Y.M. (2024). YOLOv9: Learning What You Want to Learn Using Programmable Gradient Information. arXiv.10.1007/978-3-031-72751-1_1 ↗
37. Jocher, G., and Qiu, J. (2024, December 09). Ultralytics YOLO11.2024. Available online: https://docs.ultralytics.com/pt/models/yolo11/#__tabbed_3_1.
38. Rombach, R., Blattmann, A., Lorenz, D., Esser, P., and Ommer, B. (2021). High-Resolution Image Synthesis with Latent Diffusion Models. arXiv.10.1109/CVPR52688.2022.01042 ↗
39. Zou, X., Yang, J., Zhang, H., Li, F., Li, L., Wang, J., Wang, L., Gao, J., and Lee, Y.J. (2023). Segment Everything Everywhere All at Once. arXiv.
40. Dosovitskiy, A., Beyer, L., Kolesnikov, A., Weissenborn, D., Zhai, X., Unterthiner, T., Dehghani, M., Minderer, M., Heigold, G., and Gelly, S. (2021). An Image is Worth 16 × 16 Words: Transformers for Image Recognition at Scale. arXiv.
41. Li, Y., Mao, H., Girshick, R., and He, K. (2022, January 23–27). Exploring Plain Vision Transformer Backbones for Object Detection. Proceedings of the Computer Vision—ECCV 2022: 17th European Conference, Tel Aviv, Israel. Proceedings, Part IX.10.1007/978-3-031-20077-9_17 ↗
42. Ryali, C., Hu, Y.T., Bolya, D., Wei, C., Fan, H., Huang, P.Y., Aggarwal, V., Chowdhury, A., Poursaeed, O., and Hoffman, J. (2023, January 23–29). Hiera: A hierarchical vision transformer without the bells-and-whistles. Proceedings of the International Conference on Machine Learning, Honolulu, HI, USA.
43. Zhang, C., Liu, L., Cui, Y., Huang, G., Lin, W., Yang, Y., and Hu, Y. (2023). A Comprehensive Survey on Segment Anything Model for Vision and Beyond. arXiv.
44. Chen, T., Mai, Z., Li, R., and lun Chao, W. (2023). Segment Anything Model (SAM) Enhanced Pseudo Labels for Weakly Supervised Semantic Segmentation. arXiv.
45. Jiang, P.T., and Yang, Y. (2023). Segment Anything is A Good Pseudo-label Generator for Weakly Supervised Semantic Segmentation. arXiv.
46. Cen, J., Wu, Y., Wang, K., Li, X., Yang, J., Pei, Y., Kong, L., Liu, Z., and Chen, Q. (2023). SAD: Segment Any RGBD. arXiv.
47. Yao, J., Wang, X., Ye, L., and Liu, W. (2023). Matte Anything: Interactive Natural Image Matting with Segment Anything Models. arXiv.10.1016/j.imavis.2024.105067 ↗
48. Lillrank, D.O., Akiyama, S., and Arulkumaran, K. (2024, December 09). Zero-Shot Object Manipulation with Semantic 3D Image Augmentation for Perceiver-Actor. Available online: https://openreview.net/forum?id=pInZFlKlRc9.
49. Xiao, Z., Bai, J., Lu, Z., and Xiong, Z. (2023). A Dive into SAM Prior in Image Restoration. arXiv.
50. Zhang, Z., Wei, Z., Zhang, S., Dai, Z., and Zhu, S. (2023). UVOSAM: A Mask-free Paradigm for Unsupervised Video Object Segmentation via Segment Anything Model. arXiv.10.2139/ssrn.4729959 ↗
51. Cheng, Y., Li, L., Xu, Y., Li, X., Yang, Z., Wang, W., and Yang, Y. (2023). Segment and Track Anything. arXiv.
52. Yang, J., Gao, M., Li, Z., Gao, S., Wang, F., and Zheng, F. (2023). Track Anything: Segment Anything Meets Videos. arXiv.
53. Zhang, D., Liang, D., Yang, H., Zou, Z., Ye, X., Liu, Z., and Bai, X. (2023). SAM3D: Zero-Shot 3D Object Detection via Segment Anything Model. arXiv.10.1007/s11432-023-3943-6 ↗
54. Yang, Y., Wu, X., He, T., Zhao, H., and Liu, X. (2023). SAM3D: Segment Anything in 3D Scenes. arXiv.
55. Fan, Z., Pan, P., Wang, P., Jiang, Y., Xu, D., Jiang, H., and Wang, Z. (2023). POPE: 6-DoF Promptable Pose Estimation of Any Object, in Any Scene, with One Reference. arXiv.10.1109/CVPRW63382.2024.00773 ↗
56. Chen, J., Sun, M., Bao, T., Zhao, R., Wu, L., and He, Z. (2023). ZeroPose: CAD-Model-based Zero-Shot Pose Estimation. arXiv.
57. Cheng, J., Ye, J., Deng, Z., Chen, J., Li, T., Wang, H., Su, Y., Huang, Z., Chen, J., and Sun, L.J.H. (2023). SAM-Med2D. arXiv.
58. Ye, J., Cheng, J., Chen, J., Deng, Z., Li, T., Wang, H., Su, Y., Huang, Z., Chen, J., and Jiang, L. (2023). SA-Med2D-20M Dataset: Segment Anything in 2D Medical Imaging with 20 Million masks. arXiv.
59. Ma, J., He, Y., Li, F., Han, L., You, C., and Wang, B. (2023). Segment Anything in Medical Images. arXiv.10.1038/s41467-024-44824-z ↗
60. Zhang, K., and Liu, D. (2023). Customized Segment Anything Model for Medical Image Segmentation. arXiv.10.2139/ssrn.4495221 ↗
61. Wu, J., Ji, W., Liu, Y., Fu, H., Xu, M., Xu, Y., and Jin, Y. (2023). Medical SAM Adapter: Adapting Segment Anything Model for Medical Image Segmentation. arXiv.
62. Lin, X., Xiang, Y., Zhang, L., Yang, X., Yan, Z., and Yu, L. (2023). SAMUS: Adapting Segment Anything Model for Clinically-Friendly and Generalizable Ultrasound Image Segmentation. arXiv.
63. Wada, K. (2021). Labelme: Image Polygonal Annotation with Python. Zenodo.
64. Prasetyo, E., Suciati, N., and Fatichah, C. (2020, January 10–11). A Comparison of YOLO and Mask R-CNN for Segmenting Head and Tail of Fish. Proceedings of the 2020 4th International Conference on Informatics and Computational Sciences (ICICoS), Semarang, Indonesia.10.1109/ICICoS51170.2020.9299024 ↗
65. Comparing YOLOv8 and Mask R-CNN for instance segmentation in complex orchard environments
66. Thai, T.T., Ku, K.B., Le, A.T., Oh, S.S.M., Phan, N.H., Kim, I.J., and Chung, Y.S. (2024). Comparative analysis of stomatal pore instance segmentation: Mask R-CNN vs. YOLOv8 on Phenomics Stomatal dataset. Front. Plant Sci., 15.10.3389/fpls.2024.1414849 ↗
67. Nanni, L., Fusaro, D., Fantozzi, C., and Pretto, A. (2023). Improving Existing Segmentators Performance with Zero-Shot Segmentators. Entropy, 25.10.20944/preprints202307.1729.v1 ↗
68. Kingma, D.P., and Ba, J. (2014). Adam: A Method for Stochastic Optimization. arXiv.
69. Bebis, G., Boyle, R., Parvin, B., Koracin, D., Porikli, F., Skaff, S., Entezari, A., Min, J., Iwai, D., and Sadagic, A. (2016). Optimizing Intersection-Over-Union in Deep Neural Networks for Image Segmentation. Advances in Visual Computing, Proceedings of the 12th International Symposium, ISVC 2016, Las Vegas, NV, USA, 12–14 December 2016, Springer.10.1007/978-3-319-50832-0 ↗
70. Cardoso, M.J., Arbel, T., Carneiro, G., Syeda-Mahmood, T., Tavares, J.M.R., Moradi, M., Bradley, A., Greenspan, H., Papa, J.P., and Madabhushi, A. (2017). Generalised Dice Overlap as a Deep Learning Loss Function for Highly Unbalanced Segmentations. Deep Learning in Medical Image Analysis and Multimodal Learning for Clinical Decision Support, Proceedings of the Third International Workshop, DLMIA 2017, and 7th International Workshop, ML-CDS 2017, Held in Conjunction with MICCAI 2017, Québec City, QC, Canada, 14 September 2017, Springer.10.1007/978-3-319-67558-9 ↗