Automated Segmentation and Quantification of Histology Fragments for Enhanced Macroscopic Reporting
Source abstract
Abstract
Manual tissue documentation is a critical step in the field of pathology that sets the stage for microscopic analysis and significantly influences diagnostic outcomes. In routine practice, technicians verbally dictate descriptions of specimens during gross examination; these are later transcribed into macroscopic reports. Fragment sizes are measured manually with rulers; however, these measurements are often inconsistent for small, irregular biopsies. No photographic record is captured for traceability. To address these limitations, we propose a proof-of-concept framework that automates the image capture and documentation of biopsy and resection cassettes. It integrates a custom imaging platform and a segmentation pipeline leveraging the YOLOv8 and YOLOv9 architectures to improve accuracy and efficiency. The framework was tested in a real clinical context and was evaluated on two datasets of 100 annotated images each, achieving a mask mean Average Precision (mAP) of 0.9517 ± 0107 and a tissue fragment spatial accuracy of 96.20 ± 1.37%. These results demonstrate the potential of our framework to enhance the standardization, reliability, and speed of macroscopic documentation, contributing to improved traceability and diagnostic precision.
Source: crossref · Quality: baseline
Research context
OpenAlex topics: AI in cancer detection · Radiomics and Machine Learning in Medical Imaging · Biomedical Text Mining and Ontologies
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
Affiliations
Research Laboratory in Human-System Interaction, Université de Moncton, Shippagan Campus, Shippagan, NB E8S 1P6, Canada
Medical Directorate of Laboratories, Vitalité Health Network, Bathurst, NB E2A 4L7, Canada
Funding
ResearchNB—Artificial Intelligence Strategic Acceleration Fund
References (40)
Show source-provided references
1. Macroscopic examination of pathology specimens: A critical reappraisal10.1136/jcp-2023-209045 ↗
2. The Critical Role of Breast Specimen Gross Evaluation for Optimal Personalized Cancer Care10.1016/j.path.2021.11.008 ↗
3. The efficient operation of the surgical pathology gross room10.1080/10520290802127610 ↗
4. Diepeveen, A. (2025, March 28). A Dilemma in Pathology: Overwork, Depression, and Burnout. Available online: https://lumeadigital.com/pathologists-are-overworked/.
5. Vistapath (2025, March 28). Vistapath Is Building the Next Generation of Pathology Labs: Optimize Your Grossing Workflows with Sentinel. Available online: https://www.vistapath.ai/sentinel/.
6. Druffel, E., Bridgeman, A., Brandegee, K., Bodell, A., McClintock, D., and Garcia, J. (2024, January 23–28). Current State of Intra-/Interobserver Accuracy and Reproducibility in Tissue Biopsy Grossing and Comparison to an Automated Vision System. Proceedings of the United States and Canada Association of Pathologists (USCAP) Annual Meeting, Baltimore, MD, USA. Poster #198.
7. (2025, March 28). Tissue-Tek AutoTEC® a120: An Automated Tissue Embedding System. Available online: https://www.sakuraus.com/Products/Embedding/AutoTEC-a120.html.
8. Greenlee, J., Webster, S., Gray, H., and von Bueren, E. (2019, January 20–25). Reducing Common Embedding Errors Through Automation: Manual Embedding Versus Automated Embedding Using the Tissue-Tek AutoTEC® a120 Automated Embedding System and the Tissue-Tek® Paraform® Sectionable Cassette System. Proceedings of the National Society for Histotechnology (NSH) Annual Symposium, New Orleans, LA, USA. Available online: https://www.sakuraus.com/getattachment/Products/Embedding/AutoTEC-a120/MPUB0012-Poster-NSH-2019-with-title-Reducing-common-embedding-errors-t.pdf?lang=en-US.
9. deBram Hart, M., von Bueren, E., Wander, B., Fussner, M., Scancich, C., Reed, C., and Cockerell, C.J. (September, January 28). Continuous Specimen Flow Changes Night Shifts to Day Shifts While Reducing Turn-Around-Time (TAT). Proceedings of the National Society for Histotechnology (NSH) Annual Symposium, Washington, DC, USA. Available online: https://www.sakuraus.com/SakuraWebsite/media/Sakura-Document/Poster_1_-_AutoTEC_a120_-_NSH_2015.pdf.
10. (2025, March 28). Milestone Medical. eGROSS pro-x: Ergonomic Mobile Grossing Station. Product Brochure, Available online: https://www.milestonemedsrl.com/products/grossing-and-macro-digital/egross/.
11. Comparative validation of multi-instance instrument segmentation in endoscopy: Results of the ROBUST-MIS 2019 challenge10.1016/j.media.2020.101920 ↗
12. Heidelberg colorectal data set for surgical data science in the sensor operating room10.1038/s41597-021-00882-2 ↗
13. Cheng, J., Fu, B., Ye, J., Wang, G., Li, T., Wang, H., Li, R., Yao, H., Cheng, J., and Li, J. (2025, January 10–17). Interactive medical image segmentation: A benchmark dataset and baseline. Proceedings of the Computer Vision and Pattern Recognition Conference, Nashville, TN, USA.10.1109/CVPR52734.2025.01941 ↗
14. Redmon, J., Divvala, S., Girshick, R., and Farhadi, A. (2016, January 27–30). You Only Look Once: Unified, Real-Time Object Detection. Proceedings of the Conference on Computer Vision and Pattern Recognition, Las Vegas, NV, USA.10.1109/CVPR.2016.91 ↗
15. Redmon, J., and Farhadi, A. (2017, January 21–26). YOLO9000: Better, Faster, Stronger. Proceedings of the Conference on Computer Vision and Pattern Recognition, Honolulu, HI, USA.10.1109/CVPR.2017.690 ↗
16. Redmon, J., and Farhadi, A. (2018). YOLOv3: An Incremental Improvement. arXiv.
17. Bochkovskiy, A., Wang, C., and Liao, H.M. (2020). YOLOv4: Optimal Speed and Accuracy of Object Detection. arXiv.
18. Jocher, G. (2020). Ultralytics YOLOv5, Ultralytics. Available online: https://github.com/ultralytics/yolov5.
19. Li, C., Li, L., Jiang, H., Weng, K., Geng, Y., Li, L., Ke, Z., Li, Q., Cheng, M., and Nie, W. (2022). YOLOv6: A Single-Stage Object Detection Framework for Industrial Applications. arXiv.
20. Wang, C.Y., Bochkovskiy, A., and Liao, H.Y.M. (2023, January 17–24). YOLOv7: Trainable Bag-of-Freebies Sets New State-of-the-Art for Real-Time Object Detectors. Proceedings of the Conference on Computer Vision and Pattern Recognition, Vancouver, BC, Canada.10.1109/CVPR52729.2023.00721 ↗
21. Jocher, G., Chaurasia, A., and Qiu, J. (2023). Ultralytics YOLOv8, Ultralytics. Available online: https://docs.ultralytics.com/models/yolov8/.
22. Leonardis, A., Ricci, E., Roth, S., Russakovsky, O., Sattler, T., and Varol, G. (October, January 29). YOLOv9: Learning What You Want to Learn Using Programmable Gradient Information. Proceedings of the Computer Vision—ECCV 2024, Milan, Italy.10.1007/978-3-031-72980-5 ↗
23. Wang, A., Chen, H., Liu, L., CHEN, K., Lin, Z., Han, J., and Ding, G. (2024, January 10–15). YOLOv10: Real-Time End-to-End Object Detection. Proceedings of the International Conference on Neural Information Processing Systems, Vancouver, BC, Canada.
24. Jocher, G., and Qiu, J. (2024). Ultralytics YOLO11, Ultralytics. Available online: https://github.com/ultralytics/ultralytics.
25. Tian, Y., Ye, Q., and Doermann, D. (2025). YOLOv12: Attention-Centric Real-Time Object Detectors. arXiv.
26. A Comprehensive Systematic Review of YOLO for Medical Object Detection (2018 to 2023)10.1109/ACCESS.2024.3386826 ↗
27. Microfluidic droplet detection for bio medical application using YOLO with COA based segmentation10.1007/s12530-024-09629-x ↗
28. AlSadhan, N.A., Alamri, S.A., Ben Ismail, M.M., and Bchir, O. (2024). Skin Cancer Recognition Using Unified Deep Convolutional Neural Networks. Cancers, 16.10.3390/cancers16071246 ↗
29. Rong, R., Sheng, H., Jin, K.W., Wu, F., Luo, D., Wen, Z., Tang, C., Yang, D.M., Jia, L., and Amgad, M. (2023). A Deep Learning Approach for Histology-Based Nucleus Segmentation and Tumor Microenvironment Characterization. Mod. Pathol., 36.10.1016/j.modpat.2023.100196 ↗
30. Spatiotemporal analysis of speckle dynamics to track invisible needle in ultrasound sequences using convolutional neural networks: A phantom study10.1007/s11548-022-02812-y ↗
31. Tan, L., Huangfu, T., Wu, L., and Chen, W. (2021). Comparison of RetinaNet, SSD, and YOLO v3 for real-time pill identification. Bmc Med. Inform. Decis. Mak., 21.10.1186/s12911-021-01691-8 ↗
32. YOLO-UNet Architecture for Detecting and Segmenting the Localized MRI Brain Tumor Image
33. Hossain, A., Islam, M.T., and Almutairi, A.F. (2022). A deep learning model to classify and detect brain abnormalities in portable microwave based imaging system. Sci. Rep., 12.10.1038/s41598-022-10309-6 ↗
34. Automated Brain Tumor Segmentation and Classification in MRI Using YOLO-Based Deep Learning10.1109/ACCESS.2024.3359418 ↗
35. George, J., Hemanth, T.S., Raju, J., Mattapallil, J.G., and Naveen, N. (2023, January 17–19). Dental Radiography Analysis and Diagnosis using YOLOv8. Proceedings of the International Conference on Smart Computing and Communications (ICSCC), Kochi, India.10.1109/ICSCC59169.2023.10335023 ↗
36. Microsoft Corporation (2025, April 28). OCR—Optical Character Recognition—Azure AI Services. Available online: https://learn.microsoft.com/fr-fr/azure/ai-services/computer-vision/overview-ocr.
37. Baraneedharan, P., Kalaivani, S., Vaishnavi, S., and Somasundaram, K. (2025). Revolutionizing healthcare: A review on cutting-edge innovations in Raspberry Pi-powered health monitoring sensors. Comput. Biol. Med., 190.10.1016/j.compbiomed.2025.110109 ↗
38. Kirillov, A., Mintun, E., Ravi, N., Mao, H., Rolland, C., Gustafson, L., Xiao, T., Whitehead, S., Berg, A.C., and Lo, W.Y. (2023, January 2–6). Segment Anything. Proceedings of the International Conference on Computer Vision, Paris, France.10.1109/ICCV51070.2023.00371 ↗
39. Ultralytics (2025, July 24). Brief Summary of YOLOv8 Model Structure. Available online: https://github.com/ultralytics/ultralytics/issues/189.
40. Lin, T.Y., Maire, M., Belongie, S., Bourdev, L., Girshick, R., Hays, J., Perona, P., Ramanan, D., Zitnick, C.L., and Dollár, P. (2015). Microsoft COCO: Common Objects in Context. arXiv.10.1007/978-3-319-10602-1_48 ↗