journal article·2025-11-08Open access

Ensemble-Based Refinement of Landmark Annotations for DNA Ploidy Analysis in Digital Pathology

Viktor Zoltán Jónás, Dániel Küttel, Béla Molnár, Miklós Kozlovszky

Applied Sciences· Volume 15· Issue 22

Abstract

Reliable evaluation of image segmentation algorithms in digital pathology depends on high-quality annotation datasets. Landmark-type annotations, essential for cell-counting analyses, are often limited in quality or quantity for segmentation benchmarking, particularly in rare assays where annotation is scarce and costly. In this study, we investigate whether ensemble-inspired refinement of landmark annotations can improve the robustness of segmentation evaluation. Using 15 fluorescently imaged blood samples with more than 20,000 manually placed annotations, we compared three segmentation algorithms—a threshold-based method with clump splitting, a difference-of-Gaussians (DoG) approach, and a convolutional neural network (StarDist)—and used their combined outputs to generate an ensemble-derived ground truth. Confusion matrices and standard metrics (F1 score, precision, and sensitivity) were computed against both manual and ensemble-derived ground truths. Statistical comparisons showed that ensemble-refined annotations reduced noise and decreased mean offsets between annotations and detected objects, yielding more stable evaluation metrics. Our results demonstrate that ensemble-based ground truth generation can guide targeted revision of manual markers, provide a quality measure for annotation reliability, and generate new annotations where no human-generated landmarks exist. This methodology offers a generalizable strategy to strengthen annotation datasets in image cytometry, enabling robust algorithm evaluation in DNA ploidy analysis and potentially in other low-frequency assays.
Source: crossref · Quality: baseline

Research context

OpenAlex topics: AI in cancer detection · Cell Image Analysis Techniques · Single-cell and spatial transcriptomics

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

Image Analysis Department, 3DHISTECH Ltd., 1141 Budapest, Hungary

John von Neumann Faculty of Informatics, Óbuda University, Bécsi Str. 96/b, 1034 Budapest, Hungary

2nd Department of Internal Medicine, Semmelweis University, Szentkirályi u. 46, 1088 Budapest, Hungary

Medical Device Research Group, LPDS, Institute for Computer Science and Control (SZTAKI), Hungarian Research Network (HUN-REN), Kende Str. 13-17, 1111 Budapest, Hungary

References (20)

Show source-provided references
1. Flow cytometry: An overview
2. Drescher, H., Weiskirchen, S., and Weiskirchen, R. (2021). Flow cytometry: A blessing and a curse. Biomedicines, 9.10.3390/biomedicines9111613 ↗
3. Jonas, V.Z., Kozlovszky, M., and Molnar, B. (2013, January 19–21). Ploidy analysis on digital slides. Proceedings of the 2013 IEEE 14th International Symposium on Computational Intelligence and Informatics (CINTI), Budapest, Hungary.10.1109/CINTI.2013.6705207 ↗
4. Jonas, V.Z., Kozlovszky, M., and Molnar, B. (2014, January 19–21). Detecting low intensity nuclei on propidium iodide stained digital slides. Proceedings of the 2014 IEEE 15th International Symposium on Computational Intelligence and Informatics (CINTI), Budapest, Hungary.10.1109/CINTI.2014.7028678 ↗
5. Semi-automated quantitative validation tool for medical image processing algorithm development
6. Jónás, V.Z., Paulik, R., Kozlovszky, M., and Molnár, B. (2022). Calibration-aimed comparison of image-cytometry- and flow-cytometry-based approaches of ploidy analysis. Sensors, 22.10.3390/s22186952 ↗
7. Weakly supervised deep nuclei segmentation with sparsely annotated bounding boxes for DNA image cytometry10.1109/TCBB.2021.3138189 ↗
8. An annotated fluorescence image dataset for training nuclear segmentation methods10.1038/s41597-020-00608-w ↗
9. Samsi, S., Trefois, C., Antony, P.M.A., and Skupin, A. (2014, January 1–4). Automated nuclei clump splitting by combining local concavity orientation and graph partitioning. Proceedings of the 2014 IEEE-EMBS International Conference on Biomedical and Health Informatics (BHI), Valencia, Spain.10.1109/BHI.2014.6864390 ↗
10. An optimized image analysis algorithm for detecting nuclear signals in digital whole slides for histopathology10.1002/cyto.a.23124 ↗
11. Cell detection with star-convex polygons
12. Going to extremes: Weakly supervised medical image segmentation10.3390/make3020026 ↗
13. Classification assessment methods10.1016/j.aci.2018.08.003 ↗
14. Deep learning for digital pathology image analysis: A comprehensive tutorial with selected use cases10.4103/2153-3539.186902 ↗
15. The random forest algorithm for statistical learning10.1177/1536867X20909688 ↗
16. Chen, T., and Guestrin, C. (2016, January 13–17). XGBoost: A scalable tree boosting system. Proceedings of the 22nd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining (KDD’16), San Francisco, CA, USA.10.1145/2939672.2939785 ↗
17. Jiang, D., Ren, X., and Lin, B.Y. (2023, January 9–14). LLM-BLENDER: Ensembling large language models with pairwise ranking and generative fusion. Proceedings of the 61st Annual Meeting of the Association for Computational Linguistics (ACL’23), Toronto, ON, Canada.10.18653/v1/2023.acl-long.792 ↗
18. Jónás, V.Z., Paulik, R., Molnár, B., and Kozlovszky, M. (2024). Comparative Analysis of Nucleus Segmentation Techniques for Enhanced DNA Quantification in Propidium Iodide-Stained Samples. Appl. Sci., 14.10.3390/app14198707 ↗
19. On implementing 2D rectangular assignment algorithms10.1109/TAES.2016.140952 ↗
20. SciPy 1.0: Fundamental algorithms for scientific computing in Python10.1038/s41592-019-0686-2 ↗