journal article·2026-04-18Open access

Enhancing Reliable Prostate Lesion Detection: Integrating Multi-Expert Annotations and Tailored nnU-Net Ensemble Learning Strategies

Rafal Jozwiak, Michal Gonet, Jan Mycka, Ihor Mykhalevych, Dariusz S. Radomski, Krzysztof Tupikowski, Tomasz Lorenc, Joanna Dolowy, Anna Zacharzewska-Gondek

Applied Sciences· Volume 16· Issue 8

Abstract

Accurate detection of prostate cancer suspicious areas in biparametric MRI (bpMRI) remains challenging because of severe lesion-to-background imbalance, limited lesion contrast, and inter-reader variability in lesion delineation. Unlike prior approaches that collapse inter-reader disagreement into a single consensus label, this study makes three contributions: (1) an adapted nnU-Net framework with prostate-centered preprocessing to reduce voxel-level class imbalance; (2) a class-imbalance-aware composite loss combining Dice, binary cross-entropy, and tailored focal loss to improve sensitivity to small and low-contrast lesions; and (3) a multi-expert learning strategy that preserves reader-specific annotations as separate supervision targets and aggregates predictions at the ensemble level. The method was developed on a single-center dataset of 378 bpMRI studies independently annotated by three board-certified radiologists. Of these, 323 studies were used for model development with patient-level 5-fold cross-validation, and 55 studies were reserved as a fixed independent test set. Compared with our previously published U-Net baseline, the proposed consensus-based nnU-Net improved Average Precision (AP) from 0.69 to 0.75, AUROC from 0.92 to 0.96, and the PI-CAI score from 0.81 to 0.85 on the independent test set. In addition, the multi-expert approach further improved AP to 0.81 versus 0.76 (+6.6%, p < 0.01), AUROC to 0.99 versus 0.95 (+4.2%, p < 0.01), and the PI-CAI score to 0.90 versus 0.86 (+4.7%). These findings demonstrate that explicitly preserving expert disagreement as a training signal, combined with anatomically targeted preprocessing and tailored loss design, substantially improves prostate lesion detection in bpMRI, providing a strong basis for future multi center external validation.
Source: crossref · Quality: baseline

Research context

OpenAlex topics: Prostate Cancer Diagnosis and Treatment · Advanced Radiotherapy Techniques · MRI in cancer diagnosis

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

Innovation Centre for Digital Medicine, National Information Processing Institute, 00-608 Warsaw, Poland

Faculty of Mathematics and Information Science, Warsaw University of Technology, 00-662 Warsaw, Poland

Institute of Radioelectronics and Multimedia Techniques, Warsaw University of Technology, 00-665 Warsaw, Poland

RadDarMed, 00-653 Warsaw, Poland

Subdivision of Urology, Lower Silesian Oncology, Pulmonology and Hematology Center, 53-413 Wroclaw, Poland

Departament of Oncologic Urology, Medical Faculty, Wrocław University of Science and Technology, 58-376 Wroclaw, Poland

1st Department of Clinical Radiology, Medical University of Warsaw, 02-004 Warsaw, Poland

Department of Radiology and Diagnostic Imaging, Lower Silesian Oncology, Pulmonology and Hematology Center, 53-413 Wroclaw, Poland

Independent Researcher, 52-234 Wroclaw, Poland

Funding

Polish National Centre for Research and Development

References (28)

Show source-provided references
1. Cancer statistics, 2023
2. Prostate cancer in East Asia: Evolving trend over the last decade10.4103/1008-682X.132780 ↗
3. PI-RADS v2 status update and future directions10.1016/j.eururo.2018.05.035 ↗
4. Interreader variability of Prostate Imaging Reporting and Data System version 2 in detecting and assessing prostate cancer lesions at prostate MRI10.2214/AJR.18.20536 ↗
5. Prostate magnetic resonance imaging interpretation varies substantially across radiologists10.1016/j.euf.2017.11.010 ↗
6. Jóźwiak, R., Sobecki, P., and Lorenc, T. (2023). Intraobserver and Interobserver Agreement between Six Radiologists Describing mpMRI Features of Prostate Cancer Using a PI-RADS 2.1 Structured Reporting Scheme. Life, 13.10.3390/life13020580 ↗
7. Semisupervised Learning with Report-guided Pseudo Labels for Deep Learning-based Prostate Cancer Detection Using Biparametric MRI10.1148/ryai.230031 ↗
8. nnU-Net: A self-configuring method for deep learning-based biomedical image segmentation10.1038/s41592-020-01008-z ↗
9. Segmentation of the prostate transition zone and peripheral zone on MR images with deep learning10.1148/rycan.2021200024 ↗
10. Automatic prostate and prostate zones segmentation of magnetic resonance images using DenseNet-like U-net10.1038/s41598-020-71080-0 ↗
11. SAM-UNETR: Clinically significant prostate cancer segmentation using transfer learning from large model10.1109/ACCESS.2023.3326882 ↗
12. Prostate lesion segmentation based on a 3D end-to-end convolutional neural network with deep multi-scale attention10.1016/j.mri.2023.01.015 ↗
13. Yap, M.H., Kendrick, C., Behera, A., Cootes, T., and Zwiggelaar, R. (2024). Ensemble Deep Learning Models for Segmentation of Prostate Zonal Anatomy and Pathologically Suspicious Areas. Proceedings of the Medical Image Understanding and Analysis, Springer.
14. Artificial intelligence and radiologists in prostate cancer detection on MRI (PI-CAI): An international, paired, non-inferiority, confirmatory study10.1016/S1470-2045(24)00220-1 ↗
15. Prostate158—An expert-annotated 3T MRI dataset and algorithm for prostate cancer detection10.1016/j.compbiomed.2022.105817 ↗
16. Simultaneous truth and performance level estimation (STAPLE): An algorithm for the validation of image segmentation10.1109/TMI.2004.828354 ↗
17. Le, K.H., Tran, T.V., Pham, H.H., Nguyen, H.T., Le, T.T., and Nguyen, H.Q. (2022). Learning from multiple expert annotators for enhancing anomaly detection in medical image analysis. arXiv.
18. Mirikharaji, Z., Abhishek, K., Izadi, S., and Hamarneh, G. (2021). D-LEMA: Deep learning ensembles from multiple annotations—Application to skin lesion segmentation. arXiv.10.1109/CVPRW53098.2021.00203 ↗
19. Interactive Explainable Deep Learning Model Informs Prostate Cancer Diagnosis at MRI10.1148/radiol.222276 ↗
20. Deep Learning Prostate MRI Segmentation Accuracy and Robustness: A Systematic Review10.1148/ryai.230138 ↗
21. Fully Automated Deep Learning Model to Detect Clinically Significant Prostate Cancer at MRI10.1148/radiol.232635 ↗
22. AI-powered Prostate Cancer Detection: A Multi-centre, Multi-scanner Validation Study10.1007/s00330-024-11323-0 ↗
23. Requirements for AI Development and Reporting for MRI Prostate Cancer Detection in Biopsy-Naive Men: PI-RADS Steering Committee, Version 1.010.1148/radiol.240140 ↗
24. FUTURE-AI: International Consensus Guideline for Trustworthy and Deployable Artificial Intelligence in Healthcare10.1136/bmj-2024-081554 ↗
25. Gonet, M., Majorek, S., Mycka, J., Mykhalevych, I., and Jozwiak, R. (2024, January 12). Improving prostate lesion detection with multiple annotations and ensemble techniques. Proceedings of the MIDI, Warsaw, Poland.10.1007/978-3-032-05802-7_15 ↗
26. Lowekamp, B.C., Chen, D.T., Ibáñez, L., and Blezek, D. (2013). The Design of SimpleITK. Front. Neuroinform., 7.10.3389/fninf.2013.00045 ↗
27. (2025, October 15). Pical Evaluator. Available online: https://github.com/DIAGNijmegen/picai_eval.
28. Laganà, F. (2026). Design and Simulation-Based Validation of an Embedded Acquisition Architecture for In Situ PCB Integrity Monitoring in Biomedical Devices. Electronics, 15.10.3390/electronics15040833 ↗