A Systematic Review of YOLO-Based Object Detection in Medical Imaging: Advances, Challenges, and Future Directions
Source abstract
Abstract
The YOLO (You Only Look Once) series, a leading single-stage object detection framework, has gained significant prominence in medical-image analysis due to its real-time efficiency and robust performance. Recent iterations of YOLO have further enhanced its accuracy and reliability in critical clinical tasks such as tumor detection, lesion segmentation, and microscopic image analysis, thereby accelerating the development of clinical decision support systems. This paper systematically reviews advances in YOLO-based medical object detection from 2018 to 2024. It compares YOLO’s performance with other models (e.g., Faster R-CNN, RetinaNet) in medical contexts, summarizes standard evaluation metrics (e.g., mean Average Precision (mAP), sensitivity), and analyzes hardware deployment strategies using public datasets such as LUNA16, BraTS, and CheXpert. The review highlights the impressive performance of YOLO models, particularly from YOLOv5 to YOLOv8, in achieving high precision (up to 99.17%), sensitivity (up to 97.5%), and mAP exceeding 95% in tasks such as lung nodule, breast cancer, and polyp detection. These results demonstrate the significant potential of YOLO models for early disease detection and real-time clinical applications, indicating their ability to enhance clinical workflows. However, the study also identifies key challenges, including high small-object miss rates, limited generalization in low-contrast images, scarcity of annotated data, and model interpretability issues. Finally, the potential future research directions are also proposed to address these challenges and further advance the application of YOLO models in healthcare.
Source: openalex_inverted_index · Quality: baseline
Research context
OpenAlex topics: COVID-19 diagnosis using AI · Brain Tumor Detection and Classification
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
References (100+)
Show source-provided references
1. Precision diagnosis: a view of the clinical decision support systems (CDSS) landscape through the lens of critical care10.1007/s10877-016-9849-1 ↗
2. An overview of clinical decision support systems: benefits, risks, and strategies for success10.1038/s41746-020-0221-y ↗
3. Hybrid weighted fuzzy production rule extraction utilizing modified harmony search and BPNN10.1038/s41598-025-95406-y ↗
4. A modified harmony search algorithm and its applications in weighted fuzzy production rule extraction10.1631/FITEE.2200334 ↗
5. Parallel fault diagnosis using hierarchical fuzzy Petri net by reversible and dynamic decomposition mechanism10.1631/FITEE.2400184 ↗
6. Modeling, reasoning, and application of fuzzy Petri net model: a survey10.1007/s10462-022-10161-0 ↗
7. Knowledge-based dynamic prompt learning for multi-label disease diagnosis10.1016/j.knosys.2024.111395 ↗
8. Knowledge-based anomaly detection: survey, challenges, and future directions10.1016/j.engappai.2024.108996 ↗
9. Unmasking colorectal cancer: a high-performance semantic network for polyp and surgical instrument segmentation10.1016/j.engappai.2024.109292 ↗
10. Memory guided transformer with spatio-semantic visual extractor for medical report generation10.1109/JBHI.2024.3371894 ↗
11. Deep learning-enabled medical computer vision10.1038/s41746-020-00376-2 ↗
12. Adaptive feature selection guided deep forest for COVID-19 classification with chest CT10.1109/JBHI.2020.3019505 ↗
13. Dense nested attention network for infrared small target detection10.1109/TIP.2022.3199107 ↗
14. Edge detection in medical images using a genetic algorithm10.1109/42.712136 ↗
15. Advances in medical image segmentation: a comprehensive review of traditional, deep learning and hybrid approaches10.3390/bioengineering11101034 ↗
16. CheXMed: a multimodal learning algorithm for pneumonia detection in the elderly10.1016/j.ins.2023.119854 ↗
17. DCDLN: a densely connected convolutional dynamic learning network for malaria disease diagnosis10.1016/j.neunet.2024.106339 ↗
18. Yaqoob · Metaheuristics for machine learning: algorithms and applications · 2024 · 95
19. YOLO-anti: YOLO-based counterattack model for unseen congested object detection10.1016/j.patcog.2022.108814 ↗
20. MAL-YOLO: a lightweight algorithm for target detection in side-scan sonar images based on multi-scale feature fusion and attention mechanism10.1080/17538947.2024.2398050 ↗
21. Object detection using YOLO: challenges, architectural successors, datasets and applications10.1007/s11042-022-13644-y ↗
22. Efficient loss landscape reshaping for convolutional neural networks10.1109/TNNLS.2024.3462516 ↗
23. A study of YOLO algorithm for target detection10.5954/ICAROB.2021.OS13-9 ↗
24. A review of YOLO algorithm developments10.1016/j.procs.2022.01.135 ↗
25. Benchmarking YOLO models for intracranial hemorrhage detection using varied CT data sources10.1109/ACCESS.2024.3510517 ↗
26. Development of a deep learning model for safe direct optical trocar insertion in minimally invasive surgery: an innovative method to prevent trocar injuries10.1007/s00464-023-10309-1 ↗
27. SegPath-YOLO: a high-speed, high-accuracy pathology image segmentation and tumor microenvironment feature extraction tool
28. Costa L. A hybrid deep learning framework for segmentation of crowded objects on medical images: application to digital pathology image analysis [master’s thesis]. Torino, Italy: Politecnico di Torino; 2021.
29. Trade-off of different deep learning-based auto-segmentation approaches for treatment planning of pediatric craniospinal irradiation autocontouring of OARs for pediatric CSI10.1002/mp.17782 ↗
30. A YOLO-based model for breast cancer detection in mammograms10.1007/s12559-023-10189-6 ↗
31. A new approach for detecting fundus lesions using image processing and deep neural network architecture based on YOLO model10.3390/s22176441 ↗
32. YOLO-adaptor: a fast adaptive one-stage detector for non-aligned visible-infrared object detection10.1109/TIV.2024.3393015 ↗
33. CCGL-YOLOV5: a cross-modal cross-scale global-local attention YOLOV5 lung tumor detection model10.1016/j.compbiomed.2023.107387 ↗
34. ME-YOLO: improved YOLOv5 for detecting medical personal protective equipment10.3390/app122311978 ↗
35. YOLO-based deep learning model for pressure ulcer detection and classification10.3390/healthcare11091222 ↗
36. Artificial intelligence image recognition based on 5G deep learning edge algorithm of digestive endoscopy on medical construction10.1016/j.aej.2021.07.007 ↗
37. A 5G network based conceptual framework for real-time malaria parasite detection from thick and thin blood smear slides using modified YOLOv5 model10.1177/20552076251321540 ↗
38. Internet of medical things with a blockchain-assisted smart healthcare system using metaheuristics with a deep learning model10.3390/app13106108 ↗
39. Confluence of blockchain and artificial intelligence technologies for secure and scalable healthcare solutions: a review10.1109/JIOT.2022.3232793 ↗
40. A comprehensive systematic review of YOLO for medical object detection (2018 to 2023)10.1109/ACCESS.2024.3386826 ↗
41. YOLO for medical object detection (2018–2024)
42. Das · Revolutionizing healthcare: impact of artificial intelligence on diagnosis, treatment, and patient care · 2025 · 29
43. YOLO (you only look once) making object detection work in medical imaging on convolution detection system
44. YOLO-MR: meta-learning-based lesion detection algorithm for resolving data imbalance10.1109/ACCESS.2024.3384088 ↗
45. YOLO-based ROI selection for joint encryption and compression of medical images with reconstruction through super-resolution network10.1016/j.future.2023.08.018 ↗
46. YOLO-v1 to YOLO-v8, the rise of YOLO and its complementary nature toward digital manufacturing and industrial defect detection10.3390/machines11070677 ↗
47. Embedded YOLO-fastest V2-based 3D reconstruction and size prediction of grain silo-bag10.3390/rs15194846 ↗
48. Real-time face detection based on YOLO
49. Real time object detection with audio feedback using yolo vs
50. Object detection based on YOLO network
51. YOLO with adaptive frame control for real-time object detection applications10.1007/s11042-021-11480-0 ↗
52. Object detection and tracking using YOLO
53. A photovoltaic surface defect detection method for building based on deep learning10.1016/j.jobe.2023.106375 ↗
54. Pedestrian detection based on YOLO network model
55. Understanding of object detection based on CNN family and YOLO10.1088/1742-6596/1004/1/012029 ↗
56. YOLO9000: better, faster, stronger
57. Redmon J, Farhadi A. YOLOv3: an incremental improvement. arXiv:1804.02767. 2018.
58. Bochkovskiy A, Wang CY, Liao HYM. YOLOv4: optimal speed and accuracy of object detection. arXiv:2004.10934. 2020.
59. Li C, Li L, Jiang H, Weng K, Geng Y, Li L, et al. YOLOv6: a single-stage object detection framework for industrial applications. arXiv:2209.02976. 2022.
60. YOLOv7: trainable bag-of-freebies sets new state-of-the-art for real-time object detectors
61. YOLOv9: learning what you want to learn using programmable gradient information
62. YOLOv10: real-time end-to-end object detection
63. RDD-YOLO: a modified YOLO for detection of steel surface defects10.1016/j.measurement.2023.112776 ↗
64. An automatic inspection system for pest detection in granaries using YOLOv410.1016/j.compag.2022.107302 ↗
65. EL-YOLO: an efficient and lightweight low-altitude aerial objects detector for onboard applications10.1016/j.eswa.2024.124848 ↗
66. DsP-YOLO: an anchor-free network with DsPAN for small object detection of multiscale defects10.1016/j.eswa.2023.122669 ↗
67. DC-SPP-YOLO: dense connection and spatial pyramid pooling based YOLO for object detection10.1016/j.ins.2020.02.067 ↗
68. Enhanced swine behavior detection with YOLOs and a mixed efficient layer aggregation network in real time10.3390/ani14233375 ↗
69. Integrated multiscale domain adaptive YOLO10.1109/TIP.2023.3255106 ↗
70. SA-YOLOv3: an efficient and accurate object detector using self-attention mechanism for autonomous driving10.1109/TITS.2020.3041278 ↗
71. Focal and efficient IOU loss for accurate bounding box regression10.1016/j.neucom.2022.07.042 ↗
72. Use anchor-free based object detectors to detect surface defects
73. Enhancing wheat fusarium head blight detection using rotation YOLO wheat detection network and simple spatial attention network10.1016/j.compag.2023.107968 ↗
74. You only look once: unified, real-time object detection
75. YOLO-based object detection models: a review and its applications10.1007/s11042-024-18872-y ↗
76. YOLO-based UAV technology: a review of the research and its applications10.3390/drones7030190 ↗
77. Alif MAR, Hussain M. YOLOv1 to YOLOv10: a comprehensive review of YOLO variants and their application in the agricultural domain. arXiv:2406.10139. 2024.
78. ViT-YOLO: transformer-based YOLO for object detection
79. YOLOWeeds: a novel benchmark of YOLO object detectors for multi-class weed detection in cotton production systems10.1016/j.compag.2023.107655 ↗
80. Cross-domain object detection for autonomous driving: a stepwise domain adaptative YOLO approach10.1109/TIV.2022.3165353 ↗
81. YOLO advances to its genesis: a decadal and comprehensive review of the you only look once (YOLO) series10.1007/s10462-025-11253-3 ↗
82. The research on autopilot system based on lightweight YOLO-V3 target detection algorithm10.1088/1742-6596/1486/3/032028 ↗
83. AUTOPILOT: an advanced perception, localization and path planning techniques for autonomous vehicles using YOLOv7 and MiDaS
84. Defending person detection against adversarial patch attack by using universal defensive frame10.1109/TIP.2022.3217375 ↗
85. Securing autonomous vehicles visual perception: adversarial patch attack and defense schemes with experimental validations10.1109/TIV.2024.3403667 ↗
86. Iris presentation attack detection based on best-k feature selection from YOLO inspired RoI10.1007/s00521-020-05342-3 ↗
87. Object detection YOLO algorithms and their industrial applications: overview and comparative analysis10.3390/electronics14061104 ↗
88. SED-YOLO based multi-scale attention for small object detection in remote sensing10.1038/s41598-025-87199-x ↗
89. SCENE-YOLO: a one-stage remote sensing object detection network with scene supervision
90. Exploring the impact of hyperparameter and data augmentation in YOLO V10 for accurate bone fracture detection from X-ray images10.1038/s41598-025-93505-4 ↗
91. Robust real-time polyp detection system design based on YOLO algorithms by optimizing activation functions and hyper-parameters with artificial bee colony (ABC)10.1016/j.eswa.2023.119741 ↗
92. Multi-target tracking of surveillance video with differential YOLO and DeepSort
93. Apple detection during different growth stages in orchards using the improved YOLO-V3 model10.1016/j.compag.2019.01.012 ↗
94. A YOLO-NL object detector for real-time detection10.1016/j.eswa.2023.122256 ↗
95. Improving real-time detection of laryngeal lesions in endoscopic images using a decoupled super-resolution enhanced YOLO10.1016/j.cmpb.2024.108539 ↗
96. Image-based remote evaluation of PASI scores with psoriasis by the YOLO-v4 algorithm10.1111/exd.15082 ↗
97. YOLO-MSRF for lung nodule detection10.1016/j.bspc.2024.106318 ↗
98. One-stage pulmonary nodule detection using 3-D DCNN with feature fusion and attention mechanism in CT image10.1016/j.cmpb.2022.106786 ↗
99. Automatic localization of normal active organs in 3D PET scans10.1016/j.compmedimag.2018.09.008 ↗
100. A deep learning approach for histology-based nucleus segmentation and tumor microenvironment characterization10.1016/j.modpat.2023.100196 ↗