From Benchmarking to Optimisation: A Comprehensive Study of Aircraft Component Segmentation for Apron Safety Using YOLOv8-Seg
Source abstract
Abstract
Apron incidents remain a critical safety concern in aviation, yet progress in vision-based surveillance has been limited by the lack of open-source datasets with detailed aircraft component annotations and systematic benchmarks. This study addresses these limitations through three contributions. First, a novel hybrid dataset was developed, integrating real and synthetic imagery with pixel-level labels for aircraft, fuselage, wings, tail, and nose. This publicly available resource fills a longstanding gap, reducing reliance on proprietary datasets. Second, the dataset was used to benchmark twelve advanced object detection and segmentation models, including You Only Look Once (YOLO) variants, two-stage detectors, and Transformer-based approaches, evaluated using mean Average Precision (mAP), Precision, Recall, and inference speed (FPS). Results revealed that YOLOv9 delivered the highest bounding box accuracy, whereas YOLOv8-Seg outperformed in segmentation, surpassing some of its newer successors and showing that architectural advancements do not always equate to superiority. Third, YOLOv8-Seg was systematically optimised through an eight-step ablation study, integrating optimisation strategies across loss design, computational efficiency, and data processing. The optimised model achieved an 8.04-point improvement in mAP@0.5:0.95 compared to the baseline and demonstrated enhanced robustness under challenging conditions. Overall, these contributions provide a reliable foundation for future vision-based apron monitoring and collision risk prevention systems.
Source: crossref · Quality: baseline
Research context
OpenAlex topics: Air Traffic Management and Optimization · Advanced Neural Network Applications · Aerospace and Aviation Technology
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
Affiliations
Department of Electronic and Electrical Engineering, Brunel University of London, London UB8 3PH, UK
References (78)
Show source-provided references
1. International Air Transport Association (IATA) (2023). 2023 Industry Statistics Fact Sheet, International Air Transport Association (IATA). Available online: https://www.iata.org/en/iata-repository/publications/economic-reports/industry-statistics-fact-sheet-december-2023/.
2. International Civil Aviation Organization (2025, May 11). First ICAO Global Air Cargo Summit. Available online: https://www.icao.int/Meetings/IACS/Pages/default.aspx.
3. Transportation Security at Hubs: Addressing Key Challenges across Modes of Transport10.1007/s12198-025-00294-y ↗
4. Flight Safety Foundation (FSF) (2023). 2022 Safety Report, Flight Safety Foundation (FSF).
5. Surveillance Radar System Limitations and the Advent of the Automatic Dependent Surveillance Broadcast System for Aircraft Monitoring
6. A Computer Vision Framework Using Convolutional Neural Networks for Airport-Airside Surveillance10.1016/j.trc.2022.103590 ↗
7. Chen, X., Gao, Z., and Chai, Y. (2017, January 8–12). The Development of Air Traffic Control Surveillance Radars in China. Proceedings of the 2017 IEEE Radar Conference, RadarConf 2017, Seattle, WA, USA.10.1109/RADAR.2017.7944495 ↗
8. Airport Surveillance Processing Chain for High Resolution Radar10.1109/TAES.2010.5545207 ↗
9. Novel Concepts for Surface Movement Radar Design10.1017/S1759078709000233 ↗
10. (2024, April 15). Skybrary Surface Movement Radar (SMR). Available online: https://skybrary.aero/articles/surface-movement-radar.
11. Action Recognition of Individuals on an Airport Apron Based on Tracking Bounding Boxes of the Thermal Infrared Target10.1016/j.infrared.2021.103859 ↗
12. M-ABCNet: Multi-Modal Aircraft Motion Behavior Classification Network at Airport Ramps10.1109/ACCESS.2024.3462096 ↗
13. Thermal Imaging in Aviation10.14311/MAD.2015.16.03 ↗
14. Rivera Velázquez, J.M., Khoudour, L., Saint Pierre, G., Duthon, P., Liandrat, S., and Bernardin, F. (2022). Analysis of Thermal Imaging Performance Under Extreme Foggy Conditions: Applications to Autonomous Driving. J. Imaging, 8.10.3390/jimaging8110306 ↗
15. Brassel, H., Zouhar, A., and Fricke, H. (2020, January 11–15). 3D Modeling of the Airport Environment for Fast and Accurate LiDAR Semantic Segmentation of Apron Operations. Proceedings of the 2020 AIAA/IEEE 39th Digital Avionics Systems Conference (DASC), San Antonio, TX, USA.10.1109/DASC50938.2020.9256495 ↗
16. An AI Powered Computer Vision Application for Airport CCTV Users
17. Munyer, T., Brinkman, D., Huang, C., and Zhong, X. (2021, January 9–11). Integrative Use of Computer Vision and Unmanned Aircraft Technologies in Public Inspection: Foreign Object Debris Image Collection. Proceedings of the 22nd Annual International Conference on Digital Government Research, Omaha, NE, USA.10.1145/3463677.3463743 ↗
18. ICAO (2024, June 19). International Civil Aviation Organization FOD Management Programme. Available online: https://www2023.icao.int/ESAF/Documents/meetings/2024/Aerodrome%20Certification%20Worksljop%20Luanda%20Angola%2013-17%20May%202024/Presentations/FOD%20Management%20Programme.pdf.
19. Shan, J., Miccinesi, L., Beni, A., Pagnini, L., Cioncolini, A., and Pieraccini, M. (2025). A Review of Foreign Object Debris Detection on Airport Runways: Sensors and Algorithms. Remote Sens., 17.10.3390/rs17020225 ↗
20. Mo, Y., Wang, L., Hong, W., Chu, C., Li, P., and Xia, H. (2024). Small-Scale Foreign Object Debris Detection Using Deep Learning and Dual Light Modes. Appl. Sci., 14.10.3390/app14052162 ↗
21. Detection and Classification of Foreign Object Debris (FOD) with Comparative Deep Learning Algorithms in Airport Runways10.1007/s11760-025-03901-6 ↗
22. Friederich, N., Specker, A., and Beyerer, J. (2024, January 1–6). Security Fence Inspection at Airports Using Object Detection. Proceedings of the 2024 IEEE Winter Conference on Applications of Computer Vision Workshops, WACVW 2024, Waikoloa, HI, USA.10.1109/WACVW60836.2024.00039 ↗
23. Bahrudeen, A.A.A., and Bajpai, A. (2024). Attire-Based Anomaly Detection in Restricted Areas Using YOLOv8 for Enhanced CCTV Security. arXiv.
24. Kheta, K., Delgove, C., Liu, R., Aderogba, A., and Pokam, M.-O. (2022). Vision-Based Conflict Detection Within Crowds Based on High-Resolution Human Pose Estimation for Smart and Safe Airport. arXiv.
25. A Turnaround Control System to Automatically Detect and Monitor the Time Stamps of Ground Service Actions in Airports: A Deep Learning and Computer Vision Based Approach10.1016/j.engappai.2022.105032 ↗
26. The Role of Human Factors in Aviation Ground Operation-Related Accidents/Incidents: A Human Error Analysis Approach10.1016/j.treng.2023.100184 ↗
27. Said Hamed Alzadjail, N., Balasubaramainan, S., Savarimuthu, C., and Rances, E.O. (2024). A Deep Learning Framework for Real-Time Bird Detection and Its Implications for Reducing Bird Strike Incidents. Sensors, 24.10.3390/s24175455 ↗
28. Enhancing the Aeronautical Decision-Making Knowledge and Skills of General Aviation Pilots to Mitigate the Risk of Bird Strikes: A Quasi-Experimental Study
29. Dat, N.N., Richardson, T., Watson, M., Meier, K., Kline, J., and Reid, S. (2025). WildLive: Near Real-Time Visual Wildlife Tracking Onboard UAVs. arXiv.
30. Top-Down Aircraft Detection in Large-Scale Scenes Based on Multi-Source Data and FEF-R-CNN10.1080/01431161.2022.2034194 ↗
31. Aircraft Detection for Remote Sensing Images Based on Deep Convolutional Neural Networks
32. Tahir, A., Adil, M., and Ali, A. (2021). Rapid Detection of Aircrafts in Satellite Imagery Based on Deep Neural Networks. arXiv.
33. Yang, Y., Xie, G., and Qu, Y. (2021, January 12–14). Real-Time Detection of Aircraft Objects in Remote Sensing Images Based on Improved YOLOv4. Proceedings of the 2021 IEEE 5th Advanced Information Technology, Electronic and Automation Control Conference (IAEAC), Chongqing, China.10.1109/IAEAC50856.2021.9390673 ↗
34. Wang, Y.Y., Wu, H., Shuai, L., Peng, C., and Yang, Z. (2022). Detection of Plane in Remote Sensing Images Using Super-Resolution. PLoS ONE, 17.10.1371/journal.pone.0265503 ↗
35. (2025, October 01). Flight Safety Foundation Ground Accident Prevention (GAP). Available online: https://flightsafety.org/toolkits-resources/past-safety-initiatives/ground-accident-prevention-gap/.
36. Van Phat, T., Alam, S., Lilith, N., Tran, P.N., and Binh, N.T. (2021, January 5–9). Deep4Air: A Novel Deep Learning Framework for Airport Airside Surveillance. Proceedings of the 2021 IEEE International Conference on Multimedia and Expo Workshops, ICMEW 2021, Shenzhen, China.10.1109/ICMEW53276.2021.9456005 ↗
37. Girshick, R., Donahue, J., Darrell, T., and Malik, J. (2014, January 23–28). Rich Feature Hierarchies for Accurate Object Detection and Semantic Segmentation. Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition, Columbus, OH, USA.10.1109/CVPR.2014.81 ↗
38. Girshick, R. (2015, January 7–13). Fast R-CNN. Proceedings of the IEEE International Conference on Computer Vision, Santiago, Chile.10.1109/ICCV.2015.169 ↗
39. Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks10.1109/TPAMI.2016.2577031 ↗
40. He, K., Gkioxari, G., Dollár, P., and Girshick, R. (2017, January 22–29). Mask R-CNN. Proceedings of the 2017 IEEE International Conference on Computer Vision (ICCV), Venice, Italy.10.1109/ICCV.2017.322 ↗
41. Liu, W., Anguelov, D., Erhan, D., Szegedy, C., Reed, S., Fu, C.Y., and Berg, A.C. (2016, January 11–14). SSD: Single Shot Multibox Detector. Proceedings of the European Conference on Computer Vision (ECCV), Amsterdam, The Netherlands.10.1007/978-3-319-46448-0_2 ↗
42. Focal Loss for Dense Object Detection10.1109/TPAMI.2018.2858826 ↗
43. Redmon, J., Divvala, S., Girshick, R., and Farhadi, A. (2016, January 27–30). You Only Look Once: Unified, Real-Time Object Detection. Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition, Las Vegas, NV, USA.10.1109/CVPR.2016.91 ↗
44. Jocher, G. (2025, May 29). YOLOv5 by Ultralytics. Available online: http://github.com/ultralytics/yolov5.
45. (2024, December 23). Ultralytics YOLOv8 Models. Available online: https://docs.ultralytics.com/models/yolov8/.
46. Wang, C.-Y., Yeh, I.-H., and Liao, H.-Y.M. (October, January 29). YOLOv9: Learning What You Want to Learn Using Programmable Gradient Information. Proceedings of the 18th European Conference on Computer Vision. (ECCV), Milan, Italy.
47. Wang, A., Chen, H., Liu, L., Chen, K., and Lin, Z. (2024). YOLOv10: Real-Time End-to-End Object Detection. arXiv, Available online: https://arxiv.org/abs/2405.14458.
48. (2025, February 12). Ultralytics Ultralytics YOLO11. Available online: https://docs.ultralytics.com/models/yolo11/.
49. Tian, Y., Ye, Q., and Doermann, D. (2025). YOLOv12: Attention-Centric Real-Time Object Detectors. arXiv.
50. Ultralytics_Team (2023, April 19). Introducing Instance Segmentation in Ultralytics YOLOv5 v7.0. Available online: https://www.ultralytics.com/blog/introducing-instance-segmentation-in-yolov5-v7-0.
51. (2024, April 23). Ultralytics Instance Segmentation—Ultralytics YOLO Docs. Available online: https://docs.ultralytics.com/tasks/segment/.
52. Zhu, X., Su, W., Lu, L., Li, B., Wang, X., and Dai, J. (2021, January 3–7). Deformable DETR: Deformable Transformers for End-To-End Object Detection. Proceedings of the ICLR 2021—9th International Conference on Learning Representations, Virtual.
53. Robicheaux, P., Gallagher, J., Nelson, J., and Robinson, I. (2025, May 31). RF-DETR: A SOTA Real-Time Object Detection Model. Available online: https://blog.roboflow.com/rf-detr/.
54. He, Z., He, Y., and Lv, Y. (2025). DT-YOLO: An Improved Object Detection Algorithm for Key Components of Aircraft and Staff in Airport Scenes Based on YOLOv5. Sensors, 25.10.3390/s25061705 ↗
55. ASD-YOLO: An Aircraft Surface Defects Detection Method Using Deformable Convolution and Attention Mechanism10.1016/j.measurement.2024.115300 ↗
56. Microsoft COCO: Common Objects in Context
57. ASSD-YOLO: A Small Object Detection Method Based on Improved YOLOv7 for Airport Surface Surveillance10.1007/s11042-023-17628-4 ↗
58. AD-YOLO: A Real-Time YOLO Network with Swin Transformer and Attention Mechanism for Airport Scene Detection10.1109/TIM.2024.3472805 ↗
59. Lyu, Z., and Luo, J. (2022). A Surveillance Video Real-Time Object Detection System Based on Edge-Cloud Cooperation in Airport Apron. Appl. Sci., 12.10.3390/app121910128 ↗
60. Aircraft Objection Detection Method of Airport Surface Based on Improved YOLOv510.52783/jes.1087 ↗
61. An Airport Apron Ground Service Surveillance Algorithm Based on Improved YOLO Network10.3934/era.2024164 ↗
62. (2024, September 10). CAPTAIN-WHU DOTA: Dataset for Object DeTection in Aerial Images. Available online: https://captain-whu.github.io/DOTA/index.html.
63. (2024, February 20). RSIA-LIESMARS-WHU Remote Sensing Object Detection Dataset (RSOD-Dataset). Available online: https://github.com/RSIA-LIESMARS-WHU/RSOD-Dataset-.
64. Utomo, S., Sulistyaningrum, D.R., Setiyono, B., and Nasution, A.H.I. (2024, January 6–7). Image Augmentation For Aircraft Parts Detection Using Mask R-CNN. Proceedings of the 2024 International Conference on Smart Computing, IoT and Machine Learning, SIML 2024, Surakarta, Indonesia.10.1109/SIML61815.2024.10578281 ↗
65. Advanced Semantic Segmentation of Aircraft Main Components Based on Transfer Learning and Data-Driven Approach10.1007/s00371-024-03686-8 ↗
66. Yilmaz, B., and Karsligil, M.E. (2020, January 5–7). Detection of Airplane and Airplane Parts from Security Camera Images with Deep Learning. Proceedings of the 2020 28th Signal Processing and Communications Applications Conference, SIU 2020, Gaziantep, Turkey.10.1109/SIU49456.2020.9302118 ↗
67. A Benchmark Dataset for Deep Learning-Based Airplane Detection: HRPlanes10.26833/ijeg.1107890 ↗
68. Maji, S., Rahtu, E., Kannala, J., Blaschko, M., and Vedaldi, A. (2013). Fine-Grained Visual Classification of Aircraft. arXiv.
69. (2025, May 20). Ultralytics YOLO12: Attention-Centric Object Detection. Available online: https://docs.ultralytics.com/models/yolo12/.
70. Carion, N., Massa, F., Synnaeve, G., Usunier, N., Kirillov, A., and Zagoruyko, S. (2020, January 23–28). End-to-End Object Detection with Transformers. Proceedings of the 16th European Conference, Glasgow, UK.10.1007/978-3-030-58452-8_13 ↗
71. Padilla, R., Passos, W.L., Dias, T.L.B., Netto, S.L., and Da Silva, E.A.B. (2021). A Comparative Analysis of Object Detection Metrics with a Companion Open-Source Toolkit. Electronics, 10.10.3390/electronics10030279 ↗
72. Padilla, R., Netto, S.L., and Da Silva, E.A.B. (2020, January 1–3). A Survey on Performance Metrics for Object-Detection Algorithms. Proceedings of the International Conference on Systems, Signals, and Image Processing, Niteroi, Brazil.10.1109/IWSSIP48289.2020.9145130 ↗
73. (2024, May 23). Ultralytics YOLO Performance Metrics—COCO Metrics Evaluation. Available online: https://docs.ultralytics.com/guides/yolo-performance-metrics/#coco-metrics-evaluation.
74. Fully Convolutional Networks for Semantic Segmentation
75. Lin, T.-Y., Maire, M., Belongie, S., Hays, J., and Perona, P. (2022, January 16). COCO: Common Objects in Context. Available online: https://cocodataset.org/#home.
76. The Pascal Visual Object Classes (VOC) Challenge10.1007/s11263-009-0275-4 ↗
77. Kohavi, R. (1995, January 20–25). A Study of Cross-Validation and Bootstrap for Accuracy Estimation and Model Selection. Proceedings of the International Joint Conference on Artificial Intelligence (IJCAI), Montreal, QC, Canada.
78. Zhang, Y., Zhou, B., Zhao, X., and Song, X. (2025). Enhanced Object Detection in Low-Visibility Haze Conditions with YOLOv9s. PLoS ONE, 20.10.1371/journal.pone.0317852 ↗