journal article·2026-03-11Open access

ADAS-TSR: A Deep Learning-Based Traffic Sign Recognition System with Voice Alerts for Andean Historic City Centers

Eduardo J. Urbina-Dominguez, Hemerson Lizarbe-Alarcon, Yuri Galvez-Gastelu, Efrain E. Porras-Flores, Wilmer E. Moncada-Sosa, Jose E. Estrada-Cardenas, Edward Leon-Palacios, Diego O. Tenorio-Huarancca

Applied Sciences· Volume 16· Issue 6

Abstract

Colonial historic city centers represent a paradigmatic challenge for modern road safety, as they are characterized by narrow streets originally designed for carriage and pedestrian traffic. This research presents ADAS-TSR, a deep learning-based advanced driver assistance system for vertical traffic sign detection with voice alerts, specifically designed for the Historic Center of Ayacucho, Peru, which is located at 2761 m a.s.l. An original dataset comprising 2250 images with 2450 instances corresponding to 14 sign classes according to Peruvian regulations was constructed. The dataset was captured under real operational conditions, including deteriorated, partially occluded, and vehicle impact-deformed signage. A comprehensive multi-model benchmark experiment was conducted, comparing four CNN-based detectors (YOLOv8m, YOLO11n, YOLO26n, YOLO26s) and one transformer-based detector (RT-DETR-l) spanning both classical and state-of-the-art architectures released through January 2026. YOLO26s achieved the best overall performance, with an mAP@0.5 of 0.994 and mAP@0.5:0.95 of 0.989 while using only 9.5 M parameters. YOLO11n matched the performance of YOLOv8m with 10× fewer parameters (2.6 M vs. 25.9 M). Uncertainty analysis revealed that modern architectures exhibit significantly higher prediction confidence (mean > 0.90) compared to YOLOv8m (0.82), and fairness analysis confirmed equitable detection across all 14 classes (Gini < 0.002). A voice alert system with five priority levels and rule-based temporal filtering for detection stabilization was implemented. Validation across five urban circuits spanning 14.11 km demonstrated a detection rate of 94.7% with a 73% reduction in redundant alerts.
Source: crossref · Quality: baseline

Research context

OpenAlex topics: Advanced Neural Network Applications · Infrastructure Maintenance and Monitoring · Automated Road and Building Extraction

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

Faculty of Mining, Geological and Civil Engineering, Universidad Nacional de San Cristóbal de Huamanga, Ayacucho 05000, Peru

Laboratorio de Teledetección y Energías Renovables (LABTELER), Universidad Nacional de San Cristóbal de Huamanga, Ayacucho 05000, Peru

References (50)

Show source-provided references
1. World Health Organization (2023). Global Status Report on Road Safety 2023, WHO.
2. World Health Organization (2025, January 18–20). Leaders Make New Road Safety Commitments, Endorse New Declaration to Reduce Road Deaths. Proceedings of the 4th Global Ministerial Conference on Road Safety, Marrakech, Morocco. Available online: https://www.who.int/news/item/19-02-2025-global-leaders-make-new-road-safety-commitments--endorse-new-declaration-on-action-to-reduce-road-deaths.
3. Observatorio Nacional de Seguridad Vial (ONSV) (2026, January 15). Estadísticas de Siniestralidad Vial 2023, Available online: https://www.onsv.gob.pe/.
4. Ministry of Transport and Communications of Peru (2024). Traffic Accident Statistics 2023.
5. Intelligent Traffic Light Optimization System Using Convolutional Neural Networks for Historic City Centers in Complex Scenarios
6. Assessing YOLO Models for Real-Time Object Detection in Urban Environments for Advanced Driver-Assistance Systems (ADAS)10.1016/j.aej.2025.03.077 ↗
7. Computational Methods for Automatic Traffic Signs Recognition in Autonomous Driving on Road: A Systematic Review10.1016/j.rineng.2024.103553 ↗
8. Deep Learning10.1038/nature14539 ↗
9. Evaluation of Deep Neural Networks for Traffic Sign Detection Systems10.1016/j.neucom.2018.08.009 ↗
10. Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks
11. Liu, W., Anguelov, D., Erhan, D., Szegedy, C., Reed, S., Fu, C.Y., and Berg, A.C. (2016). SSD: Single Shot MultiBox Detector. European Conference on Computer Vision, Springer.10.1007/978-3-319-46448-0_2 ↗
12. Flores-Calero, M., Astudillo, C.A., Guevara, D., Mazo, J., Lita, B.S., de la Cruz, D., and Armingol Moreno, J.M. (2024). Traffic Sign Detection and Recognition Using YOLO Object Detection Algorithm: A Systematic Review. Mathematics, 12.10.3390/math12020297 ↗
13. Yolo V4 for Advanced Traffic Sign Recognition with Synthetic Training Data Generated by Various GAN
14. DP-YOLO: A Lightweight Traffic Sign Detection Model for Small Object Detection10.1016/j.dsp.2025.105311 ↗
15. Zhu, Z., Liang, D., Zhang, S., Huang, X., Li, B., and Hu, S. (2016). Traffic-Sign Detection and Classification in the Wild. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, IEEE.10.1109/CVPR.2016.232 ↗
16. Niu, M., Chen, Y., Li, J., Qiu, X., and Cai, W. (2024). YOLOv8s-DDA: An Improved Small Traffic Sign Detection Algorithm Based on YOLOv8s. Electronics, 13.10.3390/electronics13183764 ↗
17. EDN-YOLO: Multi-Scale Traffic Sign Detection Method in Complex Scenes10.1016/j.dsp.2024.104615 ↗
18. TSD-DETR: A Lightweight Real-Time Detection Transformer of Traffic Sign Detection10.1016/j.engappai.2024.109536 ↗
19. Zhao, Y., Lv, W., Xu, S., Wei, J., Wang, G., Dang, Q., Liu, Y., and Chen, J. (2024). DETRs Beat YOLOs on Real-Time Object Detection. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, IEEE.10.1109/CVPR52733.2024.01605 ↗
20. Jocher, G., Chaurasia, A., and Qiu, J. (2025, November 15). Ultralytics YOLOv8. Available online: https://github.com/ultralytics/ultralytics.
21. Ultralytics (2026, January 20). YOLO26: Next-Generation Real-Time Object Detection. Available online: https://docs.ultralytics.com/models/yolo26/.
22. Cheng, T., Song, L., Ge, Y., Liu, W., Wang, X., and Shan, Y. (2024). YOLO-World: Real-Time Open-Vocabulary Object Detection. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, IEEE.10.1109/CVPR52733.2024.01599 ↗
23. Liu, S., Zeng, Z., Ren, T., Li, F., Zhang, H., Yang, J., Li, C., Yang, J., Su, H., and Zhu, J. (2024). Grounding DINO: Marrying DINO with Grounded Pre-Training for Open-Set Object Detection. European Conference on Computer Vision, Springer.10.1007/978-3-031-72970-6_3 ↗
24. He, Y., Guo, M., Zhang, Y., Xia, J., Geng, X., Zou, T., and Ding, R. (2025). NTS-YOLO: A Nocturnal Traffic Sign Detection Method Based on Improved YOLOv5. Appl. Sci., 15.10.3390/app15031578 ↗
25. YOLO-AEF: Traffic Sign Detection via Adaptive Enhancement and Fusion10.1016/j.neucom.2025.131430 ↗
26. FAIERDet: Fuzzy-Based Adaptive Image Enhancement for Real-Time Traffic Sign Detection10.1016/j.eswa.2025.128795 ↗
27. Improved YOLOv8 for Small Traffic Sign Detection Under Complex Conditions10.1016/j.fraope.2024.100167 ↗
28. CCTSDB 2021: A More Comprehensive Traffic Sign Detection Benchmark
29. Traffic Sign Detection Using YOLO: Evaluating Failures on Localized Data10.1016/j.procs.2025.09.091 ↗
30. Traffic Sign Dataset for Connected and Automated Vehicle Operations in Rural Areas10.1016/j.dib.2025.112280 ↗
31. Lane and Traffic Sign Detection for Autonomous Vehicles on Indian Road Conditions10.1016/j.mex.2025.103178 ↗
32. Mexican Traffic Sign Detection and Classification Using Deep Learning10.1016/j.eswa.2022.117247 ↗
33. Xing, C., Sun, H., and Yang, J. (2025). A Lightweight Traffic Sign Detection Model Based on Improved YOLOv8s for Edge Deployment. World Electr. Veh. J., 16.10.3390/wevj16080478 ↗
34. Improved Traffic Sign Recognition Algorithm Based on YOLOv4-Tiny10.1016/j.jvcir.2023.103774 ↗
35. Zhou, H., Li, M., Liu, Y., and Zhang, K. (2024). A Lightweight Traffic Sign Detection Method Based on Improved YOLOv8n. Electronics, 13.
36. Traffic Sign Classification and Voice Alert System Using CNN10.1016/j.procs.2025.01.060 ↗
37. SAAM-ReflectNet: Sign-Aware Attention-Based Multitasking Framework10.1016/j.eswa.2025.128003 ↗
38. A Universal Traffic Sign Detection System Using Self-Training Neural Networks10.1016/j.aei.2024.102674 ↗
39. Marino Ayuque, A. (2016). Traffic Sign Classification System Using Convolutional Neural Networks. [Bachelor’s Thesis, Universidad Nacional de Ingeniería].
40. Instituto Nacional de Estadística e Informática (INEI) (2024). Informe Técnico de Estadísticas de Criminalidad, Seguridad Ciudadana y Violencia, Tercer Trimestre 2024, INEI.
41. Observatorio Nacional de Seguridad Vial (ONSV) (2024). Informe de Víctimas Fatales en Siniestros de Tránsito e Identificación de Puntos de Alta Siniestralidad en la Región Ayacucho, 2021–2024, MTC.
42. Man vs. Computer: Benchmarking Machine Learning Algorithms for Traffic Sign Recognition10.1016/j.neunet.2012.02.016 ↗
43. Ministry of Transport and Communications of Peru (2016). Traffic Control Device Manual for Automobiles on Streets and Highways.
44. LabelMe: A Database and Web-Based Tool for Image Annotation10.1007/s11263-007-0090-8 ↗
45. CVAT.ai Contributors (2026, January 10). Computer Vision Annotation Tool (CVAT). Available online: https://github.com/opencv/cvat.
46. Tzutalin (2026, January 10). LabelImg: Graphical Image Annotation Tool. Available online: https://github.com/tzutalin/labelImg.
47. Tkachenko, M., Malyuk, M., Holmanyuk, A., and Liubimov, N. (2026, January 10). Label Studio: Data Labeling Software. Available online: https://github.com/HumanSignal/label-studio.
48. Kirillov, A., Mintun, E., Ravi, N., Mao, H., Rolland, C., Gustafson, L., Xiao, T., Whitehead, S., Berg, A.C., and Lo, W.-Y. (2023). Segment Anything. Proceedings of the IEEE/CVF ICCV, IEEE.10.1109/ICCV51070.2023.00371 ↗
49. Bewley, A., Ge, Z., Ott, L., Ramos, F., and Upcroft, B. (2016). Simple Online and Realtime Tracking. Proceedings of the IEEE International Conference on Image Processing (ICIP), IEEE.10.1109/ICIP.2016.7533003 ↗
50. Ratnam, N. (2025, November 15). pyttsx3: Text to Speech Library for Python. Available online: https://pypi.org/project/pyttsx3/.