Personalized Contextual Information Delivery Using Road Sign Recognition
Source abstract
Abstract
Road sign recognition is essential for navigation and autonomous driving applications. While existing models focus primarily on text detection and extraction, they fail to incorporate user-specific contextual information, limiting their effectiveness in real-world scenarios. This study proposes a modular system that enhances road sign recognition by integrating user-adapted contextual reasoning. The system applies a step-by-step Chain of Thought (CoT) approach to link detected road signs with relevant contextual data, such as location, speed, and destination. Compared to traditional image captioning models, our approach significantly improves information relevance and usability. Experimental results show that the proposed system achieves a 23.4% increase in user-adapted information accuracy and reduces interpretation errors by 17.8% in real-world navigation scenarios. These findings demonstrate that semantic inference-based reasoning improves decision-making efficiency, making road sign recognition systems more practical for real-world applications. The study also discusses challenges such as real-time processing limitations and potential future improvements for broader infrastructure recognition.
Source: crossref · Quality: baseline
Research context
OpenAlex topics: Multimodal Machine Learning Applications · Advanced Neural Network Applications · Advanced Image and Video Retrieval Techniques
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
Affiliations
Korea Artificial Intelligence Certification Institute (KAIC), Seoul 04790, Republic of Korea
School of Media, Arts, and Science, Sogang University, Seoul 04107, Republic of Korea
Funding
Ministry of Culture, Sports and Tourism
References (18)
Show source-provided references
1. Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks10.1109/TPAMI.2016.2577031 ↗
2. You Only Look Once: Unified, Real-Time Object Detection
3. Bochkovskiy, A., Wang, C., and Liao, H.-Y. (2020). YOLOv4: Optimal Speed and Accuracy of Object Detection. arXiv.
4. Show, Attend and Tell: Neural Image Caption Generation with Visual Attention
5. Bottom-Up and Top-Down Attention for Image Captioning and Visual Question Answering
6. DeepLab: Semantic Image Segmentation with Deep Convolutional Nets, Atrous Convolution, and Fully Connected CRFs10.1109/TPAMI.2017.2699184 ↗
7. Pyramid Scene Parsing Network
8. Character Region Awareness for Text Detection
9. Sign-YOLO: Traffic Sign Detection Using Attention-Based YOLOv7
10. Chen, L., Liu, Z., and Yang, K. (2024). Cross-domain Few-shot In-context Learning for Enhancing Traffic Sign Recognition. arXiv.
11. Show Your Work: Scratchpads for Intermediate Computation with Language Models
12. Wang, T. (2023). Research on Multilingual Natural Scene Text Detection Algorithm. arXiv.
13. Augmenting Scene Text Detection with Synthetic Data Using GANs
14. Feature Pyramid Networks for Object Detection
15. Panoptic Feature Pyramid Networks
16. Fully Convolutional Networks for Semantic Segmentation
17. Wei, J., Wang, X., Schuurmans, D., Le, Q.V., Chi, E.H., and Zhou, D. (2022). Chain of Thought Prompting Elicits Reasoning in Large Language Models. arXiv.
18. Language Models are Few-Shot Learners