Real-Time Object Detection and Face Recognition Application for the Visually Impaired
Source abstract
Abstract
The advancement of navigation systems for the visually impaired has significantly enhanced their mobility by mitigating the risk of encountering obstacles and guiding them along safe, navigable routes. Traditional approaches primarily focus on broad applications such as wayfinding, obstacle detection, and fall prevention. However, there is a notable discrepancy in applying these technologies to more specific scenarios, like identifying distinct food crop types or recognizing faces. This study proposes a real-time application designed for visually impaired individuals, aiming to bridge this research-application gap. It introduces a system capable of detecting 20 different food crop types and recognizing faces with impressive accuracies of 83.27% and 95.64%, respectively. These results represent a significant contribution to the field of assistive technologies, providing visually impaired users with detailed and relevant information about their surroundings, thereby enhancing their mobility and ensuring their safety. Additionally, it addresses the vital aspects of social engagements, acknowledging the challenges faced by visually impaired individuals in recognizing acquaintances without auditory or tactile signals, and highlights recent developments in prototype systems aimed at assisting with face recognition tasks. This comprehensive approach not only promises enhanced navigational aids but also aims to enrich the social well-being and safety of visually impaired communities.
Source: openalex_inverted_index · Quality: baseline
Research context
OpenAlex topics: Innovation in Digital Healthcare Systems · Image and Video Stabilization · Industrial Vision Systems and Defect Detection
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
References (38)
Show source-provided references
1. “Republic of Korea–World Blind Union–Asia Pacific,” 2018. Accessed: Dec. 20, 2022. [Online]. Available: https://wbuap.org/archives/category/countries/republic-of-korea
2. “Korean disabled people’s development institute (KODDI),” 2019. Accessed: Dec. 20, 2022. [Online]. Available: https://www.koddi.or.kr/eng/greeting.jhtml
3. Cognitive impact evaluation of multimodal interfaces for blind people: Towards a systematic review
4. Autonomous scooter navigation for people with mobility challenges
5. Real-time family member recognition using Raspberry Pi for visually impaired people
6. YOLOv7: Trainable bag-of-freebies sets new state-of-the-art for real-time object detectors
7. Fruits and vegetables detection for blind people
8. CICERONE- A real time object detection for visually impaired people
9. J. Redmon and A. Farhadi, “YOLOv3: An incremental improvement,” arXiv.1804.02767, Apr. 2018.
10. A comprehensive and systematic look up into deep learning-based object detection techniques: A review
11. A review of object detection based on deep learning10.1007/s11042-020-08976-6 ↗
12. Integrating traditional machine learning and neural networks for image processing
13. Object detection system for the blind with voice guidance
14. Microsoft COCO: Common objects in context
15. A survey of modern deep learning based object detection models10.1016/j.dsp.2022.103514 ↗
16. Lin · Let Blind People See: Real-Time Visual Recognition with Results Converted to 3D Audio · 2016
17. Privacy concerns and behaviors of people with visual impairments
18. Facial expression recognition based on local binary patterns: A comprehensive study10.1016/j.imavis.2008.08.005 ↗
19. Social problem-solving abilities and psychological adjustment of persons in low vision rehabilitation10.1037/0090-5550.50.3.232 ↗
20. S. Chaudhry and R. Chandra, “Design of a mobile face recognition system for visually impaired persons,” arXiv:1502.00756, Feb. 2015.
21. Who is here: Location aware face recognition
22. Smartphone based face recognition tool for the blind
23. A face recognition application for people with visual impairments: Understanding use beyond the lab
24. A systematic requirements analysis and development of an assistive device to enhance the social interaction of people who are blind or visually impaired
25. Face recognition system based on CNN
26. LBPH algorithm for frontal and side profile face recognition on GPU
27. Face recognition using eigenface algorithm on laptop camera
28. Face and facial expressions recognition system for blind people using ResNet50 architecture and CNN10.33093/jiwe.2023.2.2.20 ↗
29. P. Junseok, “Image data for small object detection,” 2021. Accessed: Oct. 21, 2022. [Online]. Available: https://bit.ly/aihub_small_object
30. Learning non-maximum suppression
31. YOLO9000: Better, faster, stronger
32. You only look once: Unified, real-time object detection
33. A. Bochkovskiy, C. Wang, and H. Y. M. Liao, “YOLOv4: Optimal speed and accuracy of object detection,” arXiv:2004.10934, Apr. 2020.
34. J. Glenn, “YOLOv5,” 2022. Accessed: Oct. 22, 2022. [Online]. Available: https://github.com/ultralytics/yolov5.
35. C. Li et al., “YOLOv6: A single-stage object detection framework for industrial applications,” arXiv:2004.10934, Sep. 2022.
36. Fast R-CNN
37. Faster R-CNN: Towards real-time object detection with region proposal networks
38. Z. Ge, S. Liu, F. Wang, Z. Li, and J. Sun, “YOLOX: Exceeding YOLO series in 2021,” arXiv:2107.08430, 2021.