Deep Learning Based Audio Assistive System for Visually Impaired People
Source abstract
Abstract
Vision impairment is a latent problem that affects numerous people across the globe. Technological advancements, particularly the rise of computer processing abilities like Deep Learning (DL) models and emergence of wearables pave a way for assisting visually-impaired persons. The models developed earlier specifically for visually-impaired people work effectually on single object detection in unconstrained environment. But, in real-time scenarios, these systems are inconsistent in providing effective guidance for visually-impaired people. In addition to object detection, extra information about the location of objects in the scene is essential for visually-impaired people. Keeping this in mind, the current research work presents an Efficient Object Detection Model with Audio Assistive System (EODM-AAS) using DL-based YOLO v3 model for visually-impaired people. The aim of the research article is to construct a model that can provide a detailed description of the objects around visually-impaired people. The presented model involves a DL-based YOLO v3 model for multi-label object detection. Besides, the presented model determines the position of object in the scene and finally generates an audio signal to notify the visually-impaired people. In order to validate the detection performance of the presented method, a detailed simulation analysis was conducted on four datasets. The simulation results established that the presented model produces effectual outcome over existing methods.
Source: openalex_inverted_index · Quality: baseline
Research context
OpenAlex topics: Currency Recognition and Detection · Tactile and Sensory Interactions · Smart Agriculture and AI
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
References (24)
Show source-provided references
1. Alexa, siri, cortana, and more: An introduction to voice assistants10.1080/02763869.2018.1404391 ↗
2. Robust and effective component-based banknote recognition for the blind10.1109/TSMCC.2011.2178120 ↗
3. Detecting and reading text in natural scenes
4. Plane-based detection of staircases using inverse depth
5. Rapid object detection using a boosted cascade of simple features
6. Simple smartphone-based guiding system for visually impaired people10.3390/s17061371 ↗
7. Depth map based reactive planning to aid in navigation for visually challenged
8. An indoor obstacle detection system using depth information and region growth10.3390/s151027116 ↗
9. A wearable mobility aid for the visually impaired based on embedded 3D vision and deep learning
10. Indoor assistance for visually impaired people using a RGB-D camera
11. Obstacle detection for pedestrians with a visual impairment based on 3D imaging
12. Obstacle detection and warning system for visually impaired people based on electrode matrix and mobile kinect10.1007/s40595-016-0075-z ↗
13. Obstacle classification through acoustic echolocation
14. Kinect cane: Object recognition aids for the visually impaired
15. Object detection using machine learning for visually impaired people10.31782/IJCRR.2020.122032 ↗
16. Deep learning based object detection and recognition framework for the visually-impaired
17. Real-time object detection for visually challenged people
18. SlimYOLOv3: Narrower, faster and better for real-time uav applications
19. Deep learning approach to peripheral leukocyte recognition10.1371/journal.pone.0218808 ↗
20. J. R. Darknet, “Open source neural networks in c,” 2016. [Online]. Available: http://pjreddie.com/darknet/.
21. Object detection algorithm based on improved YOLOv310.3390/electronics9030537 ↗
22. “Dataset,” 2021. [Online]. Available: http://cvlab.hanyang.ac.kr/trackerbenchmark/datasets.html. (Accessed on Feb 10, 2021)
23. Assisting the visually impaired in multi-object scene description using OWA-based fusion of CNN models10.1007/s13369-020-04799-7 ↗
24. Deep multi-layer perceptron-based obstacle classification method from partial visual information: Application to the assistance of visually impaired people10.1109/ACCESS.2020.2970979 ↗