journal article·2022-01-05Open access

Indoor-Guided Navigation for People Who Are Blind: Crowdsourcing for Route Mapping and Assistance

Darius Plikynas, Audrius Indriulionis, Algirdas Laukaitis, Leonidas Sakalauskas

Applied Sciences· Volume 12· Issue 1

Abstract

This paper presents an approach to enhance electronic traveling aids (ETAs) for people who are blind and severely visually impaired (BSVI) using indoor orientation and guided navigation by employing social outsourcing of indoor route mapping and assistance processes. This type of approach is necessary because GPS does not work well, and infrastructural investments are absent or too costly to install for indoor navigation. Our approach proposes the prior outsourcing of vision-based recordings of indoor routes from an online network of seeing volunteers, who gather and constantly update a web cloud database of indoor routes using specialized sensory equipment and web services. Computational intelligence-based algorithms process sensory data and prepare them for BSVI usage. In this way, people who are BSVI can obtain ready-to-use access to the indoor routes database. This type of service has not previously been offered in such a setting. Specialized wearable sensory ETA equipment, depth cameras, smartphones, computer vision algorithms, tactile and audio interfaces, and computational intelligence algorithms are employed for that matter. The integration of semantic data of points of interest (such as stairs, doors, WC, entrances/exits) and evacuation schemes could make the proposed approach even more attractive to BVSI users. Presented approach crowdsources volunteers’ real-time online help for complex navigational situations using a mobile app, a live video stream from BSVI wearable cameras, and digitalized maps of buildings’ evacuation schemes.
Source: crossref · Quality: baseline

Research context

OpenAlex topics: Tactile and Sensory Interactions · Indoor and Outdoor Localization Technologies · Video Surveillance and Tracking Methods

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

Department of Business Technologies and Entrepreneurship, Vilnius Gediminas Technical University, 10223 Vilnius, Lithuania

Department of Information Systems, Vilnius Gediminas Technical University, 10223 Vilnius, Lithuania

Faculty of Natural Sciences, Klaipeda University, 92294 Klaipeda, Lithuania

Funding

European Regional Development Fund under grant agreement with the Research Council of Lithuania

References (31)

Show source-provided references
1. Plikynas, D., Žvironas, A., Budrionis, A., and Gudauskis, M. (2020). Indoor navigation systems for visually impaired persons: Mapping the features of existing technologies to user needs. Sensors, 20.10.3390/s20030636 ↗
2. A survey of assistive technologies and applications for blind users on mobile platforms: A review and foundation for research10.1007/s12193-015-0182-7 ↗
3. A survey on the use of mobile applications for people who are visually impaired10.1177/0145482X1711100402 ↗
4. An integrated artificial vision framework for assisting visually impaired users10.1016/j.cviu.2015.11.007 ↗
5. Tapu, R., Mocanu, B., Bursuc, A., and Zaharia, T. (2013, January 2–8). A smartphone-based obstacle detection and classification system for assisting visually impaired people. Proceedings of the IEEE International Conference on Computer Vision Workshops, Sydney, NSW, Australia.10.1109/ICCVW.2013.65 ↗
6. Research advances of indoor navigation for blind people: A brief review of technological instrumentation10.1109/MIM.2020.9126068 ↗
7. Methods and techniques of adaptive web accessibility for the blind and visually impaired10.1016/j.sbspro.2015.06.214 ↗
8. Ferati, M., Raufi, B., Kurti, A., and Vogel, B. (2014, January 25). Accessibility requirements for blind and visually impaired in a regional context: An exploratory study. Proceedings of the 2014 IEEE 2nd International Workshop on Usability and Accessibility Focused Requirements Engineering (UsARE), Karlskrona, Sweden.10.1109/UsARE.2014.6890995 ↗
9. Design of a social collaboration and precise localization services for the blind and visually impaired10.1016/j.procs.2013.09.037 ↗
10. Brady, E.L., Zhong, Y., Morris, M.R., and Bigham, J.P. (2013, January 23). Investigating the appropriateness of social network question asking as a resource for blind users. Proceedings of the Conference on Computer Supported Cooperative Work, San Antonio, TX, USA.10.1145/2441776.2441915 ↗
11. A desktop usability evaluation of the facebook mobile interface using the jaws screen reader with blind users
12. Wu, S., and Adamic, L.A. (May, January 26). Visually impaired users on an online social network. Proceedings of the Sigchi Conference on Human Factors in Computing Systems, Toronto, ON, Canada.
13. Voykinska, V., Azenkot, S., Wu, S., and Leshed, G. (March, January 27). How blind people interact with visual content on social networking services. Proceedings of the 19th ACM Conference on Computer-Supported Cooperative Work & Social Computing, San Francisco, CA, USA.
14. Qiu, S., Hu, J., and Rauterberg, M. (2015, January 12–14). Mobile social media for the blind: Preliminary observations. Proceedings of the International Conference on Enabling Access for Persons with Visual Impairment, Athens, Greece.
15. Teenagers with visual impairment and new media: A world without barriers10.1177/0264619617711732 ↗
16. Tjostheim, I., Solheim, I., and Fuglerud, K.S. (2011). The importance of peers for visually impaired users of social media. (746) Internet and Multimedia Systems and Applications/747: Human-Computer Interaction, Norwegian Computing.10.2316/P.2011.747-015 ↗
17. Avila, M., Wolf, K., Brock, A., and Henze, N. (July, January 29). Remote assistance for blind users in daily life: A survey about be my eyes. Proceedings of the 9th ACM International Conference on Pervasive Technologies Related to Assistive Environments, Corfu Island, Greece.
18. Feasibility Study of Intersection Detection and Recognition Using a Single Shot Image for Robot Navigation10.18178/joig.9.2.39-44 ↗
19. Robust Japanese Road Sign Detection and Recognition in Complex Scenes Using Convolutional Neural Networks10.18178/joig.8.3.59-66 ↗
20. Estimation of visual motion parameters used for bio-inspired navigation10.12720/joig.1.3.120-124 ↗
21. Target Detection Algorithms in Hyperspectral Imaging Based on Discriminant Analysis10.18178/joig.7.4.140-144 ↗
22. Rizdania Combining Multiple Feature for Robust Traffic Sign Detection10.18178/joig.8.2.53-58 ↗
23. A Technique for the Measurement of Attitudes
24. Sheepy, E., and Salenikovich, S. (2013, January 21). Technological support for mobility and orientation training: Development of a smartphone navigation aid. Proceedings of the E-Learn.: World Conference on E-Learning in Corporate, Government, Healthcare, and Higher Education, Las Vegas, NV, USA.
25. Karlsson, N., Di Bernardo, E., Ostrowski, J., Goncalves, L., Pirjanian, P., and Munich, M.E. (2005, January 18–22). The vSLAM algorithm for robust localization and mapping. Proceedings of the 2005 IEEE International Conference on Robotics and Automation, Barcelona, Spain.
26. Karimi, H.A., Zimmerman, B., Ozcelik, A., and Roongpiboonsopit, D. (2009, January 3). SoNavNet: A framework for social navigation networks. Proceedings of the 2009 International Workshop on Location Based Social Networks, Seattle, WA, USA.10.1145/1629890.1629908 ↗
27. Vítek, S., Klíma, M., Husník, L., and Spirk, D. (2011, January 7–8). New Possibilities for Blind People Navigation. Proceedings of the 2011 International Conference on Applied Electronics, Pilsen, Czech Republic.
28. Show and tell: Lessons learned from the 2015 mscoco image captioning challenge10.1109/TPAMI.2016.2587640 ↗
29. Laganiere, R., and Akhoury, S. (2013, January 9–13). Training Binary Descriptors for Improved Robustness and Efficiency in Real-Time Matching. Proceedings of the International Conference on Image Analysis and Processing, Naples, Italy.
30. Tafti, A.P., Baghaie, A., Assefi, M., Arabnia, H.R., Yu, Z., and Peissig, P. (2016). OCR as a service: An experimental evaluation of Google Docs OCR, Tesseract, ABBYY FineReader, and Transym. International Symposium on Visual Computing, Springer International Publishing.10.1007/978-3-319-50835-1_66 ↗
31. ORB-SLAM3: An Accurate Open-Source Library for Visual, Visual–Inertial, and Multimap SLAM10.1109/TRO.2021.3075644 ↗