Making Shopping Easy for People with Visual Impairment Using Mobile Assistive Technologies
Source abstract
Abstract
People with visual impairment face various difficulties in their daily activities in comparison to people without visual impairment. Much research has been done to find smart solutions using mobile devices to help people with visual impairment perform tasks like shopping. One of the most challenging tasks for researchers is to create a solution that offers a good quality of life for people with visual impairment. It is also essential to develop solutions that encourage people with visual impairment to participate in social life. This study provides an overview of the various technologies that have been developed in recent years to assist people with visual impairment in shopping tasks. It gives an introduction to the latest direction in this area, which will help developers to incorporate such solutions into their research.
Source: crossref · Quality: baseline
Research context
OpenAlex topics: Tactile and Sensory Interactions · Smart Parking Systems Research · Gaze Tracking and Assistive Technology
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
Affiliations
Department of Electrical Engineering and Information Systems, University of Pannonia, 8200 Veszprém, Hungary
Department of Computer Science, Faculty of Computers and Informatics, Benha University, 13511 Benha, Egypt
Department of Organizational Systems and Adult Health, University of Maryland, Baltimore, MD 21201, USA
References (96)
Show source-provided references
1. (2018, December 23). What is Visual Impairment?. Available online: https://www.news-medical.net/health/What-is-visual-impairment.aspx.
2. World blindness and visual impairment: Despite many successes, the problem is growing
3. The Need for Heaith Promotion for Aduits Who Are Visuaiiy impaired
4. Mind the Gap: Why do people act environmentally and what are the barriers to pro-environmental behavior10.1080/13504620220145401 ↗
5. Montello, D.R. (2018). Navigating without Vision: Principles of Blind Spatial Cognition. Handbook of Behavioral and Cognitive Geography, Publisher.10.4337/9781784717544 ↗
6. Indoor Spatial Updating with Impaired Vision10.1167/iovs.16-20226 ↗
7. Spatial navigation by congenitally blind individuals10.1002/wcs.1375 ↗
8. Yuan, C.W., Hanrahan, B.V., Lee, S., Rosson, M.B., and Carroll, J.M. (2017). Constructing a holistic view of shopping with people with visual impairment: a participatory design approach. Univers. Access. Inf. Soc., 1–14. Available online: http://link.springer.com/10.1007/s10209-017-0577-1.10.1007/s10209-017-0577-1 ↗
9. Wong, E.J., Yap, K.M., Alexander, J., and Karnik, A. (2016, January 24–26). HABOS: Towards a platform of haptic-audio based online shopping for the visually impaired. Proceedings of the ICOS 2015—2015 IEEE Conference on Open Systems, Bandar Melaka, Malaysia.10.1109/ICOS.2015.7377279 ↗
10. The limitations of using activity space measurements for representing the mobilities of individuals with visual impairment: A mixed methods case study in the San Francisco Bay Area10.1016/j.jtrangeo.2017.12.004 ↗
11. Food shopping, sensory determinants of food choice and meal preparation by visually impaired people. Obstacles and expectations in daily food experiences10.1016/j.appet.2017.02.008 ↗
12. An Experimental Investigation into Wayfinding Directions for Visually Impaired People10.1007/s00779-005-0350-y ↗
13. Gaze Behavior of the Visually Impaired During Street Crossing10.1097/01.opx.0000232219.23362.a6 ↗
14. Utilizing sensors networks to develop a smart and context-aware solution for people with disabilities at the workplace (design and implementation)10.1177/1550147716658606 ↗
15. Exploring the Interdependence between Visually Impaired and Sighted People in the Early Phase of Friendship10.21776/ub.IJDS.2018.005.01.13 ↗
16. What explains health in persons with visual impairment?10.1186/1477-7525-12-65 ↗
17. An insight into assistive technology for the visually impaired and blind people: state-of-the-art and future trends10.1007/s12193-016-0235-6 ↗
18. Elgendy, M.A., Shawish, A., and Moussa, M.I. (2014, January 27–29). MCACC: New approach for augmenting the computing capabilities of mobile devices with Cloud Computing. Proceedings of the IEEE Science and Information Conference, London, UK.10.1109/SAI.2014.6918175 ↗
19. A review on distributed application processing frameworks in smart mobile devices for mobile cloud computing10.1109/SURV.2012.111412.00045 ↗
20. An efficient and secured framework for mobile cloud computing
21. Real-time mobile-cloud computing for context-aware blind navigation
22. Bai, J., Liu, D., Su, G., and Fu, Z. (2017, January 7–9). A cloud and vision-based navigation system used for blind people. Proceedings of the International Conference on Artificial Intelligence, Automation and Control Technologies, Wuhan, China.10.1145/3080845.3080867 ↗
23. Habiba, U., Barua, S., Ahmed, F., Dey, G.K., and Ahmmed, K.T. (2015, January 10–12). 3rd Hand: A device to support elderly and disabled person. Proceedings of the 2nd International Conference on Electrical Information and Communication Technology (EICT), Khulna, Bangladesh.10.1109/EICT.2015.7391912 ↗
24. An overview of the Internet of Things for people with disabilities10.1016/j.jnca.2011.10.015 ↗
25. Visual Impairments and Mobile Touchscreen Interaction: State-of-the-Art, Causes of Visual Impairment, and Design Guidelines10.1080/10447318.2017.1279827 ↗
26. A Systematic Literature Review of the Application of Information Communication Technology for Visually Impaired People
27. A survey of assistive technologies and applications for blind users on mobile platforms: a review and foundation for research10.1007/s12193-015-0182-7 ↗
28. A Survey on Hardware and Software Solutions for Multimodal Wearable Assistive Devices Targeting the Visually Impaired
29. Elgendy, M., and Lanyi, C.S. (2018, January 11–13). Review on Smart Solutions for People with Visual Impairment. Proceedings of the International Conference on Computers for Handicapped Persons (ICCHP) Conference, Linz, Austria.10.1007/978-3-319-94277-3_15 ↗
30. Elmannai, W., and Elleithy, K. (2017). Sensor-based assistive devices for visually-impaired people: Current status, challenges, and future directions. Sensors, 17.10.3390/s17030565 ↗
31. Mobile assistive technologies for the visually impaired10.1016/j.survophthal.2012.10.004 ↗
32. Ahmadi, H., Arji, G., Shahmoradi, L., Safdari, R., Nilashi, M., and Alizadeh, M. (2018). The application of internet of things in healthcare: a systematic literature review and classification. Universal Access Inf. Soc., 1–33. Available online: https://link.springer.com/article/10.1007/s10209-018-0618-4.10.1007/s10209-018-0618-4 ↗
33. Towards an efficient indoor navigation system: a near field communication approach
34. Accessible Shopping Systems for Blind and Visually Impaired Individuals: Design Requirements and the State of the Art10.2174/1874943701003010158 ↗
35. (2019, March 12). PRISMA guidelines. Available online: http://prisma-statement.org/PRISMAStatement/FlowDiagram.aspx.
36. (2018, December 03). Blind people and the World Wide Web. Available online: https://www.webbie.org.uk/webbie.htm.
37. Virtualeyez, A.M. (2014). Developing Nfc Technology to Enable the Visually Impaired to Shop Independently. [Master Thesis, Dalhousie University].
38. A State-of-the-Art Survey of Indoor Positioning and Navigation Systems and Technologies
39. Wearable Obstacle Avoidance Electronic Travel Aids for Blind: A Survey10.1109/TSMCC.2009.2021255 ↗
40. Television, computer and portable display device use by people with central vision impairment10.1111/j.1475-1313.2011.00833.x ↗
41. Third Eye: A Shopping Assistant for the Visually Impaired
42. Designing smartglasses applications for people with low vision10.1145/3167902.3167905 ↗
43. Jafri, R., and Ali, S.A. (2014, January 9–11). A Multimodal Tablet–Based Application for the Visually Impaired for Detecting and Recognizing Objects in a Home Environment. Proceedings of the International Conference on Computers for Handicapped Persons (ICCHP) Conference, Paris, France.10.1007/978-3-319-08596-8_55 ↗
44. Computer vision-based object recognition for the visually impaired in an indoors environment: A survey10.1007/s00371-013-0886-1 ↗
45. Szpiro, S., Zhao, Y., and Azenkot, S. (2016, January 12–16). Finding a store, searching for a product. Proceedings of the ACM International Joint Conference on Pervasive and Ubiquitous Computing—UbiComp, Heidelberg, Germany.10.1145/2971648.2971723 ↗
46. Symbol detection in low-resolution images using a novel method10.14257/ijca.2014.7.12.14 ↗
47. An Object Recognition Method Based on the Improved Convolutional Neural Network10.1166/jctn.2016.4888 ↗
48. Expressing and defining self and relationships through everyday shopping experiences10.1016/j.jbusres.2015.08.016 ↗
49. An enhanced text detection technique for the visually impaired to read text10.1007/s10796-016-9699-x ↗
50. Stearns, L., Du, R., Oh, U., Wang, Y., Findlater, L., Chellappa, R., and Froehlich, J.E. (2014, January 6–12). The design and preliminary evaluation of a finger-mounted camera and feedback system to enable reading of printed text for the blind. Proceedings of the European Conference on Computer Vision, Zurich, Switzerland.
51. A bidirectional text transcription of braille for odia, hindi, telugu and english via image processing on FPGA
52. Sakai, T., Matsumoto, T., Takeuchi, Y., Kudo, H., and Ohnishi, N. (2015, January 12–14). A Mobile System of Reading out Restaurant Menus for Blind People. Proceedings of the International Conference on Enabling Access for Persons with Visual Impairment, Athens, Greece.
53. Ani, R., Maria, E., Joyce, J.J., Sakkaravarthy, V., and Raja, M.A. (2017, January 16–18). Smart Specs: Voice assisted text reading system for visually impaired persons using TTS method. Proceedings of the Innovations in Green Energy and Healthcare Technologies (IGEHT), Coimbatore, India.10.1109/IGEHT.2017.8094103 ↗
54. A unit selection text-to-speech synthesis system optimized for use with screen readers10.1109/TCE.2010.5606343 ↗
55. Andò, B., Baglio, S., Marletta, V., Crispino, R., and Pistorio, A. (2018). A Measurement Strategy to Assess the Optimal Design of an RFID-Based Navigation Aid. IEEE Trans. Instrum. Meas., 1–7. Available online: https://ieeexplore.ieee.org/abstract/document/8540063.10.1109/TIM.2018.2879069 ↗
56. McDaniel, T.L., Kahol, K., Villanueva, D., and Panchanathan, S. (2008, January 1–14). Integration of RFID and computer vision for remote object perception for individuals who are blind. Proceedings of the Ambi-Sys Workshop on Haptic User Interfaces in Ambient Media Systems, Quebec City, QC, Canada.10.4108/ICST.AMBISYS2008.2902 ↗
57. López-de-Ipiña, D., Lorido, T., and López, U. (2011, January 20–22). BlindShopping: Enabling accessible shopping for visually impaired people through mobile technologies. Proceedings of the International Conference on Smart Homes and Health Telematics, Montreal, QC, Canada.10.1007/978-3-642-21535-3_39 ↗
58. Fernandes, H., Costa, P., Paredes, H., Filipe, V., and Barroso, J. (2014, January 22–27). Integrating computer vision object recognition with location based services for the blind. Proceedings of the International Conference on Universal Access in Human-Computer Interaction, Crete, Greece.10.1007/978-3-319-07446-7_48 ↗
59. An enhanced obstacle avoidance method for the visually impaired using deformable grid10.1109/TCE.2017.014832 ↗
60. A novel obstacle detection method based on deformable grid for the visually impaired10.1109/TCE.2015.7298298 ↗
61. Medeiros, V.U.S., Araújo, R.P., Silva, R.L.A., and Slaets, A.F.F. (2014, January 29–31). Device for Location Assistance and Identification of Products in a Closed Enviroment. In Proceeding of the VI Latin American Congress on Biomedical Engineering CLAIB, Paraná, Argentina.10.1007/978-3-319-13117-7_251 ↗
62. Using Augmented Reality and Internet of Things to improve accessibility of people with motor disabilities in the context of Smart Cities10.1016/j.future.2016.11.030 ↗
63. (2018, December 23). RFID versus NFC: What’s the Difference between NFC and RFID?. Available online: https://blog.atlasrfidstore.com/rfid-vs-nfc.
64. Evolution of RFID applications in construction: A literature review10.3390/s150715988 ↗
65. (2018, December 02). Active RFID vs. Passive RFID: What’s the Difference?. Available online: https://blog.atlasrfidstore.com/active-rfid-vs-passive-rfid.
66. Kornsingha, T., and Punyathep, P. (2011, January 17–18). A voice system, reading medicament label for visually impaired people. Proceedings of the RFID SysTech 7th European Workshop, Smart Objects: Systems, Technologies and Applications, Dresden, Germany.
67. Mathankumar, M., and Sugandhi, N. (2013, January 22–25). A low cost smart shopping facilitator for visually impaired. Proceedings of the Advances in Computing, Communications and Informatics (ICACCI) International Conference, Mysore, India.10.1109/ICACCI.2013.6637328 ↗
68. Shopping by Blind People: Detection of Interactions in Ambient Assisted Living Environments using RFID
69. Location based services for the blind supported by RFID technology10.1016/j.procs.2014.02.002 ↗
70. An indoor navigation system for visually impaired and elderly people based on Radio Frequency Identification (RFID)10.1016/j.ins.2014.08.011 ↗
71. (2018, December 02). What’s an NFC Tag?. Available online: https://electronics.howstuffworks.com/nfc-tag.htm.
72. NFC internal: An indoor navigation system10.3390/s150407571 ↗
73. Ozdenizci, B., Ok, K., Coskun, V., and Aydin, M.N. (2011, January 25–27). Development of an indoor navigation system using NFC technology. Proceedings of the Information and Computing (ICIC) International Conference, Phuket Island, Thailand.10.1109/ICIC.2011.53 ↗
74. Jafri, R., Ali, S.A., and Arabnia, H.R. (July, January ). Computer Vision-based Object Recognition for the Visually Impaired Using Visual Tags. Proceedings of the International Conference on Image Processing, Computer Vision, Las Vegas, NV, USA.
75. Zhang, H., Zhang, C., Yang, W., and Chen, C.Y. (2015, January 6–9). Localization and navigation using QR code for mobile robot in indoor environment. Proceedings of the IEEE International Conference on Robotics and Biomimetics (ROBIO), Zhuhai, China.10.1109/ROBIO.2015.7419715 ↗
76. Zhao, Y., Szpiro, S., Knighten, J., and Azenkot, S. (2016, January 12–16). CueSee: Exploring visual cues for people with low vision to facilitate a visual search task. Proceedings of the ACM International Joint Conference on Pervasive and Ubiquitous Computing, Heidelberg, Germany.10.1145/2971648.2971730 ↗
77. Kutiyanawala, A., and Kulyukin, V. (2010, January 12–15). Eyes-free barcode localization and decoding for visually impaired mobile phone users. Proceedings of the International Conference on Image Processing, Computer Vision and Pattern Recognition, Las Vegas, NV, USA.
78. Lee, S.J., Lim, J., Tewolde, G., and Kwon, J. (2014, January 5–7). Autonomous tour guide robot by using ultrasonic range sensors and QR code recognition in indoor environment. Proceedings of the IEEE International Conference on Electro/Information Technology, Milwaukee, WI, USA.10.1109/EIT.2014.6871799 ↗
79. Ebsar: Indoor guidance for the visually impaired10.1016/j.compeleceng.2016.07.015 ↗
80. Portable camera-based assistive text and product label reading from hand-held objects for blind persons10.1109/TMECH.2013.2261083 ↗
81. Recovering the sight to blind people in indoor environments with smart technologies10.1016/j.eswa.2015.09.054 ↗
82. Kinect cane: An assistive system for the visually impaired based on the concept of object recognition aid10.1007/s00779-015-0841-4 ↗
83. A Multitask Grocery Assist System for the Visually Impaired: Smart glasses, gloves, and shopping carts provide auditory and tactile feedback10.1109/MCE.2016.2614422 ↗
84. Kumar, R., and Meher, S. (2015, January 2–4). A Novel method for visually impaired using object recognition. Proceedings of the International Conference on Communications and Signal Processing (ICCSP), Melmaruvathur, India.10.1109/ICCSP.2015.7322596 ↗
85. Navigation Assistance for the Visually Impaired Using RGB-D Sensor with Range Expansion10.1109/JSYST.2014.2320639 ↗
86. Visual and Infrared Sensor Data-Based Obstacle Detection for the Visually Impaired Using the Google Project Tango Tablet Development Kit and the Unity Engine10.1109/ACCESS.2017.2766579 ↗
87. Obstacle detection and warning system for visually impaired people based on electrode matrix and mobile Kinect10.1007/s40595-016-0075-z ↗
88. López-de-Ipiña, D., Lorido, T., and López, U. (2011, January 8–10). Indoor navigation and product recognition for blind people assisted shopping. Proceedings of the International Workshop on Ambient Assisted Living (IWAAL), Torremolinos-Málaga, Spain.10.1007/978-3-642-21303-8_5 ↗
89. Designing Equal Participation in Informal Learning for People with Visual Impairment
90. Recent advances in wireless indoor localization techniques and system10.1155/2013/185138 ↗
91. Helal, A., Mokhtari, M., and Abdulrazak, B. (2008). Blind Navigation and the Role of Technology. The Engineering Handbook of Smart Technology for Aging, Disability, and Independence, John Wiley & Sons.10.1002/9780470379424 ↗
92. Lanigan, P.E., Paulos, A.M., Williams, A.W., Rossi, D., and Narasimhan, P. (2006, January 11–14). Trinetra: Assistive technologies for grocery shopping for the blind. Proceedings of the International Symposium on Wearable Computers, ISWC, Montreux, Switzerland.10.1109/ISWC.2006.286369 ↗
93. Billah, S.M., Ashok, V., and Ramakrishnan, I.V. (2018, January 7–11). Write-it-Yourself with the Aid of Smartwatches: A Wizard-of-Oz Experiment with Blind People. Proceedings of the 23rd International Conference on Intelligent User Interfaces, Tokyo, Japan.10.1145/3172944.3173005 ↗
94. A smart reader for visually impaired people using Raspberry pi
95. (2019, February 01). Web Content Accessibility Guidelines (WCAG) Overview|Web Accessibility Initiative (WAI)|W3C. Available online: https://www.w3.org/WAI/standards-guidelines/wcag/.
96. (2019, February 01). About the Section 508 Standards—United States Access Board, Available online: https://www.access-board.gov/guidelines-and-standards/communications-and-it/about-the-section-508-standards.