Enhancing Street-Crossing Safety for Visually Impaired Pedestrians with Haptic and Visual Feedback
Source abstract
Abstract
Safe street crossing poses significant challenges for visually impaired pedestrians, who must rely on non-visual cues to assess crossing safety. Conventional assistive technologies often fail to provide real-time, actionable information about oncoming traffic, making independent navigation difficult, particularly in uncontrolled or vehicle-based crossing scenarios. To address these challenges, we designed and evaluated two assistive systems utilizing haptic and visual feedback, tailored for traffic signal-controlled intersections and vehicle-based crossings. The results indicate that visual feedback significantly improved decision efficiency at signalized intersections, enabling users to make faster decisions, regardless of their confidence levels. However, in vehicle-based crossings, where real-time hazard assessment is crucial, haptic feedback proved more effective, enhancing decision efficiency by enabling quicker and more intuitive judgments about approaching vehicles. Moreover, users generally preferred haptic feedback in both scenarios, citing its comfort and intuitiveness. These findings highlight the distinct challenges posed by different street-crossing environments and confirm the value of multimodal feedback systems in supporting visually impaired pedestrians. Our study provides important design insights for developing effective assistive technologies that enhance pedestrian safety and independence across varied urban settings.
Source: crossref · Quality: baseline
Research context
OpenAlex topics: Tactile and Sensory Interactions · Safety Warnings and Signage · Visual perception and processing mechanisms
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
Affiliations
School of Design Arts, Xiamen University of Technology, Xiamen 361024, China
Department of Human-Centered AI, Sangmyung University, Seoul 03016, Republic of Korea
Institute for Advanced Intelligence Study, Daejeon 34189, Republic of Korea
Funding
Korea Institute of Police Technology · HAII Corporation · Fujian Provincial Lifelong Education Quality Improvement Project · Fujian Province Social Science Foundation
References (97)
Show source-provided references
1. World Health Organization (2019). World Report on Vision, World Health Organization. Technical Report.
2. Intraocular retinal prosthesis10.1109/MEMB.2006.1705748 ↗
3. Morley, J.W., Chowdhury, V., and Coroneo, M.T. (2007). Visual Cortex and Extraocular Retinal Stimulation with Surface Electrode Arrays. Visual Prosthesis and Ophthalmic Devices, Humana Press.10.1007/978-1-59745-449-0_11 ↗
4. Dynamic Crosswalk Scene Understanding for the Visually Impaired10.1109/TNSRE.2021.3096379 ↗
5. Assistive technology in smart cities: A case of street crossing for the visually-impaired10.1016/j.techsoc.2021.101805 ↗
6. Are normally sighted, visually impaired, and blind pedestrians accurate and reliable at making street crossing decisions?10.1167/iovs.11-9340 ↗
7. Driver behavior in yielding to sighted and blind pedestrians at roundabouts10.1177/0145482X0509900504 ↗
8. Ihejimba, C., and Wenkstern, R.Z. (October, January 28). DetectSignal: A Cloud-Based Traffic Signal Notification System for the Blind and Visually Impaired. Proceedings of the 2020 IEEE International Smart Cities Conference (ISC2), Piscataway, NJ, USA.10.1109/ISC251055.2020.9239004 ↗
9. Ahmetovic, D., Gleason, C., Ruan, C., Kitani, K., Takagi, H., and Asakawa, C. (2016, January 6–9). NavCog: A navigational cognitive assistant for the blind. Proceedings of the 18th International Conference on Human-Computer Interaction with Mobile Devices and Services, Florence, Italy.10.1145/2935334.2935361 ↗
10. An insight into smartphone-based assistive solutions for visually impaired and blind people: Issues, challenges and opportunities10.1007/s10209-020-00733-8 ↗
11. Smartphone-based computer vision travelling aids for blind and visually impaired individuals: A systematic review10.1080/10400435.2020.1743381 ↗
12. See, A.R., Sasing, B.G., and Advincula, W.D. (2022). A smartphone-based mobility assistant using depth imaging for visually impaired and blind. Appl. Sci., 12.10.3390/app12062802 ↗
13. Low cost GPS and GSM based navigational aid for visually impaired people10.1007/s11277-016-3622-0 ↗
14. Bhatnagar, A., Ghosh, A., and Florence, S.M. (2022, January 26–27). Android integrated voice based walking stick for blind with obstacle recognition. Proceedings of the 2022 Fourth International Conference on Emerging Research in Electronics, Computer Science and Technology (ICERECT), Mandya, India.10.1109/ICERECT56837.2022.10060809 ↗
15. Mai, C., Chen, H., Zeng, L., Li, Z., Liu, G., Qiao, Z., Qu, Y., Li, L., and Li, L. (2024). A smart cane based on 2D LiDAR and RGB-D camera sensor-realizing navigation and obstacle recognition. Sensors, 24.10.3390/s24030870 ↗
16. Guerreiro, J., Sato, D., Asakawa, S., Dong, H., Kitani, K.M., and Asakawa, C. (2019, January 28–30). CaBot: Designing and evaluating an autonomous navigation robot for blind people. Proceedings of the 21st International ACM SIGACCESS Conference on Computers and Accessibility, Pittsburgh, PA, USA.10.1145/3308561.3353771 ↗
17. Wang, L., Chen, Q., Zhang, Y., Li, Z., Yan, T., Wang, F., Zhou, G., and Gong, J. (2023, January 1–5). Can Quadruped Guide Robots be Used as Guide Dogs?. Proceedings of the 2023 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), Detroit, MI, USA.10.1109/IROS55552.2023.10341792 ↗
18. Chen, Y., Xu, Z., Jian, Z., Tang, G., Yang, L., Xiao, A., Wang, X., and Liang, B. (June, January 29). Quadruped guidance robot for the visually impaired: A comfort-based approach. Proceedings of the 2023 IEEE International Conference on Robotics and Automation (ICRA), London, UK.10.1109/ICRA48891.2023.10160854 ↗
19. National Cooperative Highway Research Program, Transportation Research Board, and National Academies of Sciences, Engineering, and Medicine (2011). Accessible Pedestrian Signals: A Guide to Best Practices (Workshop Edition 2010), The National Academies Press.
20. Manchikanti, N., Kumar, G.S., Vidyadhar, R., Dendi, P., and Yarabolu, V. (2023, January 10–11). Innovation in Public Transportation and Improving Accessibility for the Blind. Proceedings of the 2023 International Conference on Circuit Power and Computing Technologies (ICCPCT), Kollam, India.10.1109/ICCPCT58313.2023.10245254 ↗
21. Traffic gap detection for pedestrians with low vision10.1097/OPX.0b013e3182045988 ↗
22. Preferred step frequency minimizes veering during natural human walking10.1016/j.neulet.2011.10.057 ↗
23. Bharadwaj, A., Shaw, S.B., and Goldreich, D. (2019). Comparing tactile to auditory guidance for blind individuals. Front. Hum. Neurosci., 13.10.3389/fnhum.2019.00443 ↗
24. Tactile displays: Guidance for their design and application10.1518/001872008X250638 ↗
25. Comparison between audio and tactile systems for delivering simple navigational information to visually impaired pedestrians10.1177/0264619607079807 ↗
26. Ross, D.A., and Blasch, B.B. (2000, January 13–15). Wearable interfaces for orientation and wayfinding. Proceedings of the Fourth International ACM Conference on Assistive Technologies, Arlington, VA, USA.10.1145/354324.354380 ↗
27. LightGuide: Directing Visually Impaired People Along a Path Using Light Cues10.1145/3495003 ↗
28. Hicks, S.L., Wilson, I., Muhammed, L., Worsfold, J., Downes, S.M., and Kennard, C. (2013). A Depth-Based Head-Mounted Visual Display to Aid Navigation in Partially Sighted Individuals. PLoS ONE, 8.10.1371/journal.pone.0067695 ↗
29. Virtual paving: Rendering a smooth path for people with visual impairment through vibrotactile and audio feedback
30. Adebiyi, A., Sorrentino, P., Bohlool, S., Zhang, C., Arditti, M., Goodrich, G., and Weiland, J.D. (2017). Assessment of feedback modalities for wearable visual aids in blind mobility. PLoS ONE, 12.10.1371/journal.pone.0170531 ↗
31. Global causes of blindness and distance vision impairment 1990–2020: A systematic review and meta-analysis10.1016/S2214-109X(17)30393-5 ↗
32. Visual functions and functional vision10.1016/j.ics.2005.05.002 ↗
33. Global estimates of visual impairment: 201010.1136/bjophthalmol-2011-300539 ↗
34. Zhao, Y., Hu, M., Hashash, S., and Azenkot, S. (2017, January 6–11). Understanding low vision people’s visual perception on commercial augmented reality glasses. Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems, CHI ’17, New York, NY, USA.10.1145/3025453.3025949 ↗
35. Street crossing by sighted and blind pedestrians at a modern roundabout10.1061/(ASCE)0733-947X(2005)131:11(812) ↗
36. Ghilardi, M.C., Simoes, G., Wehrmann, J., Manssour, I.H., and Barros, R.C. (2018, January 8–13). Real-time detection of pedestrian traffic lights for visually-impaired people. Proceedings of the 2018 International Joint Conference on Neural Networks (IJCNN), Rio de Janeiro, Brazil.10.1109/IJCNN.2018.8489516 ↗
37. A context-aware artificial intelligence-based system to support street crossings for pedestrians with visual impairments10.1080/08839514.2022.2062818 ↗
38. Cross-safe: A computer vision-based approach to make all intersection-related pedestrian signals accessible for the visually impaired10.1007/978-3-030-17798-0_13 ↗
39. iDog: An intelligent guide dog harness for visually impaired pedestrians based on artificial intelligence and edge computing10.1109/JSEN.2024.3484576 ↗
40. Kaul, O.B., and Rohs, M. (2016, January 7–12). HapticHead: 3D guidance and target acquisition through a vibrotactile grid. Proceedings of the 2016 CHI Conference Extended Abstracts on Human Factors in Computing Systems, San Jose, CA, USA.10.1145/2851581.2892355 ↗
41. Xiao, J. (2023, January 23–28). Haptic Feedback Research of Human-Computer Interaction in Human-Machine Shared Control Context of Smart Cars. Proceedings of the HCI International 2023 Posters, Copenhagen, Denmark.10.1007/978-3-031-36004-6_16 ↗
42. Spelmezan, D., Jacobs, M., Hilgers, A., and Borchers, J. (2009, January 4–9). Tactile motion instructions for physical activities. Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, Boston, MA, USA.10.1145/1518701.1519044 ↗
43. Turmo Vidal, L., Márquez Segura, E., Parrilla Bel, L., and Waern, A. (2018, January 21–26). Exteriorizing Body Alignment in Collocated Physical Training. Proceedings of the Extended Abstracts of the 2018 CHI Conference on Human Factors in Computing Systems, Montreal, QC, Canada.10.1145/3170427.3188685 ↗
44. Do it yourself haptics: Part I10.1109/M-RA.2007.907921 ↗
45. Vibrotactile localization on the abdomen: Effects of place and space10.3758/BF03194989 ↗
46. Validation of Principles for Tactile Navigation Displays10.1177/154193120605001637 ↗
47. Weber, B., Schatzle, S., Hulin, T., Preusche, C., and Deml, B. (2011, January 21–24). Evaluation of a vibrotactile feedback device for spatial guidance. Proceedings of the 2011 IEEE World Haptics Conference, Istanbul, Turkey.10.1109/WHC.2011.5945511 ↗
48. Wang, Y., and Kuchenbecker, K.J. (2012, January 4–7). HALO: Haptic alerts for low-hanging obstacles in white cane navigation. Proceedings of the 2012 IEEE Haptics Symposium (HAPTICS), Vancouver, BC, Canada.
49. Hertel, J., Schaare, A., Feuerbach, P., Ariza, O., and Steinicke, F. (2019, January 8–11). STIC—Sensory and tactile improved cane. Proceedings of the Mensch und Computer 2019, Hamburg, Germany.10.1145/3340764.3344905 ↗
50. Shah, C., Bouzit, M., Youssef, M., and Vasquez, L. (2006, January 29–30). Evaluation of RU-netra - tactile feedback navigation system for the visually impaired. Proceedings of the 2006 International Workshop on Virtual Rehabilitation, New York, NY, USA.
51. Vibrotactile guidance for wayfinding of blind walkers10.1109/TOH.2015.2409980 ↗
52. Cosgun, A., Sisbot, E.A., and Christensen, H.I. (2014, January 23–26). Evaluation of rotational and directional vibration patterns on a tactile belt for guiding visually impaired people. Proceedings of the 2014 IEEE Haptics Symposium (HAPTICS), Houston, TX, USA.10.1109/HAPTICS.2014.6775483 ↗
53. Safe local navigation for visually impaired users with a time-of-flight and haptic feedback device10.1109/TNSRE.2018.2800665 ↗
54. Ni, D., Wang, L., Ding, Y., Zhang, J., Song, A., and Wu, J. (2013, January 12–14). The design and implementation of a walking assistant system with vibrotactile indication and voice prompt for the visually impaired. Proceedings of the 2013 IEEE International Conference on Robotics and Biomimetics (ROBIO), Shenzhen, China.10.1109/ROBIO.2013.6739885 ↗
55. Pradeep, V., Medioni, G., and Weiland, J. (2010, January 13–18). Robot vision for the visually impaired. Proceedings of the 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition—Workshops, San Francisco, CA, USA.10.1109/CVPRW.2010.5543579 ↗
56. Pradeep, V., Medioni, G., and Weiland, J. (September, January 31). A wearable system for the visually impaired. Proceedings of the 2010 Annual International Conference of the IEEE Engineering in Medicine and Biology, Buenos Aires, Argentina.10.1109/IEMBS.2010.5627715 ↗
57. Han, S.B., Kim, D.H., and Kim, J.H. (2015, January 2–5). Fuzzy gaze control-based navigational assistance system for visually impaired people in a dynamic indoor environment. Proceedings of the 2015 IEEE International Conference on Fuzzy Systems (FUZZ-IEEE), Istanbul, Turkey.10.1109/FUZZ-IEEE.2015.7337837 ↗
58. Bourbakis, N., Keefer, R., Dakopoulos, D., and Esposito, A. (2008, January 3–5). A multimodal interaction scheme between a blind user and the tyflos assistive prototype. Proceedings of the 2008 20th IEEE International Conference on Tools with Artificial Intelligence, Dayton, OH, USA.10.1109/ICTAI.2008.52 ↗
59. Dakopoulos, D., and Bourbakis, N. (2009, January 11–14). Towards a 2D tactile vocabulary for navigation of blind and visually impaired. Proceedings of the 2009 IEEE International Conference on Systems, Man and Cybernetics, San Antonio, TX, USA.10.1109/ICSMC.2009.5346336 ↗
60. Localized magnification in vibrotactile HMDs for accurate spatial awareness
61. De Jesus Oliveira, V.A., Nedel, L., Maciel, A., and Brayda, L. (2018). Anti-veering vibrotactile HMD for assistance of blind pedestrians, In Haptics: Science, Technology, and Applications Series, Springer Science & Business Media. Lecture Notes in Computer Science.10.1007/978-3-319-93399-3_43 ↗
62. Vorapatratorn, S., and Teachavorasinskun, K. (2017, January 25–28). iSonar-2: Obstacle warning device, the assistive technology integrated with universal design for the blind. Proceedings of the 11th International Convention on Rehabilitation Engineering and Assistive Technology, Midview City, Singapore.
63. Velázquez, R., and Bazán, O. (September, January 31). Preliminary evaluation of podotactile feedback in sighted and blind users. Proceedings of the 2010 Annual International Conference of the IEEE Engineering in Medicine and Biology, Buenos Aires, Argentina.10.1109/IEMBS.2010.5626205 ↗
64. Schaack, S., Chernyshov, G., Ragozin, K., Tag, B., Peiris, R., and Kunze, K. (2019, January 11–12). Haptic collar: Vibrotactile feedback around the neck for guidance applications. Proceedings of the 10th Augmented Human International Conference 2019, Reims, France.10.1145/3311823.3311840 ↗
65. Liu, G., Yu, T., Yu, C., Xu, H., Xu, S., Yang, C., Wang, F., Mi, H., and Shi, Y. (2021, January 8–13). Tactile compass: Enabling visually impaired people to follow a path with continuous directional feedback. Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems, Yokohama, Japan.10.1145/3411764.3445644 ↗
66. Leporini, B., Raucci, M., Rosellini, M., and Forgione, N. (2023, January 5–7). Towards a haptic-based virtual cane to assist blind people in obstacle detection. Proceedings of the PETRA’23: Proceedings of the 16th International Conference on PErvasive Technologies Related to Assistive Environments, Corfu, Greece.10.1145/3594806.3594864 ↗
67. Tactile working memory capacity of users who are blind in an electronic travel aid application with a vibration belt10.1145/3372273 ↗
68. Novel wrist-worn vibrotactile device for providing multi-categorical information for orientation and mobility of the blind and visually impaired10.1109/ACCESS.2023.3321802 ↗
69. Mobility performance of low-vision adults using an electronic mobility aid10.1111/j.1444-0938.2006.00004.x ↗
70. Improving mobility performance in low vision with a distance-based representation of the visual scene10.1167/iovs.14-16311 ↗
71. Using an augmented reality device as a distance-based vision aid—Promise and limitations10.1097/OPX.0000000000001232 ↗
72. Using augmented reality to cue obstacles for people with low vision10.1364/OE.479258 ↗
73. Zhao, Y., Kupferstein, E., Rojnirun, H., Findlater, L., and Azenkot, S. (2020, January 25–30). The effectiveness of visual and audio wayfinding guidance on smartglasses for people with low vision. Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems, Honolulu, HI, USA.10.1145/3313831.3376516 ↗
74. Huang, J., Kinateder, M., Dunn, M.J., Jarosz, W., Yang, X.D., and Cooper, E.A. (2019). An augmented reality sign-reading assistant for users with reduced vision. PLoS ONE, 14.10.1371/journal.pone.0210630 ↗
75. Zhao, Y., Kupferstein, E., Castro, B.V., Feiner, S., and Azenkot, S. (2019, January 20–23). Designing AR visualizations to facilitate stair navigation for people with low vision. Proceedings of the 32nd Annual ACM Symposium on User Interface Software and Technology, New Orleans, LA, USA.10.1145/3332165.3347906 ↗
76. Zhao, Y., Szpiro, S., and Azenkot, S. (2015, January 26–28). ForeSee: A customizable head-mounted vision enhancement system for people with low vision. Proceedings of the 17th International ACM SIGACCESS Conference on Computers & Accessibility—ASSETS’15, Lisbon, Portugal.10.1145/2700648.2809865 ↗
77. Angelopoulos, A.N., Ameri, H., Mitra, D., and Humayun, M. (2019). Enhanced depth navigation through augmented reality depth mapping in patients with low vision. Sci. Rep., 9.10.1038/s41598-019-47397-w ↗
78. Influence of LED-based assistive lighting solutions on the autonomous mobility of low vision people10.1016/j.buildenv.2019.04.026 ↗
79. Ross, R.D. (1998). Is perception of light useful to the blind patient?. Arch. Ophthalmol., 116.10.1001/archopht.116.2.236 ↗
80. Karuei, I., MacLean, K.E., Foley-Fisher, Z., MacKenzie, R., Koch, S., and El-Zohairy, M. (2011, January 7–12). Detecting vibrations across the body in mobile contexts. Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, Vancouver, BC, Canada.10.1145/1978942.1979426 ↗
81. Steltenpohl, H., and Bouwer, A. (2013, January 19–22). Vibrobelt: Tactile navigation support for cyclists. Proceedings of the 2013 international Conference on Intelligent User Interfaces, Santa Monica, CA, USA.10.1145/2449396.2449450 ↗
82. Subtletee: Augmenting Posture Awareness for Beginner Golfers10.1145/3427332 ↗
83. Vibrotactor-Belt on the Thigh – Directions in the Vertical Plane
84. Kim, J., Kim, H., Park, C., and Choi, S. (2023, January 10–13). Human Recognition Performance of Simple Spatial Vibrotactile Patterns on the Torso. Proceedings of the 2023 IEEE World Haptics Conference (WHC), Delft, The Netherlands.10.1109/WHC56415.2023.10224430 ↗
85. Park, W., Alsuradi, H., and Eid, M. (2024). EEG correlates to perceived urgency elicited by vibration stimulation of the upper body. Sci. Rep., 14.10.1038/s41598-024-65289-6 ↗
86. Ayaz, H. (2019, January 24–28). Assessment of User Interpretation on Various Vibration Signals in Mobile Phones. Proceedings of the Advances in Neuroergonomics and Cognitive Engineering, Washington, DC, USA.
87. Saket, B., Prasojo, C., Huang, Y., and Zhao, S. (2013, January 23–27). Designing an effective vibration-based notification interface for mobile phones. Proceedings of the 2013 Conference on Computer Supported Cooperative Work, San Antonio, TX, USA.10.1145/2441776.2441946 ↗
88. Schömbs, S., Pareek, S., Goncalves, J., and Johal, W. (2024, January 11–16). Robot-Assisted Decision-Making: Unveiling the Role of Uncertainty Visualisation and Embodiment. Proceedings of the 2024 CHI Conference on Human Factors in Computing Systems, CHI’24, Honolulu, HI, USA.10.1145/3613904.3642911 ↗
89. Statistical Analysis of Correlated Data Using Generalized Estimating Equations: An Orientation10.1093/aje/kwf215 ↗
90. Using generalized estimating equations for longitudinal data analysis10.1177/1094428104263672 ↗
91. Cross-cultural assessment of the effect of spatial information on firefighters’ wayfinding performance: A virtual reality-based study10.1016/j.ijdrr.2022.103486 ↗
92. Israr, A., and Poupyrev, I. (2011, January 7–12). Tactile brush: Drawing on skin with a tactile grid display. Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, Vancouver, BC, Canada.10.1145/1978942.1979235 ↗
93. Dynamic vibrotactile signals for forward collision avoidance warning systems10.1177/0018720814542651 ↗
94. Schneider, O.S., Israr, A., and MacLean, K.E. (2015, January 8–11). Tactile Animation by Direct Manipulation of Grid Displays. Proceedings of the 28th Annual ACM Symposium on User Interface Software & Technology, Charlotte, NC, USA.10.1145/2807442.2807470 ↗
95. Israr, A., and Poupyrev, I. (2010, January 10–15). Exploring surround haptics displays. Proceedings of the CHI’10 Extended Abstracts on Human Factors in Computing Systems, Atlanta, GA, USA.10.1145/1753846.1754121 ↗
96. Israr, A., Kim, S.C., Stec, J., and Poupyrev, I. (2012, January 5–10). Surround haptics: Tactile feedback for immersive gaming experiences. Proceedings of the CHI ’12 Extended Abstracts on Human Factors in Computing Systems, Austin, TX, USA.10.1145/2212776.2212392 ↗
97. Chien, H.P., Wu, M.C., and Hsu, C.C. (2021, January 21–26). Flowing-Haptic Sleeve: Research on Apparent Tactile Motion Applied to Simulating the Feeling of Flow on the Arm. Proceedings of the Adjunct Proceedings of the 2021 ACM International Joint Conference on Pervasive and Ubiquitous Computing and Proceedings of the 2021 ACM International Symposium on Wearable Computers, Virtually.10.1145/3460418.3480158 ↗