Touch, Texture and Haptic Feedback: A Review on How We Feel the World around Us
Source abstract
Abstract
Touch is one most of the important aspects of human life. Nearly all interactions, when broken down, involve touch in one form or another. Recent advances in technology, particularly in the field of virtual reality, have led to increasing interest in the research of haptics. However, accurately capturing touch is still one of most difficult engineering challenges currently being faced. Recent advances in technology such as those found in microcontrollers which allow the creation of smaller sensors and feedback devices may provide the solution. Beyond capturing and measuring touch, replicating touch is also another unique challenge due to the complexity and sensitivity of the human skin. The development of flexible, soft-wearable devices, however, has allowed for the creating of feedback systems that conform to the human form factor with minimal loss of accuracy, thus presenting possible solutions and opportunities. Thus, in this review, the researchers aim to showcase the technologies currently being used in haptic feedback, and their strengths and limitations.
Source: crossref · Quality: baseline
Research context
OpenAlex topics: Tactile and Sensory Interactions · Teleoperation and Haptic Systems · Gaze Tracking and Assistive Technology
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
Affiliations
Department of Electrical Engineering, Southern Taiwan University of Science and Technology, Tainan 71005, Taiwan
Funding
Ministry of Science and Technology (MOST), Taiwan · Ministry of Education, Taiwan
References (100+)
Show source-provided references
1. Hannaford, B., and Okamura, A.M. (2016). Haptics. Springer Handbook of Robotics, Springer.10.1007/978-3-319-32552-1_42 ↗
2. Haptic rendering: Introductory concepts10.1109/MCG.2004.1274058 ↗
3. Research on the application of AR technology based on Unity3D in education10.1088/1742-6596/1168/3/032045 ↗
4. Teaching with technology in higher education: Understanding conceptual change and development in practice10.1080/07294360.2016.1171300 ↗
5. A Review on Virtual Reality Skill Training Applications10.3389/frvir.2021.645153 ↗
6. A Ship Driving Teaching System Based on Multi-level Virtual Reality Technology10.3991/ijet.v11i11.6249 ↗
7. Alexander, T., Westhoven, M., and Conradi, J. (2017). Virtual environments for competency-oriented education and training. Advances in Human Factors, Business Management, Training and Education, Springer.10.1007/978-3-319-42070-7_3 ↗
8. Virtual reality-based physical therapy for patients with lower extremity injuries: Feasibility and acceptability10.1097/OI9.0000000000000132 ↗
9. The past, present, and future of virtual and augmented reality research: A network and cluster analysis of the literature10.3389/fpsyg.2018.02086 ↗
10. Low-cost headsets boost virtual reality’s lab appeal10.1038/533153a ↗
11. The impact of virtual, augmented and mixed reality technologies on the customer experience10.1016/j.jbusres.2018.10.050 ↗
12. Looking into the Future10.1109/MS.2015.142 ↗
13. Wang, S., Mao, Z., Zeng, C., Gong, H., Li, S., and Chen, B. (2010, January 18–20). A new method of virtual reality based on Unity3D. Proceedings of the 2010 18th International Conference on Geoinformatics, Beijing, China.10.1109/GEOINFORMATICS.2010.5567608 ↗
14. Studying human behavior with virtual reality: The Unity Experiment Framework10.3758/s13428-019-01242-0 ↗
15. Virtual reality and its military utility10.1007/s12652-011-0052-4 ↗
16. Improvement of user experience using virtual reality in open-architecture product design10.1177/0954405417711736 ↗
17. Haptic training simulation10.3389/frvir.2020.00003 ↗
18. Virtual reality training for improving the skills needed for performing surgery of the ear, nose or throat
19. Virtual reality rehabilitation versus conventional physical therapy for improving balance and gait in parkinson’s disease patients: A randomized controlled trial
20. Comparison of virtual reality exercise versus conventional exercise on balance in patients with functional ankle instability: A randomized controlled trial10.3233/BMR-181376 ↗
21. Advantages and challenges associated with augmented reality for education: A systematic review of the literature10.1016/j.edurev.2016.11.002 ↗
22. The impact of an augmented reality application on learning motivation of students10.1155/2019/7208494 ↗
23. An augmented reality system for patient-specific guidance of cardiac catheter ablation procedures10.1109/TMI.2005.857661 ↗
24. Jiang, H., Xu, S., State, A., Feng, F., Fuchs, H., Hong, M., and Rozenblit, J. (May, January 29). Enhancing a laparoscopy training system with augmented reality visualization. Proceedings of the 2019 Spring Simulation Conference (SpringSim), Tucson, AZ, USA.10.23919/SpringSim.2019.8732876 ↗
25. Satriadi, K.A., Ens, B., Cordeil, M., Jenny, B., Czauderna, T., and Willett, W. (2019, January 23–27). Augmented reality map navigation with freehand gestures. Proceedings of the 2019 IEEE Conference on Virtual Reality and 3D User Interfaces (VR), Osaka, Japan.10.1109/VR.2019.8798340 ↗
26. Tactile roughness of grooved surfaces: The touching process and effects of macro-and microsurface structure10.3758/BF03203958 ↗
27. Fingertip force, surface geometry, and the perception of roughness by active touch10.3758/BF03205850 ↗
28. Tactile roughness perception with a rigid link interposed between skin and surface10.3758/BF03205532 ↗
29. Tactual perception of material properties10.1016/j.visres.2010.10.005 ↗
30. Capacities of humans and monkeys to discriminate vibratory stimuli of different frequency and amplitude: A correlation between neural events and psychological measurements10.1152/jn.1975.38.3.539 ↗
31. Perception of partial slips under tangential loading of the fingertip10.1038/s41598-018-25226-w ↗
32. Peripheral neural representation of spatial dimensions of a textured surface moving across the monkey’s finger pad10.1113/jphysiol.1980.sp013499 ↗
33. Tactile discrimination of textured surfaces: Peripheral neural coding in the monkey10.1113/jphysiol.1983.sp014690 ↗
34. Tactile discrimination of textured surfaces: Psychophysical performance measurements in humans10.1113/jphysiol.1983.sp014689 ↗
35. Ergen, E., and Ulkar, B. (2007). Proprioception and Coordination, Elsevier Health Sciences.10.1016/B978-141602443-9.50021-0 ↗
36. Spatial and temporal codes mediate the tactile perception of natural textures10.1073/pnas.1305509110 ↗
37. High-dimensional representation of texture in somatosensory cortex of primates10.1073/pnas.1818501116 ↗
38. Texture from touch10.4249/scholarpedia.7956 ↗
39. Psychophysical dimensions of tactile perception of textures10.1109/TOH.2012.32 ↗
40. Robots with a sense of touch10.1038/nmat4731 ↗
41. Pursuing prosthetic electronic skin10.1038/nmat4671 ↗
42. Polymer-based flexible tactile sensor up to 32× 32 arrays integrated with interconnection terminals10.1016/j.sna.2009.08.015 ↗
43. Bioinspired 3-D tactile sensor for minimally invasive surgery10.1109/JMEMS.2010.2076778 ↗
44. Micro-vibration-based slip detection in tactile force sensors10.3390/s140100709 ↗
45. Chathuranga, K., and Hirai, S. (2012, January 11–14). A bio-mimetic fingertip that detects force and vibration modalities and its application to surface identification. Proceedings of the 2012 IEEE International Conference on Robotics and Biomimetics (ROBIO), Guangzhou, China.10.1109/ROBIO.2012.6491028 ↗
46. Creating realistic virtual textures from contact acceleration data10.1109/TOH.2011.38 ↗
47. Roughness encoding for discrimination of surfaces in artificial active-touch10.1109/TRO.2011.2116930 ↗
48. Multiscale wrinkled microstructures for piezoresistive fibers10.1002/adfm.201600580 ↗
49. Neuromorphic artificial touch for categorization of naturalistic textures10.1109/TNNLS.2015.2472477 ↗
50. Recognition of surface texture with wearable tactile sensor array: A pilot Study10.1016/j.sna.2020.111972 ↗
51. Nguyen, H., Osborn, L., Iskarous, M., Shallal, C., Hunt, C., Betthauser, J., and Thakor, N. (2018, January 17–19). Dynamic texture decoding using a neuromorphic multilayer tactile sensor. Proceedings of the 2018 IEEE Biomedical Circuits and Systems Conference (BioCAS), Cleveland, OH, USA.10.1109/BIOCAS.2018.8584826 ↗
52. Fingerprint-inspired flexible tactile sensor for accurately discerning surface texture10.1002/smll.201703902 ↗
53. Texture discrimination with a soft biomimetic finger using a flexible neuromorphic tactile sensor array that provides sensory feedback10.1089/soro.2020.0016 ↗
54. Gupta, A.K., Ghosh, R., Swaminathan, A.N., Deverakonda, B., Ponraj, G., Soares, A.B., and Thakor, N.V. (2018, January 17–19). A neuromorphic approach to tactile texture recognition. Proceedings of the 2018 IEEE International Conference on Robotics and Biomimetics (ROBIO), Cleveland, OH, USA.10.1109/ROBIO.2018.8665085 ↗
55. Bioinspired tactile sensor for surface roughness discrimination10.1016/j.sna.2016.12.021 ↗
56. Roughness discrimination with bio-inspired tactile sensor manually sliding on polished surfaces10.1016/j.sna.2018.06.049 ↗
57. Bio-inspired tactile FA-I spiking generation under sinusoidal stimuli10.1016/S1672-6529(16)60332-3 ↗
58. A spiking and adapting tactile sensor for neuromorphic applications10.1038/s41598-020-74219-1 ↗
59. Portable pen-like device with miniaturized tactile sensor for quantitative tissue palpation in oral cancer screening10.1109/JSEN.2020.2992767 ↗
60. The tactip family: Soft optical tactile sensors with 3d-printed biomimetic morphologies10.1089/soro.2017.0052 ↗
61. Ward-Cherrier, B., Pestell, N., and Lepora, N.F. (August, January 31). Neurotac: A neuromorphic optical tactile sensor applied to texture recognition. Proceedings of the 2020 IEEE International Conference on Robotics and Automation (ICRA), Virtual Event, USA.10.1109/ICRA40945.2020.9197046 ↗
62. Fishel, J.A., Santos, V.J., and Loeb, G.E. (2008, January 19–22). A robust micro-vibration sensor for biomimetic fingertips. Proceedings of the 2008 2nd IEEE RAS & EMBS International Conference on Biomedical Robotics and Biomechatronics, Scottsdale, AZ, USA.10.1109/BIOROB.2008.4762917 ↗
63. Fishel, J.A., and Loeb, G.E. (2012, January 24–28). Sensing tactile microvibrations with the BioTac—Comparison with human sensitivity. Proceedings of the 2012 4th IEEE RAS & EMBS International Conference on Biomedical Robotics and Biomechatronics (BioRob), Rome, Italy.10.1109/BioRob.2012.6290741 ↗
64. Low-cost sensor fusion technique for surface roughness discrimination with optical and piezoelectric sensors10.1109/JSEN.2017.2763245 ↗
65. Fingertip tactile sensor with single sensing element based on FSR and PVDF10.1109/JSEN.2019.2936304 ↗
66. Knud, G. (1989). NDE Handbook, Butterworth-Heinemann.
67. The spatial spectrum of tangential skin displacement can encode tactual texture10.1109/TRO.2011.2132830 ↗
68. Nobuyama, L., Kurashina, Y., Kawauchi, K., Matsui, K., and Takemura, K. (2018). Tactile estimation of molded plastic plates based on the estimated impulse responses of mechanoreceptive units. Sensors, 18.10.3390/s18051588 ↗
69. Measuring dynamic shear force and vibration with a bioinspired tactile sensor skin10.1109/JSEN.2018.2811407 ↗
70. Measurement-based modeling of contact forces and textures for haptic rendering10.1109/TVCG.2010.52 ↗
71. Ungrounded haptic augmented reality system for displaying roughness and friction10.1109/TMECH.2017.2700467 ↗
72. Noise in MEMS
73. A finger-shaped tactile sensor for fabric surfaces evaluation by 2-dimensional active sliding touch10.3390/s140304899 ↗
74. Pressure sensor: State of the art, design, and application for robotic hand10.1155/2015/846487 ↗
75. Pacchierotti, C., Salvietti, G., Hussain, I., Meli, L., and Prattichizzo, D. (2016, January 8–11). The hRing: A wearable haptic device to avoid occlusions in hand tracking. Proceedings of the 2016 IEEE Haptics Symposium (HAPTICS), Philadelphia, PA, USA.10.1109/HAPTICS.2016.7463167 ↗
76. Vechev, V., Zarate, J., Lindlbauer, D., Hinchet, R., Shea, H., and Hilliges, O. (2019, January 23–27). Tactiles: Dual-mode low-power electromagnetic actuators for rendering continuous contact and spatial haptic patterns in VR. Proceedings of the 2019 IEEE Conference on Virtual Reality and 3D User Interfaces (VR), Osaka, Japan.10.1109/VR.2019.8797921 ↗
77. (2021, October 10). LucidVR, LucidGloves. Available online: https://github.com/LucidVR/lucidgloves.
78. Hosseini, M., Sengül, A., Pane, Y., De Schutter, J., and Bruyninck, H. (2018, January 27–31). Exoten-glove: A force-feedback haptic glove based on twisted string actuation system. Proceedings of the 2018 27th IEEE International Symposium on Robot and Human Interactive Communication (RO-MAN), Nanjing, China.10.1109/ROMAN.2018.8525637 ↗
79. Placzek, J.D., and Boyce, D.A. (2016). Orthopaedic Physical Therapy Secrets-E-Book, Elsevier Health Sciences.
80. Taylor, J. (2009). Proprioception, Elsevier.10.1016/B978-008045046-9.01907-0 ↗
81. Effect of cutaneous feedback on the perception of virtual object weight during manipulation10.1038/s41598-020-58247-5 ↗
82. Bloom, F.E., Spitzer, N.C., Gage, F., and Albright, T. (2009). Encyclopedia of Neuroscience, Academic Press.
83. Responses in glabrous skin mechanoreceptors during precision grip in humans10.1007/BF00236209 ↗
84. Sensory substitution and augmentation using 3-degree-of-freedom skin deformation feedback10.1109/TOH.2015.2398448 ↗
85. Haptip: Displaying haptic shear forces at the fingertips for multi-finger interaction in virtual environments10.3389/fict.2016.00006 ↗
86. Choi, I., Culbertson, H., Miller, M.R., Olwal, A., and Follmer, S. (2017, January 22–25). Grabity: A wearable haptic interface for simulating weight and grasping in virtual reality. Proceedings of the 30th Annual ACM Symposium on User Interface Software and Technology, Quebec City, QC, Canada.10.1145/3126594.3126599 ↗
87. Evaluation of wearable haptic systems for the fingers in augmented reality applications10.1109/TOH.2017.2691328 ↗
88. Towards wearability in fingertip haptics: A 3-dof wearable device for cutaneous force feedback10.1109/TOH.2013.53 ↗
89. Three-dimensional skin deformation as force substitution: Wearable device design and performance during haptic exploration of virtual environments10.1109/TOH.2017.2672969 ↗
90. (2021, October 18). Cyberglove Systems LLC, Cyberforce. Available online: http://www.cyberglovesystems.com/cyberforce.
91. (2021, October 10). Force Dimension, Omega.6. Available online: https://www.forcedimension.com/images/doc/specsheet_-_omega6.pdf.
92. (2021, October 10). Phantom Omni—6 DOF Master Device. Available online: https://delfthapticslab.nl/device/phantom-omni/.
93. Hinchet, R., Vechev, V., Shea, H., and Hilliges, O. (2018, January 14–17). Dextres: Wearable haptic feedback for grasping in vr via a thin form-factor electrostatic brake. Proceedings of the 31st Annual ACM Symposium on User Interface Software and Technology, Berlin, Germany.10.1145/3242587.3242657 ↗
94. Egawa, M., Watanabe, T., and Nakamura, T. (2015, January 23–27). Development of a wearable haptic device with pneumatic artificial muscles and MR brake. Proceedings of the 2015 IEEE Virtual Reality (VR), Arles, France.10.1109/VR.2015.7223351 ↗
95. (2021, October 10). Maestro Glove. Available online: https://contact.ci/#maestro-product.
96. Carpi, F., Mannini, A., and De Rossi, D. (2008, January 10–13). Elastomeric contractile actuators for hand rehabilitation splints. Proceedings of the Electroactive Polymer Actuators and Devices (EAPAD) 2008, San Diego, CA, USA.10.1117/12.774644 ↗
97. Mistry, M., Mohajerian, P., and Schaal, S. (2005, January 2–6). An exoskeleton robot for human arm movement study. Proceedings of the 2005 IEEE/RSJ International Conference on Intelligent Robots and Systems, Edmonton, AB, Canada.10.1109/IROS.2005.1545450 ↗
98. Ryu, D., Moon, K.-W., Nam, H., Lee, Y., Chun, C., Kang, S., and Song, J.-B. (2008, January 22–26). Micro hydraulic system using slim artificial muscles for a wearable haptic glove. Proceedings of the 2008 IEEE/RSJ International Conference on Intelligent Robots and Systems, Nice, France.
99. Soft robotic glove for combined assistance and at-home rehabilitation10.1016/j.robot.2014.08.014 ↗
100. Wehner, M., Quinlivan, B., Aubin, P.M., Martinez-Villalpando, E., Baumann, M., Stirling, L., Holt, K., Wood, R., and Walsh, C. (2013, January 6–10). A lightweight soft exosuit for gait assistance. Proceedings of the 2013 IEEE International Conference on Robotics and Automation, Karlsruhe, Germany.10.1109/ICRA.2013.6631046 ↗