Highly pixelated, untethered tactile interfaces for an ultra-flexible on-skin telehaptic system
Source abstract
Abstract
Abstract Realizing highly immersive tactile interactions requires a skin-integrated, untethered, high-definition tactile transducer devices that can record and generate tactile stimuli. However, the rigid and bulky form factor, and insufficient resolution of existing actuators are hindering the reproduction of sophisticated tactile sensations and immersive user experiences. Here, we demonstrate an ultra-flexible tactile interface with high spatial resolution of 1.8 mm for telehaptic communication on human skin. Dual mechanism sensors and sub-mm scale piezoceramic actuators are designed to record and generate the static and dynamic pressures in a wide frequency range (1 Hz to 1 kHz). Moreover, actuators are integrated on ultra-flexible substrate with chessboard pattern to minimize stress during mechanical deformations. Finally, remote transmissions of various tactile stimuli, such as shapes, textures, and vibration patterns were demonstrated by the telehaptic system with low latency (<1.55 ms) and high fidelity as proven by the short-time Fourier-transform analysis.
Source: crossref · Quality: baseline
Research context
OpenAlex topics: Tactile and Sensory Interactions · Advanced Sensor and Energy Harvesting Materials · Interactive and Immersive Displays
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
References (50)
Show source-provided references
1. Howe, R. D. & Cutkosky, M. R. Dynamic tactile sensing: perception of fine surface features with stress rate sensing. IEEE Trans. Robot. Autom. 9, 140–151 (1993).10.1109/70.238278 ↗
2. Biswas, S. & Visell, Y. Emerging material technologies for haptics. Adv. Mater. Technol. 4, 1–30 (2019).
3. Yu, X. et al. Skin-integrated wireless haptic interfaces for virtual and augmented reality. Nature 575, 473–479 (2019).10.1038/s41586-019-1687-0 ↗
4. Steinbach, E. et al. Haptic communications. Proc. IEEE 100, 937–956 (2012).10.1109/JPROC.2011.2182100 ↗
5. Van Der Meijden, O. A. J. & Schijven, M. P. The value of haptic feedback in conventional and robot-assisted minimal invasive surgery and virtual reality training: A current review. Surg. Endosc. 23, 1180–1190 (2009).10.1007/s00464-008-0298-x ↗
6. Gavish, N. et al. Evaluating virtual reality and augmented reality training for industrial maintenance and assembly tasks. Interact. Learn. Environ. 23, 778–798 (2015).10.1080/10494820.2013.815221 ↗
7. Kavanagh, S., Kavanagh, S., Luxton-Reilly, A., Wuensche, B. & Plimmer, B. A systematic review of virtual reality in education. Themes Sci. Technol. Educ. 10, 85–119 (2017).
8. Liu, B. & Tanaka, J. Virtual marker technique to enhance user interactions in a marker-based AR system. Appl. Sci. 11, 4379 (2021).10.3390/app11104379 ↗
9. Na, W., Dao, N., Kim, J., Ryu, E. & Cho, S. Simulation and measurement: feasibility study of tactile internet applications for mmWave virtual reality. ETRI J. 42, 163–174 (2020).10.4218/etrij.2019-0284 ↗
10. Aebersold, M., Rasmussen, J. & Mulrenin, T. Virtual everest: immersive virtual reality can improve the simulation experience. Clin. Simul. Nurs. 38, 1–4 (2020).10.1016/j.ecns.2019.09.004 ↗
11. Scheibe, R., Moehring, M. & Froehlich, B. Tactile feedback at the finger tips for improved direct interaction in immersive environments. IEEE Symp. 3D User Interfaces 2007—Proceedings, 123–130 (IEEE, 2007).10.1109/3DUI.2007.340784 ↗
12. King, C. H. et al. Tactile feedback induces reduced grasping force in robot-assisted surgery. IEEE Trans. Haptics 2, 103–110 (2009).10.1109/TOH.2009.4 ↗
13. Liu, G., Sun, X., Wang, D., Liu, Y. & Zhang, Y. Effect of electrostatic tactile feedback on accuracy and efficiency of pan gestures on touch screens. IEEE Trans. Haptics 11, 51–60 (2018).10.1109/TOH.2017.2742514 ↗
14. de Jesus Oliveira, V. A., Nedel, L. & Maciel, A. Assessment of an articulatory interface for tactile intercommunication in immersive virtual environments. Comput. Graph. 76, 18–28 (2018).10.1016/j.cag.2018.07.007 ↗
15. Parida, K., Bark, H. & Lee, P. S. Emerging thermal technology enabled augmented reality. Adv. Funct. Mater. 31, 2007952 (2021).10.1002/adfm.202007952 ↗
16. Lee, J., Kim, D., Sul, H. & Ko, S. H. Thermo‐haptic materials and devices for wearable virtual and augmented reality. Adv. Funct. Mater. 31, 2007376 (2021).10.1002/adfm.202007376 ↗
17. Lee, J. et al. Stretchable skin‐like cooling/heating device for reconstruction of artificial thermal sensation in virtual reality. Adv. Funct. Mater. 30, 1909171 (2020).10.1002/adfm.201909171 ↗
18. Kim, D. et al. Highly stretchable and oxidation-resistive Cu nanowire heater for replication of the feeling of heat in a virtual world. J. Mater. Chem. A 8, 8281–8291 (2020).10.1039/D0TA00380H ↗
19. Oh, J. et al. A liquid metal based multimodal sensor and haptic feedback device for thermal and tactile sensation generation in virtual reality. Adv. Funct. Mater. 31, 2007772 (2021).10.1002/adfm.202007772 ↗
20. Kim, O., Kim, S. J. & Park, M. J. Low-voltage-driven soft actuators. Chem. Commun. 54, 4895–4904 (2018).10.1039/C8CC01670D ↗
21. Yun, S. et al. A soft and transparent visuo-haptic interface pursuing wearable devices. IEEE Trans. Ind. Electron. 67, 717–724 (2020).10.1109/TIE.2019.2898620 ↗
22. Youn, J.-H., Mun, H. & Kyung, K.-U. A wearable soft tactile actuator with high output force for fingertip interaction. IEEE Access 9, 30206–30215 (2021).10.1109/ACCESS.2021.3058979 ↗
23. Zhao, H. et al. A wearable soft haptic communicator based on dielectric elastomer actuators. Soft Robot. 7, 451–461 (2020).10.1089/soro.2019.0113 ↗
24. Ji, X. et al. Untethered feel‐through haptics using 18‐µm thick dielectric elastomer actuators. Adv. Funct. Mater. 31, 2006639 (2020).10.1002/adfm.202006639 ↗
25. Besse, N., Rosset, S., Zarate, J. J. & Shea, H. Flexible active skin: large reconfigurable arrays of individually addressed shape memory polymer actuators. Adv. Mater. Technol. 2, 1700102 (2017).10.1002/admt.201700102 ↗
26. Sonar, H. A., Gerratt, A. P., Lacour, S. P. & Paik, J. Closed-loop haptic feedback control using a self-sensing soft pneumatic actuator skin. Soft Robot. 7, 22–29 (2020).10.1089/soro.2019.0013 ↗
27. Leroy, E., Hinchet, R. & Shea, H. Multimode hydraulically amplified electrostatic actuators for wearable haptics. Adv. Mater. 32, 2002564 (2020).10.1002/adma.202002564 ↗
28. Low, J. H. et al. Hybrid tele-manipulation system using a sensorized 3-D-printed soft robotic gripper and a soft fabric-based haptic Glove. IEEE Robot. Autom. Lett. 2, 880–887 (2017).10.1109/LRA.2017.2655559 ↗
29. Qiu, Y., Lu, Z. & Pei, Q. Refreshable tactile display based on a bistable electroactive polymer and a stretchable serpentine joule heating electrode. ACS Appl. Mater. Interfaces 10, 24807–24815 (2018).10.1021/acsami.8b07020 ↗
30. WANG, D. et al. Haptic display for virtual reality: progress and challenges. Virtual Real. Intell. Hardw. 1, 136–162 (2019).10.3724/SP.J.2096-5796.2019.0008 ↗
31. Dagdeviren, C. et al. Conformal piezoelectric systems for clinical and experimental characterization of soft tissue biomechanics. Nat. Mater. 14, 728–736 (2015).10.1038/nmat4289 ↗
32. Sanati, M., Sandwell, A., Mostaghimi, H. & Park, S. S. Development of nanocomposite-based strain sensor with piezoelectric and piezoresistive properties. Sensors (Switzerland) 18, 3789 (2018).10.3390/s18113789 ↗
33. Park, J., Kim, M., Lee, Y., Lee, H. S. & Ko, H. Nanomaterials: fingertip skin-inspired microstructured ferroelectric skins discriminate static/dynamic pressure and temperature stimuli. Sci. Adv. 1, e1500661 (2015).10.1126/sciadv.1500661 ↗
34. Lu, L., Zhao, N., Liu, J. & Yang, B. Coupling piezoelectric and piezoresistive effects in flexible pressure sensors for human motion detection from zero to high frequency. J. Mater. Chem. C. 9, 9309–9318 (2021).10.1039/D1TC01894A ↗
35. Pan, L. et al. An ultra-sensitive resistive pressure sensor based on hollow-sphere microstructure induced elasticity in conducting polymer film. Nat. Commun. 5, 3002 (2014).10.1038/ncomms4002 ↗
36. Park, M., Bok, B.-G., Ahn, J.-H. & Kim, M.-S. Recent advances in tactile sensing technology. Micromachines 9, 321 (2018).10.3390/mi9070321 ↗
37. Yang, J. C. et al. Microstructured porous pyramid-based ultrahigh sensitive pressure sensor insensitive to strain and temperature. ACS Appl. Mater. Interfaces 11, 19472–19480 (2019).10.1021/acsami.9b03261 ↗
38. Oh, J. et al. Highly uniform and low hysteresis piezoresistive pressure sensors based on chemical grafting of polypyrrole on elastomer template with uniform pore size. Small 1901744 https://doi.org/10.1002/smll.201901744 (2019).10.1002/smll.201901744 ↗
39. Kim, D.-H. et al. Dissolvable films of silk fibroin for ultrathin conformal bio-integrated electronics. Nat. Mater. 9, 511–517 (2010).10.1038/nmat2745 ↗
40. Chan, A. H. S. & Ng, A. W. Y. Finger response times to visual, auditory and tactile modality stimuli. Lect. Notes Comput. Sci. 2196, 1449–1454 (2012).
41. Van Den Berg, D. et al. Challenges in haptic communications over the tactile internet. IEEE Access 5, 23502–23518 (2017).10.1109/ACCESS.2017.2764181 ↗
42. Vaicekauskaite, J., Mazurek, P., Vudayagiri, S. & Skov, A. L. Mapping the mechanical and electrical properties of commercial silicone elastomer formulations for stretchable transducers. J. Mater. Chem. C. 8, 1273–1279 (2020).10.1039/C9TC05072H ↗
43. Kim, D.-H. et al. Epidermal electronics. Science 333, 838–843 (2011).10.1126/science.1206157 ↗
44. PI (Physik Instrumente), Piezo Design: Forces & Stiffness in Piezoelectric Actuation. http://www.piezo.ws/piezoelectric_actuator_tutorial/Piezo_Design_part3.php.
45. Pyo, D., Ryu, S., Kyung, K.-U., Yun, S. & Kwon, D.-S. High-pressure endurable flexible tactile actuator based on microstructured dielectric elastomer. Appl. Phys. Lett. 112, 061902 (2018).10.1063/1.5016385 ↗
46. Morioka, M. & Griffin, M. J. Thresholds for the perception of hand-transmitted vibration: dependence on contact area and contact location. Somatosens. Mot. Res. 22, 281–297 (2005).10.1080/08990220500420400 ↗
47. Gescheider, G. A., Bolanowski, S. J., Pope, J. V. & Verrillo, R. T. A four-channel analysis of the tactile sensitivity of the fingertip: frequency selectivity, spatial summation, and temporal summation. Somatosens. Mot. Res. 19, 114–124 (2002).10.1080/08990220220131505 ↗
48. Van Duong, Q., Nguyen, V. P., Luu, A. T. & Choi, S. T. Audio-Tactile Skinny Buttons for Touch User Interfaces. Sci. Rep. 9, 13290 (2019).10.1038/s41598-019-49640-w ↗
49. Stoimenov, B. L., Maruyama, S., Adachi, K. & Kato, K. The roughness effect on the frequency of frictional sound. Tribol. Int. 40, 659–664 (2007).10.1016/j.triboint.2005.11.010 ↗
50. Rothberg, S. Numerical simulation of speckle noise in laser vibrometry. Appl. Opt. 45, 4523 (2006).10.1364/AO.45.004523 ↗