Haptic Reproduction of Virtual Textures Based on Ultrasonic Interference Principle
Source abstract
Abstract
Ultrasonic phased arrays have shown promise in generating virtual texture haptics through haptics feedback points. However, factors such as skin vibration speed, amplitude variations, acoustic interference, and energy loss can influence textural haptics. In this study, using Spatiotemporal Modulation (STM), virtual textures are produced through movement of the focal point. The acoustic field of the ultrasonic phased array as well as the stress and strain experienced by the skin during texture perception are simulated by numerical analysis. At the same time, psychophysical experiments are conducted by volunteers to evaluate these textures. The experimental results indicate that as the focal rotation frequency increases, regions closer to the center experience more significant shear wave effects, resulting in longer shear wave propagation, reduced tangential stress amplitude, and a larger affected area. Moreover, as the frequency of the shear wave interference shifts, it results in increasingly complex textural representations.
Source: crossref · Quality: baseline
Research context
OpenAlex topics: Tactile and Sensory Interactions · Multisensory perception and integration · Virtual Reality Applications and Impacts
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
Affiliations
Research Center of Fluid Machinery Engineering and Technology, Jiangsu University, Zhenjiang 212013, China
School of Electrical and Information Engineering, Jiangsu University, Zhenjiang 212013, China
School of Civil Engineering and Mechanics, Jiangsu University, Zhenjiang 212013, China
Institute of Ultrasonic Testing, Jiangsu University, Zhenjiang 212013, China
Funding
National Natural Science Foundation of China · China Postdoctoral Science Foundation Funded Project · State Key Laboratory of Tribology in Advanced Equipment
References (69)
Show source-provided references
1. Augmented tactile-perception and haptic-feedback rings as human-machine interfaces aiming for immersive interactions10.1038/s41467-022-32745-8 ↗
2. Interference haptic stimulation and consistent quantitative tactility in transparent electro tactile screen with pressure-sensitive transistors10.1038/s41467-024-51593-2 ↗
3. An artificial sensory neuron with visual-haptic fusion10.1038/s41467-020-18375-y ↗
4. A self-sensing soft pneumatic actuator with closed-Loop control for haptic feedback wearable devices10.1016/j.matdes.2022.111149 ↗
5. Adaptive tactile interaction transfer via digitally embroidered smart gloves10.1038/s41467-024-45059-8 ↗
6. Designing haptics: Improving a virtual reality glove with respect to realism, performance, and comfort10.20965/ijat.2019.p0453 ↗
7. WUBI-PEN: Sensory feedback stylus interacting with graphical user interface10.1162/PRES_a_00088 ↗
8. FW-Touch: A finger wearable haptic interface with a MR foam actuator for displaying surface material properties on a touch screen
9. Control system of a performance test-bed for frost protection wind machines
10. Pseudo-haptics and self-haptics for freehand mid-air text entry in VR10.1016/j.apergo.2022.103819 ↗
11. Noncontact Tactile Display Based on Radiation Pressure of Airborne Ultrasound10.1109/TOH.2010.4 ↗
12. AIREAL: Interactive tactile experiences in free air10.1145/2461912.2462007 ↗
13. Comparison of PIV Experiment and Numerical Simulation on the Velocity Distribution of Intermediate Pressure Jets with Different Nozzle Parameters10.1002/ird.2133 ↗
14. Data processing algorithms for generating textured 3D building facade meshes from laser scans and camera images10.1023/B:VISI.0000043756.03810.dd ↗
15. Characterization of air-coupled ultrasound transducers in the frequency range 40 kHz–2 MHz using light diffraction tomography10.1016/S0041-624X(99)00168-7 ↗
16. Contactless printing of food micro-particles controlled by ultrasound10.1016/j.jfoodeng.2024.112375 ↗
17. Design and experiment of low-frequency ultrasonic nozzle integrating air-assistant system and acoustic levitation mechanism
18. Noninvasive field measurement of low-frequency ultrasonic transducers operating in sealed vessels10.1109/TUFFC.2006.108 ↗
19. Designing Mid-Air Haptic Gesture Controlled User Interfaces for Cars10.1145/3397869 ↗
20. Review of air disturbance technology for plant frost protection
21. Development of a cleaning fan for a rice combine harvester using computational fluid dynamics and response surface methodology to optimise outlet airflow distribution10.1016/j.biosystemseng.2019.12.016 ↗
22. A whole row automatic pick-up device using air force to blow out vegetable plug seedlings10.5424/sjar/2020184-17003 ↗
23. The Motion of Strawberry Leaves in an Air-Assisted Spray Field and its Influence on Droplet Deposition10.13031/trans.14143 ↗
24. Subramanian, S., Seah, S.A., Shinoda, H., Hoggan, E., and Corenthy, L. (2016, January 7–12). Mid-Air Haptics and Displays: Systems for Un-instrumented Mid-air Interactions. Proceedings of the 2016 CHI Conference Extended Abstracts on Human Factors in Computing Systems, San Jose, CA, USA.10.1145/2851581.2856464 ↗
25. Evaluation of a Laser Scanning Sensor in Detection of Complex-Shaped Targets for Variable-Rate Sprayer Development10.13031/trans.59.11760 ↗
26. Jun, J.H., Park, J.R., Kim, S.P., Min Bae, Y., Park, J.Y., Kim, H.S., Choi, S., Jung, S.J., Park, S.H., and Yeom, D.-I. (2015). Laser-induced thermoelastic effects can evoke tactile sensations. Sci. Rep., 5.10.1038/srep11016 ↗
27. Grammatikopoulos, L., Kalisperakis, I., and Karras, G. (October, January 26). Automatic multi-image photo-texturing of 3d surface models obtained with laser scanning. Proceedings of the CIPA International Workshop on “Vision Techniques Applied to the Rehabilitation of City Centers”, Torino, Italy.
28. A survey on haptic technologies for mobile augmented reality10.1145/3465396 ↗
29. Haptic interfaces for virtual reality: Challenges and research directions10.1109/ACCESS.2021.3103598 ↗
30. Recent Advances and Opportunities of Active Materials for Haptic Technologies in Virtual and Augmented Reality10.1002/adfm.202008831 ↗
31. A new fiber-optic non-contact compact laser-ultrasound scanner for fast non-destructive testing and evaluation of aircraft composites10.1063/1.4868463 ↗
32. Experimental study of ultrasonic atomizer effects on values of EC and pH of nutrient solution
33. Non-contact method for producing tactile perception using airborne ultrasound10.1007/978-3-540-69057-3_64 ↗
34. Haptogram: Ultrasonic point-cloud tactile stimulation10.1109/ACCESS.2016.2608835 ↗
35. Wilson, G., Carter, T., Subramanian, S., and Brewster, S.A. (2006, January 22–27). Perception of ultrasonic haptic feedback on the hand: Localisation and apparent motion. Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, New York, NY, USA.
36. Howard, T., Marchal, M., and Pacchierotti, C. (2022). Ultrasound Mid-Air Haptics for Touchless Interfaces, Springer International Publishing.
37. Effect of ultrasonic pretreatment monitored by real-time online technologies on dried preparation time and yield during extraction process of okra pectin10.1002/jsfa.11076 ↗
38. Simulation of ultrasound guided needle puncture using patient specific data with 3D textures and volume haptics10.1002/cav.217 ↗
39. UltraBoard: Always-available Wearable Ultrasonic Mid-air Haptic Interface for Responsive and Robust VR Inputs10.1145/3731413 ↗
40. Freeman, E. (2021, January 18–22). Enhancing Ultrasound Haptics with Parametric Audio Effects. Proceedings of the 2021 International Conference on Multimodal Interaction, Montreal, QC, Canada.10.1145/3462244.3479951 ↗
41. A Review of Surface Haptics: Enabling Tactile Effects on Touch Surfaces10.1109/TOH.2020.2990712 ↗
42. It sounds cool: Exploring sonification of mid-air haptic textures exploration on texture judgments, body perception, and motor behaviour10.1109/TOH.2023.3320492 ↗
43. Tactile stimulation by repetitive lateral movement of midair ultrasound focus10.1109/TOH.2019.2946136 ↗
44. Using spatiotemporal modulation to draw tactile patterns in mid-air10.1007/978-3-319-93445-7_24 ↗
45. Shen, Z., Morgan, Z., Vasudevan, M.K., Obrist, M., and Plasencia, D.M. (2024, January 11–16). Controlled-STM: A two-stage model to predict user’s perceived intensity for multi-point spatiotemporal modulation in ultrasonic mid-air haptics. Proceedings of the 2024 CHI Conference on Human Factors in Computing Systems, New York, NY, USA.10.1145/3613904.3642439 ↗
46. Ablart, D., Frier, W., Limerick, H., Georgiou, O., and Obrist, M. (2019, January 3–4). Using ultrasonic mid-air haptic patterns in multi-modal user experiences. Proceedings of the 2019 IEEE International Symposium on Haptic, Audio and Visual Environments and Games (HAVE), Subang Jaya, Malaysia.10.1109/HAVE.2019.8920969 ↗
47. Shear shock waves mediate haptic holography via focused ultrasound10.1126/sciadv.adf2037 ↗
48. Sakaguchi, S., and Konyo, M. (2024). Skin viscoelasticity effects on the periodic mechanical stimuli propagation between skin layers. J. Mech. Behav. Biomed. Mater., 152.10.1016/j.jmbbm.2024.106416 ↗
49. Resolving the viscoelasticity and anisotropy dependence of the mechanical properties of skin from a porcine model10.1007/s10237-015-0700-2 ↗
50. Chilles, J., Frier, W., Abdouni, A., Giordano, M., and Georgiou, O. (2019, January 9–12). Laser doppler vibrometry and fem simulations of ultrasonic mid-air haptics. Proceedings of the IEEE World Haptics Conference, Tokyo, Japan.10.1109/WHC.2019.8816097 ↗
51. Vibrotactile display of patterned surface textures with kinesthetic haptic devices using balanced impulses10.1109/TOH.2021.3072588 ↗
52. Tactile perception of virtual edges and gratings displayed by friction modulation via ultrasonic actuation10.1109/TOH.2019.2949411 ↗
53. Zhou, W., Sarpong, F., and Zhou, C. (2022). Use of Ultrasonic Cleaning Technology in the Whole Process of Fruit and Vegetable Processing. Foods, 11.10.3390/foods11182874 ↗
54. Understanding the effects of tactile grating patterns on perceived roughness over ultrasonic friction modulation surfaces10.1177/00187208211064025 ↗
55. Tactile perception: Finger friction, surface roughness and perceived coarseness10.1016/j.triboint.2010.04.010 ↗
56. Influence of surface roughness, material and climate conditions on the friction of human skin10.1007/s11249-009-9530-7 ↗
57. The effect of dynamic friction with wet fabrics on skin wetness perception10.1080/10803548.2018.1453023 ↗
58. High-dimensional representation of texture in somatosensory cortex of primates10.1073/pnas.1818501116 ↗
59. Influence of sweeping frequency ultrasonic pretreatment on pulsed vacuum drying characteristics and microstructure of okra based on real-time monitoring10.1111/jfpe.13622 ↗
60. Multimode ultrasonic-assisted decontamination of fruits and vegetables: A review10.1016/j.foodchem.2024.139356 ↗
61. Development and experiments of low frequency ultrasonic electrostatic atomizing nozzle with double resonators
62. Improvement of skin condition by oral administration of collagen hydrolysates in chronologically aged mice10.1002/jsfa.8098 ↗
63. Development of a laser-guided, embedded-computercontrolled, air-assisted precision sprayer10.13031/trans.12455 ↗
64. Effect of Low-Frequency Ultrasonic-Assisted Enzymolysis on the Physicochemical and Antioxidant Properties of Corn Protein Hydrolysates10.1155/2017/2784146 ↗
65. Tactile sensory coding in the glabrous skin of the human hand10.1016/0166-2236(83)90011-5 ↗
66. The sensory neurons of touch10.1016/j.neuron.2013.07.051 ↗
67. (2008). The Third Joint Eurohaptics Conference and Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems. Robot. Autom. Mag., 15, 5.10.1109/MRA.2008.930406 ↗
68. The mechanosensory neurons of touch and their mechanisms of activation10.1038/s41583-021-00489-x ↗
69. Biophysical properties of the human finger for touch comprehension: Influences of ageing and gender10.1098/rsos.170321 ↗