journal article·2024-04Open access

Closely Packed Stretchable Ultrasound Array Fabricated with Surface Charge Engineering for Contactless Gesture and Materials Detection

Ankan Dutta, Zhenyuan Niu, Abu Musa Abdullah, Naveen Tiwari, Md Abu Sayeed Biswas, Bowen Li, Farnaz Lorestani, Yun Jing, Huanyu Cheng

Advanced Science· Volume 11· Issue 15

Abstract

Abstract Communication with hand gestures plays a significant role in human‐computer interaction by providing an intuitive and natural way for humans to communicate with machines. Ultrasound‐based devices have shown promising results in contactless hand gesture recognition without requiring physical contact. However, it is challenging to fabricate a densely packed wearable ultrasound array. Here, a stretchable ultrasound array is demonstrated with closely packed transducer elements fabricated using surface charge engineering between pre‐charged 1–3 Lead Zirconate Titanate (PZT) composite and thin polyimide film without using a microscope. The array exhibits excellent ultrasound properties with a wide bandwidth (≈57.1%) and high electromechanical coefficient (≈0.75). The ultrasound array can decipher gestures up to 10 cm in distance by using a contactless triboelectric module and identify materials from the time constant of the exponentially decaying impedance based on their triboelectric properties by utilizing the electrostatic induction phase. The newly proposed metric of the areal‐time constant is material‐specific and decreases monotonically from a highly positive human body (1.13 m 2 s) to negatively charged polydimethylsiloxane (PDMS) (0.02 m 2 s) in the triboelectric series. The capability of the closely packed ultrasound array to detect material along with hand gesture interpretation provides an additional dimension in the next‐generation human‐robot interaction.
Source: crossref · Quality: baseline

Research context

OpenAlex topics: Advanced Sensor and Energy Harvesting Materials · Tactile and Sensory Interactions · Conducting polymers and applications

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

Department of Engineering Science and Mechanics The Pennsylvania State University University Park State College PA 16802 USA

Center for Neural Engineering The Pennsylvania State University University Park State College PA 16802 USA

Center for Research in Biological Chemistry and Molecular Materials (CiQUS) University of Santiago de Compostela Santiago de Compostela 15705 Spain

Graduate Program in Acoustics The Pennsylvania State University University Park State College PA 16802 USA

Funding

National Institutes of Health · Pennsylvania State University

References (70)

Show source-provided references
1. Augmented and Virtual Reality Market Size Share Trends and Industry Analysis 2030 https://www.marketsandmarkets.com/Market‐Reports/augmented‐reality‐virtual‐reality‐market‐1185.html (accessed: April 2023).
2. 10.1007/s11042-015-3177-110.1007/s11042-015-3177-1 ↗
3. 10.1007/s10462-012-9356-910.1007/s10462-012-9356-9 ↗
4. V.Shen C.Shultz C.Harrison presented atProc. of the 2022 CHI Conference on Human Factors in Computing Systems (CHI '22) Association for Computing Machinery New York NY USA Article 275 pp. 1–14.10.1145/3491102.3501960 ↗
5. 10.1039/D2NR06068J10.1039/D2NR06068J ↗
6. 10.1038/s41551-021-00763-410.1038/s41551-021-00763-4 ↗
7. 10.1126/science.121621010.1126/science.1216210 ↗
8. Y.Suzuki K.Sekimori B.Shizuki S.Takahashi 2019 IEEE International Conference on Pervasive Computing and Communications Workshops PerCom Workshops Kyoto Japan 2019pp. 255–260.
9. W.Sun F. M.Li C.Huang Z.Lei B.Steeper S.Tao F.Tian C.Zhang presented atProc. of the 23rd International Conference on Mobile Human‐Computer Interaction (MobileHCI '21) Association for Computing Machinery New York NY USA Article 2 pp. 1–9.
10. 10.1038/s41551-018-0296-910.1038/s41551-018-0296-9 ↗
11. 10.1002/adfm.20230611710.1002/adfm.202306117 ↗
12. 10.1021/acs.nanolett.2c0438410.1021/acs.nanolett.2c04384 ↗
13. 10.1515/978311055248510.1515/9783110552485 ↗
14. 10.1109/THMS.2019.291970210.1109/THMS.2019.2919702 ↗
15. 10.1080/10447318.2019.161925910.1080/10447318.2019.1619259 ↗
16. Y.Iravantchi M.Goel C.Harrison presented atProc. of the 2019 CHI Conference on Human Factors in Computing Systems (CHI '19) Association for Computing Machinery New York NY USA Paper 15 pp. 1–10.10.1145/3290605.3300245 ↗
17. J.McIntosh A.Marzo M.Fraser C.Phillips presented atConf. on Human Factors in Computing Systems – Proc. Denver Colorado USA May2017.
18. X.Xu J.Gong C.Brum L.Liang B.Suh S. K.Gupta Y.Agarwal L.Lindsey R.Kang B.Shahsavari T.Nguyen H.Nieto S. E.Hudson C.Maalouf J. S.Mousavi G.Laput presnted atProc. of the 2022 CHI Conference on Human Factors in Computing Systems (CHI '22) Association for Computing Machinery New York NY USA Article 496 pp. 1–19.10.1145/3491102.3501904 ↗
19. C.Zhang Q.Xue A.Waghmare R.Meng S.Jain Y.Han X.Li K.Cunefare T.Ploetz T.Starner O.Inan G. D.Abowd presnted atProc. of the 2018 CHI Conference on Human Factors in Computing Systems (CHI '18) Association for Computing Machinery New York NY USA Paper 437 pp. 1–10.10.1145/3173574.3174011 ↗
20. D.Kim C.Harrison presented atProc. of the 35th Annual ACM Symposium on User Interface Software and Technology (UIST '22) Association for Computing Machinery New York NY USA Article 58 pp. 1–12.
21. H.Truong S.Zhang U.Muncuk P.Nguyen N.Bui A.Nguyen Q.Lv K.Chowdhury T.Dinh T.Vu presented atSenSys 2018 – Proc. of the 16th Conf. on Embedded Networked Sensor Systems Shenzhen China November2018 54.10.1145/3274783.3274854 ↗
22. 10.1109/RBME.2021.307819010.1109/RBME.2021.3078190 ↗
23. B.Zhou M.Aiskovich S.Guven Acoustic Sensing‐based Hand Gesture Detection for Wearable Device Interaction arXiv preprint arXiv:2112.05986 (2021).
24. 10.3389/fnins.2020.0063710.3389/fnins.2020.00637 ↗
25. 10.1016/j.cej.2023.14277410.1016/j.cej.2023.142774 ↗
26. 10.1038/s41928-020-0422-z10.1038/s41928-020-0422-z ↗
27. 10.1002/smll.20230259710.1002/smll.202302597 ↗
28. 10.1038/s41467-022-31599-410.1038/s41467-022-31599-4 ↗
29. 10.1038/s41586-022-05498-z10.1038/s41586-022-05498-z ↗
30. 10.1126/sciadv.abi928310.1126/sciadv.abi9283 ↗
31. 10.1126/science.abo254210.1126/science.abo2542 ↗
32. Y.Liu Y.Fan Z.Wu J.Yao Z.Long IEEE Transactions on Instrumentation and Measurement vol. 72 pp. 1–12 2023 Art no. 9503012 https://doi.org/10.1109/TIM.2023.3235438.10.1109/TIM.2023.3235438 ↗
33. Y.Iravantchi Y.Zhang E.Bernitsas M.Goel C.Harrison presented atConf. on Human Factors in Computing Systems – Proc.¸Glasgow Scotland UK May2019.
34. Liu J. · Proc. ACM Interact. Mob. Wearable Ubiquitous Technol. · 2022 · 6 · 128
35. 10.1038/s41467-023-38274-210.1038/s41467-023-38274-2 ↗
36. Office of Research Startup Founded by Researchers From UC Davis and UC Berkeley Acquired by TDK Corporation – Office of Research https://research.ucdavis.edu/chirp/(accessed April2023).
37. 10.1109/TMC.2020.303227810.1109/TMC.2020.3032278 ↗
38. 10.1038/s41578-022-00427-y10.1038/s41578-022-00427-y ↗
39. 10.1016/j.nanoen.2021.10648610.1016/j.nanoen.2021.106486 ↗
40. 10.1016/j.nanoen.2019.10439010.1016/j.nanoen.2019.104390 ↗
41. 10.1038/s41467-022-32702-510.1038/s41467-022-32702-5 ↗
42. 10.1021/acsenergylett.0c0243410.1021/acsenergylett.0c02434 ↗
43. 10.1002/adfm.20230674910.1002/adfm.202306749 ↗
44. 10.1002/nano.20200008410.1002/nano.202000084 ↗
45. 10.1002/adma.20180240510.1002/adma.201802405 ↗
46. 10.1016/j.nanoen.2019.06.03810.1016/j.nanoen.2019.06.038 ↗
47. 10.1016/j.nanoen.2021.10604110.1016/j.nanoen.2021.106041 ↗
48. 10.1002/adma.20170679010.1002/adma.201706790 ↗
49. 10.1109/TIA.2011.212603210.1109/TIA.2011.2126032 ↗
50. 10.1002/adfm.20190314210.1002/adfm.201903142 ↗
51. 10.1002/adma.20221032210.1002/adma.202210322 ↗
52. 10.1038/s41928-018-0116-y10.1038/s41928-018-0116-y ↗
53. 10.1126/science.120615710.1126/science.1206157 ↗
54. 10.1038/s41586-019-1710-510.1038/s41586-019-1710-5 ↗
55. 10.1016/j.nanoen.2017.12.05310.1016/j.nanoen.2017.12.053 ↗
56. 10.1016/j.nanoen.2022.10750310.1016/j.nanoen.2022.107503 ↗
57. 10.1016/j.nanoen.2022.10780710.1016/j.nanoen.2022.107807 ↗
58. 10.1038/s41467-019-09461-x10.1038/s41467-019-09461-x ↗
59. 10.1016/j.nanoen.2019.10400510.1016/j.nanoen.2019.104005 ↗
60. 10.1002/adfm.20180884910.1002/adfm.201808849 ↗
61. 10.1126/sciadv.170069410.1126/sciadv.1700694 ↗
62. 10.1126/scirobotics.aat251610.1126/scirobotics.aat2516 ↗
63. 10.1016/j.pmatsci.2014.06.00110.1016/j.pmatsci.2014.06.001 ↗
64. 10.1002/adma.20190254910.1002/adma.201902549 ↗
65. 10.1002/adma.20180396810.1002/adma.201803968 ↗
66. 10.1016/j.mattod.2019.05.01610.1016/j.mattod.2019.05.016 ↗
67. H.Truong P.Nguyen N.Bui A.Nguyen T.Vu presented atS3 2017 – Pro. of the 9th ACM Workshop on Wireless of the Students Snowbird Utah USA October2017.
68. S.Gupta D.Morris S. N.Patel D.Tan presnted atConf. on Human Factors in Computing Systems – Proceedings Austin Texas USA May2012 1911.10.1145/2207676.2208331 ↗
69. 10.1126/science.abn869910.1126/science.abn8699 ↗
70. 10.1039/D0EE03801F10.1039/D0EE03801F ↗