journal article·2023-05-12

Laser-Induced Graphene Strain Sensor for Conformable Lip-Reading Recognition and Human–Machine Interaction

Lin Cheng, Guoqing Fang, Lei Wei, Weizhan Gao, Xueer Wang, Zihan Lv, Wenjie Xu, Chen Ding, Huaping Wu, Wenan Zhang, Aiping Liu

ACS Applied Nano Materials· Volume 6· Issue 9
Publisher page

Abstract

Lip-reading recognition (LRR) has gained significant attention due to its potential applications in various scenarios, such as communication for the speech-impaired, conversations in noisy or dark environments, and human–machine interactions. However, existing LRR technologies based on computer vision suffer from drawbacks such as the high cost of electronic camera equipment and the negative impact of ambient lighting on recognition accuracy. Herein, a graphene-based flexible strain sensor is developed through a facile, high-efficiency, and low-cost laser-induced carbonization technique, which involves the ablation of polyimide (PI) films using ultraviolet lasers. The sensor’s patterned stripes and porous structure endow it with sensitivity to deformations caused by bending and pressing. The well-designed flexible strain sensor can tightly attach on facial skin and record high-quality strain signals of various lip muscle movements. When compared to a preconstructed lip-reading database using a fixed algorithm, the collected lip-reading signals exhibit a recognition rate exceeding 90%, enabling seamless human–machine interaction and precise control over manipulators. Consequently, the LRR approach based on the flexible strain sensor demonstrates immense potential as a promising platform for speech-impaired communication and human–machine interactions in variable environments.
Source: openalex_inverted_index · Quality: baseline

Research context

OpenAlex topics: Advanced Sensor and Energy Harvesting Materials · Tactile and Sensory Interactions · Hand Gesture Recognition Systems

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

Key Laboratory of Optical Field Manipulation of Zhejiang Province, Zhejiang Sci-Tech University, Hangzhou 310018, P. R. China

College of Information Engineering, Zhejiang University of Technology, Hangzhou 310023, P. R. China

College of Mechanical Engineering, Zhejiang University of Technology, Hangzhou 310023, P. R. China

Funding

Zhejiang Provincial Ten Thousand Plan for Young Top Talents · National Natural Science Foundation of China · Natural Science Foundation of Zhejiang Province · Fundamental Research Funds for the Provincial Universities of Zhejiang · Zhejiang Outstanding Youth Fund

References (50)

Show source-provided references
1. 10.1088/1741-2552/abca1410.1088/1741-2552/abca14 ↗
2. 10.1002/adfm.20210070910.1002/adfm.202100709 ↗
3. 10.1016/j.cose.2021.10249510.1016/j.cose.2021.102495 ↗
4. 10.1038/s41528-021-00119-710.1038/s41528-021-00119-7 ↗
5. 10.3390/app908159910.3390/app9081599 ↗
6. 10.1109/TNET.2019.289173310.1109/TNET.2019.2891733 ↗
7. 10.1002/adma.20200830810.1002/adma.202008308 ↗
8. 10.1038/s41596-020-00489-810.1038/s41596-020-00489-8 ↗
9. 10.1002/aelm.20220108610.1002/aelm.202201086 ↗
10. 10.1126/sciadv.abd019910.1126/sciadv.abd0199 ↗
11. 10.1021/acsanm.9b0017410.1021/acsanm.9b00174 ↗
12. 10.1016/j.nanoen.2020.10481410.1016/j.nanoen.2020.104814 ↗
13. 10.1016/j.mtphys.2022.10079410.1016/j.mtphys.2022.100794 ↗
14. 10.1021/acsanm.1c0372210.1021/acsanm.1c03722 ↗
15. 10.1002/adfm.20200893610.1002/adfm.202008936 ↗
16. 10.20517/ss.2022.2610.20517/ss.2022.26 ↗
17. 10.1016/j.nanoen.2020.10533710.1016/j.nanoen.2020.105337 ↗
18. 10.1016/j.sna.2021.11271010.1016/j.sna.2021.112710 ↗
19. 10.1088/1361-665X/aaf3ce10.1088/1361-665X/aaf3ce ↗
20. 10.1039/D0TC02539A10.1039/D0TC02539A ↗
21. 10.1007/s00405-019-05462-010.1007/s00405-019-05462-0 ↗
22. 10.1002/gch2.20200000110.1002/gch2.202000001 ↗
23. 10.1016/j.bios.2021.11377710.1016/j.bios.2021.113777 ↗
24. 10.1021/acsnano.9b0677810.1021/acsnano.9b06778 ↗
25. 10.3390/molecules2607190010.3390/molecules26071900 ↗
26. 10.1155/2020/204231610.1155/2020/2042316 ↗
27. 10.1007/s40820-020-00496-010.1007/s40820-020-00496-0 ↗
28. 10.1088/2058-8585/abf0f810.1088/2058-8585/abf0f8 ↗
29. 10.3390/nano1107170110.3390/nano11071701 ↗
30. 10.1016/j.mtphys.2020.10026510.1016/j.mtphys.2020.100265 ↗
31. 10.1016/j.bios.2021.11360610.1016/j.bios.2021.113606 ↗
32. 10.1016/j.matlet.2021.13063710.1016/j.matlet.2021.130637 ↗
33. 10.1002/admi.20210150210.1002/admi.202101502 ↗
34. 10.1166/jnn.2015.1156010.1166/jnn.2015.11560 ↗
35. 10.1039/C3NR04521H10.1039/C3NR04521H ↗
36. 10.1002/smtd.20190020810.1002/smtd.201900208 ↗
37. 10.1002/adfm.20180527110.1002/adfm.201805271 ↗
38. 10.1021/acsanm.1c0207610.1021/acsanm.1c02076 ↗
39. 10.1021/acsomega.1c0030910.1021/acsomega.1c00309 ↗
40. 10.1021/acsnano.1c0184310.1021/acsnano.1c01843 ↗
41. 10.1016/j.optlastec.2021.10714310.1016/j.optlastec.2021.107143 ↗
42. 10.1021/nn303328e10.1021/nn303328e ↗
43. 10.1002/adfm.20210325510.1002/adfm.202103255 ↗
44. 10.1016/j.snb.2020.12879010.1016/j.snb.2020.128790 ↗
45. 10.3390/ma1412317910.3390/ma14123179 ↗
46. 10.1088/1742-6596/1918/4/04214210.1088/1742-6596/1918/4/042142 ↗
47. 10.1007/s10208-021-09534-810.1007/s10208-021-09534-8 ↗
48. 10.1016/j.ins.2020.08.08910.1016/j.ins.2020.08.089 ↗
49. 10.3233/JIFS-18173610.3233/JIFS-181736 ↗
50. 10.1109/ACCESS.2018.288979210.1109/ACCESS.2018.2889792 ↗