journal article·2024-10-09

Multifunctional Human–Computer Interaction System Based on Deep Learning-Assisted Strain Sensing Array

Hao Gu, Ke Jiang, Fei Yu, Liying Wang, Xijia Yang, Xuesong Li, Yi Jiang, Wei Lü, Xiaojuan Sun

ACS Applied Materials & Interfaces· Volume 16· Issue 40
Publisher page

Abstract

Continuous and reliable monitoring of gait is crucial for health monitoring, such as postoperative recovery of bone joint surgery and early diagnosis of disease. However, existing gait analysis systems often suffer from large volumes and the requirement of special space for setting motion capture systems, limiting their application in daily life. Here, we develop an intelligent gait monitoring and analysis prediction system based on flexible piezoelectric sensors and deep learning neural networks with high sensitivity (241.29 mV/N), quick response (66 ms loading, 87 ms recovery), and excellent stability ( R 2 = 0.9946). The theoretical simulations and experiments confirm that the sensor provides exceptional signal feedback, which can easily acquire accurate gait data when fitted to shoe soles. By integrating high-quality gait data with a custom-built deep learning model, the system can detect and infer human motion states in real time (the recognition accuracy reaches 94.7%). To further validate the sensor’s application in real life, we constructed a flexible wearable recognition system with human–computer interaction interface and a simple operation process for long-term and continuous tracking of athletes’ gait, potentially aiding personalized health management, early detection of disease, and remote medical care.
Source: openalex_inverted_index · Quality: baseline

Research context

OpenAlex topics: Hand Gesture Recognition Systems · Gait Recognition and Analysis

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

Key Laboratory of Advanced Structural Materials, Ministry of Education & Advanced Institute of Materials Science, Changchun University of Technology, Changchun 130012, China

State Key Laboratory of Luminescence and Applications, Changchun Institute of Optics, Fine Mechanics and Physics, Chinese Academy of Sciences, Changchun 130033, China

School of Science, Changchun Institute of Technology, Changchun 130012, China

Funding

Youth Innovation Promotion Association of the Chinese Academy of Sciences · National Natural Science Foundation of China · Chinese Institute of Electronics, China Association for Science and Technology

References (64)

Show source-provided references
1. 10.1016/j.biomaterials.2014.03.06610.1016/j.biomaterials.2014.03.066 ↗
2. 10.1145/323063310.1145/3230633 ↗
3. 10.1371/journal.pcbi.100998910.1371/journal.pcbi.1009989 ↗
4. 10.1016/j.inffus.2021.09.01610.1016/j.inffus.2021.09.016 ↗
5. 10.1016/j.autcon.2022.10425310.1016/j.autcon.2022.104253 ↗
6. 10.1016/j.eswa.2023.12096810.1016/j.eswa.2023.120968 ↗
7. 10.1016/j.neucom.2022.07.00210.1016/j.neucom.2022.07.002 ↗
8. 10.1109/JSEN.2010.204515810.1109/JSEN.2010.2045158 ↗
9. 10.1109/JSEN.2016.255436010.1109/JSEN.2016.2554360 ↗
10. 10.1109/JSEN.2021.307833610.1109/JSEN.2021.3078336 ↗
11. 10.1016/j.apacoust.2020.10770110.1016/j.apacoust.2020.107701 ↗
12. 10.1021/acsami.2c1790410.1021/acsami.2c17904 ↗
13. 10.1016/j.eswa.2023.12049210.1016/j.eswa.2023.120492 ↗
14. 10.1126/sciadv.adh061510.1126/sciadv.adh0615 ↗
15. 10.1002/smll.20160279010.1002/smll.201602790 ↗
16. 10.1002/admt.20200007110.1002/admt.202000071 ↗
17. 10.3389/fphys.2023.112595210.3389/fphys.2023.1125952 ↗
18. 10.1021/acsnano.2c0950910.1021/acsnano.2c09509 ↗
19. 10.1021/acsami.2c1484710.1021/acsami.2c14847 ↗
20. 10.1002/advs.20220247010.1002/advs.202202470 ↗
21. 10.1016/j.cej.2022.13663110.1016/j.cej.2022.136631 ↗
22. 10.1021/acs.accounts.8b0050010.1021/acs.accounts.8b00500 ↗
23. 10.1063/5.007766710.1063/5.0077667 ↗
24. 10.1021/acs.nanolett.3c0045410.1021/acs.nanolett.3c00454 ↗
25. 10.1126/sciadv.adf883110.1126/sciadv.adf8831 ↗
26. 10.1002/adfm.20231090810.1002/adfm.202310908 ↗
27. 10.1002/adfm.20230611710.1002/adfm.202306117 ↗
28. 10.1016/j.measurement.2022.11072410.1016/j.measurement.2022.110724 ↗
29. 10.1002/adma.20221032210.1002/adma.202210322 ↗
30. 10.1038/s41467-023-38040-410.1038/s41467-023-38040-4 ↗
31. 10.1177/194173811561691710.1177/1941738115616917 ↗
32. 10.1007/s42114-021-00331-z10.1007/s42114-021-00331-z ↗
33. 10.1002/adfm.20230294610.1002/adfm.202302946 ↗
34. 10.1002/admt.20220202110.1002/admt.202202021 ↗
35. 10.1016/j.jallcom.2023.17050910.1016/j.jallcom.2023.170509 ↗
36. 10.1002/adfm.20240029510.1002/adfm.202400295 ↗
37. 10.1145/334029310.1145/3340293 ↗
38. 10.1021/acsphotonics.2c0112110.1021/acsphotonics.2c01121 ↗
39. 10.1002/adma.20180107210.1002/adma.201801072 ↗
40. 10.1007/s13244-018-0639-910.1007/s13244-018-0639-9 ↗
41. 10.1038/s41467-022-33457-910.1038/s41467-022-33457-9 ↗
42. 10.1021/acsami.4c0564210.1021/acsami.4c05642 ↗
43. 10.1002/adfm.20210943010.1002/adfm.202109430 ↗
44. 10.1021/acsami.1c2200110.1021/acsami.1c22001 ↗
45. 10.29026/oea.2024.23023010.29026/oea.2024.230230 ↗
46. 10.1016/j.eswa.2023.12033710.1016/j.eswa.2023.120337 ↗
47. 10.1016/j.eswa.2022.11736210.1016/j.eswa.2022.117362 ↗
48. 10.29026/oea.2023.23009410.29026/oea.2023.230094 ↗
49. 10.1016/j.cclet.2020.11.01610.1016/j.cclet.2020.11.016 ↗
50. 10.1016/j.apsusc.2004.11.01710.1016/j.apsusc.2004.11.017 ↗
51. 10.1002/adfm.20170256210.1002/adfm.201702562 ↗
52. 10.1016/j.cej.2022.13543110.1016/j.cej.2022.135431 ↗
53. 10.1088/1361-6463/aaa7dd10.1088/1361-6463/aaa7dd ↗
54. 10.1016/j.mssp.2024.10845410.1016/j.mssp.2024.108454 ↗
55. 10.1016/j.nanoen.2022.10698610.1016/j.nanoen.2022.106986 ↗
56. 10.1007/s10439-023-03151-y10.1007/s10439-023-03151-y ↗
57. 10.1016/j.engappai.2023.10771210.1016/j.engappai.2023.107712 ↗
58. 10.1109/TNNLS.2021.308482710.1109/TNNLS.2021.3084827 ↗
59. 10.1145/349023510.1145/3490235 ↗
60. 10.1016/j.neucom.2018.09.03810.1016/j.neucom.2018.09.038 ↗
61. 10.1109/MSP.2018.284264610.1109/MSP.2018.2842646 ↗
62. 10.1038/s41467-021-25637-w10.1038/s41467-021-25637-w ↗
63. 10.1126/sciadv.abq252110.1126/sciadv.abq2521 ↗
64. 10.1038/s41467-023-43664-710.1038/s41467-023-43664-7 ↗