journal article·2025-03Open access

Integration of Sensory Memory Process Display System for Gait Recognition

Tao Sun, Meng Qi, Qing‐Xiu Li, Hang‐Fei Li, Zhi‐Peng Feng, Run‐Ze Xu, You Zhou, Yu Wen, Gui‐Jun Li, Ye Zhou, Su‐Ting Han

Advanced Functional Materials· Volume 35· Issue 10

Abstract

Abstract Gait is among the most dependable, accurate, and secure methods of biometric identification. However, high power consumption and low computing capability are two major obstacles on wearable sensors‐based gait recognition system. In this work, an integrated system is reported combining a triboelectric nanogenerator (TENG), a memristor (Ag/HfOx/Pt), and perovskite‐based multicolor LEDs (PMCLED) for the visualization and recognition of foot patterns through signal‐on‐none and multi‐wavelength on‐device preprocessing. The flexible TENG acts as a sensory receptor, generating voltage based on the duration and intensity of pressure, which in turn promotes voltage‐triggered synaptic plasticity in the memristor. The PMCLED, with its threshold switching and multi‐wavelength emission characteristics, enables nonlinear filtering and amplification of the synaptic signal from the memristor, resulting in a simplified system design and reduced background noise. Additionally, the effectiveness of on‐device preprocessing is validated based on a 5 × 5 array of integrated devices and software‐built neural network for foot pattern visualization and recognition. The proposed system is able to recognize the on‐device preprocessed images with high accuracy, indicating great potentials in both healthcare monitoring and human‐machine interaction.
Source: crossref · Quality: baseline

Research context

OpenAlex topics: Hand Gesture Recognition Systems · Gait Recognition and Analysis · Gaze Tracking and Assistive Technology

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

Institute of Microscale Optoelectronics Shenzhen University Shenzhen 518060 P. R. China

College of Electronics and Information Engineering Shenzhen University Shenzhen 518060 P. R. China

College of Physics and Optoelectronic Engineering Shenzhen University Shenzhen 518060 P. R. China

Institute for Advanced Study Shenzhen University Shenzhen 518060 P. R. China

Department of Applied Biology and Chemical Technology The Hong Kong Polytechnic University Kowloon Hong Kong 999077 P. R. China

Funding

Guangdong Provincial Department of Science and Technology · National Natural Science Foundation of China

References (59)

Show source-provided references
1. 10.1038/s41598-024-68053-y10.1038/s41598-024-68053-y ↗
2. 10.1038/s41598-024-70787-810.1038/s41598-024-70787-8 ↗
3. 10.1002/adfm.20230356210.1002/adfm.202303562 ↗
4. 10.1038/s41467-022-34230-810.1038/s41467-022-34230-8 ↗
5. 10.1155/2021/664124710.1155/2021/6641247 ↗
6. 10.1038/srep4546410.1038/srep45464 ↗
7. 10.1038/s41467-019-10617-y10.1038/s41467-019-10617-y ↗
8. 10.1038/s41586-024-07770-w10.1038/s41586-024-07770-w ↗
9. 10.1038/s41598-022-18806-410.1038/s41598-022-18806-4 ↗
10. 10.1002/advs.20210369410.1002/advs.202103694 ↗
11. 10.1002/admt.20180036010.1002/admt.201800360 ↗
12. 10.1111/jgs.1531510.1111/jgs.15315 ↗
13. 10.1002/dac.434810.1002/dac.4348 ↗
14. 10.1002/mds.2198410.1002/mds.21984 ↗
15. 10.1002/mds.2568310.1002/mds.25683 ↗
16. 10.1155/2021/436012210.1155/2021/4360122 ↗
17. 10.1111/1556-4029.1403610.1111/1556-4029.14036 ↗
18. 10.1046/j.1468-1331.2001.00042.x10.1046/j.1468-1331.2001.00042.x ↗
19. Verghese J. · 2014
20. 10.1038/s41467-020-19424-210.1038/s41467-020-19424-2 ↗
21. 10.1049/iet-ipr.2014.077310.1049/iet-ipr.2014.0773 ↗
22. 10.1002/adfm.20240960210.1002/adfm.202409602 ↗
23. 10.1038/s41928-023-01078-910.1038/s41928-023-01078-9 ↗
24. 10.1038/s41928-023-01091-y10.1038/s41928-023-01091-y ↗
25. 10.1038/s41587-023-01800-010.1038/s41587-023-01800-0 ↗
26. 10.1038/ncomms903110.1038/ncomms9031 ↗
27. 10.1038/s41467-022-35628-010.1038/s41467-022-35628-0 ↗
28. 10.1038/s41467-021-22558-610.1038/s41467-021-22558-6 ↗
29. 10.1002/aisy.20230082410.1002/aisy.202300824 ↗
30. 10.1002/adfm.20140193610.1002/adfm.201401936 ↗
31. 10.1002/adma.20180363710.1002/adma.201803637 ↗
32. 10.1038/s41565-021-01003-110.1038/s41565-021-01003-1 ↗
33. 10.1038/s41467-024-51609-x10.1038/s41467-024-51609-x ↗
34. 10.1038/s41565-024-01665-710.1038/s41565-024-01665-7 ↗
35. 10.1002/smll.20220018510.1002/smll.202200185 ↗
36. 10.1002/aenm.20200082710.1002/aenm.202000827 ↗
37. 10.1109/LED.2023.324264610.1109/LED.2023.3242646 ↗
38. 10.1016/j.nanoen.2020.10517410.1016/j.nanoen.2020.105174 ↗
39. 10.1021/acsaelm.0c0109410.1021/acsaelm.0c01094 ↗
40. 10.1002/adfm.20150273410.1002/adfm.201502734 ↗
41. 10.1002/adma.20180154810.1002/adma.201801548 ↗
42. 10.1021/acsami.2c2321810.1021/acsami.2c23218 ↗
43. 10.1002/adfm.20200288210.1002/adfm.202002882 ↗
44. 10.1002/aelm.20160041610.1002/aelm.201600416 ↗
45. 10.1038/s41467-023-38396-710.1038/s41467-023-38396-7 ↗
46. 10.1155/2021/556603610.1155/2021/5566036 ↗
47. 10.1002/ca.2008110.1002/ca.20081 ↗
48. 10.1186/s13047-020-00431-x10.1186/s13047-020-00431-x ↗
49. 10.1155/2017/343207410.1155/2017/3432074 ↗
50. 10.1038/sj.ijo.080178510.1038/sj.ijo.0801785 ↗
51. 10.1038/sj.ijo.080272910.1038/sj.ijo.0802729 ↗
52. 10.1021/acs.nanolett.8b0123810.1021/acs.nanolett.8b01238 ↗
53. Kejun W. · J. Image Graphics · 2007 · 12 · 1152
54. 10.1109/JSEN.2021.313158210.1109/JSEN.2021.3131582 ↗
55. W.Kim Y.Kim K.Lee IEEE 44th Annual Computers Software and Applications Conf. (COMPSAC) IEEE Piscataway NJ2020.
56. 10.1007/s40846-016-0179-z10.1007/s40846-016-0179-z ↗
57. 10.1109/JSEN.2018.287132810.1109/JSEN.2018.2871328 ↗
58. 10.1038/s41586-020-1942-410.1038/s41586-020-1942-4 ↗
59. 10.1049/cje.2020.09.00710.1049/cje.2020.09.007 ↗