journal article·2024-12Open access

In‐Sensor Touch Analysis for Intent Recognition

Yijing Xu, Shifan Yu, Lei Liu, Wansheng Lin, Zhicheng Cao, Yu Hu, Jiming Duan, Zijian Huang, Chao Wei, Ziquan Guo, Tingzhu Wu, Zhong Chen, Qingliang Liao, Yuanjin Zheng, Xinqin Liao

Advanced Functional Materials· Volume 34· Issue 52

Abstract

Abstract Tactile intent recognition systems, which are highly desired to satisfy human's needs and humanized services, shall be accurately understanding and identifying human's intent. They generally utilize time‐driven sensor arrays to achieve high spatiotemporal resolution, however, which encounter inevitable challenges of low scalability, huge data volumes, and complex processing. Here, an event‐driven intent recognition touch sensor (IR touch sensor) with in‐sensor computing capability is presented. The merit of event‐driven and in‐sensor computing enables the IR touch sensor to achieve ultrahigh resolution and obtain complete intent information with intrinsic concise data. It achieves critical signal extraction of action trajectories with a rapid response time of 0.4 ms and excellent durability of >10 000 cycles, bringing an important breakthrough of tactile intent recognition. Versatile applications prove the integrated functions of the IR touch sensor for great interactive potential in all‐weather environments regardless of shading, dynamics, darkness, and noise. Unconscious and even hidden action features can be perfectly extracted with the ultrahigh recognition accuracy of 98.4% for intent recognition. The further auxiliary diagnostic test demonstrates the practicability of the IR touch sensor in telemedicine palpation and therapy. This groundbreaking integration of sensing, data reduction, and ultrahigh‐accuracy recognition will propel the leapfrog development for conscious machine intelligence.
Source: crossref · Quality: baseline

Research context

OpenAlex topics: Advanced Sensor and Energy Harvesting Materials · Tactile and Sensory Interactions · Gaze Tracking and Assistive Technology

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

Department of Electronic Science Xiamen University Xiamen 361005 China

General Surgery Department The Second Hospital of Shanxi Medical University Taiyuan 030001 China

Academy for Advanced Interdisciplinary Science and Technology Beijing Advanced Innovation Center for Materials Genome Engineering University of Science and Technology Beijing Beijing 100083 China

Beijing Key Laboratory for Advanced Energy Materials and Technologies School of Materials Science and Engineering University of Science and Technology Beijing Beijing 100083 China

School of Electrical and Electronic Engineering Nanyang Technological University Singapore 639798 Singapore

Funding

National Natural Science Foundation of China · Fundamental Research Funds for the Central Universities

References (58)

Show source-provided references
1. 10.1038/s41467-021-24946-410.1038/s41467-021-24946-4 ↗
2. 10.1126/science.ade008610.1126/science.ade0086 ↗
3. 10.1002/adfm.20180884910.1002/adfm.201808849 ↗
4. 10.1126/science.adf545110.1126/science.adf5451 ↗
5. 10.1002/adma.20210751110.1002/adma.202107511 ↗
6. Zheng X. T. · Sci. Adv. · 2023 · 9 · 15
7. 10.1038/s41586-020-2892-610.1038/s41586-020-2892-6 ↗
8. 10.1038/s41928-023-01012-z10.1038/s41928-023-01012-z ↗
9. 10.1038/s41467-019-14214-x10.1038/s41467-019-14214-x ↗
10. 10.1002/advs.20230278210.1002/advs.202302782 ↗
11. 10.1002/adfm.20230591910.1002/adfm.202305919 ↗
12. 10.1021/acs.nanolett.4c0062310.1021/acs.nanolett.4c00623 ↗
13. 10.1016/j.nanoen.2019.05.05410.1016/j.nanoen.2019.05.054 ↗
14. 10.1007/s42765-023-00350-z10.1007/s42765-023-00350-z ↗
15. 10.1038/s41467-023-42722-410.1038/s41467-023-42722-4 ↗
16. 10.1007/s12274-023-6248-z10.1007/s12274-023-6248-z ↗
17. 10.1002/adfm.20210110710.1002/adfm.202101107 ↗
18. Guo X. · Sci. Adv. · 2024 · 10 · 13
19. 10.1038/s41467-021-27701-x10.1038/s41467-021-27701-x ↗
20. 10.1038/s41467-023-37678-410.1038/s41467-023-37678-4 ↗
21. 10.1038/s42256-023-00616-610.1038/s42256-023-00616-6 ↗
22. 10.1002/inf2.1238510.1002/inf2.12385 ↗
23. 10.1016/j.nanoen.2023.10900610.1016/j.nanoen.2023.109006 ↗
24. 10.1038/s41467-022-29197-510.1038/s41467-022-29197-5 ↗
25. 10.1038/s41467-023-40686-z10.1038/s41467-023-40686-z ↗
26. 10.1126/scirobotics.abe131510.1126/scirobotics.abe1315 ↗
27. 10.1038/nature1400210.1038/nature14002 ↗
28. 10.1109/TPAMI.2018.288905210.1109/TPAMI.2018.2889052 ↗
29. 10.1038/s42256-023-00760-z10.1038/s42256-023-00760-z ↗
30. 10.1126/sciadv.adf883110.1126/sciadv.adf8831 ↗
31. 10.1021/acsnano.0c0415810.1021/acsnano.0c04158 ↗
32. 10.1126/scirobotics.abf336810.1126/scirobotics.abf3368 ↗
33. 10.1109/JSEN.2013.227905610.1109/JSEN.2013.2279056 ↗
34. 10.1002/adfm.20231443310.1002/adfm.202314433 ↗
35. 10.1126/scirobotics.aaz923910.1126/scirobotics.aaz9239 ↗
36. 10.1126/scirobotics.abm718710.1126/scirobotics.abm7187 ↗
37. 10.1021/acsnano.3c1108010.1021/acsnano.3c11080 ↗
38. 10.1016/j.nanoen.2020.10554810.1016/j.nanoen.2020.105548 ↗
39. 10.1002/adfm.20220812010.1002/adfm.202208120 ↗
40. 10.1002/advs.20200281710.1002/advs.202002817 ↗
41. 10.1002/aisy.20220037110.1002/aisy.202200371 ↗
42. Wang X. · Adv. Mater. · 2016 · 28
43. 10.1002/adma.20170673810.1002/adma.201706738 ↗
44. 10.1021/acsmaterialslett.1c0079910.1021/acsmaterialslett.1c00799 ↗
45. 10.1126/science.ade348310.1126/science.ade3483 ↗
46. 10.1126/sciadv.adi663310.1126/sciadv.adi6633 ↗
47. 10.1126/sciadv.adg439110.1126/sciadv.adg4391 ↗
48. 10.1126/scirobotics.aax219810.1126/scirobotics.aax2198 ↗
49. 10.1038/s41586-019-1234-z10.1038/s41586-019-1234-z ↗
50. 10.1109/TRO.2020.300323010.1109/TRO.2020.3003230 ↗
51. 10.1038/nature1073910.1038/nature10739 ↗
52. 10.1002/adfm.20230747510.1002/adfm.202307475 ↗
53. 10.1038/s41586-020-2038-x10.1038/s41586-020-2038-x ↗
54. 10.1038/s42256-022-00487-310.1038/s42256-022-00487-3 ↗
55. 10.1016/j.nanoen.2023.10882410.1016/j.nanoen.2023.108824 ↗
56. 10.1038/s41531-023-00625-710.1038/s41531-023-00625-7 ↗
57. 10.1038/s42256-023-00702-910.1038/s42256-023-00702-9 ↗
58. 10.1038/s41591-022-01932-x10.1038/s41591-022-01932-x ↗