journal article·2024-11-06

Artificial Tactile Sensory Finger for Contact Pattern Identification Based on High Spatiotemporal Piezoresistive Sensor Array

Qiangqiang Ouyang, Xiaoying Wang, Shaoyi Wang, Zizhen Huang, Zhaohui Shi, Mao Pang, Bin Liu, Chee Keong Tan, Qintai Yang, Limin Rong

ACS Applied Materials & Interfaces· Volume 16· Issue 44
Publisher page

Abstract

Human fingertip tactile perception relies on the activation of densely distributed tactile receptors to identify contact patterns in the brain. Despite significant efforts to integrate tactile sensors with machine learning algorithms for recognizing physical patterns on object surfaces, developing a tactile sensing system that emulates human fingertip capabilities for identifying contact patterns with a high spatiotemporal resolution remains a formidable challenge. In this study, we present the development of an artificial tactile finger for accurate contact pattern identification, achieved through the integration of a high spatiotemporal piezoresistive sensor array (PRSA) and a convolutional neural network (CNN) model. Spatiotemporal characterization tests reveal that the artificial finger exhibits a fast temporal resolution of approximately 7 ms and achieves a two-point threshold of 1.5 mm, surpassing that of the human fingertip. To compare the performance of the artificial finger with the human finger in recognizing different patterns, we acquired pressure images by pressing the artificial finger, coated with a flexible PRSA film, onto both simple embossed and complex curved patterns while also recording human recognition results of perceiving these patterns. Experimental findings demonstrate that the artificial finger achieves higher classification accuracy in recognizing both simple and complex patterns (99.0 and 96.1%, respectively) compared to the human fingertip (69.1 and 22.7%). This artificial finger serves as a promising platform with great potential for various robotic tactile sensing applications including prosthetics, skin electronics, and robotic surgery.
Source: openalex_inverted_index · Quality: baseline

Research context

OpenAlex topics: Advanced Sensor and Energy Harvesting Materials · Tactile and Sensory Interactions · EEG and Brain-Computer Interfaces

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

Third Affiliated Hospital of Sun Yat-sen University

Sun Yat-sen University

College of Electronic Engineering

South China Agricultural University

Ultrasound Department

Guangdong Provincial Occupational Disease Prevention Hospital

Advanced Materials Thrust, Function Hub

Hong Kong University of Science and Technology

Department of Electronic and Computer Engineering

Funding

National Natural Science Foundation of China · Key-Area Research and Development Program of Guangdong Province · Key Research and Development Program of Guangzhou

References (52)

Show source-provided references
1. 10.1126/sciadv.aaz869310.1126/sciadv.aaz8693 ↗
2. 10.1109/TBME.2021.307609410.1109/TBME.2021.3076094 ↗
3. 10.1002/aisy.20210022810.1002/aisy.202100228 ↗
4. 10.1016/S0166-4328(02)00154-710.1016/S0166-4328(02)00154-7 ↗
5. 10.1073/pnas.130550911010.1073/pnas.1305509110 ↗
6. 10.1167/17.10.35810.1167/17.10.358 ↗
7. 10.1126/sciadv.abd779510.1126/sciadv.abd7795 ↗
8. 10.1002/advs.20200281710.1002/advs.202002817 ↗
9. 10.1021/acsnano.2c0643210.1021/acsnano.2c06432 ↗
10. Rahimi, M.; Jiang, F.; Ye, C.; Shen, Y. Dynamic Spatiotemporal Pattern Identification and Analysis Using a Fingertip-based Electro-Tactile Display Array. In In 2019 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS); IEEE, 2019; pp 8132–8137.10.1109/IROS40897.2019.8967906 ↗
11. Vallbo A. B. · Hum. Neurobiol. · 1984 · 3 · 3
12. 10.1113/jphysiol.1979.sp01261910.1113/jphysiol.1979.sp012619 ↗
13. 10.1038/s41586-019-1234-z10.1038/s41586-019-1234-z ↗
14. 10.1002/adma.20220051710.1002/adma.202200517 ↗
15. 10.1038/micronano.2016.6510.1038/micronano.2016.65 ↗
16. 10.1021/acsami.2c0173010.1021/acsami.2c01730 ↗
17. 10.1016/j.nanoen.2023.10896410.1016/j.nanoen.2023.108964 ↗
18. 10.1002/adma.20140344110.1002/adma.201403441 ↗
19. 10.1038/s41467-019-14054-910.1038/s41467-019-14054-9 ↗
20. 10.1021/acsaelm.2c0034110.1021/acsaelm.2c00341 ↗
21. 10.1021/acsaelm.3c0167810.1021/acsaelm.3c01678 ↗
22. 10.1002/aenm.20230038710.1002/aenm.202300387 ↗
23. 10.1002/admt.20220067710.1002/admt.202200677 ↗
24. 10.1016/j.cej.2024.15127410.1016/j.cej.2024.151274 ↗
25. 10.1016/j.nanoen.2021.10609310.1016/j.nanoen.2021.106093 ↗
26. 10.1109/TMECH.2007.90192310.1109/TMECH.2007.901923 ↗
27. 10.1016/j.nanoen.2019.10434610.1016/j.nanoen.2019.104346 ↗
28. 10.1002/smll.20170390210.1002/smll.201703902 ↗
29. 10.1002/smtd.20200084210.1002/smtd.202000842 ↗
30. 10.3390/nano1214249510.3390/nano12142495 ↗
31. 10.1109/TMAG.2019.289854610.1109/TMAG.2019.2898546 ↗
32. 10.1039/C8NR00595H10.1039/C8NR00595H ↗
33. 10.1002/aenm.20220304010.1002/aenm.202203040 ↗
34. 10.1021/acsnano.2c0154810.1021/acsnano.2c01548 ↗
35. 10.1016/j.inffus.2022.11.03210.1016/j.inffus.2022.11.032 ↗
36. 10.1038/s41467-021-25637-w10.1038/s41467-021-25637-w ↗
37. 10.1038/s41467-022-32745-810.1038/s41467-022-32745-8 ↗
38. 10.1016/j.bios.2023.11587310.1016/j.bios.2023.115873 ↗
39. 10.1016/j.sna.2017.11.05310.1016/j.sna.2017.11.053 ↗
40. 10.1002/adfm.20180756910.1002/adfm.201807569 ↗
41. 10.1021/acsami.8b1702010.1021/acsami.8b17020 ↗
42. 10.1038/s41551-020-00604-w10.1038/s41551-020-00604-w ↗
43. 10.1021/acsami.0c2167110.1021/acsami.0c21671 ↗
44. 10.1021/acsami.0c2140710.1021/acsami.0c21407 ↗
45. 10.1016/S0959-4388(00)00234-810.1016/S0959-4388(00)00234-8 ↗
46. 10.1080/0899022022013150510.1080/08990220220131505 ↗
47. 10.1002/smtd.20210105110.1002/smtd.202101051 ↗
48. 10.1021/acsami.3c0946410.1021/acsami.3c09464 ↗
49. 10.1021/acsami.3c1878810.1021/acsami.3c18788 ↗
50. 10.1109/TBME.2020.300739710.1109/TBME.2020.3007397 ↗
51. 10.1073/pnas.170485611410.1073/pnas.1704856114 ↗
52. 10.1109/5.72679110.1109/5.726791 ↗