journal article·2025-12Open access

Bionic Fingerprint Tactile Sensor with Deep Learning‐Decoupled Multimodal Perception for Simultaneous Pressure‐Friction Mapping

Xueqian Liu, Yuanyue Li, Yi'ang Li, Xuqi Zheng, Jingjing Guo, Tao Sun, Ho‐Kun Sung, Leonid Chernogor, Minghui Cao, Ting Xu, Zhao Yao, Yang Li

Advanced Functional Materials· Volume 35· Issue 49

Abstract

Abstract In the field of intelligent tactile perception, achieving synchronous and precise monitoring of pressure and friction forces represents a fundamental challenge for replicating authentic tactile interactions. This complexity primarily stems from the intricate signal coupling between pressure and friction modalities. Drawing inspiration from the biomechanical mechanisms of human fingerprints, a dual‐mode bionic fingerprint tactile sensor (BFTS) is developed that generates distinct capacitive responses to both pressure and friction stimuli. The sensor demonstrates remarkable pressure sensitivity, enabling precise discrimination of 3D blocks with varying hardness levels. Furthermore, its superior friction‐sensing capability achieves accurate differentiation of 2D fabric surfaces with texture variations. To address the inherent signal coupling in concurrent pressure‐friction detection, a hybrid deep learning architecture is devised, synergistically integrating Convolutional Neural Network (CNN), Long Short‐Term Memory (LSTM), and Attention Mechanism (AM). This multimodal fusion model achieves exceptional signal decoupling performance ( R 2 ≥ 0.95) through spatiotemporal feature extraction and adaptive weight allocation. Implemented on the BFTS platform, the integrated intelligent tactile perception system (ITPS) attains 97% classification accuracy for six visually similar citrus varieties. The proposed methodology not only resolves long‐standing challenges in tactile signal decoupling but also establishes a new paradigm for multimodal perception in next‐generation intelligent tactile systems.
Source: crossref · Quality: baseline

Research context

OpenAlex topics: Advanced Sensor and Energy Harvesting Materials · Tactile and Sensory Interactions · Muscle activation and electromyography studies

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

Shandong Key Laboratory of Micro‐nano Packaging and System Integration College of Electronic and Information Qingdao University Qingdao 266071 China

School of Integrated Circuits Shandong University Jinan 250101 China

Department of thin film Korea Advanced Nano Fab Center (KANC) Suwon 443270 South Korea

Funding

National Natural Science Foundation of China · Natural Science Foundation of Shandong Province

References (72)

Show source-provided references
1. 10.1002/adma.20240677810.1002/adma.202406778 ↗
2. 10.1002/adfm.20240955810.1002/adfm.202409558 ↗
3. 10.1016/j.nanoen.2024.11027910.1016/j.nanoen.2024.110279 ↗
4. 10.1002/adhm.20230100510.1002/adhm.202301005 ↗
5. 10.1002/adma.20220911710.1002/adma.202209117 ↗
6. 10.1002/adfm.20200818610.1002/adfm.202008186 ↗
7. 10.1002/aisy.20230022510.1002/aisy.202300225 ↗
8. 10.1016/j.nanoen.2024.10953210.1016/j.nanoen.2024.109532 ↗
9. 10.1016/j.cej.2022.13825810.1016/j.cej.2022.138258 ↗
10. 10.1002/adfm.20230869810.1002/adfm.202308698 ↗
11. 10.1016/j.nanoen.2024.10939810.1016/j.nanoen.2024.109398 ↗
12. 10.1038/s41467-024-52331-410.1038/s41467-024-52331-4 ↗
13. 10.1038/s41467-022-32745-810.1038/s41467-022-32745-8 ↗
14. 10.1002/advs.20230683210.1002/advs.202306832 ↗
15. 10.1021/acsnano.4c0410010.1021/acsnano.4c04100 ↗
16. 10.1002/adfm.20240935810.1002/adfm.202409358 ↗
17. 10.1002/smll.20170390210.1002/smll.201703902 ↗
18. 10.1016/j.nanoen.2022.10778810.1016/j.nanoen.2022.107788 ↗
19. 10.1016/j.nanoen.2021.10600110.1016/j.nanoen.2021.106001 ↗
20. 10.1002/adfm.20230571910.1002/adfm.202305719 ↗
21. 10.1039/D0TC03110K10.1039/D0TC03110K ↗
22. 10.34133/2020/891069210.34133/2020/8910692 ↗
23. 10.1038/s41467-023-42722-410.1038/s41467-023-42722-4 ↗
24. 10.1016/j.nanoen.2022.10732410.1016/j.nanoen.2022.107324 ↗
25. 10.1038/s41467-018-04906-110.1038/s41467-018-04906-1 ↗
26. 10.1002/admt.20210078810.1002/admt.202100788 ↗
27. 10.1002/inf2.1263110.1002/inf2.12631 ↗
28. 10.1016/j.nanoen.2019.10443610.1016/j.nanoen.2019.104436 ↗
29. 10.1002/adfm.20170750310.1002/adfm.201707503 ↗
30. 10.1002/adma.20220262210.1002/adma.202202622 ↗
31. 10.1021/acsaelm.2c0046310.1021/acsaelm.2c00463 ↗
32. 10.1021/acsami.1c1739110.1021/acsami.1c17391 ↗
33. 10.1021/acsami.0c0444810.1021/acsami.0c04448 ↗
34. 10.1016/j.nanoen.2024.10935710.1016/j.nanoen.2024.109357 ↗
35. 10.1002/adma.20231014510.1002/adma.202310145 ↗
36. 10.1016/j.matdes.2023.11243910.1016/j.matdes.2023.112439 ↗
37. 10.1038/s41467-024-55790-x10.1038/s41467-024-55790-x ↗
38. 10.1021/acs.nanolett.4c0639210.1021/acs.nanolett.4c06392 ↗
39. 10.1016/j.ipm.2023.10332010.1016/j.ipm.2023.103320 ↗
40. 10.1007/s00521-020-05532-z10.1007/s00521-020-05532-z ↗
41. Feng L. · IEEE T. Neur. Net. Lear. · 2021 · 32 · 3306
42. 10.1016/j.techfore.2023.12274610.1016/j.techfore.2023.122746 ↗
43. 10.1016/j.cej.2024.15159210.1016/j.cej.2024.151592 ↗
44. 10.1016/j.cej.2023.14646410.1016/j.cej.2023.146464 ↗
45. 10.1016/j.nanoen.2024.10970110.1016/j.nanoen.2024.109701 ↗
46. 10.1016/j.eml.2020.10071410.1016/j.eml.2020.100714 ↗
47. 10.1002/advs.20240023410.1002/advs.202400234 ↗
48. 10.1002/admt.20210028510.1002/admt.202100285 ↗
49. 10.1002/adma.20241952410.1002/adma.202419524 ↗
50. 10.1002/advs.20230588310.1002/advs.202305883 ↗
51. 10.1016/j.nanoen.2023.10886210.1016/j.nanoen.2023.108862 ↗
52. 10.1016/j.cej.2024.15455310.1016/j.cej.2024.154553 ↗
53. 10.1126/sciadv.adp034810.1126/sciadv.adp0348 ↗
54. 10.1002/smtd.20240187610.1002/smtd.202401876 ↗
55. 10.1016/j.nanoen.2021.10679810.1016/j.nanoen.2021.106798 ↗
56. 10.1007/s42765-024-00458-w10.1007/s42765-024-00458-w ↗
57. 10.1016/j.aca.2023.34120010.1016/j.aca.2023.341200 ↗
58. 10.1109/ACCESS.2023.334502910.1109/ACCESS.2023.3345029 ↗
59. 10.1021/acssensors.2c0142310.1021/acssensors.2c01423 ↗
60. 10.1002/adma.20220524910.1002/adma.202205249 ↗
61. 10.1016/j.nanoen.2024.10934210.1016/j.nanoen.2024.109342 ↗
62. 10.1002/inf2.1254510.1002/inf2.12545 ↗
63. 10.1002/aisy.20230018610.1002/aisy.202300186 ↗
64. 10.1002/adma.20230982110.1002/adma.202309821 ↗
65. 10.1109/JSEN.2023.331739910.1109/JSEN.2023.3317399 ↗
66. 10.1002/advs.20240258210.1002/advs.202402582 ↗
67. 10.1039/D4CS00870G10.1039/D4CS00870G ↗
68. 10.1073/pnas.240797112110.1073/pnas.2407971121 ↗
69. 10.1088/1674-4926/2412170110.1088/1674-4926/24121701 ↗
70. 10.1088/1674-4926/2409004610.1088/1674-4926/24090046 ↗
71. 10.1002/adma.20240023610.1002/adma.202400236 ↗
72. 10.1038/s41467-023-43664-710.1038/s41467-023-43664-7 ↗