Bionic Fingerprint Tactile Sensor with Deep Learning‐Decoupled Multimodal Perception for Simultaneous Pressure‐Friction Mapping
Source abstract
Abstract
Abstract In the field of intelligent tactile perception, achieving synchronous and precise monitoring of pressure and friction forces represents a fundamental challenge for replicating authentic tactile interactions. This complexity primarily stems from the intricate signal coupling between pressure and friction modalities. Drawing inspiration from the biomechanical mechanisms of human fingerprints, a dual‐mode bionic fingerprint tactile sensor (BFTS) is developed that generates distinct capacitive responses to both pressure and friction stimuli. The sensor demonstrates remarkable pressure sensitivity, enabling precise discrimination of 3D blocks with varying hardness levels. Furthermore, its superior friction‐sensing capability achieves accurate differentiation of 2D fabric surfaces with texture variations. To address the inherent signal coupling in concurrent pressure‐friction detection, a hybrid deep learning architecture is devised, synergistically integrating Convolutional Neural Network (CNN), Long Short‐Term Memory (LSTM), and Attention Mechanism (AM). This multimodal fusion model achieves exceptional signal decoupling performance ( R 2 ≥ 0.95) through spatiotemporal feature extraction and adaptive weight allocation. Implemented on the BFTS platform, the integrated intelligent tactile perception system (ITPS) attains 97% classification accuracy for six visually similar citrus varieties. The proposed methodology not only resolves long‐standing challenges in tactile signal decoupling but also establishes a new paradigm for multimodal perception in next‐generation intelligent tactile systems.
Source: crossref · Quality: baseline
Research context
OpenAlex topics: Advanced Sensor and Energy Harvesting Materials · Tactile and Sensory Interactions · Muscle activation and electromyography studies
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
Affiliations
Shandong Key Laboratory of Micro‐nano Packaging and System Integration College of Electronic and Information Qingdao University Qingdao 266071 China
School of Integrated Circuits Shandong University Jinan 250101 China
Department of thin film Korea Advanced Nano Fab Center (KANC) Suwon 443270 South Korea
Funding
National Natural Science Foundation of China · Natural Science Foundation of Shandong Province
References (72)
Show source-provided references
1. 10.1002/adma.20240677810.1002/adma.202406778 ↗
2. 10.1002/adfm.20240955810.1002/adfm.202409558 ↗
3. 10.1016/j.nanoen.2024.11027910.1016/j.nanoen.2024.110279 ↗
4. 10.1002/adhm.20230100510.1002/adhm.202301005 ↗
5. 10.1002/adma.20220911710.1002/adma.202209117 ↗
6. 10.1002/adfm.20200818610.1002/adfm.202008186 ↗
7. 10.1002/aisy.20230022510.1002/aisy.202300225 ↗
8. 10.1016/j.nanoen.2024.10953210.1016/j.nanoen.2024.109532 ↗
9. 10.1016/j.cej.2022.13825810.1016/j.cej.2022.138258 ↗
10. 10.1002/adfm.20230869810.1002/adfm.202308698 ↗
11. 10.1016/j.nanoen.2024.10939810.1016/j.nanoen.2024.109398 ↗
12. 10.1038/s41467-024-52331-410.1038/s41467-024-52331-4 ↗
13. 10.1038/s41467-022-32745-810.1038/s41467-022-32745-8 ↗
14. 10.1002/advs.20230683210.1002/advs.202306832 ↗
15. 10.1021/acsnano.4c0410010.1021/acsnano.4c04100 ↗
16. 10.1002/adfm.20240935810.1002/adfm.202409358 ↗
17. 10.1002/smll.20170390210.1002/smll.201703902 ↗
18. 10.1016/j.nanoen.2022.10778810.1016/j.nanoen.2022.107788 ↗
19. 10.1016/j.nanoen.2021.10600110.1016/j.nanoen.2021.106001 ↗
20. 10.1002/adfm.20230571910.1002/adfm.202305719 ↗
21. 10.1039/D0TC03110K10.1039/D0TC03110K ↗
22. 10.34133/2020/891069210.34133/2020/8910692 ↗
23. 10.1038/s41467-023-42722-410.1038/s41467-023-42722-4 ↗
24. 10.1016/j.nanoen.2022.10732410.1016/j.nanoen.2022.107324 ↗
25. 10.1038/s41467-018-04906-110.1038/s41467-018-04906-1 ↗
26. 10.1002/admt.20210078810.1002/admt.202100788 ↗
27. 10.1002/inf2.1263110.1002/inf2.12631 ↗
28. 10.1016/j.nanoen.2019.10443610.1016/j.nanoen.2019.104436 ↗
29. 10.1002/adfm.20170750310.1002/adfm.201707503 ↗
30. 10.1002/adma.20220262210.1002/adma.202202622 ↗
31. 10.1021/acsaelm.2c0046310.1021/acsaelm.2c00463 ↗
32. 10.1021/acsami.1c1739110.1021/acsami.1c17391 ↗
33. 10.1021/acsami.0c0444810.1021/acsami.0c04448 ↗
34. 10.1016/j.nanoen.2024.10935710.1016/j.nanoen.2024.109357 ↗
35. 10.1002/adma.20231014510.1002/adma.202310145 ↗
36. 10.1016/j.matdes.2023.11243910.1016/j.matdes.2023.112439 ↗
37. 10.1038/s41467-024-55790-x10.1038/s41467-024-55790-x ↗
38. 10.1021/acs.nanolett.4c0639210.1021/acs.nanolett.4c06392 ↗
39. 10.1016/j.ipm.2023.10332010.1016/j.ipm.2023.103320 ↗
40. 10.1007/s00521-020-05532-z10.1007/s00521-020-05532-z ↗
41. Feng L. · IEEE T. Neur. Net. Lear. · 2021 · 32 · 3306
42. 10.1016/j.techfore.2023.12274610.1016/j.techfore.2023.122746 ↗
43. 10.1016/j.cej.2024.15159210.1016/j.cej.2024.151592 ↗
44. 10.1016/j.cej.2023.14646410.1016/j.cej.2023.146464 ↗
45. 10.1016/j.nanoen.2024.10970110.1016/j.nanoen.2024.109701 ↗
46. 10.1016/j.eml.2020.10071410.1016/j.eml.2020.100714 ↗
47. 10.1002/advs.20240023410.1002/advs.202400234 ↗
48. 10.1002/admt.20210028510.1002/admt.202100285 ↗
49. 10.1002/adma.20241952410.1002/adma.202419524 ↗
50. 10.1002/advs.20230588310.1002/advs.202305883 ↗
51. 10.1016/j.nanoen.2023.10886210.1016/j.nanoen.2023.108862 ↗
52. 10.1016/j.cej.2024.15455310.1016/j.cej.2024.154553 ↗
53. 10.1126/sciadv.adp034810.1126/sciadv.adp0348 ↗
54. 10.1002/smtd.20240187610.1002/smtd.202401876 ↗
55. 10.1016/j.nanoen.2021.10679810.1016/j.nanoen.2021.106798 ↗
56. 10.1007/s42765-024-00458-w10.1007/s42765-024-00458-w ↗
57. 10.1016/j.aca.2023.34120010.1016/j.aca.2023.341200 ↗
58. 10.1109/ACCESS.2023.334502910.1109/ACCESS.2023.3345029 ↗
59. 10.1021/acssensors.2c0142310.1021/acssensors.2c01423 ↗
60. 10.1002/adma.20220524910.1002/adma.202205249 ↗
61. 10.1016/j.nanoen.2024.10934210.1016/j.nanoen.2024.109342 ↗
62. 10.1002/inf2.1254510.1002/inf2.12545 ↗
63. 10.1002/aisy.20230018610.1002/aisy.202300186 ↗
64. 10.1002/adma.20230982110.1002/adma.202309821 ↗
65. 10.1109/JSEN.2023.331739910.1109/JSEN.2023.3317399 ↗
66. 10.1002/advs.20240258210.1002/advs.202402582 ↗
67. 10.1039/D4CS00870G10.1039/D4CS00870G ↗
68. 10.1073/pnas.240797112110.1073/pnas.2407971121 ↗
69. 10.1088/1674-4926/2412170110.1088/1674-4926/24121701 ↗
70. 10.1088/1674-4926/2409004610.1088/1674-4926/24090046 ↗
71. 10.1002/adma.20240023610.1002/adma.202400236 ↗
72. 10.1038/s41467-023-43664-710.1038/s41467-023-43664-7 ↗