journal article·2024-09

Zero‐Biased Bionic Fingertip E‐Skin with Multimodal Tactile Perception and Artificial Intelligence for Augmented Touch Awareness

Xinge Guo, Zhongda Sun, Yao Zhu, Chengkuo Lee

Advanced Materials· Volume 36· Issue 39
Publisher page

Abstract

Abstract Electronic skins (E‐Skins) are crucial for future robotics and wearable devices to interact with and perceive the real world. Prior research faces challenges in achieving comprehensive tactile perception and versatile functionality while keeping system simplicity for lack of multimodal sensing capability in a single sensor. Two kinds of tactile sensors, transient voltage artificial neuron (TVAN) and sustained potential artificial neuron (SPAN), featuring self‐generated zero‐biased signals are developed to realize synergistic sensing of multimodal information (vibration, material, texture, pressure, and temperature) in a single device instead of complex sensor arrays. Simultaneously, machine learning with feature fusion is applied to fully decode their output information and compensate for the inevitable instability of applied force, speed, etc, in real applications. Integrating TVAN and SPAN, the formed E‐Skin achieves holistic touch awareness in only a single unit. It can thoroughly perceive an object through a simple touch without strictly controlled testing conditions, realize the capability to discern surface roughness from 0.8 to 1600 µm, hardness from 6HA to 85HD, and correctly distinguish 16 objects with temperature variance from 0 to 80 °C. The E‐skin also features a simple and scalable fabrication process, which can be integrated into various devices for broad applications.
Source: crossref · Quality: baseline

Research context

OpenAlex topics: Advanced Sensor and Energy Harvesting Materials · Tactile and Sensory Interactions · Muscle activation and electromyography studies

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

Department of Electrical & Computer Engineering National University of Singapore 4 Engineering Drive 3 Singapore 117576 Singapore

Center for Intelligent Sensors and MEMS (CISM) National University of Singapore 5 Engineering Drive 1 Singapore 117608 Singapore

Institute of Microelectronics (IME) Agency for Science Technology, and Research (A*STAR) Singapore 138634 Singapore

National University of Singapore Suzhou Research Institute (NUSRI) Suzhou 215123 China

NUS Graduate School – Integrative Sciences and Engineering Program (ISEP) National University of Singapore Singapore 119077 Singapore

Funding

National Research Foundation Singapore

References (63)

Show source-provided references
1. 10.1038/nmat467110.1038/nmat4671 ↗
2. 10.1021/acsnano.2c1260610.1021/acsnano.2c12606 ↗
3. 10.1021/acs.chemrev.3c0050710.1021/acs.chemrev.3c00507 ↗
4. 10.1016/j.nwnano.2023.10001310.1016/j.nwnano.2023.100013 ↗
5. 10.1002/adfm.20200808710.1002/adfm.202008087 ↗
6. 10.1002/adma.20210790210.1002/adma.202107902 ↗
7. 10.1038/s41467-023-40763-310.1038/s41467-023-40763-3 ↗
8. Guo Z. H. · Sci. Adv. · 2022 · 8
9. 10.1007/s40820-023-01216-010.1007/s40820-023-01216-0 ↗
10. 10.1002/adma.20220378610.1002/adma.202203786 ↗
11. 10.1002/adma.20190476510.1002/adma.201904765 ↗
12. 10.1038/s42256-022-00487-310.1038/s42256-022-00487-3 ↗
13. 10.1038/s42256-023-00616-610.1038/s42256-023-00616-6 ↗
14. 10.1016/j.sna.2020.11235010.1016/j.sna.2020.112350 ↗
15. 10.1002/adma.20231042910.1002/adma.202310429 ↗
16. 10.1002/advs.20230900610.1002/advs.202309006 ↗
17. 10.1126/sciadv.abq252110.1126/sciadv.abq2521 ↗
18. 10.1002/adma.20211008210.1002/adma.202110082 ↗
19. 10.1038/s41467-024-45611-610.1038/s41467-024-45611-6 ↗
20. 10.1002/inf2.1247210.1002/inf2.12472 ↗
21. 10.1126/scirobotics.abn049510.1126/scirobotics.abn0495 ↗
22. 10.1002/adma.20140136710.1002/adma.201401367 ↗
23. 10.1126/sciadv.150066110.1126/sciadv.1500661 ↗
24. 10.1016/j.nanoen.2023.10918910.1016/j.nanoen.2023.109189 ↗
25. 10.1002/adma.20220307310.1002/adma.202203073 ↗
26. 10.1021/acs.nanolett.9b0092210.1021/acs.nanolett.9b00922 ↗
27. 10.1016/j.nanoen.2021.10679810.1016/j.nanoen.2021.106798 ↗
28. 10.1016/j.nanoen.2017.08.00110.1016/j.nanoen.2017.08.001 ↗
29. 10.1002/adma.20170629910.1002/adma.201706299 ↗
30. 10.1002/advs.20200260610.1002/advs.202002606 ↗
31. 10.1038/s41467-021-25637-w10.1038/s41467-021-25637-w ↗
32. 10.1002/advs.20230552810.1002/advs.202305528 ↗
33. 10.1002/advs.20230502510.1002/advs.202305025 ↗
34. 10.1038/s41928-021-00585-x10.1038/s41928-021-00585-x ↗
35. 10.1038/s41467-023-42722-410.1038/s41467-023-42722-4 ↗
36. 10.1007/978-1-4939-6418-5_810.1007/978-1-4939-6418-5_8 ↗
37. 10.1002/neu.2007910.1002/neu.20079 ↗
38. 10.1021/acsnano.2c0529910.1021/acsnano.2c05299 ↗
39. 10.1126/sciadv.abb908310.1126/sciadv.abb9083 ↗
40. 10.1038/nprot.2017.15710.1038/nprot.2017.157 ↗
41. 10.1121/1.38722510.1121/1.387225 ↗
42. 10.1002/advs.20210023010.1002/advs.202100230 ↗
43. 10.1038/s41467-019-09461-x10.1038/s41467-019-09461-x ↗
44. 10.1126/science.116646710.1126/science.1166467 ↗
45. 10.1002/advs.20200260610.1002/advs.202002606 ↗
46. 10.1002/adma.20230059310.1002/adma.202300593 ↗
47. 10.1038/s41467-022-32745-810.1038/s41467-022-32745-8 ↗
48. 10.1002/adfm.20201082410.1002/adfm.202010824 ↗
49. Shin J. · Sci. Adv. · 2019 · 5
50. 10.1002/adma.20210206910.1002/adma.202102069 ↗
51. 10.1016/j.cej.2022.13833510.1016/j.cej.2022.138335 ↗
52. 10.1016/j.apsusc.2023.15632810.1016/j.apsusc.2023.156328 ↗
53. 10.1016/j.cej.2022.13852510.1016/j.cej.2022.138525 ↗
54. 10.1002/adfm.20190961610.1002/adfm.201909616 ↗
55. 10.1021/acsami.2c1112410.1021/acsami.2c11124 ↗
56. 10.1002/adfm.20210064910.1002/adfm.202100649 ↗
57. 10.1126/science.aaw197410.1126/science.aaw1974 ↗
58. 10.1002/adma.20210305610.1002/adma.202103056 ↗
59. 10.1002/adma.20220069310.1002/adma.202200693 ↗
60. 10.1126/sciadv.aba106210.1126/sciadv.aba1062 ↗
61. 10.1126/sciadv.abo531410.1126/sciadv.abo5314 ↗
62. 10.1016/j.sna.2020.11236210.1016/j.sna.2020.112362 ↗
63. 10.1038/s41467-021-27672-z10.1038/s41467-021-27672-z ↗