journal article·2025-05Open access

A Bio‐Inspired Event‐Driven Mechanoluminescent Visuotactile Sensor for Intelligent Interactions

Kit‐Wa Sou, Wang‐Sing Chan, Kai‐Chong Lei, Zihan Wang, Shoujie Li, Dengfeng Peng, Wenbo Ding

Advanced Functional Materials· Volume 35· Issue 20

Abstract

Abstract Event‐driven sensors are essential for real‐time applications, yet the integration of current technologies faces limitations such as high cost, complex signal processing, and vulnerability to noise. This work introduces a bio‐inspired mechanoluminescence visuotactile sensor that enables standard frame‐based cameras to perform event‐driven sensing by emitting light only under mechanical stress, effectively acting as an event trigger. Drawing inspiration from the biomechanics of canine teeth, the sensor utilizes a rod‐patterned array to enhance mechanoluminescent signal sensitivity and expand the contact surface area. In addition, a machine learning‐enabled algorithm is designed to accurately analyze the interaction‐triggered mechanoluminescence signal in real‐time. The sensor is integrated into a quadruped robot's mouth interface, demonstrating enhanced interactive capabilities. The system successfully classifies eight interactive activities with an average accuracy of 92.68%. Comprehensive tests validate the sensor's efficacy in capturing dynamic tactile signals and broadening the application scope of robots in interaction with the environment.
Source: crossref · Quality: baseline

Research context

OpenAlex topics: Advanced Sensor and Energy Harvesting Materials · Analytical Chemistry and Sensors

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

Shenzhen International Graduate School Tsinghua University Shenzhen 518055 P. R. China

Department of Mechanical Engineering University of California Berkeley CA 94709 USA

Shenzhen Key Laboratory of Intelligent Optical Measurement and Detection Key Laboratory of Optoelectronic Devices and Systems of Ministry of Education and Guangdong Province College of Physics and Optoelectronic Engineering Shenzhen University Shenzhen 518060 P. R. China

RISC‐V International Open Source Laboratory Shenzhen 518055 P. R. China

Funding

National Key Research and Development Program of China · Guangdong Innovative and Entrepreneurial Research Team Program · National Natural Science Foundation of China

References (63)

Show source-provided references
1. 10.1038/s41928-022-00765-310.1038/s41928-022-00765-3 ↗
2. 10.1038/s42256-022-00543-y10.1038/s42256-022-00543-y ↗
3. 10.3390/s1712276210.3390/s17122762 ↗
4. a)S.Wang Y.She B.Romero E.Adelson in2021 IEEE Int. Conf. on Robotics and Automation (ICRA) IEEE Piscataway NJ2021 pp.6468–6475;10.1109/ICRA48506.2021.9560783 ↗
5. b)M. H.Tippur E. H.Adelson in2023 IEEE Int. Conf. on Soft Robotics (RoboSoft) IEEE Piscataway NJ2023 pp.1–8;10.1109/RoboSoft55895.2023.10122097 ↗
6. 10.1109/LRA.2020.297725710.1109/LRA.2020.2977257 ↗
7. d)J.Zhao E. H.Adelson in2023 IEEE/RSJ Int. Conf. on Intelligent Robots and Systems (IROS) IEEE Piscataway NJ2023 pp.8979–8984;
8. e)Y.She S. Q.Liu P.Yu E.Adelson in2020 IEEE Int. Conf. on Robotics and Automation (ICRA) IEEE Piscataway NJ2020 pp.10075–10081;10.1109/ICRA40945.2020.9197369 ↗
9. f)S. Q.Liu E. H.Adelson in2022 IEEE Int. Conf. on Soft Robotics (RoboSoft) IEEE Piscataway NJ2022 pp.925–931.10.1109/RoboSoft54090.2022.9762175 ↗
10. a)B.Ward‐Cherrier N.Pestell N. F.Lepora Presented at 2020 IEEE Int. Conf. on Robotics and Automation (ICRA) Piscataway NJ May2020;
11. b)K.Kumagai K.Shimonomura Presented at 2019 IEEE World Haptics Conf. (WHC) Piscataway NJ July2019.
12. a)P.Lichtsteiner T.Delbruck in2005 PhD Research in Microelectronics and Electronics IEEE Piscataway NJ 2005 pp.202–205;
13. 10.1109/JPROC.2014.234615310.1109/JPROC.2014.2346153 ↗
14. 10.1109/TPAMI.2020.300841310.1109/TPAMI.2020.3008413 ↗
15. 10.1038/s41565-019-0501-310.1038/s41565-019-0501-3 ↗
16. 10.1038/s41565-021-01003-110.1038/s41565-021-01003-1 ↗
17. 10.1038/s41467-022-31148-z10.1038/s41467-022-31148-z ↗
18. 10.1038/s41928-023-01055-210.1038/s41928-023-01055-2 ↗
19. a)D.Gehrig A.Loquercio K. G.Derpanis D.Scaramuzza Proceedings of the IEEE/CVF Int. Conf. on Computer Vision IEEE Piscataway NJ2019 pp.5633–5643;
20. b)S.Tulyakov D.Gehrig S.Georgoulis J.Erbach M.Gehrig Y.Li D.Scaramuzza Proceedings of the IEEE/CVF Conf. on Computer Vision and Pattern Recognition IEEE Piscataway NJ2021 pp.15155–16164.
21. a)Z.Sun N.Messikommer D.Gehrig D.Scaramuzza European Conf. on Computer Vision Springer Nature Switzerland2022 pp.341–357;10.1007/978-3-031-19830-4_20 ↗
22. Perot E. · Adv. Neural Inf. Proc. Syst. · 2020 · 33
23. 10.1109/TMM.2023.326063810.1109/TMM.2023.3260638 ↗
24. 10.1126/science.aba550410.1126/science.aba5504 ↗
25. 10.1021/acs.nanolett.4c0251210.1021/acs.nanolett.4c02512 ↗
26. 10.1002/adfm.20230032110.1002/adfm.202300321 ↗
27. 10.1063/1.479168910.1063/1.4791689 ↗
28. 10.1063/1.496413910.1063/1.4964139 ↗
29. 10.1063/1.482536010.1063/1.4825360 ↗
30. 10.1002/inf2.1225010.1002/inf2.12250 ↗
31. 10.1002/adom.20210013710.1002/adom.202100137 ↗
32. 10.1002/adma.20210905510.1002/adma.202109055 ↗
33. 10.1002/adma.20180029110.1002/adma.201800291 ↗
34. 10.1038/s41467-022-31705-610.1038/s41467-022-31705-6 ↗
35. 10.1038/s41467-024-46432-310.1038/s41467-024-46432-3 ↗
36. 10.1038/s41467-024-47962-610.1038/s41467-024-47962-6 ↗
37. 10.1002/adma.20200592510.1002/adma.202005925 ↗
38. 10.1002/lpor.20230100210.1002/lpor.202301002 ↗
39. 10.1016/j.nanoen.2021.10586010.1016/j.nanoen.2021.105860 ↗
40. 10.1038/s41928-022-00841-810.1038/s41928-022-00841-8 ↗
41. 10.1002/sus2.20710.1002/sus2.207 ↗
42. 10.1152/jn.1993.69.5.156710.1152/jn.1993.69.5.1567 ↗
43. 10.1113/jphysiol.1992.sp01900710.1113/jphysiol.1992.sp019007 ↗
44. 10.1016/S0889-5406(00)70254-X10.1016/S0889-5406(00)70254-X ↗
45. 10.1039/C4EE01776E10.1039/C4EE01776E ↗
46. 10.1089/soro.2018.013110.1089/soro.2018.0131 ↗
47. 10.1021/acs.macromol.9b0222110.1021/acs.macromol.9b02221 ↗
48. 10.1039/C7TC01146F10.1039/C7TC01146F ↗
49. 10.3390/polym1401000910.3390/polym14010009 ↗
50. 10.1021/acsnano.0c0889010.1021/acsnano.0c08890 ↗
51. 10.1111/j.1600-0765.1994.tb01208.x10.1111/j.1600-0765.1994.tb01208.x ↗
52. 10.1177/1045441199010003040110.1177/10454411990100030401 ↗
53. 10.1109/JSEN.2021.310064510.1109/JSEN.2021.3100645 ↗
54. 10.1016/B978-0-12-820633-1.00007-310.1016/B978-0-12-820633-1.00007-3 ↗
55. 10.1002/advs.20220492510.1002/advs.202204925 ↗
56. 10.1002/smll.20220708910.1002/smll.202207089 ↗
57. 10.1002/bio.292410.1002/bio.2924 ↗
58. 10.1016/j.nanoen.2021.10664610.1016/j.nanoen.2021.106646 ↗
59. 10.1016/j.jallcom.2015.07.17010.1016/j.jallcom.2015.07.170 ↗
60. 10.1143/JJAP.48.04C15010.1143/JJAP.48.04C150 ↗
61. 10.1002/lpor.20210027610.1002/lpor.202100276 ↗
62. 10.1063/1.482536010.1063/1.4825360 ↗
63. 10.1021/acsami.5b0759410.1021/acsami.5b07594 ↗