journal article·2024-08-27

Physical Reservoir Computing Using van der Waals Ferroelectrics for Acoustic Keyword Spotting

Yi Cao, Zefeng Zhang, Bo-Wei Qin, Weihui Sang, Honghong Li, Tinghao Wang, Feixia Tan, Yang Gan, Xumeng Zhang, Tao Liu, Du Xiang, Wei Lin, Qi Liu

ACS Nano· Volume 18· Issue 34
Publisher page

Abstract

Acoustic keyword spotting (KWS) plays a pivotal role in the voice-activated systems of artificial intelligence (AI), allowing for hands-free interactions between humans and smart devices through information retrieval of the voice commands. The cloud computing technology integrated with the artificial neural networks has been employed to execute the KWS tasks, which however suffers from propagation delay and the risk of privacy breach. Here, we report a single-node reservoir computing (RC) system based on the CuInP 2 S 6 (CIPS)/graphene heterostructure planar device for implementing the KWS task with low computation cost. Through deliberately tuning the Schottky barrier height at the ferroelectric CIPS interfaces for the thermionic injection and transport of the electrons, the typical nonlinear current response and fading memory characteristics are achieved in the device. Additionally, the device exhibits diverse synaptic plasticity with an excellent separation capability of the temporal information. We construct a RC system through employing the ferroelectric device as the physical node to spot the acoustic keywords, i.e., the natural numbers from 1 to 9 based on simulation, in which the system demonstrates outstanding performance with high accuracy rate (>94.6%) and recall rate (>92.0%). Our work promises physical RC in single-node configuration as a prospective computing platform to process the acoustic keywords, promoting its applications in the artificial auditory system at the edge.
Source: openalex_inverted_index · Quality: baseline

Research context

OpenAlex topics: Neural Networks and Reservoir Computing · Advanced Memory and Neural Computing · Ferroelectric and Negative Capacitance Devices

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

State Key Laboratory of Integrated Chips and Systems, Frontier Institute of Chip and System, Fudan University, Shanghai 200433, China

School of Microelectronics, Fudan University, Shanghai 200433, China

Research Institute of Intelligent Complex Systems and MOE Frontiers Center for Brain Science, Fudan University, Shanghai 200433, China

Shanghai Artificial Intelligence Laboratory, Shanghai 200232, China

Shanghai Frontiers Science Research Base of Intelligent Optoelectronics and Perception, Institute of Optoelectronics and Department of Materials Science, Fudan University, Shanghai 200433, China

Zhangjiang Fudan International Innovation Center, Fudan University, Shanghai 200433, China

School of Mathematical Sciences, SCMS, SCAM, and CCSB, Fudan University, Shanghai 200433, China

Funding

Natural Science Foundation of Shanghai Municipality · National Key Research and Development Program of China · Shanghai Municipal Education Commission · Science and Technology Commission of Shanghai Municipality · National Natural Science Foundation of China · Shanghai Rising-Star Program

References (50)

Show source-provided references
1. 10.1109/ACCESS.2019.289183810.1109/ACCESS.2019.2891838 ↗
2. Zbib, R.; Zhao, L.; Karakos, D.; Hartmann, W.; DeYoung, J.; Huang, Z.; Jiang, Z.; Rivkin, N.; Zhang, L.; Schwartz, R. Neural-Network Lexical Translation for Cross-Lingual IR from Text and Speech. In Proceedings of the 42nd International ACM SIGIR Conference on Research and Development in Information Retrieval, 2019; pp 645–654.10.1145/3331184.3331222 ↗
3. 10.1109/TCSII.2022.317968010.1109/TCSII.2022.3179680 ↗
4. 10.1145/356946810.1145/3569468 ↗
5. 10.3390/s1711249610.3390/s17112496 ↗
6. Mudassar, B. A.; Ko, J. H.; Mukhopadhyay, S. Edge-Cloud Collaborative Processing for Intelligent Internet of Things: a Case Study on Smart Surveillance. In Proceedings of the 55th Annual Design Automation Conference, 2018; pp 1–6.10.1145/3195970.3196036 ↗
7. Ding, L.Y.; Nadkarni, S. Automatic Construction of Knowledge-Based System Using Knowware System. In 2007 International Conference on Machine Learning and Cybernetics; IEEE, 2007; Vol. 2, pp 789–794.10.1109/ICMLC.2007.4370250 ↗
8. 10.1016/j.rser.2015.12.11410.1016/j.rser.2015.12.114 ↗
9. 10.1109/JPROC.2022.322648110.1109/JPROC.2022.3226481 ↗
10. 10.1109/ACCESS.2020.299173410.1109/ACCESS.2020.2991734 ↗
11. 10.1016/j.future.2019.02.05010.1016/j.future.2019.02.050 ↗
12. 10.1109/JAS.2017.751050810.1109/JAS.2017.7510508 ↗
13. 10.1088/1741-2552/aaab6f10.1088/1741-2552/aaab6f ↗
14. 10.1016/0378-5955(86)90089-410.1016/0378-5955(86)90089-4 ↗
15. Demetrios, N. Lateralized Temporal Integration Properties of the Mouse Auditory Cortex. Master Thesis, City College of New York: New York, U.S.A., 2020.
16. 10.1371/journal.pbio.300180310.1371/journal.pbio.3001803 ↗
17. 10.1016/j.neuron.2008.09.03410.1016/j.neuron.2008.09.034 ↗
18. 10.3390/s2303163910.3390/s23031639 ↗
19. 10.3390/s1807211010.3390/s18072110 ↗
20. 10.1016/j.ijforecast.2020.06.00810.1016/j.ijforecast.2020.06.008 ↗
21. 10.1016/j.neucom.2018.09.08210.1016/j.neucom.2018.09.082 ↗
22. 10.1038/s41928-019-0313-310.1038/s41928-019-0313-3 ↗
23. 10.1038/s41928-024-01133-z10.1038/s41928-024-01133-z ↗
24. 10.1038/s41928-022-00838-310.1038/s41928-022-00838-3 ↗
25. 10.1038/s41467-024-45187-110.1038/s41467-024-45187-1 ↗
26. 10.1038/ncomms147610.1038/ncomms1476 ↗
27. 10.1038/s41467-020-20692-110.1038/s41467-020-20692-1 ↗
28. 10.1038/s41467-023-38286-y10.1038/s41467-023-38286-y ↗
29. 10.1364/OE.27.02743110.1364/OE.27.027431 ↗
30. 10.1063/1.503803810.1063/1.5038038 ↗
31. 10.1021/acsami.0c1379910.1021/acsami.0c13799 ↗
32. 10.1038/s41467-023-44132-y10.1038/s41467-023-44132-y ↗
33. 10.1002/adma.20230241910.1002/adma.202302419 ↗
34. 10.1007/s11467-020-0986-010.1007/s11467-020-0986-0 ↗
35. 10.1039/C9MH01215J10.1039/C9MH01215J ↗
36. 10.1038/s41928-022-00847-210.1038/s41928-022-00847-2 ↗
37. 10.1002/advs.20200166210.1002/advs.202001662 ↗
38. 10.1002/adfm.20240010510.1002/adfm.202400105 ↗
39. 10.1007/s12274-021-3496-710.1007/s12274-021-3496-7 ↗
40. 10.1002/aelm.20200076010.1002/aelm.202000760 ↗
41. 10.1146/annurev.physiol.64.092501.11454710.1146/annurev.physiol.64.092501.114547 ↗
42. 10.1002/aisy.20190008410.1002/aisy.201900084 ↗
43. 10.1038/s41467-017-02337-y10.1038/s41467-017-02337-y ↗
44. 10.3389/felec.2022.86901310.3389/felec.2022.869013 ↗
45. 10.1126/sciadv.abg145510.1126/sciadv.abg1455 ↗
46. International Sunspot Number Monthly Bulletin and Online Catalogue, 1/1/1818–5/31/2022. https://www.sidc.be/SILSO/datafiles-old.
47. 10.1038/s41598-021-98982-x10.1038/s41598-021-98982-x ↗
48. 10.1142/S021812742330015X10.1142/S021812742330015X ↗
49. 10.1098/rspb.2012.277710.1098/rspb.2012.2777 ↗
50. 10.1111/dsji.1226510.1111/dsji.12265 ↗