journal article·2025-02Open access

Weighted Echo State Graph Neural Networks Based on Robust and Epitaxial Film Memristors

Zhenqiang Guo, Guojun Duan, Yinxing Zhang, Yong Sun, Weifeng Zhang, Xiaohan Li, Haowan Shi, Pengfei Li, Zhen Zhao, Jikang Xu, Biao Yang, Yousef Faraj, Xiaobing Yan

Advanced Science· Volume 12· Issue 8

Abstract

Abstract Hardware system customized toward the demands of graph neural network learning would promote efficiency and strong temporal processing for graph‐structured data. However, most amorphous/polycrystalline oxides‐based memristors commonly have unstable conductance regulation due to random growth of conductive filaments. And graph neural networks based on robust and epitaxial film memristors can especially improve energy efficiency due to their high endurance and ultra‐low power consumption. Here, robust and epitaxial Gd: HfO2‐based film memristors are reported and construct a weighted echo state graph neural network (WESGNN). Benefiting from the optimized epitaxial films, the high switching speed (20 ns), low energy consumption (2.07 fJ), multi‐value storage (4 bits), and high endurance (109) outperform most memristors. Notably, thanks to the appropriately dispersed conductance distribution (standard deviation = 7.68 nS), the WESGNN finely regulates the relative weights of input nodes and recursive matrix to realize state‐of‐the‐art performance using the MUTAG and COLLAB datasets for graph classification tasks. Overall, robust and epitaxial film memristors offer nanoscale scalability, high reliability, and low energy consumption, making them energy‐efficient hardware solutions for graph learning applications.
Source: crossref · Quality: baseline

Research context

OpenAlex topics: Advanced Memory and Neural Computing · Ferroelectric and Negative Capacitance Devices · Neural Networks and Reservoir Computing

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

College of Physics Science & Technology School of Life Sciences Institute of Life Science and Green Development Key Laboratory of Brain‐Like Neuromorphic Devices and Systems of Hebei Province Hebei University Baoding 071002 China

College of Electron and Information Engineering Hebei University Baoding 071002 China

School of Natural Sciences University of Chester Chester CH1 4BJ UK

Department of Materials Science and Engineering National University of Singapore Singapore 117576 Singapore

Funding

National Natural Science Foundation of China

References (49)

Show source-provided references
1. 10.1109/TNN.2008.200560510.1109/TNN.2008.2005605 ↗
2. T. N.Kipf M.Welling arXiv preprint arXiv:1609.02907 2016.
3. S.Cao W.Lu Q.Xu inProceedings of the AAAI Conference on Artificial Intelligence Phoenix Arizona USA February2016 30.10.1609/aaai.v30i1.10179 ↗
4. R.Ying R.He K.Chen P.Eksombatchai W. L.Hamilton J.Leskovec Proc. 24th ACM SIGKDD Int. Conf. Knowledge Discovery & Data Mining2018 974.10.1145/3219819.3219890 ↗
5. Y.Li R.Yu C.Shahabi Y.Liu arXiv preprint arXiv:1707.01926 2017.
6. T.Gaudelet B.Day A. R.Jamasb J.Soman C.Regep G.Liu J. B.Hayter R.Vickers C.Roberts J.Tang arXiv preprint arXiv:2012.05716 2020.
7. Lerer A. · Proceedings of Machine Learning and Systems · 2019 · 1 · 120
8. 10.1038/s41928-018-0092-210.1038/s41928-018-0092-2 ↗
9. 10.1038/s41928-020-0435-710.1038/s41928-020-0435-7 ↗
10. 10.1038/s41928-017-0006-810.1038/s41928-017-0006-8 ↗
11. 10.1038/s41565-020-0647-z10.1038/s41565-020-0647-z ↗
12. 10.1038/s41565-020-0655-z10.1038/s41565-020-0655-z ↗
13. 10.1109/JPROC.2020.300454310.1109/JPROC.2020.3004543 ↗
14. 10.1038/s42256-023-00609-510.1038/s42256-023-00609-5 ↗
15. 10.1038/s41563-021-01099-910.1038/s41563-021-01099-9 ↗
16. 10.1038/s41928-020-00523-310.1038/s41928-020-00523-3 ↗
17. 10.1038/s41467-020-17850-w10.1038/s41467-020-17850-w ↗
18. 10.1126/science.abj794310.1126/science.abj7943 ↗
19. 10.1038/s41467-022-30539-610.1038/s41467-022-30539-6 ↗
20. 10.1038/s41467-022-34178-910.1038/s41467-022-34178-9 ↗
21. 10.1038/s41467-020-16261-110.1038/s41467-020-16261-1 ↗
22. 10.1038/s41467-023-39371-y10.1038/s41467-023-39371-y ↗
23. 10.1038/s41928-022-00838-310.1038/s41928-022-00838-3 ↗
24. 10.1038/s41467-023-39430-410.1038/s41467-023-39430-4 ↗
25. 10.1126/science.ade348310.1126/science.ade3483 ↗
26. 10.1002/adma.20240102110.1002/adma.202401021 ↗
27. 10.1063/5.008291910.1063/5.0082919 ↗
28. 10.1038/s41467-017-00869-x10.1038/s41467-017-00869-x ↗
29. 10.1126/science.abk319510.1126/science.abk3195 ↗
30. 10.1002/aisy.20220002710.1002/aisy.202200027 ↗
31. Jaeger H. · German National Research Center for Information Technology GMD Technical Report · 2001 · 148 · 13
32. 10.1038/s41467-017-02337-y10.1038/s41467-017-02337-y ↗
33. 10.1038/s41928-019-0313-310.1038/s41928-019-0313-3 ↗
34. C.Gallicchio A.Micheli inProceedings of the AAAI Conference on Artificial Intelligence New York Hilton Midtown February2020 34 pp.3898–3905.10.1609/aaai.v34i04.5803 ↗
35. C.Gallicchio A.Micheli inThe 2010 international joint conference on neural networks (IJCNN) IEEE Barcelona Spain October2010 pp.1–8.10.1109/IJCNN.2010.5596796 ↗
36. 10.1002/aelm.20180014310.1002/aelm.201800143 ↗
37. L.Zhao S.‐W.Ryu A.Hazeghi D.Duncan B.Magyari‐Köpe Y.Nishi in2013 Symposium on VLSI Technology IEEE 2013 pp.T106‐T107.
38. 10.1038/s41467-020-15249-110.1038/s41467-020-15249-1 ↗
39. 10.1038/s41467-022-28303-x10.1038/s41467-022-28303-x ↗
40. 10.1002/adfm.20180603710.1002/adfm.201806037 ↗
41. 10.1021/acsami.2c1983610.1021/acsami.2c19836 ↗
42. 10.1021/jm00106a04610.1021/jm00106a046 ↗
43. P.Yanardag S.Vishwanathan in:Proceedings of the 21st ACM SIGKDD International Conference on Knowledge Discovery and Data Mining ACM New York 2015.
44. K.Oono T.Suzuki arXiv preprint arXiv:1905.10947 2019.
45. 10.1016/j.patcog.2018.11.00210.1016/j.patcog.2018.11.002 ↗
46. G.Skenderi H.Li J.Tang M.Cristani arXiv preprint arXiv:2309.16014 2023.
47. A.Arnaiz‐Rodríguez A.Begga F.Escolano N.Oliver arXiv preprint arXiv:2206.07369 2022.
48. W.Hamilton Z.Ying J.Leskovec inAdvances in Neural Information Processing Systems Vol.30 2017.
49. 10.1016/j.neunet.2012.07.00510.1016/j.neunet.2012.07.005 ↗