journal article·2024-10Open access

Fully Hardware Memristive Neuromorphic Computing Enabled by the Integration of Trainable Dendritic Neurons and High‐Density RRAM Chip

Zhen Yang, Wenshuo Yue, Chang Liu, Yaoyu Tao, Pek Jun Tiw, Longhao Yan, Yuxiang Yang, Teng Zhang, Bingjie Dang, Keqin Liu, Xiaodong He, Yongqin Wu, Weihai Bu, Kai Zheng, Jin Kang, Ru Huang, Yuchao Yang

Advanced Functional Materials· Volume 34· Issue 44

Abstract

Abstract Computing‐in‐memory (CIM) architecture inspired by the hierarchy of human brain is proposed to resolve the von Neumann bottleneck and boost acceleration of artificial intelligence. Whereas remarkable progress has been achieved for CIM, making further improvements in CIM performance is becoming increasingly challenging, which is mainly caused by the disparity between rapid evolution of synaptic arrays and relatively slow progress in building efficient neuronal devices. Specifically, dedicated efforts are required toward developments of more advanced activation units in terms of both optimized algorithms and innovative hardware implementations. Here a novel bio‐inspired dendrite function‐like neuron based on negative‐differential‐resistance (NDR) behavior is reported and experimentally demonstrates this design as a more efficient neuron. By integrating electrochemical random‐access memory (ECRAM) with ionic regulation, the tunable NDR neuron can be trained to enhance neural network performances. Furthermore, based on a high‐density RRAM chip, fully hardware implementation of CIM is experimentally demonstrated by integrating NDR neuron devices with only a 1.03% accuracy loss. This work provides 516 × and 1.3 × 105 × improvements on LAE (Latency‐Area‐Energy) property, compared to the digital and analog CMOS activation circuits, respectively. With device‐algorithm co‐optimization, this work proposes a compact and energy‐efficient solution that pushes CIM‐based neuromorphic computing into a new paradigm.
Source: crossref · Quality: baseline

Research context

OpenAlex topics: Advanced Memory and Neural Computing · Ferroelectric and Negative Capacitance Devices · Photoreceptor and optogenetics research

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

Beijing Advanced Innovation Center for Integrated Circuits School of Integrated Circuits Peking University Beijing 100871 China

Center for Brain Inspired Chips Institute for Artificial Intelligence Frontiers Science Center for Nano‐optoelectronics Peking University Beijing 100871 China

Guangdong Provincial Key Laboratory of In‐Memory Computing Chips School of Electronic and Computer Engineering Peking University Shenzhen 518055 China

Semiconductor Technology Innovation Center (Beijing) Corporation Beijing 100176 China

Center for Brain Inspired Intelligence Chinese Institute for Brain Research (CIBR) Beijing 102206 China

Funding

National Key Research and Development Program of China · Natural Science Foundation of Beijing Municipality · Higher Education Discipline Innovation Project · National Natural Science Foundation of China

References (46)

Show source-provided references
1. K.He X.Zhang S.Ren J.Sun presented atProceedings of the IEEE Conference on Computer Vision and Pattern Recognition Las Vegas NV USA June2016.
2. 10.1038/s41928-017-0006-810.1038/s41928-017-0006-8 ↗
3. 10.1007/s11432-023-3739-010.1007/s11432-023-3739-0 ↗
4. 10.1038/s41565-020-0655-z10.1038/s41565-020-0655-z ↗
5. 10.1007/s11432-021-3327-710.1007/s11432-021-3327-7 ↗
6. 10.1038/s41586-020-1942-410.1038/s41586-020-1942-4 ↗
7. 10.1007/s11432-020-2866-010.1007/s11432-020-2866-0 ↗
8. 10.1038/s41928-018-0023-210.1038/s41928-018-0023-2 ↗
9. 10.1007/s11432-020-3245-710.1007/s11432-020-3245-7 ↗
10. 10.1002/adfm.20230045810.1002/adfm.202300458 ↗
11. 10.1038/nnano.2016.7010.1038/nnano.2016.70 ↗
12. 10.1038/s41467-023-42110-y10.1038/s41467-023-42110-y ↗
13. C.Sun X.Wang H.Xu J.Zhang Z.Zheng Q.Kong Y.Kang K.Han L.Jiao Z.Zhou Y.Chen D.Zhang G.Liu L.Liu X.Gong presented atIEEE Int. Electron Devices Meeting (IEDM) San Francisco USA December2022.
14. 10.1002/adfm.20210004210.1002/adfm.202100042 ↗
15. 10.1002/adfm.20210006910.1002/adfm.202100069 ↗
16. 10.1002/adma.20200301810.1002/adma.202003018 ↗
17. 10.1038/s41928-023-01020-z10.1038/s41928-023-01020-z ↗
18. 10.1038/nmat485610.1038/nmat4856 ↗
19. 10.1002/adma.20200398410.1002/adma.202003984 ↗
20. 10.1038/nature1444110.1038/nature14441 ↗
21. 10.1109/TCSI.2018.286651010.1109/TCSI.2018.2866510 ↗
22. 10.1109/JETCAS.2019.291153710.1109/JETCAS.2019.2911537 ↗
23. 10.1038/s41565-021-00874-810.1038/s41565-021-00874-8 ↗
24. 10.1002/adma.20230002310.1002/adma.202300023 ↗
25. 10.1038/s41467-020-17215-310.1038/s41467-020-17215-3 ↗
26. 10.1002/adfm.20211199610.1002/adfm.202111996 ↗
27. 10.1038/s41467-022-32497-510.1038/s41467-022-32497-5 ↗
28. 10.1038/s41467-022-31747-w10.1038/s41467-022-31747-w ↗
29. 10.1038/nature2330710.1038/nature23307 ↗
30. 10.1126/science.aax623910.1126/science.aax6239 ↗
31. 10.1038/s41928-021-00549-110.1038/s41928-021-00549-1 ↗
32. 10.1038/s41928-019-0364-510.1038/s41928-019-0364-5 ↗
33. 10.1002/adma.20220847710.1002/adma.202208477 ↗
34. 10.1038/s41467-021-25802-110.1038/s41467-021-25802-1 ↗
35. 10.1038/s41467-017-00773-410.1038/s41467-017-00773-4 ↗
36. 10.1002/adma.20220279910.1002/adma.202202799 ↗
37. 10.1126/science.abd908810.1126/science.abd9088 ↗
38. 10.1126/science.abc065210.1126/science.abc0652 ↗
39. 10.1038/s41467-023-39703-y10.1038/s41467-023-39703-y ↗
40. 10.1002/adma.20220477110.1002/adma.202204771 ↗
41. 10.1038/s41563-022-01373-410.1038/s41563-022-01373-4 ↗
42. 10.1002/aisy.20230002610.1002/aisy.202300026 ↗
43. 10.1002/adma.20180019510.1002/adma.201800195 ↗
44. 10.1038/s41563-018-0248-510.1038/s41563-018-0248-5 ↗
45. Z.Wang B.Crafton J.Gomez R.Xu A.Luo Z.Krivokapic L.Martin S.Datta A.Raychowdhury A. I.Khan presented atIEEE Int. Electron Devices Meeting (IEDM) San Francisco USA December2018.
46. X.Zhang Z.Wu J.Lu J.Wei J.Lu J.Zhu J.Qiu R.Wang K.Lou Y.Wang T.Shi C.Dou D.Shang Q.Liu M.Liu presented atIEEE Int. Electron Devices Meeting (IEDM) San Francisco USA December2020.