journal article·2022-07

Demonstration of Neuromodulation‐inspired Stashing System for Energy‐efficient Learning of Spiking Neural Network using a Self‐Rectifying Memristor Array

Woon Hyung Cheong, Jae Bum Jeon, Jae Hyun In, Geunyoung Kim, Hanchan Song, Janho An, Juseong Park, Young Seok Kim, Cheol Seong Hwang, Kyung Min Kim

Advanced Functional Materials· Volume 32· Issue 29
Publisher page

Abstract

Abstract Neuromorphic engineering aims to mimic brain functions to achieve energy‐efficient artificial intelligence. Since researchers have indicated that memristors can mimic synapses and neurons, various studies have demonstrated the operation of neural networks using memristive dot product engine (MDPE) hardware. However, although several feasible implementations of synapse and neuron behaviors have been reported, few studies have demonstrated the system‐level energy‐efficient operation on the hardware. This work proposes a novel system inspired by the neuromodulation of the brain, referred to as a “stashing system.” In the system, the trained synapses are stashed temporarily during the training of the spiking neural network and then merged for inferencing. The software simulation first confirmed the working principle of the stashing system. Then, a hardware demonstration is performed at an integrated 32 × 32 MDPE embodying a self‐rectifying and electroforming‐free memristor cell to validate the system. The results confirm that energy consumption in the memristor array is reduced by 37% for the unsupervised learning of the MNIST dataset.
Source: crossref · Quality: baseline

Research context

OpenAlex topics: Advanced Memory and Neural Computing · Neuroscience and Neural Engineering · Photoreceptor and optogenetics research

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

Department of Materials Science and Engineering Korea Advanced Institute of Science and Technology (KAIST) Daejeon 34141 Republic of Korea

System Development – Computing Platform Laboratory Samsung Advanced Institute of Technology (SAIT) Suwon 16678 Republic of Korea

Department of Materials Science and Engineering Inter‐University Semiconductor Research Center Seoul National University Seoul 08826 Republic of Korea

Funding

Korea Advanced Institute of Science and Technology · National Research Foundation of Korea

References (50)

Show source-provided references
1. 10.1002/adma.20200361010.1002/adma.202003610 ↗
2. 10.1016/S0893-6080(97)00011-710.1016/S0893-6080(97)00011-7 ↗
3. 10.1007/978-3-319-54840-1_1110.1007/978-3-319-54840-1_11 ↗
4. 10.1016/j.neuron.2004.09.00710.1016/j.neuron.2004.09.007 ↗
5. 10.1126/science.125464210.1126/science.1254642 ↗
6. Diehl P. U. · Front. Comput. Neurosci. · 2015 · 9
7. 10.1038/srep2954510.1038/srep29545 ↗
8. 10.1113/jphysiol.1952.sp00476410.1113/jphysiol.1952.sp004764 ↗
9. 10.1016/S0361-9230(99)00161-610.1016/S0361-9230(99)00161-6 ↗
10. 10.1023/A:100891602614310.1023/A:1008916026143 ↗
11. 10.1002/adfm.20160474010.1002/adfm.201604740 ↗
12. 10.1038/s41563-019-0291-x10.1038/s41563-019-0291-x ↗
13. 10.1002/adfm.20110193510.1002/adfm.201101935 ↗
14. 10.1016/j.neunet.2003.06.00510.1016/j.neunet.2003.06.005 ↗
15. 10.1385/NI:2:2:14510.1385/NI:2:2:145 ↗
16. 10.1146/annurev.pharmtox.011008.14553310.1146/annurev.pharmtox.011008.145533 ↗
17. 10.3389/fnhum.2018.0012810.3389/fnhum.2018.00128 ↗
18. P.Molchanov S.Tyree T.Karras T.Aila J.Kautz arXiv pre‐print serverarXiv:1611.06440: 6 2017.
19. D.Blalock Jose J.Frankle J.Guttag arXiv pre‐print serverarXiv:2003.03033: 3 2020.
20. 10.1109/TCAD.2018.281936610.1109/TCAD.2018.2819366 ↗
21. 10.1016/j.biosystems.2004.09.01610.1016/j.biosystems.2004.09.016 ↗
22. S. S.Chowdhury I.Garg K.Roy Int. Jt. Conf. on Neural Netw. (IJCNN)2021.
23. M.Hu J. P.Strachan Z.Li E. M.Grafals N.Davila C.Graves S.Lam N.Ge J. J.Yang R. S.Williams 53nd ACM/EDAC/IEEE Des. Auto. Conf. (DAC)6 2016.
24. 10.1038/s41928-017-0006-810.1038/s41928-017-0006-8 ↗
25. 10.1038/s41928-017-0002-z10.1038/s41928-017-0002-z ↗
26. 10.1038/s41586-019-1677-210.1038/s41586-019-1677-2 ↗
27. 10.1038/s41578-019-0159-310.1038/s41578-019-0159-3 ↗
28. 10.1038/s41928-020-0397-910.1038/s41928-020-0397-9 ↗
29. 10.1002/adma.20150275810.1002/adma.201502758 ↗
30. 10.1038/srep2852510.1038/srep28525 ↗
31. 10.1021/acsami.9b1649910.1021/acsami.9b16499 ↗
32. 10.1063/1.503396710.1063/1.5033967 ↗
33. 10.1109/LED.2016.258285910.1109/LED.2016.2582859 ↗
34. 10.1109/LED.2017.273185910.1109/LED.2017.2731859 ↗
35. Kim K. M. · Nanotechnology · 2011 · 22
36. 10.1038/s42256-019-0089-110.1038/s42256-019-0089-1 ↗
37. 10.1002/adma.20160445710.1002/adma.201604457 ↗
38. Luo Q. · IEEE Electron Device Lett. · 2018 · 39 · 5
39. Wang W. · IEEE Electron Device Lett. · 2019 · 40 · 9
40. 10.1016/j.chaos.2020.11023610.1016/j.chaos.2020.110236 ↗
41. 10.1038/s41427-018-0101-y10.1038/s41427-018-0101-y ↗
42. Hsu C.‐W. · Symp. VLSI Technol. · 2013
43. 10.1002/aelm.20210005010.1002/aelm.202100050 ↗
44. 10.1038/s41467-021-23180-210.1038/s41467-021-23180-2 ↗
45. 10.1021/acs.nanolett.6b0178110.1021/acs.nanolett.6b01781 ↗
46. 10.1039/C7NR02215H10.1039/C7NR02215H ↗
47. 10.1002/adfm.20140006410.1002/adfm.201400064 ↗
48. 10.1002/adma.20150116710.1002/adma.201501167 ↗
49. 10.1038/ncomms1566610.1038/ncomms15666 ↗
50. 10.1063/1.499191710.1063/1.4991917 ↗