Demonstration of Neuromodulation‐inspired Stashing System for Energy‐efficient Learning of Spiking Neural Network using a Self‐Rectifying Memristor Array
Source abstract
Abstract
Abstract Neuromorphic engineering aims to mimic brain functions to achieve energy‐efficient artificial intelligence. Since researchers have indicated that memristors can mimic synapses and neurons, various studies have demonstrated the operation of neural networks using memristive dot product engine (MDPE) hardware. However, although several feasible implementations of synapse and neuron behaviors have been reported, few studies have demonstrated the system‐level energy‐efficient operation on the hardware. This work proposes a novel system inspired by the neuromodulation of the brain, referred to as a “stashing system.” In the system, the trained synapses are stashed temporarily during the training of the spiking neural network and then merged for inferencing. The software simulation first confirmed the working principle of the stashing system. Then, a hardware demonstration is performed at an integrated 32 × 32 MDPE embodying a self‐rectifying and electroforming‐free memristor cell to validate the system. The results confirm that energy consumption in the memristor array is reduced by 37% for the unsupervised learning of the MNIST dataset.
Source: crossref · Quality: baseline
Research context
OpenAlex topics: Advanced Memory and Neural Computing · Neuroscience and Neural Engineering · Photoreceptor and optogenetics research
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
Affiliations
Department of Materials Science and Engineering Korea Advanced Institute of Science and Technology (KAIST) Daejeon 34141 Republic of Korea
System Development – Computing Platform Laboratory Samsung Advanced Institute of Technology (SAIT) Suwon 16678 Republic of Korea
Department of Materials Science and Engineering Inter‐University Semiconductor Research Center Seoul National University Seoul 08826 Republic of Korea
Funding
Korea Advanced Institute of Science and Technology · National Research Foundation of Korea
References (50)
Show source-provided references
1. 10.1002/adma.20200361010.1002/adma.202003610 ↗
2. 10.1016/S0893-6080(97)00011-710.1016/S0893-6080(97)00011-7 ↗
3. 10.1007/978-3-319-54840-1_1110.1007/978-3-319-54840-1_11 ↗
4. 10.1016/j.neuron.2004.09.00710.1016/j.neuron.2004.09.007 ↗
5. 10.1126/science.125464210.1126/science.1254642 ↗
6. Diehl P. U. · Front. Comput. Neurosci. · 2015 · 9
7. 10.1038/srep2954510.1038/srep29545 ↗
8. 10.1113/jphysiol.1952.sp00476410.1113/jphysiol.1952.sp004764 ↗
9. 10.1016/S0361-9230(99)00161-610.1016/S0361-9230(99)00161-6 ↗
10. 10.1023/A:100891602614310.1023/A:1008916026143 ↗
11. 10.1002/adfm.20160474010.1002/adfm.201604740 ↗
12. 10.1038/s41563-019-0291-x10.1038/s41563-019-0291-x ↗
13. 10.1002/adfm.20110193510.1002/adfm.201101935 ↗
14. 10.1016/j.neunet.2003.06.00510.1016/j.neunet.2003.06.005 ↗
15. 10.1385/NI:2:2:14510.1385/NI:2:2:145 ↗
16. 10.1146/annurev.pharmtox.011008.14553310.1146/annurev.pharmtox.011008.145533 ↗
17. 10.3389/fnhum.2018.0012810.3389/fnhum.2018.00128 ↗
18. P.Molchanov S.Tyree T.Karras T.Aila J.Kautz arXiv pre‐print serverarXiv:1611.06440: 6 2017.
19. D.Blalock Jose J.Frankle J.Guttag arXiv pre‐print serverarXiv:2003.03033: 3 2020.
20. 10.1109/TCAD.2018.281936610.1109/TCAD.2018.2819366 ↗
21. 10.1016/j.biosystems.2004.09.01610.1016/j.biosystems.2004.09.016 ↗
22. S. S.Chowdhury I.Garg K.Roy Int. Jt. Conf. on Neural Netw. (IJCNN)2021.
23. M.Hu J. P.Strachan Z.Li E. M.Grafals N.Davila C.Graves S.Lam N.Ge J. J.Yang R. S.Williams 53nd ACM/EDAC/IEEE Des. Auto. Conf. (DAC)6 2016.
24. 10.1038/s41928-017-0006-810.1038/s41928-017-0006-8 ↗
25. 10.1038/s41928-017-0002-z10.1038/s41928-017-0002-z ↗
26. 10.1038/s41586-019-1677-210.1038/s41586-019-1677-2 ↗
27. 10.1038/s41578-019-0159-310.1038/s41578-019-0159-3 ↗
28. 10.1038/s41928-020-0397-910.1038/s41928-020-0397-9 ↗
29. 10.1002/adma.20150275810.1002/adma.201502758 ↗
30. 10.1038/srep2852510.1038/srep28525 ↗
31. 10.1021/acsami.9b1649910.1021/acsami.9b16499 ↗
32. 10.1063/1.503396710.1063/1.5033967 ↗
33. 10.1109/LED.2016.258285910.1109/LED.2016.2582859 ↗
34. 10.1109/LED.2017.273185910.1109/LED.2017.2731859 ↗
35. Kim K. M. · Nanotechnology · 2011 · 22
36. 10.1038/s42256-019-0089-110.1038/s42256-019-0089-1 ↗
37. 10.1002/adma.20160445710.1002/adma.201604457 ↗
38. Luo Q. · IEEE Electron Device Lett. · 2018 · 39 · 5
39. Wang W. · IEEE Electron Device Lett. · 2019 · 40 · 9
40. 10.1016/j.chaos.2020.11023610.1016/j.chaos.2020.110236 ↗
41. 10.1038/s41427-018-0101-y10.1038/s41427-018-0101-y ↗
42. Hsu C.‐W. · Symp. VLSI Technol. · 2013
43. 10.1002/aelm.20210005010.1002/aelm.202100050 ↗
44. 10.1038/s41467-021-23180-210.1038/s41467-021-23180-2 ↗
45. 10.1021/acs.nanolett.6b0178110.1021/acs.nanolett.6b01781 ↗
46. 10.1039/C7NR02215H10.1039/C7NR02215H ↗
47. 10.1002/adfm.20140006410.1002/adfm.201400064 ↗
48. 10.1002/adma.20150116710.1002/adma.201501167 ↗
49. 10.1038/ncomms1566610.1038/ncomms15666 ↗
50. 10.1063/1.499191710.1063/1.4991917 ↗