Integrated neuromorphic computing networks by artificial spin synapses and spin neurons
Source abstract
Abstract
Abstract One long-standing goal in the emerging neuromorphic field is to create a reliable neural network hardware implementation that has low energy consumption, while providing massively parallel computation. Although diverse oxide-based devices have made significant progress as artificial synaptic and neuronal components, these devices still need further optimization regarding linearity, symmetry, and stability. Here, we present a proof-of-concept experiment for integrated neuromorphic computing networks by utilizing spintronics-based synapse (spin-S) and neuron (spin-N) devices, along with linear and symmetric weight responses for spin-S using a stripe domain and activation functions for spin-N. An integrated neural network of electrically connected spin-S and spin-N successfully proves the integration function for a simple pattern classification task. We simulate a spin-N network using the extracted device characteristics and demonstrate a high classification accuracy (over 93%) for the spin-S and spin-N optimization without the assistance of additional software or circuits required in previous reports. These experimental studies provide a new path toward establishing more compact and efficient neural network systems with optimized multifunctional spintronic devices.
Source: crossref · Quality: baseline
Research context
OpenAlex topics: Advanced Memory and Neural Computing · Ferroelectric and Negative Capacitance Devices · Neural Networks and Reservoir Computing
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
References (42)
Show source-provided references
1. LeCun, Y., Bengio, Y. & Hinton, G. Deep learning. Nature 521, 436–444 (2015).10.1038/nature14539 ↗
2. Silver, D. et al. Mastering the game of Go without human knowledge. Nature 550, 354–359 (2017).10.1038/nature24270 ↗
3. Nurvitadhi, E. et al. Proceedings of the 2017 ACM/SIGDA International Symposium on Field-Programmable Gate Arrays 5 (Monterey, California, USA, 2017).
4. Raihan, M. A., Goli, N. & Aamodt, T. M. 2019 IEEE International Symposium on Performance Analysis of Systems and Software 79–92 (ISPASS, Madison, Wisconsin, 2019).
5. Jouppi, N. P. et al. 2017 ACM/IEEE 44th Annual International Symposium on Computer Architecture 1–12 (ISCA, Toronto, ON).
6. Jouppi, N., Young, C., Patil, N. & Patterson, D. Motivation for and evaluation of the first tensor processing unit. IEEE Micro 38, 10–19 (2018).10.1109/MM.2018.032271057 ↗
7. Chen, Y. et al. 2014 47th Annual IEEE/ACM International Symposium on Microarchitecture. 609-622 (IEEE Computer Society, 2014).
8. Li, C., Wang, Z. & Rao, M. et al. Long short-term memory networks in memristor crossbar arrays. Nat. Mach. Intell. 1, 49–57 (2019).10.1038/s42256-018-0001-4 ↗
9. Hu, M. et al. 2016 53nd ACM/EDAC/IEEE Design Automation Conference (DAC), 1–6 (IEEE, Austin, TX).
10. Sheridan, P. M. et al. Sparse coding with memristor networks. Nat. Nanotechnol. 12, 784 (2017).10.1038/nnano.2017.83 ↗
11. Li, C. et al. Analogue signal and image processing with large memristor crossbars. Nat. Electron. 1, 52–59 (2018).10.1038/s41928-017-0002-z ↗
12. Prezioso, M. et al. Training and operation of an integrated neuromorphic network based on metal-oxide memristors. Nature 521, 61 (2015).10.1038/nature14441 ↗
13. Bayat, F. M. et al. Implementation of multilayer perceptron network with highly uniform passive memristive crossbar circuits. Nat. Commun. 9, 2331 (2018).10.1038/s41467-018-04482-4 ↗
14. Li, C. et al. Efficient and self-adaptive in-situ learning in multilayer memristor neural networks. Nat. Commun. 9, 2385 (2018).10.1038/s41467-018-04484-2 ↗
15. Torrejon, J. et al. Neuromorphic computing with nanoscale spintronic oscillators. Nature 547, 428 (2017).10.1038/nature23011 ↗
16. Huang, Y., Kang, W., Zhang, X., Zhou, Y. & Zhao, W. Magnetic skyrmion-based synaptic devices. Nanotechnology 28, 08LT02 (2017).10.1088/1361-6528/aa5838 ↗
17. Romera, M. et al. Vowel recognition with four coupled spin-torque nano-oscillators. Nature 563, 230–234 (2018).10.1038/s41586-018-0632-y ↗
18. Bhowmik, D. et al. On-chip learning for domain wall synapse based fully connected neural network. J. Magn. Magn. Mater. 489, 165434 (2019).10.1016/j.jmmm.2019.165434 ↗
19. Yue, K., Liu, Y., Lake, R. K. & Parker, A. C. A brain-plausible neuromorphic on-the-fly learning system implemented with magnetic domain wall analog memristors. Sci. Adv. 5, eaau8170 (2019).10.1126/sciadv.aau8170 ↗
20. Sengupta, A., Shim, Y. & Roy, K. Proposal for an all-spin artificial neural network: emulating neural and synaptic functionalities through domain wall motion in ferromagnets. IEEE Trans. Biomed. 10, 1152–1160 (2016).
21. Lemerle, S. et al. Domain wall creep in an Ising ultrathin magnetic film. Phys. Rev. Lett. 80, 849–852 (1998).10.1103/PhysRevLett.80.849 ↗
22. Kim, K.-J. et al. Interdimensional universality of dynamic interfaces. Nature 458, 740–742 (2009).10.1038/nature07874 ↗
23. Shibata, T. et al. Linear and symmetric conductance response of magnetic domain wall type spin-memristor for analog neuromorphic computing. Appl. Phys. Express 13, 043004 (2020).10.35848/1882-0786/ab7e07 ↗
24. Siddiqui, S. A. et al. Magnetic domain wall based synaptic and activation function generator for neuromorphic accelerators. Nano Lett. 20, 1033–1040 (2020).10.1021/acs.nanolett.9b04200 ↗
25. Song, K. M. et al. Skyrmion-based artificial synapses for neuromorphic computing. Nat. Electron. 3, 148–155 (2020).10.1038/s41928-020-0385-0 ↗
26. Lee, J.-C. et al. Universality classes of magnetic domain wall motion. Phys. Rev. Lett. 107, 067201 (2011).10.1103/PhysRevLett.107.067201 ↗
27. Moon, K.-W. et al. Distinct universality classes of domain wall roughness in two-dimensional Pt/Co/Pt films. Phys. Rev. Lett. 110, 107203 (2013).10.1103/PhysRevLett.110.107203 ↗
28. Zhang, S. et al. A spin–orbit-torque memristive device. Adv. Electron. 5, 1800782 (2019).10.1002/aelm.201800782 ↗
29. Zhang, X. et al. Direct observation of domain-wall surface tension by deflating or inflating a magnetic bubble. Phys. Rev. Appl. 9, 024032 (2018).10.1103/PhysRevApplied.9.024032 ↗
30. Jiang, W. et al. Blowing magnetic skyrmion bubbles. Science 349, 283–286 (2015).10.1126/science.aaa1442 ↗
31. Jang, J., Park, S., Burr, G. W., Hwang, H. & Jeong, Y. Optimization of conductance change in Pr1–xCaxMnO3-based synaptic devices for neuromorphic systems. IEEE Electron Device Lett. 36, 457–459 (2015).10.1109/LED.2015.2418342 ↗
32. Moon, K.-W. et al. Long-range domain wall tension in Pt/Co/Pt films with perpendicular magnetic anisotropy. Appl. Phys. Express 4, 043004 (2011).10.1143/APEX.4.043004 ↗
33. Karlik, I. Jo. A. Ia. E. S. & Olgac, A. V. Performance analysis of various activation functions in generalized MLP architectures of neural networks. Int. J. Artif. Intell. Expert Syst. 1, 111–122 (2011).
34. Lecun, Y., Bottou, L., Bengio, Y. & Haffner, P. Gradient-based learning applied to document recognition. Proc. IEEE 86, 2278–2324 (1998).10.1109/5.726791 ↗
35. Krizhevsky, A. Learning Multiple Layers of Features from Tiny Images. Technical Report TR-2009 (University of Toronto, 2012).
36. Cai, K. et al. Ultrafast and energy-efficient spin-orbit torque switching in compensated ferrimagnets. Nat. Electron. 3, 37–42 (2020).10.1038/s41928-019-0345-8 ↗
37. Parkin, S. S. P., Hayashi, M. & Thomas, L. Magnetic domain-wall racetrack memory. Science 320, 190–194 (2008).10.1126/science.1145799 ↗
38. Lau, Y. C., Betto, D., Rode, K., Coey, J. M. D. & Stamenov, P. Spin-orbit torque switching without an external field using interlayer exchange coupling. Nat. Nanotechnol. 11, 758–762 (2016).10.1038/nnano.2016.84 ↗
39. Choi, S. et al. A self-rectifying TaOy/nanoporous TaOx memristor synaptic array for learning and energy-efficient neuromorphic systems. NPG Asia Mater. 10, 1097–1106 (2018).10.1038/s41427-018-0101-y ↗
40. Lequeux, S. et al. A magnetic synapse: multilevel spin-torque memristor with perpendicular anisotropy. Sci. Rep. 6, 31510 (2016).10.1038/srep31510 ↗
41. Fuller, E. J. et al. Parallel programming of an ionic floating-gate memory array for scalable neuromorphic computing. Science 364, 570–574 (2019).10.1126/science.aaw5581 ↗
42. Burgt, Y. et al. A non-volatile organic electrochemical device as a low-voltage artificial synapse for neuromorphic computing. Nat. Mater. 16, 414–418 (2017).10.1038/nmat4856 ↗