Integration of nanoscale memristor synapses in neuromorphic computing architectures
Source abstract
Abstract
Conventional neuro-computing architectures and artificial neural networks have often been developed with no or loose connections to neuroscience. As a consequence, they have largely ignored key features of biological neural processing systems, such as their extremely low-power consumption features or their ability to carry out robust and efficient computation using massively parallel arrays of limited precision, highly variable, and unreliable components. Recent developments in nano-technologies are making available extremely compact and low power, but also variable and unreliable solid-state devices that can potentially extend the offerings of availing CMOS technologies. In particular, memristors are regarded as a promising solution for modeling key features of biological synapses due to their nanoscale dimensions, their capacity to store multiple bits of information per element and the low energy required to write distinct states. In this paper, we first review the neuro- and neuromorphic computing approaches that can best exploit the properties of memristor and scale devices, and then propose a novel hybrid memristor-CMOS neuromorphic circuit which represents a radical departure from conventional neuro-computing approaches, as it uses memristors to directly emulate the biophysics and temporal dynamics of real synapses. We point out the differences between the use of memristors in conventional neuro-computing architectures and the hybrid memristor-CMOS circuit proposed, and argue how this circuit represents an ideal building block for implementing brain-inspired probabilistic computing paradigms that are robust to variability and fault tolerant by design.
Source: openalex_inverted_index · Quality: baseline
Research context
OpenAlex topics: Advanced Memory and Neural Computing · Neural dynamics and brain function · Photoreceptor and optogenetics research
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
References (100+)
Show source-provided references
1. 10.1007/BF0247825910.1007/BF02478259 ↗
2. von Neumann J · The Computer and the Brain · 1958
3. 10.1037/h004251910.1037/h0042519 ↗
4. Minsky M L · Computation: Finite and Infinite Machines · 1967
5. 10.1073/pnas.79.8.255410.1073/pnas.79.8.2554 ↗
6. Rumelhart D E · Parallel Distributed Processing: Explorations in the Microstructure of Cognition. Volume 1. Foundations · 198610.7551/mitpress/5236.001.0001 ↗
7. 10.1007/978-3-662-00784-610.1007/978-3-662-00784-6 ↗
8. Hertz J · Introduction to the Theory of Neural Computation · 1991
9. Bishop C M · Pattern Recognition and Machine Learning · 2006
10. 10.3389/fnins.2011.0011810.3389/fnins.2011.00118 ↗
11. 10.1109/5.5835610.1109/5.58356 ↗
12. Markram H · ACM/IEEE Conf. on Supercomputing, SC · 2006 · 53
13. 10.1109/IJCNN.2008.463382810.1109/IJCNN.2008.4633828 ↗
14. 10.1109/MCSE.2010.11210.1109/MCSE.2010.112 ↗
15. 10.1109/IJCNN.2012.625263710.1109/IJCNN.2012.6252637 ↗
16. Wong T M · 2012
17. 10.1523/JNEUROSCI.3575-07.200710.1523/JNEUROSCI.3575-07.2007 ↗
18. 10.1007/978-3-642-33269-2_1610.1007/978-3-642-33269-2_16 ↗
19. 10.1016/S1369-7021(11)70299-110.1016/S1369-7021(11)70299-1 ↗
20. 10.1103/PhysRevLett.92.17830210.1103/PhysRevLett.92.178302 ↗
21. Govoreanu B · Int. Technical Digest on Electron Devices Meeting · 2011 · 31
22. Snider G S · Nanotechnology · 2007 · 18
23. 10.1002/adma.20090368010.1002/adma.200903680 ↗
24. 10.3389/fnins.2013.0000210.3389/fnins.2013.00002 ↗
25. 10.3389/fnins.2011.0002610.3389/fnins.2011.00026 ↗
26. 10.1021/nl904092h10.1021/nl904092h ↗
27. Choi H · Nanotechnology · 2009 · 20
28. 10.1021/nl201040y10.1021/nl201040y ↗
29. 10.1007/s00339-011-6264-910.1007/s00339-011-6264-9 ↗
30. 10.1109/TCT.1971.108333710.1109/TCT.1971.1083337 ↗
31. 10.1109/JPROC.2009.202107710.1109/JPROC.2009.2021077 ↗
32. 10.1038/nmat333810.1038/nmat3338 ↗
33. 10.1038/nature0816610.1038/nature08166 ↗
34. 10.1109/TED.2011.215800410.1109/TED.2011.2158004 ↗
35. Shihong M W Prodromakis T Salaoru I Toumazou C · 2012
36. 10.1021/nl203687n10.1021/nl203687n ↗
37. 10.1063/1.315182210.1063/1.3151822 ↗
38. Yoon K J · Nanotechnology · 2012 · 23
39. 10.1038/srep0074410.1038/srep00744 ↗
40. 10.1016/S0166-2236(97)01124-710.1016/S0166-2236(97)01124-7 ↗
41. Chance F S · J. Neurosci. · 1998 · 18 · 478510.1523/JNEUROSCI.18-12-04785.1998 ↗
42. 10.1103/PhysRevE.85.04191810.1103/PhysRevE.85.041918 ↗
43. 10.1109/LED.2011.217065410.1109/LED.2011.2170654 ↗
44. 10.1016/j.sse.2012.06.01010.1016/j.sse.2012.06.010 ↗
45. Chin A · Meeting Abstracts · 2012 · MA2012-02 · 257410.1149/MA2012-02/31/2574 ↗
46. 10.1109/3DIC.2009.530658210.1109/3DIC.2009.5306582 ↗
47. 10.1007/978-94-007-4491-2_710.1007/978-94-007-4491-2_7 ↗
48. 10.1166/sam.2011.117710.1166/sam.2011.1177 ↗
49. 10.3389/fnins.2011.0007310.3389/fnins.2011.00073 ↗
50. Bi G-Q · J. Neurosci. · 1998 · 18 · 1046410.1523/JNEUROSCI.18-24-10464.1998 ↗
51. 10.1109/NANOARCH.2008.458579610.1109/NANOARCH.2008.4585796 ↗
52. Linares-Barranco B Serrano-Gotarredona T · IEEE-NANO 2009: 9th IEEE Conf. on Nanotechnology, 2009 · 2009 · 601
53. Deiss S R · Pulsed Neural Networks · 1998 · 157
54. 10.1109/TCSI.2007.89350910.1109/TCSI.2007.893509 ↗
55. 10.1196/annals.1292.01010.1196/annals.1292.010 ↗
56. Zamarreño-Ramos C · IEEE Trans. Biomed. Circuits Syst. · 2012 · PP(99) · 82
57. 10.1109/TBCAS.2012.218613610.1109/TBCAS.2012.2186136 ↗
58. 10.1109/TCSI.2011.215107010.1109/TCSI.2011.2151070 ↗
59. Tomazou C · Analogue IC Design: the Current–Mode Approach · 1990
60. Liu S-C · Analog VLSI: Circuits and Principles · 200210.7551/mitpress/1250.001.0001 ↗
61. Mitra S Indiveri G Etienne-Cummings R · ISCAS 2010: Int. Symp. on Circuits and Systems · 2010 · 97
62. 10.1162/neco.2007.19.10.258110.1162/neco.2007.19.10.2581 ↗
63. 10.1109/BIOCAS.2006.460032510.1109/BIOCAS.2006.4600325 ↗
64. 10.1007/BF0016640810.1007/BF00166408 ↗
65. 10.1038/8145310.1038/81453 ↗
66. 10.1038/nrn132710.1038/nrn1327 ↗
67. 10.1152/jn.00686.200510.1152/jn.00686.2005 ↗
68. Indiveri G Chicca E · Neural Nets WIRN11—Proc. 21st Italian Workshop on Neural Nets · 2011 · 305
69. 10.1109/TBCAS.2008.200578110.1109/TBCAS.2008.2005781 ↗
70. 10.1016/j.neucom.2008.05.01610.1016/j.neucom.2008.05.016 ↗
71. 10.1162/neco.2007.19.11.288110.1162/neco.2007.19.11.2881 ↗
72. 10.1038/nn96310.1038/nn963 ↗
73. 10.1038/nrn225810.1038/nrn2258 ↗
74. 10.1152/jn.01166.200310.1152/jn.01166.2003 ↗
75. 10.1111/j.1467-9280.2006.01780.x10.1111/j.1467-9280.2006.01780.x ↗
76. 10.1126/science.119278810.1126/science.1192788 ↗
77. Pearl J · Probabilistic Reasoning in Intelligent Systems: Networks of Plausible Inference · 1988
78. 10.1162/neco.2009.08-08-83710.1162/neco.2009.08-08-837 ↗
79. 10.1371/journal.pcbi.100221110.1371/journal.pcbi.1002211 ↗
80. 10.1371/journal.pcbi.100229410.1371/journal.pcbi.1002294 ↗
81. Nessler B · Proc. of NIPS 2009: Advances in Neural Information Processing Systems · 2010 · 22 · 1357
82. 10.1371/journal.pcbi.100018010.1371/journal.pcbi.1000180 ↗
83. 10.1523/JNEUROSCI.4284-09.201010.1523/JNEUROSCI.4284-09.2010 ↗
84. Hoerzer G M · Cerebral Cortex · 2012
85. 10.1126/science.109127710.1126/science.1091277 ↗
86. 10.1162/08997660276040795510.1162/089976602760407955 ↗
87. 10.1038/srep0028710.1038/srep00287 ↗
88. Legenstein R · What Makes a Dynamical System Computationally Powerful? · 2007 · 127
89. 10.1038/nn.226410.1038/nn.2264 ↗
90. 10.1007/s10462-009-9124-710.1007/s10462-009-9124-7 ↗
91. 10.1023/A:102285900300610.1023/A:1022859003006 ↗
92. 10.1023/A:101093340432410.1023/A:1010933404324 ↗
93. 10.1007/BF0005865510.1007/BF00058655 ↗
94. 10.1007/BF0011603710.1007/BF00116037 ↗
95. 10.1063/1.477031510.1063/1.4770315 ↗
96. 10.1021/nl101715710.1021/nl1017157 ↗
97. 10.1007/s00339-011-6288-110.1007/s00339-011-6288-1 ↗
98. Hu M Li H Chen Y Wang X Pino R E · ASPDAC’11: Proc. 16th Asia and South Pacific Design Automation Conf. · 2011 · 25
99. Querlioz D Bichler O Dollfus P Gamrat C · IEEE Trans. Nanotechnology · 2013
100. Suri M Bichler O Querlioz D Palma G Vianello E Vuillaume D Gamrat C DeSalvo B · Electron Devices Meeting (EDM) IEEE Int. · 2012 · 10.3.1–10.3.4