Memristor design rules for dynamic learning and edge processing applications
Source abstract
Abstract
The ability to dynamically learn and adapt to changes in the environment is one of the hallmarks of biological systems. In this work, we identify the subset of the design space of memristive materials that is optimal for dynamic learning applications. Using an architecture inspired on the learning center of the insect brain, we implement a model system consisting of a discrete implementation of spiking neurons where dynamic learning takes place on a set of plastic synapses formed by memristor pairs in a crossbar array. Using two separate benchmarks, one comprising the dynamic learning of the Modified National Institute of Standards and Technology dataset and another one targeting one shot learning, we have identified the key properties that memristive materials should have to be optimal dynamic learners. The results obtained show that a fine degree of control of the memristor internal state is key to achieve high classification accuracy during dynamic learning but that within this optimal region learning is extremely robust both to device variability and to errors in the writing of the internal state, in all cases allowing for 2σ variations greater than 40% without significant loss of accuracy, hence overcoming two of the perceived limitations of memristors. By additionally requiring that learning takes place concurrently to information processing, we are able to derive a set constraints to the memristor dynamics.
Source: crossref · Quality: baseline
Research context
OpenAlex topics: Advanced Memory and Neural Computing · Photoreceptor and optogenetics research · Neural dynamics and brain function
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
Affiliations
Applied Materials Division, Argonne National Laboratory , Argonne, Illinois 60439, USA
Funding
Defense Advanced Research Projects Agency · Argonne National Laboratory
References (26)
Show source-provided references
1. Neuromorphic electronic systems10.1109/5.58356 ↗
2. Pattern classification by memristive crossbar circuits using ex situ and in situ training10.1038/ncomms3072 ↗
3. Neuromorphic computing using non-volatile memory10.1080/23746149.2016.1259585 ↗
4. Biorealistic implementation of synaptic functions with oxide memristors through internal ionic dynamics10.1002/adfm.201501427 ↗
5. Integration of nanoscale memristor synapses in neuromorphic computing architectures10.1088/0957-4484/24/38/384010 ↗
6. Training andoperation of an integrated neuromorphic network based on metal-oxide memristors10.1038/nature14441 ↗
7. Nanoscale memristor device as synapse in neuromorphic systems10.1021/nl904092h ↗
8. The missing memristor found10.1038/nature06932 ↗
9. Memristive devices for computing10.1038/nnano.2012.240 ↗
10. Memristive switching of single-component metallic nanowires10.1088/0957-4484/21/12/125204 ↗
11. Bioinspired programming of memory devices for implementing an inference engine10.1109/jproc.2015.2437616 ↗
12. Memristor-based circuit design for multilayer neural networks10.1109/tcsi.2017.2729787 ↗
13. Learning in memristor crossbar-based spiking neural networks through modulation of weight-dependent spike-timing-dependent plasticity10.1109/tnano.2018.2821131 ↗
14. Going small: Using the insect brain as a model system for edge processing applications
15. A million spiking-neuron integrated circuit with a scalable communication network and interface10.1126/science.1254642 ↗
16. Loihi: A neuromorphic manycore processor with on-chip learning10.1109/mm.2018.112130359 ↗
17. Circuit elements with memory: Memristors, memcapacitors, and meminductors10.1109/jproc.2009.2021077 ↗
18. Vteam: A general model for voltage-controlled memristors10.1109/tcsii.2015.2433536 ↗
19. The neuronal architecture of the mushroom body provides a logic for associative learning10.7554/elife.04577 ↗
20. Generating sparse and selective third-order responses in the olfactory system of the fly10.1073/pnas.1005635107 ↗
21. Mushroom body output neurons encode valence and guide memory-based action selection in drosophila10.7554/elife.04580 ↗
22. Heterosynaptic plasticity underlies aversive olfactory learning in drosophila10.1016/j.neuron.2015.11.003 ↗
23. Sparse coding with memristor networks10.1038/nnano.2017.83 ↗
24. Gradient-based learning applied to document recognition10.1109/5.726791 ↗
25. A ferroelectric memristor10.1038/nmat3415 ↗
26. A memristor device model10.1109/led.2011.2163292 ↗