Comparison of update and genetic training algorithms in a memristor crossbar perceptron
Source abstract
Abstract
Memristor-based computer architectures are becoming more attractive as a possible choice of hardware for the implementation of neural networks. However, at present, memristor technologies are susceptible to a variety of failure modes, a serious concern in any application where regular access to the hardware may not be expected or even possible. In this study, we investigate whether certain training algorithms may be more resilient to particular hardware failure modes and, therefore, more suitable for use in those applications. We implement two training algorithms—a local update scheme and a genetic algorithm—in a simulated memristor crossbar and compare their ability to train for a simple image classification task as an increasing number of memristors fail to adjust their conductance. We demonstrate that there is a clear distinction between the two algorithms in several measures of the rate of failure to train.
Source: crossref · Quality: baseline
Research context
OpenAlex topics: Advanced Memory and Neural Computing · Neuroscience and Neural Engineering · Ferroelectric and Negative Capacitance Devices
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
Affiliations
Department of Physics and Materials Science, University of Memphis , Memphis, Tennessee 38152, USA
Funding
University of Memphis
References (21)
Show source-provided references
1. Nat. Electron. · 2018 · 1 · 33310.1038/s41928-018-0092-2 ↗
2. Vaidyanathan · 2017 · 27510.1007/978-3-319-51724-7 ↗
3. Nat. Electron. · 2018 · 1 · 41110.1038/s41928-018-0100-6 ↗
4. Sci. Adv. Mater. · 2011 · 3 · 32210.1166/sam.2011.1177 ↗
5. Nature · 2015 · 521 · 6110.1038/nature14441 ↗
6. Vaidyanathan · 2017 · 30510.1007/978-3-319-51724-7 ↗
7. Nano Lett. · 2010 · 10 · 129710.1021/nl904092h ↗
8. Appl. Phys. Lett. · 2017 · 110 · 10350310.1063/1.4974535 ↗
9. Far East J. Electron. Commun. · 2017 · 17 · 10510.17654/ec017010105 ↗
10. Touretzky · 1990 · 598
11. 2016 · 2722
12. 2012 · 9
13. Memristor crossbar architectures for implementing deep neural networks10.1007/s40747-021-00282-4 ↗
14. W. Schiffmann, M. Joost, and R. Werner, “Optimization of the backpropagation algorithm for training multilayer perceptrons,” Technical Report, Institute of Physics, University of Koblenz, 1994.
15. 1989 · 762
16. Neural Networks · 1988 · 1 · 23010.1016/0893-6080(88)90267-5 ↗
17. Int. J. Neural Syst. · 1995 · 06 · 29910.1142/s0129065795000226 ↗
18. 2007 · 373
19. IEEE J. Emerg. Sel. Top. Circuits Syst. · 2018 · 8 · 12510.1109/jetcas.2017.2777181 ↗
20. Nanotechnology · 2012 · 23 · 07520110.1088/0957-4484/23/7/075201 ↗
21. Nat. Commun. · 2013 · 4 · 207210.1038/ncomms3072 ↗