journal article·2020-11-24

High Robustness Memristor Neural State Machines

Lei Tian, Yaoyuan Wang, Luping Shi, Rong Zhao

ACS Applied Electronic Materials· Volume 2· Issue 11
Publisher page

Abstract

Neural state machines (NSMs) with weight tunable synapses and leaky integrate-and-fire neurons can control the workflow according to the input information and current state, which has attracted increasing attention in handling complex control logic for various applications. The emerging memristor crossbar network provides an opportunity to further develop NSMs due to the unique analog properties, high density, low-power consumption, and high scalability. However, memristors exhibit nonideal features, such as variation, nonlinearity, and asymmetry of the conductance update, which may hinder the implementation of memristors in NSMs. In this paper, we investigate the implementation of a memristor in an NSM and demonstrate a fully memristor neural state machine (MNSM). Nonvolatile and volatile memristors are designed to emulate the synaptic and neuronal behaviors in MNSMs, respectively. Through a map search task, the MNSM not only exhibits strong robustness to the substantial nonideal behaviors of memristors but also benefits from these shortcomings, showing a faster convergence in the training process. This work proves the feasibility of applying memristors in NSMs and the great potential of MNSMs in handling complex control logic, which promotes the further development of NSMs for neuromorphic computing systems.
Source: openalex_inverted_index · Quality: baseline

Research context

OpenAlex topics: Advanced Memory and Neural Computing · Ferroelectric and Negative Capacitance Devices · Neural Networks and Reservoir Computing

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

Department of Precision Instrument, Center for Brain Inspired Computing Research, Beijing Innovation Center for Future Chip, Tsinghua University, Beijing 100084, China

Funding

National Natural Science Foundation of China · Suzhou-Tsinghua innovation leading program · Brain-Science Special Program of Beijing · CETC Haikang Group-Brain Inspired Computing Joint Research Center

References (39)

Show source-provided references
1. Krizhevsky A. · Adv. in neu. info. process. sys. · 2012 · 1097
2. 10.1109/MSP.2012.220559710.1109/MSP.2012.2205597 ↗
3. 10.1038/nature2427010.1038/nature24270 ↗
4. Hu B. · Adv. in Neur. Info. Process. Sys. · 2014 · 2042
5. 10.1109/MCI.2018.284073810.1109/MCI.2018.2840738 ↗
6. 10.1038/s41586-019-1424-810.1038/s41586-019-1424-8 ↗
7. 10.1109/JSSC.2020.297070910.1109/JSSC.2020.2970709 ↗
8. 10.1038/nnano.2012.24010.1038/nnano.2012.240 ↗
9. 10.1109/MNANO.2018.284490110.1109/MNANO.2018.2844901 ↗
10. 10.1038/s41563-019-0291-x10.1038/s41563-019-0291-x ↗
11. 10.1038/ncomms1519910.1038/ncomms15199 ↗
12. 10.1038/s41467-018-04484-210.1038/s41467-018-04484-2 ↗
13. 10.1038/s42256-019-0089-110.1038/s42256-019-0089-1 ↗
14. 10.1038/s41586-020-1942-410.1038/s41586-020-1942-4 ↗
15. 10.1038/s42256-018-0001-410.1038/s42256-018-0001-4 ↗
16. 10.1038/s41928-018-0023-210.1038/s41928-018-0023-2 ↗
17. 10.1038/s41928-019-0221-610.1038/s41928-019-0221-6 ↗
18. 10.1109/TCSI.2020.297846010.1109/TCSI.2020.2978460 ↗
19. 10.1109/TCSI.2019.295781310.1109/TCSI.2019.2957813 ↗
20. 10.1109/TCSI.2019.294090910.1109/TCSI.2019.2940909 ↗
21. 10.1038/s41467-018-05677-510.1038/s41467-018-05677-5 ↗
22. Henzinger T. A. · Proceedings 11th Annual IEEE Symposium on Logic in Computer Science · 1996 · 27810.1109/LICS.1996.561342 ↗
23. 10.1016/0304-3975(94)90010-810.1016/0304-3975(94)90010-8 ↗
24. Ahmad M. W. · International Conference on Computer Information Systems and Industrial Management · 2020 · 307
25. Tvardovskii A. S. · 2019 · 10210.1109/EDM.2019.8823493 ↗
26. Laputenko A. V. · 2019 · 7010.1109/EDM.2019.8823364 ↗
27. 10.1007/978-3-662-58387-6_2810.1007/978-3-662-58387-6_28 ↗
28. Le, L. H.; Bezerra, C. E.; Pedone, F. Dynamic Scalable State Machine Replication. 2016 46th Annual IEEE/IFIP International Conference on Dependable Systems and Networks (DSN) 2016, 13–24.10.1109/DSN.2016.11 ↗
29. 10.1080/01431161.2015.105404910.1080/01431161.2015.1054049 ↗
30. 10.1007/978-3-030-01418-6_2110.1007/978-3-030-01418-6_21 ↗
31. Hudson D. A. · Adv. in Neural Info. Process. Syst. · 2019 · 5903
32. 10.1145/3355089.335650510.1145/3355089.3356505 ↗
33. 10.1016/j.neucom.2020.04.13010.1016/j.neucom.2020.04.130 ↗
34. 10.1038/ncomms278410.1038/ncomms2784 ↗
35. 10.1002/adma.20150275810.1002/adma.201502758 ↗
36. 10.1007/s11664-018-6730-710.1007/s11664-018-6730-7 ↗
37. 10.1038/nmat475610.1038/nmat4756 ↗
38. 10.1002/adma.20160445710.1002/adma.201604457 ↗
39. 10.1109/TNN.2004.83271910.1109/TNN.2004.832719 ↗