Nonlinear memristor model with exact solution allows for ex situ reservoir computing training and in situ inference
Source abstract
Abstract
Memristive physical reservoir computing is a promising approach for solving data classification and temporal processing tasks. This method exploits the nonlinear dynamics of physical, low-power devices to achieve high-dimensional mapping of input signals. Ion-channel-based memristors, which operate with similar voltages, currents, and timescales as biological synapses, are promising due to their rich dynamics, especially for use in biological edge settings. Accurate modeling of their dynamics is essential for optimizing network hyperparameters ex situ to save time and energy. Here, a generalized sigmoidal growth model of ion-channel memristor conductance is presented and shown to be more accurate in predicting dynamics than linear or logistic models. Using the exact solution of the proposed sigmoidal model, the MNIST handwritten digit classification task is optimized and trained ex situ, then tested in situ with the same trained weights. This approach achieved an experimental testing accuracy of 90.6%.
Source: europepmc · Quality: candidate unverified · Source record ↗
Research context
OpenAlex topics: Advanced Memory and Neural Computing · Neural Networks and Reservoir Computing · Neural Networks and Applications
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
Affiliations
Department of Mechanical Engineering, The Pennsylvania State University, University Park, PA, USA
Department of Electrical and Computer Engineering, The University of Mississippi, University, MS, USA
Funding
Division of Computing and Communication Foundations
References (34)
Show source-provided references
1. Misra · Neurocomputing · 2010 · 74 · 23910.1016/j.neucom.2010.03.021 ↗
2. A.Henderson , C.Yakopcic , S.Harbour , T.Taha , C.Merkel and H.Hazan
3. Hasan · Analog Integr. Circuits Signal Process. · 2019 · 99 · 110.1007/s10470-018-1303-5 ↗
4. Appeltant · Nat. Commun. · 2011 · 2 · 46810.1038/ncomms1476 ↗
5. Du · Nat. Commun. · 2017 · 8 · 220410.1038/s41467-017-02337-y ↗
6. Moon · Nat. Electron. · 2019 · 2 · 48010.1038/s41928-019-0313-3 ↗
7. Midya · Adv. Intell. Syst. · 2019 · 1 · 190008410.1002/aisy.201900084 ↗
8. Tanaka · Neural Networks · 2019 · 115 · 10010.1016/j.neunet.2019.03.005 ↗
9. Taniguchi · Sci. Rep. · 2022 · 12 · 1062710.1038/s41598-022-14738-1 ↗
10. Cao · Nanoscale · 2022 · 14 · 28910.1039/D1NR06680C ↗
11. Maraj · Adv. Intell. Syst. · 2023 · 230004910.1002/aisy.202300049 ↗
12. Armendarez · ACS Appl. Mater. Interfaces · 2024 · 16 · 617610.1021/acsami.3c16003 ↗
13. Mohamed · ACS Appl. Eng. Mater. · 2024 · 2 · 211810.1021/acsaenm.4c00309 ↗
14. H.Jaeger
15. Maass · Neural Comput. · 2002 · 14 · 253110.1162/089976602760407955 ↗
16. Jaeger · Adv. Neural Inf. Process. Syst. · 2002 · 15 · 609
17. Jaeger · science · 2004 · 304 · 7810.1126/science.1091277 ↗
18. Liang · Nat. Electron. · 2024 · 1
19. Ghenzi · Nanoscale Horiz. · 2024 · 9 · 42710.1039/D3NH00493G ↗
20. Chua · IEEE Trans. Circuit Theory · 1971 · 18 · 50710.1109/TCT.1971.1083337 ↗
21. Zhu · Nat. Commun. · 2020 · 11 · 243910.1038/s41467-020-16261-1 ↗
22. John · Nat. Commun. · 2022 · 13 · 207410.1038/s41467-022-29727-1 ↗
23. Najem · ACS Nano · 2018 · 12 · 470210.1021/acsnano.8b01282 ↗
24. Robin · Science · 2023 · 379 · 16110.1126/science.adc9931 ↗
25. Maraj · ACS Appl. Electron. Mater. · 2021 · 3 · 444810.1021/acsaelm.1c00610 ↗
26. Eisenberg · J. Membr. Biol. · 1973 · 14 · 14310.1007/BF01868075 ↗
27. Vodyanoy · Biophys. J. · 1983 · 42 · 7110.1016/S0006-3495(83)84370-7 ↗
28. Yang · Small Sci. · 2022 · 2 · 210004910.1002/smsc.202100049 ↗
29. Richards · J. Exp. Bot. · 1959 · 10 · 29010.1093/jxb/10.2.290 ↗
30. Simpson · J. Theor. Biol. · 2022 · 535 · 11099810.1016/j.jtbi.2021.110998 ↗
31. Boheim · J. Membr. Biol. · 1978 · 38 · 9910.1007/BF01875164 ↗
32. Okazaki · Biophys. J. · 2003 · 85 · 26710.1016/S0006-3495(03)74472-5 ↗
33. Najem · J. Visualized Exp. · 2019 · e58998
34. Kwon · Journal of Semiconductor Technology and Science · 2022 · 22 · 11510.5573/JSTS.2022.22.2.115 ↗