journal article·2024-10-17Open access

Stochastic Memristor Modeling Framework Based on Physics-Informed Neural Networks

Kyeongmin Kim, Jonghwan Lee

Applied Sciences· Volume 14· Issue 20

Abstract

In this paper, we present a framework of modeling memristor noise for circuit simulators using physics-informed neural networks (PINNs). The variability of the memristor that is directly related to the neuromorphic system can be handled with this approach. The memristor noise model is transformed into a Fokker–Planck equation (FPE) from a probabilistic perspective. The translated equations are physically interpreted through the PINN. The weights and biases extracted from the PINN are implemented in Verilog-A through simple operations. The characteristics of the stochastic system under the noise are obtained by integrating the probability density function. This approach allows for the unification of different memristor models and the analysis of the effects of noise.
Source: crossref · Quality: baseline

Research context

OpenAlex topics: Advanced Memory and Neural Computing · Neural dynamics and brain function · stochastic dynamics and bifurcation

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

Department of System Semiconductor Engineering, Sangmyung University, Cheonan 31066, Republic of Korea

Funding

Sangmyung University

References (50)

Show source-provided references
1. Neuromorphic computing using non-volatile memory
2. Beyond von Neumann architecture: Brain-inspired artificial neuromorphic devices and integrated computing10.1002/aelm.202300839 ↗
3. Energy-efficient memcapacitor devices for neuromorphic computing10.1038/s41928-021-00649-y ↗
4. A functional hybrid memristor crossbar-array/CMOS system for data storage and neuromorphic applications10.1021/nl203687n ↗
5. You, T., Zhao, M., Fan, Z., and Ju, C. (2023). Emerging memtransistors for neuromorphic system applications: A review. Sensors, 23.10.3390/s23125413 ↗
6. Neuromorphic computing with memristor crossbar10.1002/pssa.201700875 ↗
7. High-speed and low-energy nitride memristors10.1002/adfm.201600680 ↗
8. Review of memristor devices in neuromorphic computing: Materials sciences and device challenges10.1088/1361-6463/aade3f ↗
9. Memristor-The missing circuit element10.1109/TCT.1971.1083337 ↗
10. The future of memristors: Materials engineering and neural networks
11. Memris-tors: A short review on fundamentals, structures, materials and applications10.24425/ijet.2020.131888 ↗
12. Memristive technologies for data storage, computation, encryption, and radio-frequency communication10.1126/science.abj9979 ↗
13. A review of memristor: Material and structure design, device performance, applications and prospects10.1080/14686996.2022.2162323 ↗
14. State of the art of metal oxide memristor devices
15. Research progress of artificial neural systems based on memristors10.1016/j.mtnano.2023.100439 ↗
16. A process-aware memory compact-device model using long-short term memory10.1109/ACCESS.2020.3047491 ↗
17. Lee, Y., Kim, K., and Lee, J. (2024). A compact memristor model based on physics-informed neural networks. Micromachines, 15.10.3390/mi15020253 ↗
18. Nonstationary distributions and relaxation times in a stochastic model of memristor10.1088/1742-5468/ab684a ↗
19. Mimicking neurotransmitter release and long-term plasticity by oxygen vacancy migration in a tunnel junction memristor10.1002/aisy.201900036 ↗
20. Signal and noise extraction from analog memory elements for neuromorphic computing10.1038/s41467-018-04485-1 ↗
21. Stochastic resonance in a metal-oxide memristive device10.1016/j.chaos.2021.110723 ↗
22. Stochastic memory: Memory enhancement due to noise10.1103/PhysRevE.85.011116 ↗
23. Nonlinear stochastic modelling with Langevin regression
24. Stochastic model of memristor based on the length of conductive region10.1016/j.chaos.2021.111131 ↗
25. hysics-informed machine learning10.1038/s42254-021-00314-5 ↗
26. Moradi, S., Duran, B., Azam, S.E., and Mofid, M. (2023). Novel physics-informed artificial neural network architectures for system and input identification of structural dynamics PDEs. Buildings, 13.10.3390/buildings13030650 ↗
27. Physics-informed neural networks: A deep learning framework for solving forward and inverse problems involving nonlinear partial differential equations10.1016/j.jcp.2018.10.045 ↗
28. Sha, Y., Lan, J., Li, Y., and Chen, Q. (2023). A physics-informed recurrent neural network for RRAM modeling. Electronics, 12.10.3390/electronics12132906 ↗
29. Design flow for hybrid cmos/memristor systems-part I: Modeling and verification steps10.1109/TCSI.2021.3122343 ↗
30. The missing memristor found10.1038/nature06932 ↗
31. The elusive memristor: Properties of basic electrical circuits10.1088/0143-0807/30/4/001 ↗
32. Kumar, N., Philip, E., and Elfving, V.E. (2022). Integral transforms in a physics-informed (Quantum) neural network setting: Applications & use-cases. arXiv.
33. Memristor devices for neural networks10.1088/1361-6463/aae223 ↗
34. Scientific machine learning through physics–informed neural networks: Where we are and what’s next10.1007/s10915-022-01939-z ↗
35. Multiplicative neuron model artificial neural network based on gaussian activation function10.1007/s00521-015-1908-x ↗
36. Liu, Y., and Yao, X. (1996, January 20–22). Evolutionary design of artificial neural networks with different nodes. Proceedings of the IEEE International Conference on Evolutionary Computation, Nagoya, Japan.
37. Some history of the study of higher-order moments and spectra
38. Review on various memristor models, characteristics, potential applications, and future works10.1007/s42341-019-00116-8 ↗
39. Isah, A., and Bilbault, J.-M. (2022). Review on the basic circuit elements and memristor interpretation: Analysis, technology and applications. J. Low Power Electron. Appl., 12.10.3390/jlpea12030044 ↗
40. Memristor oscillators10.1142/S0218127408022354 ↗
41. New memristor applications: AM, ASK, FSK, and BPSK modulators10.1109/MAP.2013.6529381 ↗
42. Resistive switching memory: Nanoionic resistive switching memories: On the physical nature of the dynamic reset process10.1002/aelm.201500233 ↗
43. Measurement of the activation energies of oxygen ion diffusion in yttria stabilized zirconia by flicker noise spectroscopy10.1063/1.5098066 ↗
44. A SPICE compact model of metal oxide resistive switching memory with variations10.1109/LED.2012.2210856 ↗
45. Variability in resistive memories10.1002/aisy.202200338 ↗
46. Alternative approaches to program memristor and reduce the effect of random telegraphic noise10.1080/03772063.2019.1670105 ↗
47. Quantized conductance coincides with state instability and excess noise in tantalum oxide memristors10.1038/ncomms11142 ↗
48. Stochastic resonance in a neuronal network from mammalian brain10.1103/PhysRevLett.77.4098 ↗
49. Stochastic resonance and the benefits of noise: From ice ages to crayfish and SQUIDs10.1038/373033a0 ↗
50. True random number generation by variability of resistive switching in oxide-based devices10.1109/JETCAS.2015.2426492 ↗