Pr x Ca 1 − x MnO 3 based stochastic neuron for Boltzmann machine to solve “maximum cut” problem
Source abstract
Abstract
The neural network enables efficient solutions for Nondeterministic Polynomial-time (NP) hard problems, which are challenging for conventional von Neumann computing. The hardware implementation, i.e., neuromorphic computing, aspires to enhance this efficiency by custom hardware. Particularly, NP hard graphical constraint optimization problems are solved by a network of stochastic binary neurons to form a Boltzmann Machine (BM). The implementation of stochastic neurons in hardware is a major challenge. In this work, we demonstrate that the high to low resistance switching (set) process of a PrxCa1−xMnO3 (PCMO) based RRAM (Resistive Random Access Memory) is probabilistic. Additionally, the voltage-dependent probability distribution approximates a sigmoid function with 1.35%–3.5% error. Such a sigmoid function is required for a BM. Thus, the Analog Approximate Sigmoid (AAS) stochastic neuron is proposed to solve the maximum cut—an NP hard problem. It is compared with Digital Precision-controlled Sigmoid (DPS) implementation using (a) pure CMOS design and (b) hybrid (RRAM integrated with CMOS). The AAS design solves the problem with 98% accuracy, which is comparable with the DPS design but with 10× area and 4× energy advantage. Thus, ASIC neuro-processors based on novel analog neuromorphic devices based BM are promising for efficiently solving large scale NP hard optimization problems.
Source: crossref · Quality: baseline
Research context
OpenAlex topics: Advanced Memory and Neural Computing · Ferroelectric and Negative Capacitance Devices · Machine Learning and ELM
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
Affiliations
Department of Electrical Engineering, IIT Bombay 1 , Mumbai, India
Processor Architecture Research Lab, Intel Labs 2 , Bangalore, India
Funding
DST Nanomission · Ministry of Electronics and IT
References (62)
Show source-provided references
1. Memory and information processing in neuromorphic systems10.1109/jproc.2015.2444094 ↗
2. From von Neumann, John Atanasoff and ABC to neuromorphic computation and the NeuCube spatio-temporal data machine
3. Optimization by neural networks
4. New optimization methods from physics and biology10.1038/329215a0 ↗
5. The traveling salesman problem: A hierarchical model10.3758/bf03211820 ↗
6. Stochastic computations in cortical microcircuit models10.1371/journal.pcbi.1003311 ↗
7. Neural networks for combinatorial optimization: A review of more than a decade of research10.1287/ijoc.11.1.15 ↗
8. Networks of spiking neurons: The third generation of neural network models10.1016/s0893-6080(97)00011-7 ↗
9. Learning in spiking neural networks by reinforcement of stochastic synaptic transmission10.1016/s0896-6273(03)00761-x ↗
10. What is stochastic resonance? Definitions, misconceptions, debates, and its relevance to biology10.1371/journal.pcbi.1000348 ↗
11. Solving constraint satisfaction problems with networks of spiking neurons10.3389/fnins.2016.00118 ↗
12. Refractoriness and neural precision10.1523/jneurosci.18-06-02200.1998 ↗
13. Using stochastic spiking neural networks on spinnaker to solve constraint satisfaction problems10.3389/fnins.2017.00714 ↗
14. Chaotic dynamics in nanoscale NbO2 Mott memristors for analogue computing10.1038/nature23307 ↗
15. Vertex coloring of graphs via phase dynamics of coupled oscillatory networks10.1038/s41598-017-00825-1 ↗
16. Transient joule heating-based oscillator neuron for neuromorphic computing10.1109/led.2018.2854732 ↗
17. Memristive Boltzmann machine: A hardware accelerator for combinatorial optimization and deep learning
18. Combinatorial optimization on a Boltzmann machine10.1016/0743-7315(89)90064-6 ↗
19. Neural dynamics as sampling: A model for stochastic computation in recurrent networks of spiking neurons10.1371/journal.pcbi.1002211 ↗
20. Synaptic electronics: Materials, devices and applications10.1088/0957-4484/24/38/382001 ↗
21. A mini review of neuromorphic architectures and implementations10.1109/ted.2016.2598413 ↗
22. Neuromorphic silicon neuron circuits10.3389/fnins.2011.00073 ↗
23. Analog versus digital: Extrapolating from electronics to neurobiology10.1162/089976698300017052 ↗
24. Leaky integrate and fire neuron by charge-discharge dynamics in floating-body MOSFET10.1038/s41598-017-07418-y ↗
25. Transient variability in SOI-based LIF neuron and impact on unsupervised learning10.1109/ted.2018.2872407 ↗
26. Stochastic memristive devices for computing and neuromorphic applications10.1039/c3nr01176c ↗
27. Programmable resistance switching in nanoscale two-terminal devices10.1021/nl803669s ↗
28. Stochastic switching of TiO2-based memristive devices with identical initial memory states10.1186/1556-276x-9-293 ↗
29. Leveraging stochastic memristor devices in neuromorphic hardware systems10.1109/jetcas.2016.2547780 ↗
30. The memristive magnetic tunnel junction as a nanoscopic synapse-neuron system10.1002/adma.201103723 ↗
31. The stochastic modeling of TiO2 memristor and its usage in neuromorphic system design
32. Stochastic phase-change neurons10.1038/nnano.2016.70 ↗
33. Design of stochastic nanomagnets for probabilistic spin logic10.1109/lmag.2018.2860547 ↗
34. Composable probabilistic inference networks using MRAM-based stochastic neurons10.1145/3304105 ↗
35. Low-barrier magnet design for efficient hardware binary stochastic neurons10.1109/lmag.2019.2910787 ↗
36. Biological plausibility and stochasticity in scalable VO2 active memristor neurons10.1038/s41467-018-07052-w ↗
37. Realistic Hodgkin–Huxley axons using stochastic behavior of memristors10.1007/s11063-016-9502-5 ↗
38. Inherently stochastic spiking neurons for probabilistic neural computation
39. A current-mode CMOS/memristor hybrid implementation of an extreme learning machine
40. Stochasticity modeling in memristors10.1109/tnano.2015.2493960 ↗
41. Memristors empower spiking neurons with stochasticity10.1109/jetcas.2015.2435512 ↗
42. Modeling and implementation of firing-rate neuromorphic-network classifiers with bilayer Pt/Al2O3/TiO2-x/Pt memristors
43. Magnetic tunnel junction mimics stochastic cortical spiking neurons10.1038/srep30039 ↗
44. Voltage-controlled spintronic stochastic neuron based on a magnetic tunnel junction10.1103/physrevapplied.11.034015 ↗
45. P. Wijesinghe, A. Ankit, A. Sengupta, and K. Roy, “An all-memristor deep spiking neural computing system: A step towards realizing the low power, stochastic brain,” e-print arXiv:1712.01472 (2017).10.1109/TETCI.2018.2829924 ↗
46. HfO2-based OxRAM devices as synapses for convolutional neural networks10.1109/ted.2015.2440102 ↗
47. Low programming voltage resistive switching in reactive metal/polycrystalline Pr0.7Ca0.3MnO3 devices10.1016/j.ssc.2010.09.036 ↗
48. Effect of morphological change on unipolar and bipolar switching characteristics in Pr0.7Ca0.3MnO3 based RRAM10.1557/opl.2015.192 ↗
49. Electronic system with memristive synapses for pattern recognition10.1038/srep10123 ↗
50. Arbitrary spike time dependent plasticity (STDP) in memristor by analog waveform engineering10.1109/led.2017.2696023 ↗
51. PCMO-based RRAM and NPN bipolar selector as synapse for energy efficient STDP10.1109/led.2017.2723503 ↗
52. Stochastic learning in deep neural networks based on nanoscale PCMO device characteristics10.1016/j.neucom.2018.09.019 ↗
53. PCMO RRAM for integrate-and-fire neuron in spiking neural networks10.1109/led.2018.2805822 ↗
54. Maximum cut in fuzzy nature: Models and algorithms10.1016/j.cam.2009.12.022 ↗
55. Ionic transport barrier tuning by composition in Pr1-xCaxMnO3-based selector-less RRAM and its effect on memory performance10.1109/ted.2018.2827420 ↗
56. Least-squares minimising finite-element formulation for static and stationary electric and magnetic fields10.1109/20.717556 ↗
57. A. Khanna, S. Prasad, N. Panwar, and U. Ganguly, “Reaction-drift model for switching transients in Pr0.7Ca0.3MnO3 based resistive RAM,” e-print arXiv:1612.05293 (2016).
58. Temperature effects in set/reset voltage–time dilemma in Pr0.7Ca0.3MnO3-based RRAM10.1109/ted.2018.2882447 ↗
59. 1980
60. 65nm low power digital to analog converter for CUWB
61. A 0.024 mm2 4.9 fJ 10-bit 2 MS/s SAR ADC in 65 nm CMOS
62. Improved approximation algorithms for maximum cut and satisfiability problems using semidefinite programming10.1145/227683.227684 ↗