A linear compensation method for inference accuracy improvement of memristive in-memory computing
Source abstract
Abstract
Abstract Memristive computing system (MCS), with the feature of in-memory computing capability, for artificial neural networks (ANNs) deployment showing low power and massive parallelism, is a promising alternative for traditional Von-Neumann architecture computing system. However, because of the various non-idealities of both peripheral circuits and memristor array, the performance of the practical MCS tends to be significantly reduced. In this work, a linear compensation method (LCM) is proposed for the performance improvement of MCS under the effect of non-idealities. By considering the effects of various non-ideal states in the MCS as a whole, the output error of the MCS under different conditions is investigated. Then, a mathematic model for the output error is established based on the experimental data. Furthermore, the MCS is researched at the physical circuit level as well, in order to analyze the specific way in which the non-idealities affect the output current. Finally, based on the established mathematical model, the LCM output current is compensated in real time to improve the system performance. The effectiveness of LCM is verified and showing outstanding performance in the residual neural network-34 network architecture, which is easily affected by the non-idealities in hardware. The proposed LCM can be naturally integrated into the operation processes of MCS, paving the way for optimizing the deployment on generic ANN hardware based on the memristor.
Source: crossref · Quality: baseline
Research context
OpenAlex topics: Advanced Memory and Neural Computing · Neural dynamics and brain function · Photoreceptor and optogenetics research
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
References (45)
Show source-provided references
1. ImageNet classification with deep convolutional neural networks10.1145/3065386 ↗
2. IEEE · 2015
3. Deep learning in medical imaging: general overview10.3348/kjr.2017.18.4.570 ↗
4. Saon · 2015 · 3140
5. A survey of artificial neural network in wind energy systems10.1016/j.apenergy.2018.07.084 ↗
6. Application of artificial neural networks to photovoltaic fault detection and diagnosis: a review10.1016/j.rser.2020.110512 ↗
7. Solar radiation prediction using artificial neural network techniques: a review10.1016/j.rser.2013.08.055 ↗
8. Sze · 201810.1109/EMBC.2018.8512281 ↗
9. An overview on edge computing research10.1109/access.2020.2991734 ↗
10. Computation offloading toward edge computing10.1109/jproc.2019.2922285 ↗
11. Evolution of memory architecture10.1109/jproc.2015.2435018 ↗
12. Research progress in architecture and application of RRAM with computing-in-memory10.1039/d3na00025g ↗
13. In-memory computing with resistive switching devices10.1038/s41928-018-0092-2 ↗
14. Overview of memristor-based neural network design and applications10.3389/fphy.2022.839243 ↗
15. Memristors: understanding, utilization and upgradation for neuromorphic computing10.1142/s1793292020300054 ↗
16. A review of memristor: material and structure design, device performance, applications and prospects10.1080/14686996.2022.2162323 ↗
17. Synapse-mimetic hardware-implemented resistive random-access memory for artificial neural network10.3390/s23063118 ↗
18. Analysis and test of influence of memristor non-ideal characteristics on facial expression recognition accuracy10.1016/j.eswa.2023.121028 ↗
19. Variability in resistive memories10.1002/aisy.202200338 ↗
20. Challenges and solutions in emerging memory testing10.1109/tetc.2017.2691263 ↗
21. Gebregiorgis · 202210.1016/j.prevetmed.2021.105557 ↗
22. IEEE · 2019
23. Memristor-CMOS hybrid neuron circuit with nonideal-effect correction related to parasitic resistance for binary-memristor-crossbar neural networks10.3390/mi12070791 ↗
24. Noise-induced resistance broadening in resistive switching memory-part II: array statistics10.1109/ted.2015.2477135 ↗
25. A 121 dB SNDR zoom ADC using dynamic amplifier and asynchronous SAR quantizer10.3390/electronics12020313 ↗
26. Compute in-memory with non-volatile elements for neural networks: a review from a co-design perspective10.1002/adma.202204944 ↗
27. Memristor-the missing circuit element10.1109/tct.1971.1083337 ↗
28. The missing memristor found10.1038/nature06932 ↗
29. Ambrogio · 2019
30. Parasitic effect analysis in memristor-array-based neuromorphic systems10.1109/tnano.2017.2784364 ↗
31. Modeling and analysis of passive switching crossbar arrays10.1109/tcsi.2017.2714101 ↗
32. A high-speed and high-efficiency diverse error margin write-verify Scheme for an RRAM-based neuromorphic hardware accelerator10.1109/tcsii.2022.3224470 ↗
33. Investigation of read disturb and bipolar read scheme on multilevel RRAM-based deep learning inference engine10.1109/ted.2020.2985013 ↗
34. Singh · 2022 · 1413
35. Improved conductance linearity and conductance ratio of 1T2R synapse device for neuromorphic systems10.1109/led.2017.2721638 ↗
36. Wu · 2017
37. W-AMA: weight-aware approximate multiplication architecture for neural processing10.1016/j.compeleceng.2023.108921 ↗
38. Fast and high-accuracy approximate MAC unit design for CNN computing10.1109/les.2021.3137335 ↗
39. Yu · 2020 · 2909
40. Optimization for deep convolutional neural networks: how slim can it go?10.1109/tetci.2018.2876573 ↗
41. Guo · 2020 · 235
42. IEEE · 2016 · 770
43. Gradient-based learning applied to document recognition10.1109/5.726791 ↗
44. Learning multiple layers of features from tiny images
45. IEEE · 2020