High-speed programming with threshold division for RRAM-based neural network accelerators
Source abstract
Abstract
RRAM-based neural network accelerators offer significant improvements in energy efficiency and throughput for machine learning and artificial intelligence. However, it is challenging to transfer trained neural network weights to RRAM arrays precisely due to non-ideal characteristics such as read noise and write variability. A write-verify strategy is commonly employed to adjust the RRAM cells within acceptable error margins. However, this process is time-consuming and resource-intensive. In this work, a high-speed programming strategy based on threshold division is proposed, inspired by magnitude-based network pruning. The relationship between threshold conductance and programming error is systematically investigated by allowing a larger programming error for cells below the threshold. Results of experiments on MLP and LeNet-5 networks demonstrate that the programming speed is enhanced by 3.41 times and 2.39 times, respectively. This strategy provides a novel method for fast transfer of weights in large-scale RRAM-based neural network accelerators.
Source: crossref · Quality: baseline
Research context
OpenAlex topics: Advanced Memory and Neural Computing · Ferroelectric and Negative Capacitance Devices · Neural Networks and Reservoir Computing
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
Affiliations
College of Electronic Science and Technology, National University of Defense Technology 1 , Changsha 410073,
Beijing Institute of Tracking and Telecommunication Technology 2 , Beijing 100094,
Funding
National Natural Science Foundation of China · The Science and Technology Innovation Program of Hunan Province
References (17)
Show source-provided references
1. A compute-in-memory chip based on resistive random-access memory10.1038/s41586-022-04992-8 ↗
2. Optimised weight programming for analogue memory-based deep neural networks10.1038/s41467-022-31405-1 ↗
3. Memristive crossbar arrays for storage and computing applications10.1002/aisy.202100017 ↗
4. Cross-layer transmission realized by light-emitting memristor for constructing ultra-deep neural network with transfer learning ability10.1038/s41467-024-46246-3 ↗
5. Memristor-based storage system with convolutional autoencoder-based image compression network10.1038/s41467-024-45312-0 ↗
6. Neural network learning using non-ideal resistive memory devices10.3389/fnano.2022.1008266 ↗
7. Intrinsic bounds for computing precision in memristor-based vector-by-matrix multipliers10.1109/tnano.2020.2992493 ↗
8. Recent progress in analog memory-based accelerators for deep learning10.1088/1361-6463/aac8a5 ↗
9. Fully hardware-implemented memristor convolutional neural network10.1038/s41586-020-1942-4 ↗
10. High precision tuning of state for memristive devices by adaptable variation-tolerant algorithm10.1088/0957-4484/23/7/075201 ↗
11. Highly parallel writing strategy based on diagonal-gates-connection 1T1R arrays10.1109/ted.2022.3214794 ↗
12. Thousands of conductance levels in memristors integrated on CMOS10.1038/s41586-023-05759-5 ↗
13. Programming memristor arrays with arbitrarily high precision for analog computing10.1126/science.adi9405 ↗
14. U-SWIM: Universal selective write-verify for computing-in-memory neural accelerators10.1109/tcad.2024.3352496 ↗
15. A high-speed and high-efficiency diverse error margin write-verify scheme for an RRAM-based neuromorphic hardware accelerator10.1109/tcsii.2022.3224470 ↗
16. Iterative magnitude pruning-based light-version of AlexNet for skin cancer classification10.1007/s00521-023-09111-w ↗
17. Stage-wise magnitude-based pruning for recurrent neural networks10.1109/tnnls.2022.3184730 ↗