journal article·2026-05-12

Enhancing Post-Training Quantization Robustness in RRAM-Based CIM via σ-Clipping of Weights

Byeongchan Oh, Sangwook Youn, Hyungjin Kim, Tae-Hyeon Kim

Publisher page

Abstract

Resistive random-access memory (RRAM)-based computing-in-memory (CIM) has emerged as a promising solution for energy-efficient deep learning inference by eliminating the memory bottleneck of conventional von Neumann architectures. However, the limited bit precision and inherent variability of memristive devices pose significant challenges to inference accuracy. In this study, we present a post-training quantization (PTQ) framework that incorporates σ-based clipping to suppress weight outliers before quantization. This technique narrows the dynamic range of weights, improving quantization resolution and robustness. Using a three-layer fully connected neural network trained on binarized MNIST data, we analyzed the impact of σ-clipping on PTQ performance across z-score thresholds. Clipping improved inference accuracy and reduced accuracy variance across retrained models. Furthermore, we experimentally validated our approach using a 48 × 48 Al 2 O 3 /TiO x -based RRAM crossbar array. Despite conductance deviations during weight programming, clipping improved inference accuracy from 96.27% to 97.76%, confirming its effectiveness under hardware variation. In simulation, when variation corresponding to experimentally observed fluctuation was introduced, PTQ accuracy dropped from 96.42% to 83.67%, while the clipped model maintained 96.96%, demonstrating a 12.75%p improvement. These results establish σ-clipping as a practical and lightweight strategy to enhance the quantization robustness of CIM-based neural networks.
Source: openalex_inverted_index · Quality: baseline

Research context

OpenAlex topics: Advanced Memory and Neural Computing · Ferroelectric and Negative Capacitance Devices · Transition Metal Oxide Nanomaterials

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

Department of Semiconductor Engineering

Seoul National University of Science and Technology

Division of Materials Science and Engineering

Hanyang University

Funding

National Research Foundation of Korea · Ministry of Science, ICT and Future Planning · Korea Advanced Institute of Science and Technology · Seoul National University of Science and Technology · KIAT

References (41)

Show source-provided references
1. 10.1109/CONFLUENCE.2017.794314910.1109/CONFLUENCE.2017.7943149 ↗
2. 10.1109/ISQED.2019.869735410.1109/ISQED.2019.8697354 ↗
3. 10.1109/ACCESS.2024.345010510.1109/ACCESS.2024.3450105 ↗
4. 10.1007/s11432-020-3227-110.1007/s11432-020-3227-1 ↗
5. 10.1016/j.nanoen.2022.10788610.1016/j.nanoen.2022.107886 ↗
6. 10.1109/MM.2018.289003310.1109/MM.2018.2890033 ↗
7. 10.1016/j.memori.2024.10011510.1016/j.memori.2024.100115 ↗
8. 10.3390/electronics1122366710.3390/electronics11223667 ↗
9. 10.1002/aisy.20250003210.1002/aisy.202500032 ↗
10. 10.1016/j.neunet.2024.10635510.1016/j.neunet.2024.106355 ↗
11. 10.5573/JSTS.2024.24.3.22610.5573/JSTS.2024.24.3.226 ↗
12. 10.1002/adfm.20231019310.1002/adfm.202310193 ↗
13. 10.1002/aisy.20230079710.1002/aisy.202300797 ↗
14. 10.1109/IEDM.2008.479667710.1109/IEDM.2008.4796677 ↗
15. 10.1016/j.sse.2016.07.00610.1016/j.sse.2016.07.006 ↗
16. 10.1007/s11390-016-1608-810.1007/s11390-016-1608-8 ↗
17. 10.1002/pssr.20190007310.1002/pssr.201900073 ↗
18. 10.1007/s10853-018-2134-610.1007/s10853-018-2134-6 ↗
19. 10.1109/IEDM.2013.672469310.1109/IEDM.2013.6724693 ↗
20. 10.7873/DATE.2015.036210.7873/DATE.2015.0362 ↗
21. 10.1109/VLSIT.2018.851069010.1109/VLSIT.2018.8510690 ↗
22. 10.1016/j.chaos.2023.11335910.1016/j.chaos.2023.113359 ↗
23. 10.1109/TCSI.2016.252807910.1109/TCSI.2016.2528079 ↗
24. 10.5573/JSTS.2023.23.6.38210.5573/JSTS.2023.23.6.382 ↗
25. 10.1039/D1RA08103A10.1039/D1RA08103A ↗
26. 10.1016/j.mejo.2008.06.09610.1016/j.mejo.2008.06.096 ↗
27. 10.1109/TETCI.2022.319139710.1109/TETCI.2022.3191397 ↗
28. 10.1109/TCAD.2019.291785210.1109/TCAD.2019.2917852 ↗
29. 10.1109/TCSI.2022.314568710.1109/TCSI.2022.3145687 ↗
30. 10.1109/ISNE.2015.713202710.1109/ISNE.2015.7132027 ↗
31. 10.1109/TCSII.2023.324656210.1109/TCSII.2023.3246562 ↗
32. 10.1109/TCAD.2023.329870510.1109/TCAD.2023.3298705 ↗
33. 10.1038/s41586-025-08639-210.1038/s41586-025-08639-2 ↗
34. 10.1007/978-3-031-19775-8_1210.1007/978-3-031-19775-8_12 ↗
35. 10.1145/3649476.365880910.1145/3649476.3658809 ↗
36. 10.1109/TCSI.2023.333837810.1109/TCSI.2023.3338378 ↗
37. 10.1016/j.chaos.2021.11138810.1016/j.chaos.2021.111388 ↗
38. 10.1063/5.002775710.1063/5.0027757 ↗
39. 10.5573/JSTS.2022.22.6.41710.5573/JSTS.2022.22.6.417 ↗
40. 10.1021/acsaelm.4c0019910.1021/acsaelm.4c00199 ↗
41. 10.1109/TED.2015.243963510.1109/TED.2015.2439635 ↗