journal article·2025-04

Dynamic Convolutional Neural Networks Based on Adaptive 2D Memristors

Heemyoung Hong, Xi Chen, Woohyun Cho, Ho Yeon Yoo, Jaewhan Oh, Minseok Kim, Geunwoo Hwang, Yongsoo Yang, Linfeng Sun, Zhongrui Wang, Heejun Yang

Advanced Functional Materials· Volume 35· Issue 17
Publisher page

Abstract

Abstract Convolutional Neural Networks (CNNs) are pivotal in modern digital computing, particularly for tasks like image classification, inspired by the receptive fields of the human brain. Nevertheless, CNNs implemented on conventional digital computers face significant limitations due to inflexible kernels that cannot adjust to dynamic inputs, and the von Neumann architecture, which leads to inefficient data transfer between memory and processing units. This research presents a hardware‐software co‐designed solution, a Dynamic Convolutional Neural Network (dCNN), empowered by three‐terminal adaptive two‐dimensional (2D) memristors. These memristors consist of a vertical heterostructure integrating silver, an atomically thin insulator (CrPS4), and graphene as a semimetal. This configuration allows for the dynamic tuning of conductive filament properties, emulating the heterosynaptic plasticity observed in biological neural systems. The three‐terminal memristor design permits the dCNN to actively adjust kernel weights in its attention layer according to the input stimuli. The empirical tests demonstrate that image classification accuracy using our adaptive 2D memristor‐enhanced dVGG reaches up to 94% on the CIFAR‐10 dataset, which exceeds the performance of static VGG. Furthermore, the energy efficiency of our dVGG significantly outperforms that of GPUs, aligning more closely with the energy dynamics of the human brain in terms of both consumption and classification accuracy.
Source: crossref · Quality: baseline

Research context

OpenAlex topics: Advanced Memory and Neural Computing · Neural Networks and Applications · Ferroelectric and Negative Capacitance Devices

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

Department of Physics Korea Advanced Institute of Science and Technology (KAIST) Daejeon 34141 South Korea

Department of Electrical and Electronic Engineering The University of Hong Kong Hong Kong 999077 Hong Kong

Division of Chemical Engineering and Materials Science Graduate Program in System Health Science and Engineering Ewha Womans University Seoul 03760 South Korea

Graduate School of Semiconductor Technology School of Electrical Engineering Korea Advanced Institute of Science and Technology (KAIST) Daejeon 34141 South Korea

School of Physics Beijing Institute of Technology Beijing 100081 China

School of Microelectronics Southern University of Science and Technology Shenzhen 518055 China

Funding

Samsung Science and Technology Foundation

References (37)

Show source-provided references
1. 10.1038/nature1453910.1038/nature14539 ↗
2. 10.1109/TPAMI.2013.5010.1109/TPAMI.2013.50 ↗
3. 10.1109/5.72679110.1109/5.726791 ↗
4. 10.1186/s40537-021-00444-810.1186/s40537-021-00444-8 ↗
5. 10.1016/j.specom.2019.01.00410.1016/j.specom.2019.01.004 ↗
6. M.Coşkun A.Uçar Ö.Yildirim Y.Demir presented at2017 Modern Electrical and Energy Systems (MEES) Kremenchuk Ukraine November 2017.
7. N.Aloysius M.Geetha presented at2017 Int. Conf. Commun. Signal Processing (ICCSP) Chennai India April 2017.
8. 10.1109/TPAMI.2021.311783710.1109/TPAMI.2021.3117837 ↗
9. Jia X. · Adv. Neural Inf. Process. Syst. · 2016 · 29
10. Y.Zhang J.Zhang Q.Wang Z.Zhong arXiv preprint arXiv:2004.106942020.
11. Y.Chen X.Dai M.Liu D.Chen L.Yuan Z.Liu presented atProc. IEEE/CVF Conf. Computer Vision and Pattern Recognition (CVPR) Seattle WA USA June 2020.
12. H.Amrouch N.Du A.Gebregiorgis S.Hamdioui I.Polian presented at2021 IFIP/IEEE 29th Int. Conf. Very Large Scale Integration (VLSI‐SoC) Salt Lake City October 2021 1.10.1109/VLSI-SoC53125.2021.9606966 ↗
13. Schuman C. D. · arXiv preprint arXiv · 2017 · 1705
14. James C. D. · Biol. Insp. Cog. Arch. · 2017 · 19 · 49
15. Strukov D. · Nat. Commun. · 2019 · 2019 · 4838
16. 10.1038/s42254-020-0208-210.1038/s42254-020-0208-2 ↗
17. 10.1080/23746149.2016.125958510.1080/23746149.2016.1259585 ↗
18. 10.1002/smll.20200676010.1002/smll.202006760 ↗
19. 10.1016/j.nanoen.2020.10447210.1016/j.nanoen.2020.104472 ↗
20. 10.1021/nl901572a10.1021/nl901572a ↗
21. 10.1088/2053-1583/ab23ba10.1088/2053-1583/ab23ba ↗
22. 10.1088/2634-4386/ac8a6a10.1088/2634-4386/ac8a6a ↗
23. 10.1002/adma.20221152510.1002/adma.202211525 ↗
24. 10.1002/advs.20210463210.1002/advs.202104632 ↗
25. 10.1038/nnano.2010.8910.1038/nnano.2010.89 ↗
26. 10.1038/s41427-020-00272-x10.1038/s41427-020-00272-x ↗
27. N.Sinha M.Gupta D.Rao presented atProc. IEEE Int. Conf. Industrial Technology 2000 (IEEE Cat. No. 00TH8482) Goa India August 2000.
28. 10.1152/jn.2000.83.5.258010.1152/jn.2000.83.5.2580 ↗
29. 10.1146/annurev.neuro.23.1.44110.1146/annurev.neuro.23.1.441 ↗
30. 10.1146/annurev.neuro.27.070203.14422010.1146/annurev.neuro.27.070203.144220 ↗
31. 10.1113/jphysiol.1962.sp00683710.1113/jphysiol.1962.sp006837 ↗
32. 10.1109/LED.2013.229559210.1109/LED.2013.2295592 ↗
33. 10.1016/j.mtelec.2022.10000410.1016/j.mtelec.2022.100004 ↗
34. 10.3389/fnins.2016.0033310.3389/fnins.2016.00333 ↗
35. 10.1038/s41467-018-04485-110.1038/s41467-018-04485-1 ↗
36. S.Agarwal S. J.Plimpton D. R.Hughart A. H.Hsia I.Richter J. A.Cox C. D.James M. J.Marinella in2016 Int. Joint Conf. Neural Networks (IJCNN) IEEE 2016.
37. P.‐Y.Chen B.Lin I.‐T.Wang T.‐H.Hou J.Ye S.Vrudhula J.‐s.Seo Y.Cao S.Yu in2015 Int. Conf. Computer‐Aided Design (ICCAD) IEEE 2015.