journal article·2022-12

A Reconfigurable Two‐WSe2‐Transistor Synaptic Cell for Reinforcement Learning

Yue Zhou, Yasai Wang, Fuwei Zhuge, Jianmiao Guo, Sijie Ma, Jingli Wang, Zijian Tang, Yi Li, Xiangshui Miao, Yuhui He, Yang Chai

Advanced Materials· Volume 34· Issue 48
Publisher page

Abstract

Abstract Reward‐modulated spike‐timing‐dependent plasticity (R‐STDP) is a brain‐inspired reinforcement learning (RL) rule, exhibiting potential for decision‐making tasks and artificial general intelligence. However, the hardware implementation of the reward‐modulation process in R‐STDP usually requires complicated Si complementary metal–oxide–semiconductor (CMOS) circuit design that causes high power consumption and large footprint. Here, a design with two synaptic transistors (2T) connected in a parallel structure is experimentally demonstrated. The 2T unit based on WSe2 ferroelectric transistors exhibits reconfigurable polarity behavior, where one channel can be tuned as n‐type and the other as p‐type due to nonvolatile ferroelectric polarization. In this way, opposite synaptic weight update behaviors with multilevel (>6 bit) conductance states, ultralow nonlinearity (0.56/−1.23), and large Gmax/Gmin ratio of 30 are realized. By applying positive/negative reward to (anti‐)STDP component of 2T cell, R‐STDP learning rules are realized for training the spiking neural network and demonstrated to solve the classical cart–pole problem, exhibiting a way for realizing low‐power (32 pJ per forward process) and highly area‐efficient (100 µm2) hardware chip for reinforcement learning.
Source: crossref · Quality: baseline

Research context

OpenAlex topics: Advanced Memory and Neural Computing · Ferroelectric and Negative Capacitance Devices · Neuroscience and Neural Engineering

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

Wuhan National Laboratory for Optoelectronics School of Integrated Circuits Huazhong University of Science and Technology Wuhan 430000 China

Department of Applied Physics The Hong Kong Polytechnic University Hong Kong 999077 China

School of Materials Science and Engineering Huazhong University of Science and Technology Wuhan 430000 China

Frontier Institute of Chip and System Fudan University Shanghai 200433 China

Funding

National Natural Science Foundation of China · Hong Kong Polytechnic University

References (61)

Show source-provided references
1. 10.1038/s41928-020-00501-910.1038/s41928-020-00501-9 ↗
2. 10.1038/s41586-019-1677-210.1038/s41586-019-1677-2 ↗
3. 10.1038/s41586-020-2861-010.1038/s41586-020-2861-0 ↗
4. 10.1038/s41928-020-0435-710.1038/s41928-020-0435-7 ↗
5. 10.1038/s41586-019-1424-810.1038/s41586-019-1424-8 ↗
6. 10.1126/science.aaw558110.1126/science.aaw5581 ↗
7. 10.1126/science.abg316110.1126/science.abg3161 ↗
8. 10.3389/fnins.2015.0014110.3389/fnins.2015.00141 ↗
9. 10.1088/0957-4484/24/38/38401010.1088/0957-4484/24/38/384010 ↗
10. Sutton R. S. · 2018
11. 10.2200/S00268ED1V01Y201005AIM00910.2200/S00268ED1V01Y201005AIM009 ↗
12. 10.1162/neco.2007.19.6.146810.1162/neco.2007.19.6.1468 ↗
13. 10.1016/j.patcog.2019.05.01510.1016/j.patcog.2019.05.015 ↗
14. 10.1109/TNNLS.2018.282672110.1109/TNNLS.2018.2826721 ↗
15. 10.1371/journal.pcbi.100018010.1371/journal.pcbi.1000180 ↗
16. 10.1016/j.neunet.2019.05.01910.1016/j.neunet.2019.05.019 ↗
17. Berdan R. · 2019 · T2210.23919/VLSIT.2019.8776500 ↗
18. 10.1038/s41928-019-0221-610.1038/s41928-019-0221-6 ↗
19. Ota K. · 2019
20. 10.3389/fncir.2018.0005310.3389/fncir.2018.00053 ↗
21. 10.1109/MM.2018.11213035910.1109/MM.2018.112130359 ↗
22. 10.1109/JPROC.2014.230463810.1109/JPROC.2014.2304638 ↗
23. 10.1007/s11265-020-01558-710.1007/s11265-020-01558-7 ↗
24. Rubino A. · 2019 · 458
25. Wijekoon J. H. B. · 2011 · 877
26. Demirağ Y. · 2021
27. 10.1038/s41928-020-00511-710.1038/s41928-020-00511-7 ↗
28. 10.1038/s41928-020-0433-910.1038/s41928-020-0433-9 ↗
29. 10.1126/sciadv.aba617310.1126/sciadv.aba6173 ↗
30. 10.1038/s41467-021-23719-310.1038/s41467-021-23719-3 ↗
31. 10.1038/s41928-021-00591-z10.1038/s41928-021-00591-z ↗
32. 10.1002/adma.20160423010.1002/adma.201604230 ↗
33. 10.1002/adma.20160643310.1002/adma.201606433 ↗
34. 10.1038/s41467-019-11328-010.1038/s41467-019-11328-0 ↗
35. 10.1038/s41928-019-0350-y10.1038/s41928-019-0350-y ↗
36. 10.1002/adma.20190793710.1002/adma.201907937 ↗
37. 10.1002/adma.20150334010.1002/adma.201503340 ↗
38. 10.1038/ncomms1150210.1038/ncomms11502 ↗
39. 10.1063/1.514354710.1063/1.5143547 ↗
40. 10.1088/1361-6528/aaa62910.1088/1361-6528/aaa629 ↗
41. 10.1038/s41699-019-0114-610.1038/s41699-019-0114-6 ↗
42. 10.1038/s41565-020-0724-310.1038/s41565-020-0724-3 ↗
43. 10.1002/adfm.20160029210.1002/adfm.201600292 ↗
44. 10.1002/adfm.20160348410.1002/adfm.201603484 ↗
45. 10.1002/adfm.20200385910.1002/adfm.202003859 ↗
46. Wang J. · 2018
47. 10.1126/sciadv.160281310.1126/sciadv.1602813 ↗
48. 10.1021/acs.chemmater.7b0414910.1021/acs.chemmater.7b04149 ↗
49. Shi C. · 2021
50. 10.1109/TSMC.1983.631307710.1109/TSMC.1983.6313077 ↗
51. 10.1039/C5NR01072A10.1039/C5NR01072A ↗
52. 10.1063/1.311921510.1063/1.3119215 ↗
53. 10.1103/PhysRevLett.105.16660210.1103/PhysRevLett.105.166602 ↗
54. 10.1002/aelm.20180060010.1002/aelm.201800600 ↗
55. 10.1002/adma.20200562010.1002/adma.202005620 ↗
56. 10.1002/adma.20190361310.1002/adma.201903613 ↗
57. 10.1021/nl304777e10.1021/nl304777e ↗
58. 10.1088/2053-1583/aaa4ca10.1088/2053-1583/aaa4ca ↗
59. Jerry M. · 2017
60. Chung W. · 2018
61. Zhou Y. · IEEE Int. Electron Devices Meet. · 2019 · 6.5.1