journal article·2022-12-14

Adaptive Memory and In Materia Reinforcement Learning Enabled by Flexoelectric-like Response from Ultrathin HfO2

Mohit Kumar, Hyungtak Seo

ACS Applied Materials & Interfaces· Volume 14· Issue 49
Publisher page

Abstract

Reinforcement learning (RL) is a mathematical framework of neural learning by trial and error that revolutionized the field of artificial intelligence. However, until now, RL has been implemented in algorithms with the compatibly of traditional complementary metal-oxide-semiconductor-based von Neumann digital platforms, which thus limits performance in terms of latency, fault tolerance, and robustness. Here, we demonstrate that nanocolumnar (∼12 nm) HfO2 structures can be used as building blocks to conduct the RL within the material by combining its stress-adjustable charge transport and memory functions. Specifically, HfO2 nanostructures grown by the sputtering method exhibit self-assembled vertical nanocolumnar structures that generate voltage depending on the impact of stress under self-biased conditions. The observed results are attributed to the flexoelectric-like response of HfO2. Further, multilevel current (>10–3 A) modulation with touch and controlled suspension (∼10–12 A) with a short electric pulse (100 ms) were demonstrated, yielding a proof-of-concept memory with an on/off ratio greater than 109. Utilizing multipattern dynamic memory and tactile sensing, RL was implemented to successfully solve a maze game using an array of 6 × 4. This work could pave the way to do RL within materials for a variety of applications such as memory storage, neuromorphic sensors, smart robots, and human–machine interaction systems.
Source: openalex_inverted_index · Quality: baseline

Research context

OpenAlex topics: Advanced Sensor and Energy Harvesting Materials · Ferroelectric and Negative Capacitance Devices · Advanced Memory and Neural Computing

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

Department of Energy Systems Research, Ajou University, Suwon16499, Republic of Korea

Department of Materials Science and Engineering, Ajou University, Suwon16499, Republic of Korea

Funding

National Research Foundation of Korea

References (38)

Show source-provided references
1. 10.23919/MIPRO.2018.840004010.23919/MIPRO.2018.8400040 ↗
2. 10.1126/science.aau659510.1126/science.aau6595 ↗
3. 10.1038/s41586-020-2973-610.1038/s41586-020-2973-6 ↗
4. 10.1038/s41591-018-0310-510.1038/s41591-018-0310-5 ↗
5. 10.1109/COMST.2019.291658310.1109/COMST.2019.2916583 ↗
6. 10.1038/s41586-019-1924-610.1038/s41586-019-1924-6 ↗
7. 10.1016/j.cma.2019.11279010.1016/j.cma.2019.112790 ↗
8. 10.1016/j.cma.2017.12.00510.1016/j.cma.2017.12.005 ↗
9. 10.1126/science.aau624910.1126/science.aau6249 ↗
10. 10.1038/nature1423610.1038/nature14236 ↗
11. Sutton R. S. · 1998
12. 10.1002/advs.20200166210.1002/advs.202001662 ↗
13. 10.1038/s41563-021-01099-910.1038/s41563-021-01099-9 ↗
14. 10.1038/nnano.2015.26010.1038/nnano.2015.260 ↗
15. 10.1103/PhysRevLett.121.20550210.1103/PhysRevLett.121.205502 ↗
16. 10.1039/c8nr00618k10.1039/c8nr00618k ↗
17. 10.1103/PhysRevLett.122.25760110.1103/PhysRevLett.122.257601 ↗
18. 10.1002/smtd.20210034210.1002/smtd.202100342 ↗
19. 10.1016/j.nanoen.2021.10646910.1016/j.nanoen.2021.106469 ↗
20. 10.1021/acsnano.2c0045010.1021/acsnano.2c00450 ↗
21. 10.1063/1.495505610.1063/1.4955056 ↗
22. 10.1063/1.493083110.1063/1.4930831 ↗
23. 10.1103/PhysRevB.84.21451710.1103/PhysRevB.84.214517 ↗
24. 10.1002/adma.20210688110.1002/adma.202106881 ↗
25. 10.1021/acs.nanolett.1c0317110.1021/acs.nanolett.1c03171 ↗
26. 10.1103/PhysRevE.96.03280410.1103/PhysRevE.96.032804 ↗
27. 10.1002/adfm.20140291010.1002/adfm.201402910 ↗
28. 10.1103/PhysRevLett.105.08720410.1103/PhysRevLett.105.087204 ↗
29. 10.1021/ma802658910.1021/ma8026589 ↗
30. 10.1002/adma.20180039610.1002/adma.201800396 ↗
31. 10.1002/adom.20210137210.1002/adom.202101372 ↗
32. 10.1016/j.nanoen.2021.10647110.1016/j.nanoen.2021.106471 ↗
33. 10.1002/adma.20150159410.1002/adma.201501594 ↗
34. 10.1186/s40580-016-0072-z10.1186/s40580-016-0072-z ↗
35. 10.1016/j.nanoen.2014.11.04610.1016/j.nanoen.2014.11.046 ↗
36. 10.1038/s41586-020-2602-410.1038/s41586-020-2602-4 ↗
37. 10.1002/advs.20190139110.1002/advs.201901391 ↗
38. 10.1016/j.nanoen.2020.10538110.1016/j.nanoen.2020.105381 ↗