journal article·2024-02Open access

Reinforcement Learning‐Guided Long‐Timescale Simulation of Hydrogen Transport in Metals

Hao Tang, Boning Li, Yixuan Song, Mengren Liu, Haowei Xu, Guoqing Wang, Heejung Chung, Ju Li

Advanced Science· Volume 11· Issue 5

Abstract

Abstract Diffusion in alloys is an important class of atomic processes. However, atomistic simulations of diffusion in chemically complex solids are confronted with the timescale problem: the accessible simulation time is usually far shorter than that of experimental interest. In this work, long‐timescale simulation methods are developed using reinforcement learning (RL) that extends simulation capability to match the duration of experimental interest. Two special limits, RL transition kinetics simulator (TKS) and RL low‐energy states sampler (LSS), are implemented and explained in detail, while the meaning of general RL are also discussed. As a testbed, hydrogen diffusivity is computed using RL TKS in pure metals and a medium entropy alloy, CrCoNi, and compared with experiments. The algorithm can produce counter‐intuitive hydrogen‐vacancy cooperative motion. We also demonstrate that RL LSS can accelerate the sampling of low‐energy configurations compared to the Metropolis–Hastings algorithm, using hydrogen migration to copper (111) surface as an example.
Source: crossref · Quality: baseline

Research context

OpenAlex topics: Machine Learning in Materials Science · Fuel Cells and Related Materials · Nuclear Materials and Properties

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

Department of Materials Science and Engineering Massachusetts Institute of Technology Cambridge MA 02139 USA

Research Laboratory of Electronics Massachusetts Institute of Technology Cambridge MA 02139 USA

Department of Physics Massachusetts Institute of Technology Cambridge MA 02139 USA

Department of Nuclear Science and Engineering Massachusetts Institute of Technology Cambridge MA 02139 USA

Funding

National Science Foundation · U.S. Department of Energy

References (38)

Show source-provided references
1. Allen S. M. · 2005
2. 10.1103/PhysRevB.84.05410310.1103/PhysRevB.84.054103 ↗
3. 10.1016/j.ijhydene.2018.09.20110.1016/j.ijhydene.2018.09.201 ↗
4. 10.1063/1.497453510.1063/1.4974535 ↗
5. 10.1103/PhysRevLett.92.11550510.1103/PhysRevLett.92.115505 ↗
6. 10.1103/PhysRevLett.65.72910.1103/PhysRevLett.65.729 ↗
7. 10.1038/nature0086510.1038/nature00865 ↗
8. 10.1007/978-3-319-44677-6_2410.1007/978-3-319-44677-6_24 ↗
9. 10.1557/jmr.2017.45610.1557/jmr.2017.456 ↗
10. 10.1007/978-1-4020-5295-8_110.1007/978-1-4020-5295-8_1 ↗
11. 10.1007/978-3-319-44677-6_2910.1007/978-3-319-44677-6_29 ↗
12. 10.1063/1.48157610.1063/1.481576 ↗
13. 10.1016/j.commatsci.2022.11128010.1016/j.commatsci.2022.111280 ↗
14. 10.1016/j.jmat.2022.12.00710.1016/j.jmat.2022.12.007 ↗
15. 10.1109/ROBIO.2013.673962710.1109/ROBIO.2013.6739627 ↗
16. 10.1088/1361-648X/aa680e10.1088/1361-648X/aa680e ↗
17. 10.1142/9789812839664_001610.1142/9789812839664_0016 ↗
18. Zhang L. · Advances in Neural Information Processing Systems · 2018 · 31
19. Bouneffouf D. · 2020 · 1
20. 10.1103/PhysRevMaterials.5.06540610.1103/PhysRevMaterials.5.065406 ↗
21. 10.2320/jinstmet1952.46.3_28510.2320/jinstmet1952.46.3_285 ↗
22. 10.1016/S0921-5093(00)01233-810.1016/S0921-5093(00)01233-8 ↗
23. 10.1016/0022-3697(85)90110-610.1016/0022-3697(85)90110-6 ↗
24. 10.1016/0036-9748(84)90411-310.1016/0036-9748(84)90411-3 ↗
25. 10.1007/s11669-017-0518-y10.1007/s11669-017-0518-y ↗
26. 10.1126/science.abp807010.1126/science.abp8070 ↗
27. 10.1073/pnas.180866011510.1073/pnas.1808660115 ↗
28. 10.1016/B978-0-12-079050-0.50011-410.1016/B978-0-12-079050-0.50011-4 ↗
29. 10.1007/s40192-022-00269-010.1007/s40192-022-00269-0 ↗
30. 10.1038/s41586-020-2275-z10.1038/s41586-020-2275-z ↗
31. 10.1073/pnas.202054011810.1073/pnas.2020540118 ↗
32. 10.1021/acs.jpclett.0c0179810.1021/acs.jpclett.0c01798 ↗
33. 10.1038/nature1423610.1038/nature14236 ↗
34. Henkelman G. · 2018 · 1
35. 10.1093/biomet/57.1.9710.1093/biomet/57.1.97 ↗
36. Vaswani A. · Advances in Neural Information Processing Systems · 2017 · 30
37. 10.1371/journal.pone.001790910.1371/journal.pone.0017909 ↗
38. 10.1063/1.169911410.1063/1.1699114 ↗