Exploring parameter dependence of atomic minima with implicit differentiation
Source abstract
Abstract
Interatomic potentials are essential to go beyond ab initio size limitations, but simulation results depend sensitively on potential parameters. Forward propagation of parameter variation is key for uncertainty quantification, whilst backpropagation has found application for emerging inverse problems such as fine-tuning or targeted design. Here, the implicit derivative of functions defined as a fixed point is used to Taylor-expand the energy and structure of atomic minima in potential parameters, evaluating terms via automatic differentiation, dense linear algebra or a sparse operator approach. The latter allows efficient forward and backpropagation through relaxed structures of arbitrarily large systems. The implicit expansion accurately predicts lattice distortion and defect formation energies and volumes with classical and machine-learning potentials, enabling high-dimensional uncertainty propagation without prohibitive overhead. We then show how the implicit derivative can be used to solve challenging inverse problems, minimizing an implicit loss to fine-tune potentials and stabilize solute-induced structural rearrangements at dislocations in tungsten.
Source: openalex_inverted_index · Quality: baseline
Research context
OpenAlex topics: Thermal and Kinetic Analysis · X-ray Diffraction in Crystallography · Machine Learning in Materials Science
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
References (55)
Show source-provided references
1. Van Der Giessen, E. et al. Roadmap on multiscale materials modeling. Model. Simul. Mater. Sci. Eng. 28, 043001 (2020).10.1088/1361-651X/ab7150 ↗
2. Deringer, V. L., Caro, M. A. & Csányi, G. Machine learning interatomic potentials as emerging tools for materials science. Adv. Mater. 31, 1902765 (2019).10.1002/adma.201902765 ↗
3. Swinburne, T. & Perez, D. Automated calculation and convergence of defect transport tensors. Npj Comput. Mater. 6, 190 (2020).10.1038/s41524-020-00463-8 ↗
4. Grigorev, P., Goryaeva, A. M., Marinica, M.-C., Kermode, J. R. & Swinburne, T. D. Calculation of dislocation binding to helium-vacancy defects in tungsten using hybrid ab initio-machine learning methods. Acta Mater. 247, 118734 (2023).10.1016/j.actamat.2023.118734 ↗
5. Wales, D. J. Energy Landscapes (Cambridge, 2003).
6. Proville, L., Rodney, D. & Marinica, M.-C. Quantum effect on thermally activated glide of dislocations. Nat. Mater. 11, 845–849 (2012).10.1038/nmat3401 ↗
7. Goodrich, C. P., King, E. M., Schoenholz, S. S., Cubuk, E. D. & Brenner, M. P. Designing self-assembling kinetics with differentiable statistical physics models. Proc. Natl. Acad. Sci. USA 118, e2024083118 (2021).10.1073/pnas.2024083118 ↗
8. Goryaeva, A. M. et al. Efficient and transferable machine learning potentials for the simulation of crystal defects in bcc Fe and W. Phys. Rev. Mater. 5, 103803 (2021).10.1103/PhysRevMaterials.5.103803 ↗
9. Swinburne, T. D. & Perez, D. Parameter uncertainties for imperfect surrogate models in the low-noiseregime. Machine Learning: Science and Technology (IOP Publishing, 2024). https://doi.org/10.1088/2632-2153/ad9fce.10.1088/2632-2153/ad9fce ↗
10. Musil, F., Willatt, M. J., Langovoy, M. A. & Ceriotti, M. Fast and accurate uncertainty estimation in chemical machine learning. J. Chem. Theory Comput. 15, 906–915 (2019).10.1021/acs.jctc.8b00959 ↗
11. George, E. P., Raabe, D. & Ritchie, R. O. High-entropy alloys. Nat. Rev. Mater. 4, 515–534 (2019).10.1038/s41578-019-0121-4 ↗
12. Zhou, Z. et al. Machine learning guided appraisal and exploration of phase design for high entropy alloys. Npj Comput. Mater. 5, 128 (2019).10.1038/s41524-019-0265-1 ↗
13. Ha, M.-Q. et al. Evidence-based recommender system for high-entropy alloys. Nat. Comput. Sci. 1, 470–478 (2021).10.1038/s43588-021-00097-w ↗
14. Giuntoli, A. et al. Systematic coarse-graining of epoxy resins with machine learning-informed energy renormalization. Npj Comput. Mater. 7, 128 (2021).10.1038/s41524-021-00634-1 ↗
15. Banik, S. et al. A continuous action space tree search for inverse design (casting) framework for materials discovery. Npj Comput. Mater. 9, 177 (2023).10.1038/s41524-023-01128-y ↗
16. Thaler, S., Stupp, M. & Zavadlav, J. Deep coarse-grained potentials via relative entropy minimization. J. Chem. Phys. 157, 244103 (2022).10.1063/5.0124538 ↗
17. Batatia, I., Kovács, D. P., Simm, G. N., Ortner, C. & Csányi, G. MACE: Higher order equivariantmessage passing neural networks for fast and accurate force fields. Koyejo, S., Mohamed, S., Agarwal, A., Belgrave, D., Cho, K. & Oh A. (eds) Advances in Neural Information Processing Systems, Vol. 35, 11423-11436 (Curran Associates, Inc., 2022). https://proceedings.neurips.cc/paper_files/paper/2022/file/4a36c3c51af11ed9f34615b81edb5bbc-Paper-Conference.pdf.
18. Batatia, I. et al. A foundation model for atomistic materials chemistry (2024).
19. Deng, B. et al. Overcoming systematic softening in universal machine learning interatomic potentials by fine-tuning (2024).10.1038/s41524-024-01500-6 ↗
20. Nam, J. & Gomez-Bombarelli, R. Interpolation and differentiation of alchemical degrees of freedom in machine learning interatomic potentials (2024).
21. Schoenholz, S. & Cubuk, E. D. Jax md: a framework for differentiable physics. Adv. Neural Inf. Process. Syst. 33, 11428–11441 (2020).
22. Ablin, P., Peyré, G. & Moreau, T. Super-efficiency of automatic differentiation for functions defined as a minimum. In Proc. International Conference on Machine Learning, 32–41 (PMLR, 2020).
23. Blondel, M. et al. Efficient and modular implicit differentiation. Adv. Neural Inf. Process. Syst. 35, 5230–5242 (2022).
24. Liu, H. et al. End-to-end differentiability and tensor processing unit computing to accelerate materials’ inverse design. Npj Comput. Mater. 9, 1–12 (2023).10.1038/s41524-023-01080-x ↗
25. Greener, J. G. Differentiable simulation to develop molecular dynamics force fields for disordered proteins. Chem. Science 15, 4897–4909 (2024).10.1039/D3SC05230C ↗
26. Wang, X. et al. Dmff: an open-source automatic differentiable platform for molecular force field development and molecular dynamics simulation. J. Chem. Theory Comput. 19, 5897–5909 (2023).10.1021/acs.jctc.2c01297 ↗
27. Kellner, M. & Ceriotti, M. Uncertainty quantification by direct propagation of shallow ensembles. Mach. Learn. Sci. Technol. 5, 035006 (2024).10.1088/2632-2153/ad594a ↗
28. Lakshminarayanan, B., Pritzel, A. & Blundell, C. Simple and scalable predictive uncertainty estimation using deep ensembles. In Guyon, I. et al. (eds.) Advances in Neural Information Processing Systems, Vol. 30 (Curran Associates, Inc., 2017).
29. Gneiting, T., Raftery, A. E., Westveld, A. H. & Goldman, T. Calibrated probabilistic forecasting using ensemble model output statistics and minimum CRPS estimation. Monthly Weather Review 133, 1098–1118 (2005).10.1175/MWR2904.1 ↗
30. Krantz, S. G. & Parks, H. R. The Implicit Function Theorem: History, Theory, and Applications (Springer Science & Business Media, 2002).10.1007/978-1-4612-0059-8_2 ↗
31. Plimpton, S. Fast parallel algorithms for short-range molecular dynamics. J. Comput. Phys. 117, 1–19 (1995).10.1006/jcph.1995.1039 ↗
32. Xie, S. R., Rupp, M. & Hennig, R. G. Ultra-fast interpretable machine-learning potentials. Npj Comput. Mater. 9, 162 (2023).10.1038/s41524-023-01092-7 ↗
33. Del Masto, A., Baccou, J., Tréglia, G., Ribeiro, F. & Varvenne, C. Insights on the capabilities and improvement ability of classical many-body potentials: application to α-zirconium. Comput. Mater. Sci. 231, 112544 (2024).10.1016/j.commatsci.2023.112544 ↗
34. Thompson, A. P., Swiler, L. P., Trott, C. R., Foiles, S. M. & Tucker, G. J. Spectral neighbor analysis method for automated generation of quantum-accurate interatomic potentials. J. Comp. Phys. 285, 316 (2015).10.1016/j.jcp.2014.12.018 ↗
35. Allen, A. E., Dusson, G., Ortner, C. & Csányi, G. Atomic permutationally invariant polynomials for fitting molecular force fields. Mach. Learn. Sci. Technol. 2, 025017 (2021).10.1088/2632-2153/abd51e ↗
36. Podryabinkin, E. V. & Shapeev, A. V. Active learning of linearly parametrized interatomic potentials. Comput. Mater. Sci. 140, 171–180 (2017).10.1016/j.commatsci.2017.08.031 ↗
37. Lysogorskiy, Y. et al. Performant implementation of the atomic cluster expansion (PACE) and application to copper and silicon. Npj Comput. Mater. 7, 1–12 (2021).10.1038/s41524-021-00559-9 ↗
38. Batzner, S. et al. E (3)-equivariant graph neural networks for data-efficient and accurate interatomic potentials. Nat. Commun. 13, 1–11 (2022).10.1038/s41467-022-29939-5 ↗
39. Reali, L., Boleininger, M., Gilbert, M. R. & Dudarev, S. L. Macroscopic elastic stress and strain produced by irradiation. Nucl. Fusion 62, 016002 (2021).10.1088/1741-4326/ac35d4 ↗
40. Zeni, C. et al. Mattergen: A Generative Model for Inorganic Materials Design (2023).
41. Sanchez-Lengeling, B. & Aspuru-Guzik, A. Inverse molecular design using machine learning: generative models for matter engineering. Science 361, 360–365 (2018).10.1126/science.aat2663 ↗
42. Bartók, A. P., Payne, M. C., Kondor, R. & Csányi, G. Gaussian approximation potentials: the accuracy of quantum mechanics, without the electrons. Phys. Rev. Lett. 104, 136403 (2010).10.1103/PhysRevLett.104.136403 ↗
43. Bartók, A. P. et al. Machine learning unifies the modeling of materials and molecules. Sci. Adv. 3, e1701816 (2017).10.1126/sciadv.1701816 ↗
44. Ashcroft, N. W. & Mermin, N. D. Solid State Physics (Holt-Saunders, 1976).
45. Grigorev, P., Swinburne, T. D. & Kermode, J. R. Hybrid quantum/classical study of hydrogen-decorated screw dislocations in tungsten: ultrafast pipe diffusion, core reconstruction, and effects on glide mechanism. Phys. Rev. Mater. 4, 023601 (2020).10.1103/PhysRevMaterials.4.023601 ↗
46. Wood, M. A., Cusentino, M. A., Wirth, B. D. & Thompson, A. P. Data-driven material models for atomistic simulation. Phys. Rev. B 99, 184305 (2019).10.1103/PhysRevB.99.184305 ↗
47. Lehmann, U. & Walther, A. The Implementation and Testing of Time-minimal and Resource-optimal Parallel Reversal Schedules, 1049–1058 (Springer Berlin Heidelberg, 2002).10.1007/3-540-46080-2_110 ↗
48. Schanen, M. et al. Transparent Checkpointing for Automatic Differentiation of Program Loops Through Expression Transformations, 483–497 (Springer Nature Switzerland, 2023).10.1007/978-3-031-36024-4_37 ↗
49. Fang, S., Geiger, M., Checkelsky, J. G. & Smidt, T. Phonon predictions with e(3)-equivariant graphneural networks. AI for Accelerated Materials Design - NeurIPS 2023 Workshop. https://openreview.net/forum?id=xxyHjer00Y (2023).
50. Hachet, G., Ventelon, L., Willaime, F. & Clouet, E. Screw dislocation-carbon interaction in bcc tungsten: an ab initio study. Acta Mater. 200, 481–489 (2020).10.1016/j.actamat.2020.09.014 ↗
51. Grigorev, P. et al. matscipy: materials science at the atomic scale with python. J. Open Source Softw. 9, 5668 (2024).10.21105/joss.05668 ↗
52. Kresse, G. & Furthmüller, J. Efficient iterative schemes for ab initio total-energy calculations using a plane-wave basis set. Phys. Rev. B 54, 11169–11186 (1996).10.1103/PhysRevB.54.11169 ↗
53. Perdew, J. P., Burke, K. & Ernzerhof, M. Generalized gradient approximation made simple. Phys. Rev. Lett. 77, 3865–3868 (1996).10.1103/PhysRevLett.77.3865 ↗
54. Stukowski, A. Visualization and analysis of atomistic simulation data with ovito-the open visualization tool. Model. Simul. Mat. Sci. Eng. 18, 015012 (2009).10.1088/0965-0393/18/1/015012 ↗
55. Vitek, V. Theory of the core structures of dislocations in body-centred-cubic metals. Cryst. Latt. Def. Amorp. 5, 1–34 (1974).