journal article·2026-01-14Open access

Constructing surrogates for atomistic simulations via deep learning and generative large language models

Mahshad Fani, William Chadwell, Nishad Tasnim, Xin Wang, Mohammad Younes Araghi, Kun Lu, Zejian Zhou, Tang Gu, Shuozhi Xu

Journal of Materials Research· Volume 41· Issue 1

Abstract

Abstract Atomistic simulations offer insights into material behavior at the atomic level. However, they can be computationally intensive. In this paper, two deep learning models, deep symbolic optimization (DSO) and deep neural networks (DNN), and one generative large language model, GPT-4o, are employed to construct surrogates for atomistic simulations. Specifically, atomistic simulations are first performed to investigate the collapse of a nanovoid under hydrostatic pressure. We focus on the role of initial void radius and material characteristics, such as intrinsic and unstable stacking fault energies and surface energy (SE). We find that the critical pressure required for void collapse spans from 17.05 to 19.62 GPa, with the highest values corresponding to the maximum USFE. Additionally, an intermediate SE value (1068.13 $$\hbox {mJ/m}^2$$ ) minimizes the critical pressure. Based on the simulation results, surrogate models based on DSO, DNN, and GPT-4o are constructed, concluding that the SE affects the critical pressure the most. Graphical abstract
Source: crossref · Quality: candidate unverified · Source record ↗

Research context

OpenAlex topics: Machine Learning in Materials Science · Topic Modeling · Natural Language Processing Techniques

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

References (83)

Show source-provided references
1. D. Farkas, Atomistic simulations of metallic microstructures. Curr. Opin. Solid State Mater. Sci. 17, 284–297 (2013). https://doi.org/10.1016/j.cossms.2013.11.00210.1016/j.cossms.2013.11.002 ↗
2. D. Perez, B.P. Uberuaga, Y. Shim, J.G. Amar, A.F. Voter, Chapter 4 Accelerated Molecular Dynamics Methods: Introduction and Recent Developments, in Annual Reports in Computational Chemistry, vol. 5, ed. by R.A. Wheeler (Elsevier, Amsterdam, 2009), pp.79–98. https://doi.org/10.1016/S1574-1400(09)00504-010.1016/S1574-1400(09)00504-0 ↗
3. E.A. Barros de Moraes, J.L. Suzuki, M. Zayernouri, Atomistic-to-meso multi-scale data-driven graph surrogate modeling of dislocation glide. Comput. Mater. Sci. 197, 110569 (2021). https://doi.org/10.1016/j.commatsci.2021.11056910.1016/j.commatsci.2021.110569 ↗
4. C. Nyshadham, M. Rupp, B. Bekker, A.V. Shapeev, T. Mueller, C.W. Rosenbrock, G. Csányi, D.W. Wingate, G.L.W. Hart, Machine-learned multi-system surrogate models for materials prediction. npj Comput. Mater. 5, 51 (2019). https://doi.org/10.1038/s41524-019-0189-910.1038/s41524-019-0189-9 ↗
5. J.C.S. Kadupitiya, F. Sun, G. Fox, V. Jadhao, Machine learning surrogates for molecular dynamics simulations of soft materials. J. Comput. Sci. 42, 101107 (2020). https://doi.org/10.1016/j.jocs.2020.10110710.1016/j.jocs.2020.101107 ↗
6. C. Ruiz, A. Raj, S. Xu, Multivariate Gaussian process surrogates for predicting basic structural parameters of refractory non-dilute random alloys. APL Mach. Learn. 2, 026107 (2024). https://doi.org/10.1063/5.018604510.1063/5.0186045 ↗
7. S. Liu, B. Bocklund, J. Diffenderfer, S. Chaganti, B. Kailkhura, S.K. McCall, B. Gallagher, A. Perron, J.T. McKeown, A comparative study of predicting high entropy alloy phase fractions with traditional machine learning and deep neural networks. npj Comput. Mater. 10, 172 (2024)10.1038/s41524-024-01335-1 ↗
8. K.N. Petersen, M.L. Landajuela, T.N. Mundhenk, C. Pineda Santiago, S. Kim, J.J. Thiagarajan, Deep Symbolic Regression: Recovering Mathematical Expressions from Data via Risk-Seeking Policy Gradients, in Proceedings of the 9th International Conference on Learning Representations, ICLR, Virtual Conference. (2021), https://openreview.net/forum?id=Qlgo4g5Yh1
9. F.L. da Silva, A. Goncalves, S. Nguyen, D. Vashchenko, R. Glatt, T. Desautels, M. Landajuela, D. Faissol, B. Petersen, Language model-accelerated deep symbolic optimization. Neural Comput. Appl. (2023). https://doi.org/10.1007/s00521-023-08802-810.1007/s00521-023-08802-8 ↗
10. S.-M. Udrescu, M. Tegmark, A.I. Feynman, A physics-inspired method for symbolic regression. Sci. Adv. 6, eaay2631 (2020)10.1126/sciadv.aay2631 ↗
11. Z. Xu, N. Yuktanan, M. Liu, T. Gu, M. Shi, Characterization of microstructures and micromechanical properties of Ti6Al4V powders. Powder Technol. 448, 120352 (2024)10.1016/j.powtec.2024.120352 ↗
12. W. Sha, K. Edwards, The use of artificial neural networks in materials science based research. Mater. Des. 28, 1747–1752 (2007)10.1016/j.matdes.2007.02.009 ↗
13. S. Feng, H. Zhou, H. Dong, Using deep neural network with small dataset to predict material defects. Mater. Des. 162, 300–310 (2019)10.1016/j.matdes.2018.11.060 ↗
14. A. Korotcov, V. Tkachenko, D.P. Russo, S. Ekins, Comparison of deep learning with multiple machine learning methods and metrics using diverse drug discovery data sets. Mol. Pharm. 14, 4462–4475 (2017)10.1021/acs.molpharmaceut.7b00578 ↗
15. A. Vaswani, N. Shazeer, N. Parmar, J. Uszkoreit, L. Jones, A.N. Gomez, Ł Kaiser, I. Polosukhin, Attention is all you need. Adv. Neural. Inf. Process. Syst. 30, 5998–6008 (2017)
16. A. Radford, Improving language understanding by generative pre-training, OpenAI Technical Report (2018), https://cdn.openai.com/research-covers/language-unsupervised/language_understanding_paper.pdf
17. X. Wang, L. Huang, S. Xu, K. Lu, How does a generative large language model perform on domain-specific information extraction?-a comparison between gpt-4 and a rule-based method on band gap extraction. J. Chem. Inf. Model. 64, 7895–7904 (2024). https://doi.org/10.1021/acs.jcim.4c0088210.1021/acs.jcim.4c00882 ↗
18. M.P. Polak, D. Morgan, Extracting accurate materials data from research papers with conversational language models and prompt engineering. Nat. Commun. 15, 1569 (2024)10.1038/s41467-024-45914-8 ↗
19. Y.J. Park, D. Kaplan, Z. Ren, C.-W. Hsu, C. Li, H. Xu, S. Li, J. Li, Can ChatGPT be used to generate scientific hypotheses? J. Materiomics 10, 578–584 (2024)10.1016/j.jmat.2023.08.007 ↗
20. K.M. Jablonka, Q. Ai, A. Al-Feghali, S. Badhwar, J.D. Bocarsly, A.M. Bran, S. Bringuier, L.C. Brinson, K. Choudhary, D. Circi et al., 14 examples of how LLMs can transform materials science and chemistry: a reflection on a large language model hackathon. Digit. Discov. 2, 1233–1250 (2023)10.1039/D3DD00113J ↗
21. H. Hao, X. Zhang, A. Zhou, Large language models as surrogate models in evolutionary algorithms: a preliminary study. Swarm Evol. Comput. 91, 101741 (2024). https://doi.org/10.1016/j.swevo.2024.10174110.1016/j.swevo.2024.101741 ↗
22. C. Crussard, J. Plateau, R. Tamhankar, G. Henry, D. Lajeunesse, A Comparison of Ductile and Fatigue Fractures, in Fracture, vol. 1, ed. by E. Name (Wiley, New York, 1959), pp.31–37
23. H. Rogers, The tensile fracture of ductile metals. Metal. Soc. AIME 218, 498–506 (1960)
24. M.F. Horstemeyer, A.M. Gokhale, A void-crack nucleation model for ductile metals. Int. J. Solids Struct. 36, 5029–5055 (1999)10.1016/S0020-7683(98)00239-X ↗
25. M. Ashby, C. Gandhi, D. Taplin, Overview No. 3 fracture-mechanism maps and their construction for FCC metals and alloys. Acta Metall. 27, 699–729 (1979)10.1016/0001-6160(79)90105-6 ↗
26. R.N. Gardner, T. Pollock, H. Wilsdorf, Crack initiation at dislocation cell boundaries in the ductile fracture of metals. Mater. Sci. Eng. 29, 169–174 (1977)10.1016/0025-5416(77)90123-9 ↗
27. M.R.G. Prasad, A. Neogi, N. Vajragupta, R. Janisch, A. Hartmaier, Influence of temperature on void collapse in single crystal nickel under hydrostatic compression. Materials 14, 2369 (2021)10.3390/ma14092369 ↗
28. G.R. Johnson, W.H. Cook, Fracture characteristics of three metals subjected to various strains, strain rates, temperatures and pressures. Eng. Fract. Mech. 21, 31–48 (1985)10.1016/0013-7944(85)90052-9 ↗
29. J.R. Rice, D.M. Tracey, On the ductile enlargement of voids in triaxial stress fields. J. Mech. Phys. Solids 17, 201–217 (1969)10.1016/0022-5096(69)90033-7 ↗
30. Y. Guo, C. Paramatmuni, E. Avcu, Void nucleation and growth from heterophases and the exploitation of new toughening mechanisms in metals. Curr. Comput. Aided Drug Des. 13, 860 (2023)
31. J. Leclerc, M. Marteleur, M.-S. Colla, T. Pardoen, L. Noels, V.-D. Nguyen, Ductile fracture of high strength steels with morphological anisotropy, Part II: Nonlocal micromechanics-based modeling. Eng. Fract. Mech. 248, 107716 (2021)10.1016/j.engfracmech.2021.107716 ↗
32. N. Bonora, G. Testa, Plasticity damage self-consistent model incorporating stress triaxiality and shear controlled fracture mechanisms—model formulation. Eng. Fract. Mech. 271, 108634 (2022)10.1016/j.engfracmech.2022.108634 ↗
33. S. Xu, Y. Su, S.Z. Chavoshi, Deformation of periodic nanovoid structures in Mg single crystals. Mater. Res. Express 5, 016523 (2018)10.1088/2053-1591/aaa678 ↗
34. L. Xiong, S. Xu, D.L. McDowell, Y. Chen, Concurrent atomistic-continuum simulations of dislocation-void interactions in FCC crystals. Int. J. Plast. 65, 33–42 (2015)10.1016/j.ijplas.2014.08.002 ↗
35. S. Xu, Y. Su, Nanovoid growth in bcc α-fe: influences of initial void geometry. Model. Simul. Mater. Sci. Eng. 24, 085015 (2016)10.1088/0965-0393/24/8/085015 ↗
36. K. Chen, Y. Zhang, G. Cheng, Y. Zhang, A machine learning and finite element simulation-based void inspection for higher solder joint reliability. Microelectron. Reliab. 154, 115323 (2024)10.1016/j.microrel.2024.115323 ↗
37. D. Kong, K. Motoyama, H. Huang, B. Mendoza, M. Breton, G.R. Muthinti, H. Shobha, L. Jiang, J. Li, J.J. Demarest et al., Machine Learning and Hybrid Metrology Using Scatterometry and LE-XRF to Detect Voids in Copper Lines, in Metrology, Inspection, and Process Control for Microlithography XXXIII, vol. 10959 (SPIE, 2019), pp. 37–5010.1117/12.2515257 ↗
38. A. Saleh, H. Zahedmanesh, H. Ceric, K. Croes, I. De Wolf, Dynamics of Electromigration Voids in Cu Interconnects: Investigation Using a Physics-Based Model Augmented by Neural Networks, in IEEE International Interconnect Technology Conference (IITC). (IEEE, 2022), pp.25–27
39. G. Potirniche, M. Horstemeyer, G. Wagner, P. Gullett, A molecular dynamics study of void growth and coalescence in single crystal nickel. Int. J. Plast 22, 257–278 (2006)10.1016/j.ijplas.2005.02.001 ↗
40. K. Zhao, C. Chen, Y. Shen, T. Lu, Molecular dynamics study on the nano-void growth in face-centered cubic single crystal copper. Comput. Mater. Sci. 46, 749–754 (2009)10.1016/j.commatsci.2009.04.034 ↗
41. S. Traiviratana, E.M. Bringa, D.J. Benson, M.A. Meyers, Void growth in metals: atomistic calculations. Acta Mater. 56, 3874–3886 (2008)10.1016/j.actamat.2008.03.047 ↗
42. T. Tang, S. Kim, M. Horstemeyer, Fatigue crack growth in magnesium single crystals under cyclic loading: molecular dynamics simulation. Comput. Mater. Sci. 48, 426–439 (2010)10.1016/j.commatsci.2010.02.003 ↗
43. T. Tang, S. Kim, M. Horstemeyer, Molecular dynamics simulations of void growth and coalescence in single crystal magnesium. Acta Mater. 58, 4742–4759 (2010)10.1016/j.actamat.2010.05.011 ↗
44. G. Potirniche, J. Hearndon, M. Horstemeyer, X. Ling, Lattice orientation effects on void growth and coalescence in FCC single crystals. Int. J. Plast 22, 921–942 (2006)10.1016/j.ijplas.2005.06.003 ↗
45. R. Rudd, E. Seppälä, L. Dupuy, J. Belak, Void coalescence processes quantified through atomistic and multiscale simulation,. J. Comput. Aided Mater. Des. 14, 425–434 (2007)10.1007/s10820-007-9054-0 ↗
46. R.E. Rudd, Void growth in bcc metals simulated with molecular dynamics using the finnis-sinclair potential. Philos. Mag. 89, 3133–3161 (2009)10.1080/14786430903222529 ↗
47. J. Segurado, J. LLorca, Discrete dislocation dynamics analysis of the effect of lattice orientation on void growth in single crystals. Int. J. Plast 26, 806–819 (2010)10.1016/j.ijplas.2009.10.009 ↗
48. X.-X. Zhang, Z.-S. Cui, Theoretical study of void closure in nonlinear plastic materials. Appl. Math. Mech. 30, 631–642 (2009)10.1007/s10483-009-0509-7 ↗
49. X. Yang, T. Zhou, C. Chen, Effective elastic modulus and atomic stress concentration of single crystal nano-plate with void. Comput. Mater. Sci. 40, 51–56 (2007)10.1016/j.commatsci.2006.10.022 ↗
50. A. Needleman, Void growth in an elastic-plastic medium. J. Appl. Mech. 39, 964–970 (1972)10.1115/1.3422899 ↗
51. T. Pardoen, J. Hutchinson, An extended model for void growth and coalescence. J. Mech. Phys. Solids 48, 2467–2512 (2000)10.1016/S0022-5096(00)00019-3 ↗
52. M. Kuna, D. Sun, Three-dimensional cell model analyses of void growth in ductile materials. Int. J. Fract. 81, 235–258 (1996)10.1007/BF00039573 ↗
53. M. Worswick, R. Pick, Void growth and constitutive softening in a periodically voided solid. J. Mech. Phys. Solids 38, 601–625 (1990)10.1016/0022-5096(90)90025-Y ↗
54. N. Hosseini, J.C. Nieto-Fuentes, M. Dakshinamurthy, J.A. Rodríguez-Martínez, G. Vadillo, The effect of material orientation on void growth. Int. J. Plast 148, 103149 (2022)10.1016/j.ijplas.2021.103149 ↗
55. V. Monchiet, O. Cazacu, E. Charkaluk, D. Kondo, Macroscopic yield criteria for plastic anisotropic materials containing spheroidal voids. Int. J. Plast 24, 1158–1189 (2008)10.1016/j.ijplas.2007.08.008 ↗
56. A.A. Benzerga, J.-B. Leblond, A. Needleman, V. Tvergaard, Ductile failure modeling. Int. J. Fract. 201, 29–80 (2016)10.1007/s10704-016-0142-6 ↗
57. S. Xu, Z. Hao, Y. Su, Y. Yu, Q. Wan, W. Hu, An analysis on nanovoid growth in body-centered cubic single crystalline vanadium. Comput. Mater. Sci. 50, 2411–2421 (2011)10.1016/j.commatsci.2011.03.019 ↗
58. M. Bhatia, K. Solanki, A. Moitra, M. Tschopp, Investigating damage evolution at the nanoscale: molecular dynamics simulations of nanovoid growth in single-crystal aluminum. Metall. Mater. Trans. A 44, 617–626 (2013)10.1007/s11661-012-1082-z ↗
59. J. Wang, Z. Yue, Z. Wen, D. Zhang, C. Liu, Orientation effects on the tensile properties of single crystal nickel with nanovoid: atomistic simulation. Comput. Mater. Sci. 132, 116–124 (2017)10.1016/j.commatsci.2017.02.024 ↗
60. Y. Zhang, S. Jiang, X. Zhu, D. Sun, Orientation dependence of void growth at triple junction of grain boundaries in nanoscale tricrystal nickel film subjected to uniaxial tensile loading. J. Phys. Chem. Solids 98, 220–232 (2016)10.1016/j.jpcs.2016.07.018 ↗
61. W. Liu, X. Zhang, J. Tang, Y. Du, Simulation of void growth and coalescence behavior with 3D crystal plasticity theory. Comput. Mater. Sci. 40, 130–139 (2007)10.1016/j.commatsci.2006.11.009 ↗
62. P.M. Anderson, J.P. Hirth, J. Lothe, Theory of Dislocations, 3rd edn. (Cambridge University Press, Cambridge, 2017)
63. W. Li, S. Lu, Q.-M. Hu, B. Johansson, S.K. Kwon, M. Grehk, J.Y. Johnsson, L. Vitos, Generalized stacking fault energy of γ-Fe. Philos. Mag. 96, 524–541 (2016)10.1080/14786435.2016.1140912 ↗
64. W. Liu, N. Wang, Y. Ji, P. Song, C. Zhang, Z. Yang, L. Chen, Effects of surface energy anisotropy on void evolution during irradiation: a phase-field model. J. Nucl. Mater. 479, 316–322 (2016)10.1016/j.jnucmat.2016.07.010 ↗
65. M.A. Meyers, A. Mishra, D.J. Benson, Mechanical properties of nanocrystalline materials. Prog. Mater Sci. 51, 427–556 (2006)10.1016/j.pmatsci.2005.08.003 ↗
66. B.P. Uberuaga, R.G. Hoagland, A.F. Voter, S.M. Valone, Direct transformation of vacancy voids to stacking fault tetrahedra. Phys. Rev. Lett. 99, 135501 (2007)10.1103/PhysRevLett.99.135501 ↗
67. V. Borovikov, M.I. Mendelev, A.H. King, Effects of stable and unstable stacking fault energy on dislocation nucleation in nano-crystalline metals. Model. Simul. Mater. Sci. Eng. 24, 085017 (2016)10.1088/0965-0393/24/8/085017 ↗
68. Y.-R. Jeng, C.-M. Tan, Computer simulation of tension experiments of a thin film using an atomic model. Phys. Rev. B 65, 174107 (2002)10.1103/PhysRevB.65.174107 ↗
69. O. Vinogradov, A static analog of molecular dynamics method for crystals. Int. J. Comput. Methods 3, 153–161 (2006)10.1142/S0219876206000485 ↗
70. H.-J. Lee, B.D. Wirth, Molecular dynamics simulation of dislocation-void interactions in BCC Mo. J. Nucl. Mater. 386, 115–118 (2009)10.1016/j.jnucmat.2008.12.084 ↗
71. A.P. Thompson, H.M. Aktulga, R. Berger, D.S. Bolintineanu, W.M. Brown, P.S. Crozier, P.J. Int Veld, A. Kohlmeyer, S.G. Moore, T.D. Nguyen et al., LAMMPS-a flexible simulation tool for particle-based materials modeling at the atomic, meso, and continuum scales. Comput. Phys. Comm. 271, 108171 (2022)10.1016/j.cpc.2021.108171 ↗
72. A. Stukowski, Visualization and analysis of atomistic simulation data with ovito-the open visualization tool. Model. Simul. Mater. Sci. Eng. 18, 015012 (2009)10.1088/0965-0393/18/1/015012 ↗
73. A. Stukowski, Structure identification methods for atomistic simulations of crystalline materials. Model. Simul. Mater. Sci. Eng. 20, 045021 (2012)10.1088/0965-0393/20/4/045021 ↗
74. A. Kumar, Y. Bai, A. Eklund, C.B. Williams, Effects of hot isostatic pressing on copper parts fabricated via binder jetting. Proc. Manuf. 10, 935–944 (2017)
75. V. Prithivirajan, M.D. Sangid, The role of defects and critical pore size analysis in the fatigue response of additively manufactured IN718 via crystal plasticity. Mater. Des. 150, 139–153 (2018)10.1016/j.matdes.2018.04.022 ↗
76. W. Ji, W.-R. Jian, Y. Su, S. Xu, I.J. Beyerlein, Role of stacking fault energy in confined layer slip in nanolaminated Cu. J. Mater. Sci. 59, 4775–4787 (2024)10.1007/s10853-023-08779-8 ↗
77. M.S. Daw, M.I. Baskes, Embedded-atom method: Derivation and application to impurities, surfaces, and other defects in metals. Phys. Rev. B 29, 6443 (1984)10.1103/PhysRevB.29.6443 ↗
78. V. Borovikov, M.I. Mendelev, A.H. King, R. LeSar, Effect of stacking fault energy on mechanism of plastic deformation in nanotwinned FCC metals. Model. Simul. Mater. Sci. Eng. 23, 055003 (2015)10.1088/0965-0393/23/5/055003 ↗
79. Y. Su, S. Xu, I.J. Beyerlein, Density functional theory calculations of generalized stacking fault energy surfaces for eight face-centered cubic transition metals. J. Appl. Phys. 126, 10 (2019)10.1063/1.5115282 ↗
80. R. Tran, Z. Xu, B. Radhakrishnan, D. Winston, W. Sun, K.A. Persson, S.P. Ong, Surface energies of elemental crystals. Sci. Data 3, 160080 (2016). https://doi.org/10.1038/sdata.2016.8010.1038/sdata.2016.80 ↗
81. A.M. Dongare, A.M. Rajendran, B. LaMattina, M.A. Zikry, D.W. Brenner, Atomic scale studies of spall behavior in nanocrystalline Cu. J. Appl. Phys. 108, 113518 (2010)10.1063/1.3517827 ↗
82. I. Goodfellow, Y. Bengio, A. Courville, Deep Learning (MIT Press, Cambridge, Massachusetts, 2016)
83. I. Mirzadeh, K. Alizadeh, H. Shahrokhi, O. Tuzel, S. Bengio, M. Farajtabar, GSM-Symbolic: Understanding the limitations of mathematical reasoning in large language models (2024), Preprint at http://arxiv.org/abs/2410.05229