Multi-head attention network for prediction of irradiation embrittlement in reactor pressure vessel steels
Source abstract
Abstract
The accurate prediction of irradiation embrittlement in reactor pressure vessel (RPV) steel remains challenging. Here, we develop a multi-head attention network (MHANet) and target the service-relevant shift in ductile-brittle transition temperature (ΔDBTT) co-varying with temperature, flux, and fluence. MHANet treats each input column as a token, learns feature dependencies via attention, and yields accurate predictions with transparent attribution. Trained/validated on 1266 IVAR+NUREG samples, MHANet achieves MAE of 5.63 ∘C(IVAR) and 16.21 ∘C (NUREG), and outperforms a baseline multilayer perceptron model. The learned dependencies are found to be physically consistent with the coupled effects by which ΔDBTT is governed, including point defects, solute-defect interactions (particularly involving Cu, Ni, and P), and irradiation-induced precipitation. (i) a higher temperature mitigates embrittlement; (ii) at a fixed fluence, the reduction in ΔDBTT with increasing flux is attributed to the competition between steady-state defect concentrations and the available evolution time; (iii) threshold-like synergies emerge-ΔDBTT increases sharply when Ni ≈ 0.9–1.1 wt.% and Cu (≥0.10 wt.%) or P is elevated. These results provide a coherent path from data-driven prediction to mechanism-aware interpretation and actionable criteria for RPV life assessment and alloy design.
Source: openalex_inverted_index · Quality: baseline
Research context
OpenAlex topics: Nuclear Materials and Properties · Hydrogen embrittlement and corrosion behaviors in metals · Fusion materials and technologies
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
References (52)
Show source-provided references
1. Odette, G., Yamamoto, T., Williams, T., Nanstad, R. & English, C. On the history and status of reactor pressure vessel steel ductile to brittle transition temperature shift prediction models. J. Nucl. Mater. 526, 151863 (2019).10.1016/j.jnucmat.2019.151863 ↗
2. Odette, G., Almirall, N., Wells, P. & Yamamoto, T. Precipitation in reactor pressure vessel steels under ion and neutron irradiation: on the role of segregated network dislocations. Acta Mater. 212, 116922 (2021).10.1016/j.actamat.2021.116922 ↗
3. Ke, H. et al. Thermodynamic and kinetic modeling of Mn-Ni-Si precipitates in low-cu reactor pressure vessel steels. Acta Mater. 138, 10–26 (2017).10.1016/j.actamat.2017.07.021 ↗
4. Wharry, J. P. & Was, G. S. A systematic study of radiation-induced segregation in ferritic–martensitic alloys. J. Nucl. Mater. 442, 7–16 (2013).10.1016/j.jnucmat.2013.07.071 ↗
5. Wells, P. B. et al. Evolution of manganese–nickel–silicon-dominated phases in highly irradiated reactor pressure vessel steels. Acta Mater. 80, 205–219 (2014).10.1016/j.actamat.2014.07.040 ↗
6. Lindgren, K., Boåsen, M., Stiller, K., Efsing, P. & Thuvander, M. Evolution of precipitation in reactor pressure vessel steel welds under neutron irradiation. J. Nucl. Mater. 488, 222–230 (2017).10.1016/j.jnucmat.2017.03.019 ↗
7. Toyama, T. et al. Effects of neutron flux on irradiation-induced hardening and defects in RPV steels studied by positron annihilation spectroscopy. J. Nucl. Mater. 532, 152041 (2020).10.1016/j.jnucmat.2020.152041 ↗
8. Wagner, A. et al. Effect of neutron flux on the characteristics of irradiation-induced nanofeatures and hardening in pressure vessel steels. Acta Mater. 104, 131–142 (2016).10.1016/j.actamat.2015.11.027 ↗
9. Whiting, T., King, D. & Wenman, M. On the formation and structure of Mn-Ni-Ni γ2 precipitates in steels. J. Nucl. Mater. 542, 152429 (2020).10.1016/j.jnucmat.2020.152429 ↗
10. Nagai, Y., Tang, Z., Hassegawa, M., Kanai, T. & Saneyasu, M. Irradiation-induced cu aggregations in Fe: an origin of embrittlement of reactor pressure vessel steels. Phys. Rev. B. 63, 134110 (2001).10.1103/PhysRevB.63.134110 ↗
11. Lynch, S. Hydrogen embrittlement phenomena and mechanisms. Corros. Rev. 30, 105–123 (2012).10.1515/corrrev-2012-0502 ↗
12. Martin, M. L., Connolly, M. J., DelRio, F. W. & Slifka, A. J. Hydrogen embrittlement in ferritic steels. Appl. Phys. Rev. 7, 041301 (2020).10.1063/5.0012851 ↗
13. Zhou, X., Tehranchi, A. & Curtin, W. A. Mechanism and prediction of hydrogen embrittlement in fcc stainless steels and high entropy alloys. Phys. Rev. Lett. 127, 175501 (2021).10.1103/PhysRevLett.127.175501 ↗
14. Xia, L. et al. Radiation induced grain boundary segregation in ferritic/martensitic steels. Nucl. Eng. Technol. 52, 148–154 (2020).10.1016/j.net.2019.07.009 ↗
15. Xu, C. et al. A study of predicting irradiation-induced transition temperature shift for RPV steels with XGBoost modeling. Nucl. Eng. Technol. 53, 2610–2615 (2021).10.1016/j.net.2021.02.015 ↗
16. Chen Liu, Y., Morgan, D., Yamamoto, T. & Odette, G. R. Characterizing the flux effect on the irradiation embrittlement of reactor pressure vessel steels using machine learning. Acta Mater. 256, 119144 (2023).10.1016/j.actamat.2023.119144 ↗
17. Liu, Y.-C. et al. Machine learning predictions of irradiation embrittlement in reactor pressure vessel steels. npj Comput. Mater. 8, 85 (2022).10.1038/s41524-022-00760-4 ↗
18. Mathew, J. et al. Reactor pressure vessel embrittlement: insights from neural network modelling. J. Nucl. Mater. 502, 311–322 (2018).10.1016/j.jnucmat.2018.02.027 ↗
19. Hashimoto, Y., Nomoto, A., Kirk, M. & Nishida, K. Development of new embrittlement trend curve based on Japanese surveillance and atom probe tomography data. J. Nucl. Mater. 553, 153007 (2021).10.1016/j.jnucmat.2021.153007 ↗
20. Mamivand, M. et al. Cumnnisi precipitate evolution in irradiated reactor pressure vessel steels: Integrated cluster dynamics and experiments. Acta Mater. 180, 199–217 (2019).10.1016/j.actamat.2019.09.016 ↗
21. Jin, M., Cao, P. & Short, M. P. Predicting the onset of void swelling in irradiated metals with machine learning. J. Nucl. Mater. 523, 189–197 (2019).10.1016/j.jnucmat.2019.05.054 ↗
22. Castin, N., Malerba, L. & Chaouadi, R. Prediction of radiation induced hardening of reactor pressure vessel steels using artificial neural networks. J. Nucl. Mater. 408, 30–39 (2011).10.1016/j.jnucmat.2010.10.039 ↗
23. Eason, E., Odette, G., Nanstad, R. & Yamamoto, T. A physically-based correlation of irradiation-induced transition temperature shifts for RPV steels. J. Nucl. Mater. 433, 240–254 (2013).10.1016/j.jnucmat.2012.09.012 ↗
24. Odette, G. R. & Nanstad, R. K. Predictive reactor pressure vessel steel irradiation embrittlement models: Issues and opportunities. JOM 61, 17–23 (2009).10.1007/s11837-009-0097-4 ↗
25. Gneiting, T. & Raftery, A. E. Strictly proper scoring rules, prediction, and estimation. J. Am. Stat. Assoc. 102, 359–378 (2007).10.1198/016214506000001437 ↗
26. Palmer, G. et al. Calibration after bootstrap for accurate uncertainty quantification in regression models. npj Comput. Mater. 8, 115 (2022).10.1038/s41524-022-00794-8 ↗
27. Pernot, P. Calibration in machine learning uncertainty quantification: Beyond consistency to target adaptivity. APL Mach. Learn. 1, 046121 (2023).10.1063/5.0174943 ↗
28. Jiao, Z. et al. Synergistic effects of Cu and Ni on nanoscale precipitation and mechanical properties of high-strength steels. Acta Mater. 61, 5996–6005 (2013).10.1016/j.actamat.2013.06.040 ↗
29. Hata, K. et al. Grain-boundary phosphorus segregation in highly neutron-irradiated reactor pressure vessel steels and its effect on irradiation embrittlement. J. Nucl. Mater. 543, 152564 (2021).10.1016/j.jnucmat.2020.152564 ↗
30. Ferreño, D., Kirk, M., Serrano, M. & Sainz-Aja, J. A. Assessment of the generalization ability of the astm e900-15 embrittlement trend curve by means of Monte Carlo cross-validation. Metals 12, 481 (2022).10.3390/met12030481 ↗
31. Lundberg, S. & Lee, S.-I. A unified approach to interpreting model predictions. Preprint at https://doi.org/10.48550/arXiv.1705.07874 (2017).10.48550/arXiv.1705.07874 ↗
32. Odette, G. R. & Lucas, G. E. Embrittlement of nuclear reactor pressure vessels. JOM 53, 18–22 (2001).10.1007/s11837-001-0081-0 ↗
33. Hashimoto, Y. & Kirk, M. Charpy v-notch energy prediction for irradiated reactor pressure vessel steel using the extreme gradient boost method. Int. J. Press. Vessels Pip. 218, 105559 (2025).10.1016/j.ijpvp.2025.105559 ↗
34. Ferreño, D., Erickson, M., Kirk, M. & Sainz-Aja, J. A. Machine learning assessment of the importance of unirradiated yield strength as a variable in embrittlement trend forecasting. Int. J. Press. Vessels Pip. 214, 105444 (2025).10.1016/j.ijpvp.2025.105444 ↗
35. Slugeň, V. et al. Radiation damage of reactor pressure vessel steels studied by positron annihilation spectroscopy—a review. Metals 10, 1378 (2020).10.3390/met10101378 ↗
36. Odette, G. R. & Lucas, G. E. Recent progress in understanding reactor pressure vessel steel embrittlement. Radiat. Eff. Defects Solids 144, 189–231 (1998).10.1080/10420159808229676 ↗
37. Almirall, N. et al. On the elevated temperature thermal stability of nanoscale Mn-Ni-Si precipitates formed at lower temperature in highly irradiated reactor pressure vessel steels. Sci. Rep. 9, 9587 (2019).10.1038/s41598-019-45944-z ↗
38. Xiong, W. et al. Thermodynamic models of low-temperature mn–ni–si precipitation in reactor pressure vessel steels. MRS Commun. 4, 101–105 (2014).10.1557/mrc.2014.21 ↗
39. Bonny, G. et al. On the thermal stability of late blooming phases in reactor pressure vessel steels: an atomistic study. J. Nucl. Mater. 442, 282–291 (2013).10.1016/j.jnucmat.2013.08.018 ↗
40. Ke, J.-H., Reese, E. R., Marquis, E. A., Odette, G. R. & Morgan, D. Flux effects in precipitation under irradiation – simulation of Fe-Cr alloys. Acta Mater. 164, 586–601 (2019).10.1016/j.actamat.2018.10.063 ↗
41. Ortner, S., Styman, P. & Long, E. The effects of flux on the radiation-induced embrittlement of reactor pressure vessel steels: review of current understanding and application to high fluences. Front. Nucl. Eng. 3, 2024 (2024).10.3389/fnuen.2024.1339222 ↗
42. Ortner, S., Styman, P. & Long, E. The effects of flux on the radiation-induced embrittlement of reactor pressure vessel steels: review of current understanding and application to high fluences. Front. Nucl. Eng. 3, 1339222 (2024).10.3389/fnuen.2024.1339222 ↗
43. Odette, G. R., Yamamoto, T. & Klingensmith, D. On the effect of dose rate on irradiation hardening of RPV steels. Philos. Mag. 85, 779–797 (2005).10.1080/14786430412331319910 ↗
44. Shu, S., Wells, P. B., Almirall, N., Odette, G. R. & Morgan, D. D. Thermodynamics and kinetics of core-shell versus appendage co-precipitation morphologies: an example in the Fe-Cu-Mn-Ni-Si system. Acta Mater. 157, 298–306 (2018).10.1016/j.actamat.2018.07.037 ↗
45. Faulkner, R. G. Radiation-induced grain boundary segregation in nuclear reactor steels. J. Nucl. Mater. 251, 269–275 (1997).10.1016/S0022-3115(97)00248-1 ↗
46. Nikolaeva, A., Nikolaev, Y. & Kryukov, A. The contribution of grain boundary effects to low-alloy steel irradiation embrittlement. J. Nucl. Mater. 218, 85–93 (1995).10.1016/0022-3115(94)00361-0 ↗
47. Ferreño, J., de Prada, J. M. & Chabás, J. L. Machine learning prediction of neutron radiation damage in RPV steel using the surveillance data from PLOTTER. Metals 12, 186 (2022).10.3390/met12020186 ↗
48. Odette, G. R. et al. Ucsb mrpg-rpv: 23-1 the ucsb ivar, atr-2 and br2 irradiation experiments and the RPV steel hardening database used in recent machine learning studies. https://doi.org/10.6084/m9.figshare.23304227.v1 (2023).10.6084/m9.figshare.23304227.v1 ↗
49. Pace, J., Rosseel, T. & Wang, J. Us NRC Embrittlement Database. http://www.osti.gov/scitech/biblio/14353 (1999).
50. Vaswani, A. et al. Attention is all you need. Preprint at https://doi.org/10.48550/arXiv.1706.03762 (2023).10.48550/arXiv.1706.03762 ↗
51. Huang, X., Khetan, A., Cvitkovic, M. & Karnin, Z. Tabtransformer: tabular data modeling using contextual embeddings. Preprint at https://doi.org/10.48550/arXiv.2012.06678 (2020).10.48550/arXiv.2012.06678 ↗
52. Arik, S. Ö & Pfister, T. Tabnet: attentive interpretable tabular learning. AAAI 35, 6679–6687 (2021).10.1609/aaai.v35i8.16826 ↗