Data-augmented machine learning models for oxynitride glasses via Wasserstein generative adversarial network with gradient penalty and content constraint
Source abstract
Abstract
Data-driven machine learning methods have been proven highly successful in predicting glass properties, but hampered when dealing with small datasets, such as oxynitride glasses with excellent mechanical properties and chemical stability. Here, a data augmentation method based on the Wasserstein Generative Adversarial Network with Gradient Penalty (GP) and Content Constraint Penalty (CP) terms, a generative deep-learning model via the adversarial training of a generator and a discriminator, was established, in which the GP and CP terms ensure training stability and the physical rationality of the generated samples. The results indicate that the generated samples improve the performance of the oxynitride glass composition-property models trained with the XGBoost algorithm in terms of prediction accuracy and generalization capability. Furthermore, the augmented models outperform the general glass prediction model, GlassNet, over 101 experimental samples not included in the training datasets. Based on SHAP's single feature analysis and feature interaction analysis, the interpretability study further sheds light on the contributions of elements and the interactive effects of element pairs on the properties of oxynitride glasses. These achievements not only provide reliable models for the composition-property studies of oxynitride glasses but also offer a novel strategy for developing high-performance data-driven models under data scarcity scenarios. • Introducing a Content Constraint Penalty (CP) into WGAN-GP ensures that the synthetic samples are physically reasonable. • Augmented data improved XGBoost models in terms of prediction accuracy and generalization capability. • Augmented XGBoost models outperformed the previously reported deep neural network model on 101 unseen experimental samples. • SHAP analysis revealed the elemental contributions and pairwise interactions of oxynitride glasses.
Source: openalex_inverted_index · Quality: baseline
Research context
OpenAlex topics: Phase-change materials and chalcogenides · Machine Learning in Materials Science · Glass properties and applications
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
References (100+)
Show source-provided references
1. Research progress of oxynitride glasses
2. Oxynitride glasses: a review10.1016/j.bsecv.2016.09.004 ↗
3. Oxynitride glasses
4. Nitride ceramics
5. Investigation of the structural and thermal properties of aluminum-rich Ca–Al–Si–O–N glasses10.1016/j.progsolidstchem.2023.100414 ↗
6. Ab initio molecular orbital calculation of the interatomic potential and force constants in silicon oxynitride glass10.1016/0022-3093(88)90163-9 ↗
7. Review: elaboration, structure, and mechanical properties of oxynitride glasses10.1111/jace.18824 ↗
8. An overview of the structure and properties of silicon-based oxynitride glasses10.1111/j.2041-1294.2011.00042.x ↗
9. Oxynitride glasses10.1016/j.jeurceramsoc.2007.12.021 ↗
10. Viscosity of Na–Si–O–N–F melts: mixing effect of oxygen, nitrogen, and fluorine10.2355/isijinternational.ISIJINT-2020-326 ↗
11. Effects of addition of nitrogen on bioglass properties and structure10.1016/j.jnoncrysol.2011.11.036 ↗
12. Structure and rheological properties of the RE–Si–Mg–O–N (RE=Sc, Y, La, Nd, Sm, Gd, Yb and Lu) glasses10.1016/j.jnoncrysol.2004.07.018 ↗
13. Mechanical properties, structure, bioactivity and cytotoxicity of bioactive Na-Ca-Si-P-O-(N) glasses10.1016/j.jmbbm.2018.06.023 ↗
14. The influence of the mixed alkaline earth effect on the structure and properties of (Ca, Mg)–Si–Al–O–N glasses10.1016/j.ceramint.2021.01.078 ↗
15. Structural characterisation of Er–Si–Al–O–N glasses by Raman spectroscopy10.1016/j.jeurceramsoc.2006.04.058 ↗
16. Effects of nitrogen on properties of oxyfluoronitride bioglasses10.1016/j.procbio.2012.05.024 ↗
17. SiAlON glasses: effects of nitrogen on structure and properties10.2109/jcersj2.116.755 ↗
18. Independent effects of nitrogen substitution for oxygen and yttrium substitution for magnesium on the properties of Mg–Y–Si–Al–O–N glasses10.1111/j.1151-2916.2003.tb03321.x ↗
19. Rheological properties of Y–Si–Al–ON glasses—elastic moduli, viscosity and creep10.1007/BF02403674 ↗
20. Thermal and mechanical properties of Mg–Al–Si–O–N glasses with up to 6.2 at.% nitrogen10.1111/jace.20487 ↗
21. Compositional effects on the properties of high nitrogen content alkaline-earth silicon oxynitride glasses, AE=Mg, Ca, Sr, Ba10.1016/j.jeurceramsoc.2010.11.005 ↗
22. Effect of composition on the thermal properties and structure of M–Al–Si–O–N glasses, M = Na, Mg, Ca10.1016/j.progsolidstchem.2024.100461 ↗
23. Effects of nitrogen and lanthanum on the preparation and properties of La–Ca–Si–Al–O–N oxynitride glasses10.1016/j.jnoncrysol.2012.10.020 ↗
24. Elastic Properties and hardness of mixed alkaline earth silicate oxynitride glasses10.3390/ma15145022 ↗
25. Factors controlling properties of Ca-Mg, Ca-Er, Ca-Nd, or Ca-Y-modified aluminosilicate glasses containing nitrogen and fluorine10.1111/jace.12543 ↗
26. Mechanical properties of oxynitride glasses10.1111/ijac.14204 ↗
27. Temperature-dependent viscosity of SiREAl-based glasses as a function of N:O and RE:Al ratios (RE = La, Gd, Y, and Lu)10.1111/j.1151-2916.2004.tb07722.x ↗
28. Properties and crystallization of rare-earth Si–Al–O–N glasses containing mixed trivalent modifiers10.1111/j.1551-2916.2004.00141.x ↗
29. Formation of ln–Si–Al–O–N glasses and their properties10.1016/S0955-2219(97)00057-5 ↗
30. Issues associated with the development of transparent oxynitride glasses10.1016/j.ceramint.2014.11.030 ↗
31. Glass-forming region in the Ca–Si–O–N system using CaH2 as Ca source10.1016/j.jeurceramsoc.2008.04.017 ↗
32. Preparation and properties of Ca–Al–Si–O–N oxynitride glasses10.1016/0022-3093(83)90460-X ↗
33. Nitrogen-containing phosphate glasses10.1016/0022-3093(83)90464-7 ↗
34. Nitrogen-containing SiO2 glass fibers prepared by ammonolysis of gels made from silicon alkoxides10.1016/0022-3093(86)90068-2 ↗
35. Problems associated with the melting of oxynitride glasses10.1111/j.1151-2916.1984.tb19492.x ↗
36. Physical and chemical solubility of nitrogen in glass melts10.1111/j.1151-2916.1966.tb13300.x ↗
37. Preparation and properties of oxynitride glasses10.1016/0022-3093(83)90457-X ↗
38. INTERGLAD, V8, 2019, https://www.newglass.jp/interglad_n/gaiyo/outline_e.html.
39. Interpreting the optical properties of oxide glasses with machine learning and shapely additive explanations10.1111/jace.18345 ↗
40. Machine learning on density and elastic property of oxide glasses driven by large dataset10.1016/j.jnoncrysol.2019.119768 ↗
41. Extracting processing and testing parameters from materials science literature for improved property prediction of glasses10.1016/j.cep.2021.108607 ↗
42. Glass hardness: predicting composition and load effects via symbolic reasoning-informed machine learning10.1016/j.actamat.2023.119046 ↗
43. Theoretical prediction of vickers hardness for oxide glasses: machine learning model, interpretability analysis, and experimental validation10.1016/j.mtla.2024.102006 ↗
44. Using a simple radial basis function neural network to predict the glass transition temperature of alkali borate glasses10.1016/j.jnoncrysol.2024.122870 ↗
45. Explainable machine learning algorithms for predicting glass transition temperatures10.1016/j.actamat.2020.01.047 ↗
46. Predicting glass transition temperatures using neural networks10.1016/j.actamat.2018.08.022 ↗
47. Predicting the Young's modulus of silicate glasses using high-throughput molecular dynamics simulations and machine learning10.1038/s41598-019-45344-3 ↗
48. Predicting glass properties by using physics- and chemistry-informed machine learning models10.1016/j.jnoncrysol.2022.121511 ↗
49. Data-driven predictive models for chemical durability of oxide glass under different chemical conditions10.1038/s41529-020-0118-x ↗
50. ViscNet: neural network for predicting the fragility index and the temperature-dependency of viscosity10.1016/j.actamat.2020.116602 ↗
51. Predicting the dissolution kinetics of silicate glasses by topology-informed machine learning10.1038/s41529-019-0094-1 ↗
52. Predicting the dissolution kinetics of silicate glasses using machine learning10.1016/j.jnoncrysol.2018.02.023 ↗
53. Predicting oxide glass properties with low complexity neural network and physical and chemical descriptors10.1016/j.jnoncrysol.2023.122488 ↗
54. Predicting and interpreting oxide glass properties by machine learning using large datasets10.1016/j.ceramint.2021.05.105 ↗
55. Accelerated design of chalcogenide glasses through interpretable machine learning for composition–property relationships10.1088/2515-7639/acc6f2 ↗
56. Machine learning unveils composition-property relationships in chalcogenide glasses10.1016/j.actamat.2022.118302 ↗
57. Understanding the compositional control on electrical, mechanical, optical, and physical properties of inorganic glasses with interpretable machine learning10.1016/j.actamat.2022.118439 ↗
58. Scalable Gaussian processes for predicting the optical, physical, thermal, and mechanical properties of inorganic glasses with large datasets10.1039/D0MA00764A ↗
59. GlassNet: a multitask deep neural network for predicting many glass properties10.1016/j.ceramint.2023.08.281 ↗
60. Deep learning aided rational design of oxide glasses10.1039/D0MH00162G ↗
61. Small data machine learning in materials science10.1038/s41524-023-01000-z ↗
62. Predicting Young's modulus of oxide glasses with sparse datasets using machine learning10.1016/j.jnoncrysol.2019.119643 ↗
63. Enhancing glass property predictions through ab initio-derived descriptors10.1111/jace.19904 ↗
64. A survey on Image data augmentation for deep learning10.1186/s40537-019-0197-0 ↗
65. Accelerating design of glass substrates by machine learning using small-to-medium datasets10.1016/j.ceramint.2023.11.048 ↗
66. SMOTE: synthetic minority over-sampling technique10.1613/jair.953 ↗
67. Deep neural networks and tabular data: a survey
68. Tabular and latent space synthetic data generation: a literature review10.1186/s40537-023-00792-7 ↗
69. Generating multi-label discrete patient records using generative adversarial networks. Machine learning for healthcare conference
70. Data synthesis based on generative adversarial networks10.14778/3231751.3231757 ↗
71. Modeling tabular data using conditional GAN
72. Faketables: using GANs to generate functional dependency preserving tables with bounded real data
73. Data augmentation with generative models for improved malware detection: a comparative study
74. Effective data generation for imbalanced learning using conditional generative adversarial networks10.1016/j.eswa.2017.09.030 ↗
75. Relational data synthesis using generative adversarial networks10.14778/3407790.3407802 ↗
76. A universal metric for robust evaluation of synthetic tabular data10.1109/TAI.2022.3229289 ↗
77. Elastic properties and short-to medium-range order in glasses10.1111/j.1551-2916.2007.01945.x ↗
78. Oxyfluoronitride glasses with high elastic modulus and low glass transition temperatures10.1111/j.1551-2916.2009.03041.x ↗
79. Bioactive oxynitride glasses: synthesis, structure and properties10.1016/j.jeurceramsoc.2015.12.017 ↗
80. An introduction to the glass formation and properties of Ca–Si–Al–O–N–F glasses
81. Properties, bioactivity and viability of the new generation of oxyfluoronitride bioglasses10.18321/ectj1565 ↗
82. Effect of nitrogen and fluorine on mechanical properties and bioactivity in two series of bioactive glasses10.1016/j.jmbbm.2013.03.010 ↗
83. Independent but additive effects of fluorine and nitrogen substitution on properties of a calcium aluminosilicate glass10.1111/j.1551-2916.2011.05001.x ↗
84. XGBoost: a scalable tree boosting system
85. Algorithms for hyper-parameter optimization
86. Generative adversarial nets
87. Wasserstein generative adversarial networks
88. Improved training of Wasserstein GANs
89. From local explanations to global understanding with explainable AI for trees10.1038/s42256-019-0138-9 ↗
90. A unified approach to interpreting model predictions
91. Hardness of oxynitride glasses: topological origin10.1021/jp512235t ↗
92. Properties of silicon-aluminum-yttrium oxynitride glasses10.1016/S0022-3093(96)00510-8 ↗
93. La-Si-O-N glasses10.1016/j.jeurceramsoc.2007.04.003 ↗
94. Formation and properties of nitrogen-rich strontium silicon oxynitride glasses10.1007/s10853-008-3058-3 ↗
95. Oxynitride glasses and glass ceramics10.1557/PROC-287-93 ↗
96. Oxynitride glasses, their properties and crystallisation – A review10.1016/S0022-3093(02)01938-5 ↗
97. Properties of high nitrogen content mixed alkali earth oxynitride glasses (AExCa1−x)1.2(1)SiO1.9(1)N0.86(6), AE=Mg, Sr, Ba10.1016/j.jnoncrysol.2009.04.036 ↗
98. Preparation and properties of some Li–Al–Si–O–N glasses10.1016/0022-3093(83)90463-5 ↗
99. Hardness and refractive index of Ca–Si–O–N glasses10.1016/j.jnoncrysol.2008.11.019 ↗
100. Compositional effects on the properties of Si–Al–RE-based oxynitride glasses (RE = La, Nd, Gd, Y, or Lu)10.1111/j.1151-2916.2002.tb00189.x ↗