Explainable Machine Learning Algorithms For Predicting Glass Transition Temperatures
Source abstract
Abstract
Abstract Modern technologies demand the development of new glasses with unusual properties. Most of the previous developments occurred by slow, expensive trial-and-error approaches, which have produced a considerable amount of data over the past 100 years. By finding patterns in such types of data, Machine Learning (ML) algorithms can extract useful knowledge, providing important insights into composition-property maps. A key step in glass composition design is to identify their physical-chemical properties, such as the glass transition temperature, Tg. In this paper, we investigate how different ML algorithms can be used to predict the Tg of glasses based on their chemical composition. For such, we used a dataset of 43,240 oxide glass compositions, each one with its assigned Tg. Besides, to assess the predictive performance obtained by ML algorithms, we investigated the possible gains by tuning the hyperparameters of these algorithms. The results show that the best ML algorithm for predicting Tg is the Random Forest (RF). One of the main challenges in this task is the prediction of extreme Tg values. To do this, we assessed the predictive performance of the investigated ML algorithms in three Tg intervals. For extreme Tg values ( ≤ 450 K and ≥ 1150 K), the top-performing algorithm was the k-Nearest Neighbours, closely followed by RF. The induced RF model predicted extreme values of Tg with a Relative Deviation (RD) of 3.5% for glasses with high Tg ( ≥ 1150 K), and RD of 7.5% for glasses with very low Tg ( ≤ 450 K). Finally, we propose a new visual approach to explain what our RF model learned, highlighting the importance of each chemical element to obtain glasses with extreme Tg. This study can be easily expanded to predict other composition–property combinations and can advantageously replace empirical approaches for developing novel glasses with relevant properties and applications.
Source: openaire · Quality: candidate unverified · Source record ↗
Research context
OpenAlex topics: Cultural Heritage Materials Analysis · Aesthetic Perception and Analysis · Sensory Analysis and Statistical Methods
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
References (47)
Show source-provided references
1. The glassy state of matter: Its definition and ultimate fate10.1016/j.jnoncrysol.2017.05.019 ↗
2. How many non-crystalline solids can be made from all the elements of the periodic table?10.1016/j.jnoncrysol.2004.07.081 ↗
3. Unsupervised word embeddings capture latent knowledge from materials science literature10.1038/s41586-019-1335-8 ↗
4. Semi-supervised machine-learning classification of materials synthesis procedures10.1038/s41524-019-0204-1 ↗
5. Can glass stability parameters infer glass forming ability?10.1016/j.jnoncrysol.2005.08.013 ↗
6. Varshneya · 2019
7. Predicting glass transition temperatures using neural networks10.1016/j.actamat.2018.08.022 ↗
8. Neural network prediction of glass-transition temperatures from monomer structure10.1039/ft9959102491 ↗
9. Neural Networks in Materials Science10.2355/isijinternational.39.966 ↗
10. A machine learning approach to the estimation of the liquidus temperature of glass-forming oxide blends10.1016/S0022-3093(02)01859-8 ↗
11. Artificial neural networks applied to polymer composites: a review10.1016/S0266-3538(03)00106-4 ↗
12. Prediction of high weight polymers glass transition temperature using RBF neural networks10.1016/j.theochem.2004.11.021 ↗
13. Solubility of glasses in the system P2O5–CaO–MgO–Na2O–TiO2: Experimental and modeling using artificial neural networks10.1016/j.jnoncrysol.2006.12.005 ↗
14. A neural network approach to prediction of glass transition temperature of polymers10.1002/int.20256 ↗
15. Artificial neural network prediction of glass transition temperature of polymers10.1007/s00396-009-2035-y ↗
16. Accelerating the Design of Functional Glasses through Modeling10.1021/acs.chemmater.6b01054 ↗
17. Bishop · 2006
18. An empirical comparison of supervised learning algorithms
19. Random search for hyper-parameter optimization
20. A tutorial on support vector regression10.1023/B:STCO.0000035301.49549.88 ↗
21. Explaining explanations: An overview of interpretability of machine learning
22. Towards trustable machine learning10.1038/s41551-018-0315-x ↗
23. Multilayer feedforward networks are universal approximators10.1016/0893-6080(89)90020-8 ↗
24. A.V. Dorogush, V. Ershov, A. Gulin, Catboost: gradient boosting with categorical features support, arXiv: 1810.11363(2018).
25. Distance metric learning for large margin nearest neighbor classification
26. Random forests10.1023/A:1010933404324 ↗
27. Breiman · 2017
28. Artificial neural network modeling for undercooled liquid region of glass forming alloys10.1016/j.commatsci.2009.12.012 ↗
29. Diagnosis of polymer electrolyte fuel cells failure modes (flooding & drying out) by neural networks modeling10.1016/j.ijhydene.2010.10.077 ↗
30. Prediction of critical cooling rate for glass forming alloys by artificial neural network10.1016/j.matdes.2013.06.012 ↗
31. Machine Learning Strategy for Accelerated Design of Polymer Dielectrics10.1038/srep20952 ↗
32. A predictable glass forming ability expression by statistical learning and evolutionary intelligence10.1016/j.intermet.2017.06.008 ↗
33. Machine Learning Approach for Prediction and Understanding of Glass-Forming Ability10.1021/acs.jpclett.7b01046 ↗
34. A. Ziletti, D. Kumar, M. Scheffler, L.M. Ghiringhelli, The face of crystals: insightful classification using deep learning, arXiv: 1709.02298[cond-mat](2017).
35. Accelerated discovery of metallic glasses through iteration of machine learning and high-throughput experiments10.1126/sciadv.aaq1566 ↗
36. Predicting the dissolution kinetics of silicate glasses using machine learning10.1016/j.jnoncrysol.2018.02.023 ↗
37. Ruusunen · 2018
38. S. Bishnoi, S. Singh, R. Ravinder, M. Bauchy, N.N. Gosvami, H. Kodamana, N. Krishnan, Predicting young’s modulus of glasses with sparse datasets using machine learning, arXiv: 1902.09776(2019).10.1016/j.jnoncrysol.2019.119643 ↗
39. Predicting the young’s modulus of silicate glasses using high-throughput molecular dynamics simulations and machine learning10.1038/s41598-019-45344-3 ↗
40. Balance between accuracy and simplicity in empirical forcefields for glass modeling: Insights from machine learning10.1016/j.jnoncrysol.2019.04.020 ↗
41. Mazurin · 2017
42. Random decision forests
43. A survey on multi-output regression
44. Siegel · 1956 · 7
45. Influence of hyperparameters on random forest accuracy
46. Explainable AI for trees: From local explanations to global understanding
47. Violin plots: A box plot-density trace synergism10.1080/00031305.1998.10480559 ↗