Understanding Polymers Through Transfer Learning and Explainable AI
Source abstract
Abstract
In this work we study the use of artificial intelligence models, particularly focusing on transfer learning and interpretability, to predict polymer properties. Given the challenges imposed by data scarcity in polymer science, transfer learning offers a promising solution by using learnt features of models pre-trained on other datasets. We conducted a comparative analysis of direct modelling and transfer learning-based approaches using a polyacrylates’ glass transitions dataset as a proof-of-concept study. The AI models utilized tokenized SMILES strings to represent polymer structures, with convolutional neural networks processing these representations to predict Tg. To enhance model interpretability, Shapley value analysis was employed to assess the contribution of specific chemical groups to the predictions. The results indicate that while transfer learning provides robust predictive capabilities, direct modelling on polymer-specific data offers superior performance, particularly in capturing the complex interactions influencing Tg. This work highlights the importance of model interpretability and the limitations of applying molecular-level models to polymer systems.
Source: crossref · Quality: baseline
Research context
OpenAlex topics: Explainable Artificial Intelligence (XAI) · Machine Learning in Materials Science · Machine Learning and Data Classification
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
Affiliations
Donostia International Physics Center, P. M. de Lardizábal 4, 20018 San Sebastián, Spain
Institute of Materials Science and Technology (INTEMA), National Research Council (CONICET), Colón 10850, Mar del Plata 7600, Argentina
Departamento Polímeros y Materiales Avanzados: Física, Química y Tecnología, University of the Basque Country (UPV/EHU), P. Manuel Lardizábal 3, 20018 San Sebastián, Spain
Funding
Basque Government · MCIN/AEI/10.13039/50110001103
References (44)
Show source-provided references
1. Explainable AI: From black box to glass box10.1007/s11747-019-00710-5 ↗
2. Interpreting Black-Box Models: A Review on Explainable Artificial Intelligence10.1007/s12559-023-10179-8 ↗
3. Grad-CAM: Visual Explanations from Deep Networks via Gradient-Based Localization10.1007/s11263-019-01228-7 ↗
4. Prediction and Interpretability of Glass Transition Temperature of Homopolymers by Data-Augmented Graph Convolutional Neural Networks10.1021/acsami.3c13698 ↗
5. Localizing and quantifying the intra-monomer contributions to the glass transition temperature using artificial neural networks10.1016/j.polymer.2020.122786 ↗
6. Characterising the glass transition temperature-structure relationship through a recurrent neural network
7. Visual analytics of an interpretable prediction model for the glass transition temperature of fluoroelastomers10.1016/j.mtcomm.2024.110155 ↗
8. Methods for interpreting and understanding deep neural networks10.1016/j.dsp.2017.10.011 ↗
9. Interpretable and explainable machine learning for materials science and chemistry10.1021/accountsmr.1c00244 ↗
10. Explainable machine learning for scientific insights and discoveries10.1109/ACCESS.2020.2976199 ↗
11. Explainable machine learning in materials science10.1038/s41524-022-00884-7 ↗
12. Peeking inside the black-box: A survey on explainable artificial intelligence (xai)10.1109/ACCESS.2018.2870052 ↗
13. Polymer reaction engineering meets explainable machine learning10.1016/j.compchemeng.2023.108356 ↗
14. Explainable artificial intelligence (xai): Concepts, taxonomies, opportunities and challenges toward responsible ai10.1016/j.inffus.2019.12.012 ↗
15. Notions of explainability and evaluation approaches for explainable artificial intelligence10.1016/j.inffus.2021.05.009 ↗
16. Chen, G., Tao, L., and Li, Y. (2021). Predicting Polymers’ Glass Transition Temperature by a Chemical Language Processing Model. Polymers, 13.10.3390/polym13111898 ↗
17. A Machine Learning Framework for Predicting the Glass Transition Temperature of Homopolymers10.1021/acs.iecr.2c01302 ↗
18. Predicting glass transition temperatures using neural networks10.1016/j.actamat.2018.08.022 ↗
19. Prediction of Glass Transition Temperatures from Monomer and Repeat Unit Structure Using Computational Neural Networks10.1021/ci010062o ↗
20. Mapping Chemical Structure-Glass Transition Temperature Relationship through Artificial Intelligence10.1021/acs.macromol.0c02594 ↗
21. Machine Learning Models and Dimensionality Reduction for Prediction of Polymer Properties10.1021/acs.macromol.3c02401 ↗
22. Comparison Study on the Prediction of Multiple Molecular Properties by Various Neural Networks10.1021/acs.jpca.8b09376 ↗
23. A glimpse inside materials: Polymer structure—Glass transition temperature relationship as observed by a trained artificial intelligence10.1016/j.commatsci.2024.112863 ↗
24. Uddin, M.J., and Fan, J. (2024). Interpretable Machine Learning Framework to Predict the Glass Transition Temperature of Polymers. Polymers, 16.10.3390/polym16081049 ↗
25. Polymer Informatics: Opportunities and Challenges10.1021/acsmacrolett.7b00228 ↗
26. Transfer learning-driven artificial intelligence model for glass transition temperature estimation of molecular glass formers mixtures10.1016/j.commatsci.2024.112931 ↗
27. Nature of the Glass Transition in Polymers10.1063/1.1742830 ↗
28. Elucidating the Physicochemical Basis of the Glass Transition Temperature in Linear Polyurethane Elastomers with Machine Learning10.1021/acs.jpcb.0c06439 ↗
29. Machine learning glass transition temperature of polymers10.1016/j.heliyon.2020.e05055 ↗
30. Neural network prediction of glass-transition temperatures from monomer structure10.1039/ft9959102491 ↗
31. From chemical structure to quantitative polymer properties prediction through convolutional neural networks10.1016/j.polymer.2020.122341 ↗
32. Machine Learning with Enormous ‘synthetic’ Data Sets: Predicting Glass Transition Temperature of Polyimides Using Graph Convolutional Neural Networks10.1021/acsomega.2c04649 ↗
33. SMILES, a chemical language and information system. 1. Introduction to methodology and encoding rules10.1021/ci00057a005 ↗
34. Towards a Universal SMILES representation—A standard method to generate canonical SMILES based on the InChI10.1186/1758-2946-4-22 ↗
35. Improving the quality of chemical language model outcomes with atom-in-SMILES tokenization10.1186/s13321-023-00725-9 ↗
36. Wu, H., and Gu, X. (2015). Max-Pooling Dropout for Regularization of Convolutional Neural Networks. arXiv.10.1007/978-3-319-26532-2_6 ↗
37. LeCun, Y., Kavukcuoglu, K., and Farabet, C. (June, January 30). Convolutional networks and applications in vision. Proceedings of the 2010 IEEE International Symposium on Circuits and Systems, Paris, France.10.1109/ISCAS.2010.5537907 ↗
38. Kingma, D.P., and Ba, J.L. (2015, January 7–9). Adam: A method for stochastic optimization. Proceedings of the 3rd International Conference on Learning Representations, ICLR 2015, San Diego, CA, USA.
39. Sundararajan, M., and Najmi, A. (2020, January 13–18). The many shapley values for model explanation. Proceedings of the 37th International Conference on Machine Learning ICML 2020, Online. PartF168147-12.
40. Anjum, M., Khan, K., Ahmad, W., Ahmad, A., Amin, M.N., and Nafees, A. (2022). New SHapley Additive ExPlanations (SHAP) Approach to Evaluate the Raw Materials Interactions of Steel-Fiber-Reinforced Concrete. Materials, 15.10.3390/ma15186261 ↗
41. Liu, T., and Barnard, A. (2023, January 23–29). Shapley Based Residual Decomposition for Instance Analysis. Proceedings of the 40th International Conference on Machine Learning, Honolulu, HI, USA.10.1007/978-3-031-44754-9_3 ↗
42. Importance of Structural Features and the Influence of Individual Structures of Graphene Oxide Using Shapley Value Analysis10.1021/acs.chemmater.3c00715 ↗
43. Rubinstein, M., and Colby, R.H. (2003). Polymer Physics, Oxford University Press (OUP).10.1093/oso/9780198520597.001.0001 ↗
44. Similarity of Polymer Packing in Melts Is Dictated by N¯10.1021/acs.macromol.3c02273 ↗