journal article·2026-03-27Open access

Dynamic embedding representation for graph neural networks to enhance materials property prediction with limited datasets

Vishu Gupta, Kamal Choudhary, Youjia Li, Muhammed Nur Talha Kilic, Daniel Wines, Wei-keng Liao, Alok Choudhary, Ankit Agrawal

Materials Research Express· Volume 13· Issue 6

Abstract

Abstract Graph neural networks (GNNs) have proven effective in understanding and predicting diverse material properties, even when working with limited datasets. An important step in training GNN is to use an appropriate and informative graph embedding that can adequately represent the structural and compositional information in the chemical space. Current graph embeddings consist of composition and structure-agnostic element-level encodings, which are static in nature. This makes it challenging to differentiate between different compounds on the element level, especially for datasets with limited data size, thereby relying more on the complex input and architecture for model training. Here, we present a novel framework for GNN-based prediction tasks that use dynamic embedding to significantly improve the models’ predictive ability on materials properties with limited data size. We evaluated the proposed framework on multiple materials datasets across various domains to find that the model trained using dynamic embedding outperforms the models trained using conventional static embedding and features obtained using a pre-trained model. The proposed framework holds significant potential for expediting artificial intelligence (AI)-driven materials discovery.
Source: crossref · Quality: baseline

Research context

OpenAlex topics: Machine Learning in Materials Science · Advanced Graph Neural Networks · Computational Drug Discovery Methods

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

References (57)

Show source-provided references
1. Opportunities and challenges for machine learning in materials science10.1146/annurev-matsci-070218-010015 ↗
2. Machine-learned potentials for next-generation matter simulations10.1038/s41563-020-0777-6 ↗
3. Perspective on integrating machine learning into computational chemistry and materials science10.1063/5.0047760 ↗
4. An ai-driven microstructure optimization framework for elastic properties of titanium beyond cubic crystal systems10.1038/s41524-023-01067-8 ↗
5. Machine learning in materials science: from explainable predictions to autonomous design10.1016/j.commatsci.2021.110360 ↗
6. Crystal structure prediction by joint equivariant diffusion10.5555/3666122.3666889 ↗
7. Machine learning in materials informatics: recent applications and prospects10.1038/s41524-017-0056-5 ↗
8. Deep materials informatics: applications of deep learning in materials science10.1557/mrc.2019.73 ↗
9. Evolution of artificial intelligence for application in contemporary materials science10.1557/s43579-023-00433-3 ↗
10. Francesca Tavazza JARVIS-Leaderboard: a large scale benchmark of materials design methods10.1038/s41524-024-01259-w ↗
11. Recent advances and applications of deep learning methods in materials science10.1038/s41524-022-00734-6 ↗
12. A review on the applications of graph neural networks in materials science at the atomic scale10.1002/mgea.50 ↗
13. Towards accurate prediction of configurational disorder properties in materials using graph neural networks10.1038/s41524-024-01283-w ↗
14. DenseGNN: universal and scalable deeper graph neural networks for high-performance property prediction in crystals and molecules10.1038/s41524-024-01444-x ↗
15. Optimal pre-train/fine-tune strategies for accurate material property predictions10.1038/s41524-024-01486-1 ↗
16. Crystal graph convolutional neural networks for an accurate and interpretable prediction of material properties10.1103/PhysRevLett.120.145301 ↗
17. Predicting materials properties without crystal structure: deep representation learning from stoichiometry10.1038/s41467-020-19964-7 ↗
18. Schnet: a continuous-filter convolutional neural network for modeling quantum interactions10.5555/3294771.3294866 ↗
19. Graph networks as a universal machine learning framework for molecules and crystals10.1021/acs.chemmater.9b01294 ↗
20. Klicpera · 2020
21. Atomistic line graph neural network for improved materials property predictions10.1038/s41524-021-00650-1 ↗
22. Moving closer to experimental level materials property prediction using ai10.1038/s41598-022-15816-0 ↗
23. Prediction of low-thermal-conductivity compounds with first-principles anharmonic lattice-dynamics calculations and bayesian optimization10.1103/PhysRevLett.115.205901 ↗
24. Big data of materials science: critical role of the descriptor10.1103/PhysRevLett.114.105503 ↗
25. Prediction model of band gap for inorganic compounds by combination of density functional theory calculations and machine learning techniques10.1103/PhysRevB.93.115104 ↗
26. Holistic computational structure screening of more than 12000 candidates for solid lithium-ion conductor materials10.1039/C6EE02697D ↗
27. Ai for learning deformation behavior of a material: predicting stress-strain curves 4000x faster than simulations10.1109/IJCNN54540.2023.10191138 ↗
28. Cross-property deep transfer learning framework for enhanced predictive analytics on small materials data10.1038/s41467-021-26921-5 ↗
29. Mppredictor: An artificial intelligence-driven web tool for composition-based material property prediction10.1021/acs.jcim.3c00307 ↗
30. Pre-activation based representation learning to enhance predictive analytics on small materials data10.1109/IJCNN54540.2023.10191086 ↗
31. Brnet: Branched residual network for fast and accurate predictive modeling of materials properties10.1137/1.9781611977172.3 ↗
32. Improving deep learning model performance under parametric constraints for materials informatics applications10.1038/s41598-023-36336-5 ↗
33. Simultaneously improving accuracy and computational cost under parametric constraints in materials property prediction tasks10.1186/s13321-024-00811-6 ↗
34. Element similarity in high-dimensional materials representations10.1039/D3DD00121K ↗
35. Efficient and interpretable graph network representation for angle-dependent properties applied to optical spectroscopy10.1038/s41524-022-00841-4 ↗
36. Large language models meet graph neural networks: a perspective of graph mining
37. Improving chemical reaction yield prediction using pre-trained graph neural networks10.1186/s13321-024-00818-z ↗
38. Structure-aware graph neural network based deep transfer learning framework for enhanced predictive analytics on diverse materials datasets10.1038/s41524-023-01185-3 ↗
39. Accelerated discovery of energy materials via graph neural network10.3390/inorganics13120395 ↗
40. Ensembles of graph and physics-informed machine learning for scientific modeling in materials science: a review: DDK Wayo
41. High throughput screening of new piezoelectric materials using graph machine learning and knowledge graph approach10.1016/j.commatsci.2024.113445 ↗
42. The materials project: a materials genome approach to accelerating materials innovation10.1063/1.4812323 ↗
43. JARVIS: an integrated infrastructure for data-driven materials design
44. Recent progress in the JARVIS infrastructure for next-generation data-driven materials design10.1063/5.0159299 ↗
45. Atomsets as a hierarchical transfer learning framework for small and large materials datasets10.1038/s41524-021-00639-w ↗
46. Self-supervised representations and node embedding graph neural networks for accurate and multi-scale analysis of materials10.1088/2632-2153/ad612b ↗
47. ElemNet: deep learning the chemistry of materials from only elemental composition10.1038/s41598-018-35934-y ↗
48. A general-purpose machine learning framework for predicting properties of inorganic materials10.1038/npjcompumats.2016.28 ↗
49. Unsupervised word embeddings capture latent knowledge from materials science literature10.1038/s41586-019-1335-8 ↗
50. Named entity recognition and normalization applied to large-scale information extraction from the materials science literature10.1021/acs.jcim.9b00470 ↗
51. Compositionally restricted attention-based network for materials property predictions10.1038/s41524-021-00545-1 ↗
52. Efficient and robust automated machine learning
53. Machine learning with force-field-inspired descriptors for materials: fast screening and mapping energy landscape10.1103/PhysRevMaterials.2.083801 ↗
54. Including crystal structure attributes in machine learning models of formation energies via Voronoi tessellations10.1103/PhysRevB.96.024104 ↗
55. Enabling deeper learning on big data for materials informatics applications10.1038/s41598-021-83193-1 ↗
56. Applying transfer learning with convolutional neural networks to identify novel electrolytes for metal air batteries10.1016/j.comptc.2021.113443 ↗
57. Transfer learning of memory kernels for transferable coarse-graining of polymer dynamics10.1039/D1SM00364J ↗