journal article·2025-12-18Open access

SA-GAT-SR: self-adaptable graph attention networks with symbolic regression for high-fidelity material property prediction

Junchi Liu, Ying Tang, Sergei Tretiak, Wenhui Duan, Liujiang Zhou

npj Computational Materials· Volume 11· Issue 1

Abstract

Recent advances in machine learning have demonstrated an enormous utility of deep learning approaches, particularly Graph Neural Networks (GNNs) for materials science. These methods have emerged as powerful tools for high-throughput prediction of material properties, offering a compelling enhancement and alternative to traditional first-principles calculations. While the community has predominantly focused on developing increasingly complex and universal models to enhance predictive accuracy, such approaches often lack physical interpretability and insights into materials behavior. Here, we introduce a novel computational paradigm—Self-Adaptable Graph Attention Networks integrated with Symbolic Regression (SA-GAT-SR)—that synergistically combines the predictive capability of GNNs with the interpretative power of symbolic regression. Our framework employs a self-adaptable encoding algorithm that automatically identifies and adjust attention weights so as to screen critical features from an expansive 180-dimensional feature space while maintaining O ( n ) computational scaling. The integrated SR module subsequently distills these features into compact analytical expressions that explicitly reveal quantum-mechanically meaningful relationships, achieving 23 × acceleration compared to conventional SR implementations that heavily rely on first-principle calculations-derived features as input. This work suggests a new framework in computational materials science, bridging the gap between predictive accuracy and physical interpretability, offering valuable physical insights into material behavior.
Source: openalex_inverted_index · Quality: baseline

Research context

OpenAlex topics: Machine Learning in Materials Science · Advanced Graph Neural Networks · Electrocatalysts for Energy Conversion

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

References (58)

Show source-provided references
1. Zou, Y., Qian, J., Wang, X., Li, S. & Li, Y. Machine learning-assisted prediction and interpretation of electrochemical corrosion behavior in high-entropy alloys. Comput. Mater. Sci. 244, 113259 (2024).10.1016/j.commatsci.2024.113259 ↗
2. Xu, G., Xue, Y., Geng, X., Hou, X. & Xu, J. A machine learning-based crystal graph network and its application in development of functional materials. Mater. Genome Eng. Adv. 2, e38 (2024).10.1002/mgea.38 ↗
3. Okabe, R. et al. Virtual node graph neural network for full phonon prediction. Nat. Comput. Sci. 4, 522–531 (2024).10.1038/s43588-024-00661-0 ↗
4. Chen, C., Ye, W., Zuo, Y., Zheng, C. & Ong, S. P. Graph networks as a universal machine learning framework for molecules and crystals. Chem. Mater. 31, 3564–3572 (2019).10.1021/acs.chemmater.9b01294 ↗
5. Hwang, D. et al. Comprehensive study on molecular supervised learning with graph neural networks. J. Chem. Inf. Model. 60, 5936–5945 (2020).10.1021/acs.jcim.0c00416 ↗
6. Wang, T. et al. Crysformer: An attention-based graph neural network for properties prediction of crystals. Chin. Phys. B 32, 090703 (2023).10.1088/1674-1056/ace247 ↗
7. Gilmer, J., Schoenholz, S. S., Riley, P. F., Vinyals, O. & Dahl, G. E. Neural message passing for quantum chemistry. In Proc. 34th International Conference on Machine Learning (eds Precup, D. & Teh, Y. W.) vol. 70, 1263–1272 (2017).
8. Xie, T. & Grossman, J. C. Crystal graph convolutional neural networks for an accurate and interpretable prediction of material properties. Phys. Rev. Lett. 120, 145301 (2018).10.1103/PhysRevLett.120.145301 ↗
9. Choudhary, K. & DeCost, B. Atomistic line graph neural network for improved materials property predictions. npj Comput. Mater. 7, 185 (2021).10.1038/s41524-021-00650-1 ↗
10. Chen, D., O’Bray, L. & Borgwardt, K. Structure-aware transformer for graph representation learning. In Proc. 39th International Conference on Machine Learning (eds Chaudhuri, K. et al.) vol. 162, 3469–3489 (2022).
11. Witman, M. D., Goyal, A., Ogitsu, T., McDaniel, A. H. & Lany, S. Defect graph neural networks for materials discovery in high-temperature clean-energy applications. Nat. Comput. Sci. 3, 675–686 (2023).10.1038/s43588-023-00495-2 ↗
12. Jin, L. et al. Transformer-generated atomic embeddings to enhance prediction accuracy of crystal properties with machine learning. Nat. Commun. 16, 1210 (2025).10.1038/s41467-025-56481-x ↗
13. Lim, J. et al. Predicting drug-target interaction using a novel graph neural network with 3d structure-embedded graph representation. J. Chem. Inf. Model. 59, 3981–3988 (2019).10.1021/acs.jcim.9b00387 ↗
14. Dwivedi, V. P., Luu, A. T., Laurent, T., Bengio, Y. & Bresson, X. Graph neural networks with learnable structural and positional representations. International Conference on Learning Representations (2022).
15. Ma, L., Rabbany, R. & Romero-Soriano, A. Graph attention networks with positional embeddings. In Advances in Knowledge Discovery and Data Mining (eds Karlapalem, K. et al.) 514–527 (Springer International Publishing, 2021).10.1007/978-3-030-75762-5_41 ↗
16. Chen, Y. et al. Sp-gnn: Learning structure and position information from graphs. Neural Networks 161, 505–514 (2023).10.1016/j.neunet.2023.01.051 ↗
17. Karamad, M. et al. Orbital graph convolutional neural network for material property prediction. Phys. Rev. Mater. 4, 093801 (2020).10.1103/PhysRevMaterials.4.093801 ↗
18. Reiser, P. et al. Graph neural networks for materials science and chemistry. Commun. Mater. 3, 93 (2022).10.1038/s43246-022-00315-6 ↗
19. Doshi, S. & Chepuri, S. P. Graph neural networks with parallel neighborhood aggregations for graph classification. IEEE Trans. Signal Process. 70, 4883–4896 (2022).10.1109/TSP.2022.3205476 ↗
20. Schweidtmann, A. M. et al. Physical pooling functions in graph neural networks for molecular property prediction. Comput. Chem. Eng. 172, 108202 (2023).10.1016/j.compchemeng.2023.108202 ↗
21. Du, H., Wang, J., Hui, J., Zhang, L. & Wang, H. Densegnn: universal and scalable deeper graph neural networks for high-performance property prediction in crystals and molecules. npj Comput. Mater. 10, 292 (2024).10.1038/s41524-024-01444-x ↗
22. Shi, X., Zhou, L., Huang, Y., Wu, Y. & Hong, Z. A review on the applications of graph neural networks in materials science at the atomic scale. Mater. Genome Eng. Adv. 2, e50 (2024).10.1002/mgea.50 ↗
23. Gupta, V. et al. Structure-aware graph neural network-based deep transfer learning framework for enhanced predictive analytics on diverse materials datasets. npj Comput. Mater. 10, 1 (2024).10.1038/s41524-023-01185-3 ↗
24. Li, H., Wang, X., Zhang, Z. & Zhu, W. Ood-gnn: Out-of-distribution generalized graph neural network. IEEE Trans. Knowl. Data Eng. 35, 7328–7340 (2023).10.1109/TKDE.2022.3193725 ↗
25. Gao, H., Guo, X.-W., Li, G., Li, C. & Yang, C. Gcpnet: An interpretable generic crystal pattern graph neural network for predicting material properties. Neural Netw. 188, 107466 (2025).10.1016/j.neunet.2025.107466 ↗
26. Shang, Y. et al. Materials genome engineering accelerates the research and development of organic and perovskite photovoltaics. Mater. Genome Eng. Adv. 2, e28 (2024).10.1002/mgea.28 ↗
27. Li, Q., Fu, N., Omee, S. S. & Hu, J. Md-hit: Machine learning for material property prediction with dataset redundancy control. npj Comput. Mater. 10, 245 (2024).10.1038/s41524-024-01426-z ↗
28. Omee, S. S., Fu, N., Dong, R., Hu, M. & Hu, J. Structure-based out-of-distribution (ood) materials property prediction: a benchmark study. npj Comput. Mater. 10, 144 (2024).10.1038/s41524-024-01316-4 ↗
29. Fu, N., Omee, S. S. & Hu, J. Physical encoding improves ood performance in deep learning materials property prediction. Comput. Mater. Sci. 248, 113603 (2025).10.1016/j.commatsci.2024.113603 ↗
30. Li, K. et al. Exploiting redundancy in large materials datasets for efficient machine learning with less data. Nat. Commun. 14, 7283 (2023).10.1038/s41467-023-42992-y ↗
31. Wang, H., Ouyang, R., Chen, W. & Pasquarello, A. High-quality data enabling universality of band gap descriptor and discovery of photovoltaic perovskites. J. Am. Chem. Soc. 146, 17636–17645 (2024).10.1021/jacs.4c03507 ↗
32. Weng, B. et al. Simple descriptor derived from symbolic regression accelerating the discovery of new perovskite catalysts. Nat. Commun. 11, 3513 (2020).10.1038/s41467-020-17263-9 ↗
33. Wang, G., Wang, E., Li, Z., Zhou, J. & Sun, Z. Exploring the mathematic equations behind the materials science data using interpretable symbolic regression. Interdiscip. Mater. 3, 637–657 (2024).
34. Liu, S., Li, Q., Shen, X., Sun, J. & Yang, Z. Automated discovery of symbolic laws governing skill acquisition from naturally occurring data. Nat. Comput. Sci. 4, 334–345 (2024).10.1038/s43588-024-00629-0 ↗
35. Chen, C. & Ong, S. P. A universal graph deep learning interatomic potential for the periodic table. Nat. Comput. Sci. 2, 718–728 (2022).10.1038/s43588-022-00349-3 ↗
36. Lu, Y. et al. A simple and efficient graph transformer architecture for molecular properties prediction. Chem. Eng. Sci. 280, 119057 (2023).10.1016/j.ces.2023.119057 ↗
37. Ihalage, A. & Hao, Y. Formula graph self-attention network for representation-domain independent materials discovery. Adv. Sci. 9, 2200164 (2022).10.1002/advs.202200164 ↗
38. Morgan, J. P., Paiement, A. & Klinke, C. Domain-informed graph neural networks: a quantum chemistry case study. Neural Networks 165, 938–952 (2023).10.1016/j.neunet.2023.06.030 ↗
39. Ouyang, R., Curtarolo, S., Ahmetcik, E., Scheffler, M. & Ghiringhelli, L. M. Sisso: A compressed-sensing method for identifying the best low-dimensional descriptor in an immensity of offered candidates. Phys. Rev. Mater. 2, 083802 (2018).10.1103/PhysRevMaterials.2.083802 ↗
40. Ouyang, R., Ahmetcik, E., Carbogno, C., Scheffler, M. & Ghiringhelli, L. M. Simultaneous learning of several materials properties from incomplete databases with multi-task sisso. J. Phys.: Mater. 2, 024002 (2019).
41. Choudhary, K. et al. The joint automated repository for various integrated simulations (Jarvis) for data-driven materials design. npj Comput. Mater. 6, 173 (2020).10.1038/s41524-020-00440-1 ↗
42. Klimeš, J., Bowler, D. R. & Michaelides, A. Chemical accuracy for the van der Waals density functional. J. Phys.:Condens. Matter 22, 022201 (2009).
43. Li, X. et al. Computational screening of new perovskite materials using transfer learning and deep learning. Appl. Sci. 9, 5510 (2019).10.3390/app9245510 ↗
44. Tao, Q., Xu, P., Li, M. & Lu, W. Machine learning for perovskite materials design and discovery. npj Comput. Mater. 7, 23 (2021).10.1038/s41524-021-00495-8 ↗
45. Prasanna, R. et al. Band gap tuning via lattice contraction and octahedral tilting in perovskite materials for photovoltaics. J. Am. Chem. Soc. 139, 11117–11124 (2017).10.1021/jacs.7b04981 ↗
46. Banik, S. et al. Cegann: Crystal edge graph attention neural network for multiscale classification of materials environment. npj Comput. Mater 9, 23 (2023).10.1038/s41524-023-00975-z ↗
47. Yan, L. et al. Extending the mxenes to mo enes with emergent quantum phenomena. ACS Nano 19, 30060–30071 (2025).10.1021/acsnano.5c05603 ↗
48. Yan, L. et al. Thickness-dependent superconductivity and quantum spin hall effects in ti n+ 1 o n (n = 2, 3) moenes. Phys. Rev. B 110, 045421 (2024).10.1103/PhysRevB.110.045421 ↗
49. Yan, L. et al. Two dimensional moene: From superconductors to direct semiconductors and weyl fermions. Nano Lett. 22, 5592–5599 (2022).10.1021/acs.nanolett.2c01914 ↗
50. Schmidt, J., Pettersson, L., Verdozzi, C., Botti, S. & Marques, M. A. Crystal graph attention networks for the prediction of stable materials. Sci. Adv. 7, eabi7948 (2021).10.1126/sciadv.abi7948 ↗
51. Vaswani, A. et al. Attention is all you need. In Advances in Neural Information Processing Systems (eds Guyon, I. et al.) vol. 30 (Curran, 2017).
52. Kuang, W., Wang, Z., Wei, Z., Li, Y. & Ding, B. When transformer meets large graphs: An expressive and efficient two-view architecture. IEEE Trans. Knowledge Data Eng. 36, 5440–5452 (2024).10.1109/TKDE.2024.3381125 ↗
53. Sun, Y., Zhu, D., Wang, Y., Fu, Y. & Tian, Z. Gtc: Gnn-transformer co-contrastive learning for self-supervised heterogeneous graph representation. Neural Netw. 181, 106645 (2025).10.1016/j.neunet.2024.106645 ↗
54. Wang, C. et al. Automatic graph topology-aware transformer. IEEE Trans. Neural Networks Learn. Syst. 36, 8470–8484 (2024).10.1109/TNNLS.2024.3440269 ↗
55. Vinyals, O., Bengio, S. & Kudlur, M. Order matters: Sequence to sequence for sets. International Conference on Learning Representations (2016).
56. Ying, C. et al. Do transformers really perform badly for graph representation? In Advances in Neural Information Processing Systems (eds Ranzato, M., Beygelzimer, A., Dauphin, Y., Liang, P. & Vaughan, J. W.) vol. 34, 28877–28888 (Curran, 2021).
57. Yang, L., Chen, J., Wang, Z. & Shang, F. Subgraph-aware virtual node matching graph attention network for entity alignment. Expert Syst. Appl. 231, 120694 (2023).10.1016/j.eswa.2023.120694 ↗
58. Bahdanau, D., Cho, K. & Bengio, Y. Neural machine translation by jointly learning to align and translate. In International Conference on Learning Representations (eds Bengio, Y. & LeCun, Y.) (2015).