Known Unknowns: Out-of-Distribution Property Prediction in Materials and Molecules
Source abstract
Abstract
Abstract Discovery of high-performance materials and molecules requires identifying extremes with property values that fall outside the known distribution. Therefore, the ability to extrapolate to out-of-distribution (OOD) property values is critical for both solid-state materials and molecular design. Our objective is to train predictor models that extrapolate zero-shot to higher ranges than in the training data, given the chemical compositions of solids or molecular graphs and their property values. We propose using a transductive approach to OOD property prediction, achieving improvements in prediction accuracy. In particular, our method improves extrapolative precision by 1.8× for materials and 1.5× for molecules, and boosts recall of high-performing candidates by up to 3×. Our method leverages analogical input-target relations in the training and test sets, enabling generalization beyond the training target support, and can be applied to any other material and molecular tasks.
Source: crossref · Quality: baseline
Research context
OpenAlex topics: Machine Learning in Materials Science · Computational Drug Discovery Methods · Machine Learning in Bioinformatics
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
References (43)
Show source-provided references
1. Axelrod, S. et al. Learning matter: materials design with machine learning and atomistic simulations. Acc. Mater. Res. 3, 343–357 (2022).10.1021/accountsmr.1c00238 ↗
2. Sanchez-Lengeling, B. & Aspuru-Guzik, A. Inverse molecular design using machine learning: generative models for matter engineering. Science 361, 360–365 (2018).10.1126/science.aat2663 ↗
3. Bilodeau, C., Jin, W., Jaakkola, T., Barzilay, R. & Jensen, K. F. Generative models for molecular discovery: recent advances and challenges. Wiley Interdiscip. Rev.: Comput. Mol. Sci. 12, e1608 (2022).
4. Noh, J., Gu, G. H., Kim, S. & Jung, Y. Machine-enabled inverse design of inorganic solid materials: promises and challenges. Chem. Sci. 11, 4871–4881 (2020).10.1039/D0SC00594K ↗
5. Kim, Y. et al. Deep learning framework for material design space exploration using active transfer learning and data augmentation. npj Computational Mater. 7, 140 (2021).10.1038/s41524-021-00609-2 ↗
6. Louie, S. G., Chan, Y.-H., da Jornada, F. H., Li, Z. & Qiu, D. Y. Discovering and understanding materials through computation. Nat. Mater. 20, 728–735 (2021).10.1038/s41563-021-01015-1 ↗
7. Jacobs, R. et al. Machine learning materials properties with accurate predictions, uncertainty estimates, domain guidance, and persistent online accessibility. Mach. Learn.: Sci. Technol. 5, 045051 (2024).
8. Zeni, C. et al. A generative model for inorganic materials design. Nature 639, 624–632 (2025).10.1038/s41586-025-08628-5 ↗
9. Yang, S. et al. Scalable diffusion for materials generation. In Proc. The Twelfth International Conference on Learning Representations.
10. Xie, T. et al. Crystal diffusion variational autoencoder for periodic material generation. In Proc. International Conference on Learning Representations.
11. Walters, W. P. & Barzilay, R. Applications of deep learning in molecule generation and molecular property prediction. Acc. Chem. Res. 54, 263–270 (2020).10.1021/acs.accounts.0c00699 ↗
12. Dunn, A., Wang, Q., Ganose, A., Dopp, D. & Jain, A. Benchmarking materials property prediction methods: the matbench test set and automatminer reference algorithm. npj Comput. Mater. 6, 138 (2020).10.1038/s41524-020-00406-3 ↗
13. Wang, A. Y.-T., Kauwe, S. K., Murdock, R. J. & Sparks, T. D. Compositionally restricted attention-based network for materials property predictions. Npj Comput. Mater. 7, 77 (2021).10.1038/s41524-021-00545-1 ↗
14. Zhuo, Y., Mansouri Tehrani, A. & Brgoch, J. Predicting the band gaps of inorganic solids by machine learning. J. Phys. Chem. Lett. 9, 1668–1673 (2018).10.1021/acs.jpclett.8b00124 ↗
15. De Breuck, P.-P., Hautier, G. & Rignanese, G.-M. Materials property prediction for limited datasets enabled by feature selection and joint learning with modnet. npj Comput. Mater. 7, 83 (2021).10.1038/s41524-021-00552-2 ↗
16. Ward, L., Agrawal, A., Choudhary, A. & Wolverton, C. A general-purpose machine learning framework for predicting properties of inorganic materials. npj Comput. Mater. 2, 1–7 (2016).10.1038/npjcompumats.2016.28 ↗
17. Kim, K. et al. Machine-learning-accelerated high-throughput materials screening: Discovery of novel quaternary heusler compounds. Phys. Rev. Mater. 2, 123801 (2018).10.1103/PhysRevMaterials.2.123801 ↗
18. Jain, A., Shin, Y. & Persson, K. A. Computational predictions of energy materials using density functional theory. Nat. Rev. Mater. 1, 1–13 (2016).10.1038/natrevmats.2015.4 ↗
19. Sendek, A. D. et al. Holistic computational structure screening of more than 12000 candidates for solid lithium-ion conductor materials. Energy Environ. Sci. 10, 306–320 (2017).10.1039/C6EE02697D ↗
20. Kauwe, S. K., Graser, J., Murdock, R. & Sparks, T. D. Can machine learning find extraordinary materials? Comput. Mater. Sci. 174, 109498 (2020).10.1016/j.commatsci.2019.109498 ↗
21. Zhao, Z.-W., Del Cueto, M. & Troisi, A. Limitations of machine learning models when predicting compounds with completely new chemistries: possible improvements applied to the discovery of new non-fullerene acceptors. Digital Discov. 1, 266–276 (2022).10.1039/D2DD00004K ↗
22. Omee, S. S., Fu, N., Dong, R., Hu, M. & Hu, J. Structure-based out-of-distribution (ood) materials property prediction: a benchmark study. npj Comput. Mater. 10, 144 (2024).10.1038/s41524-024-01316-4 ↗
23. Noda, K., Wakiuchi, A., Hayashi, Y. & Yoshida, R. Advancing extrapolative predictions of material properties through learning to learn using extrapolative episodic training. Commun. Mater. 6, 36 (2025).10.1038/s43246-025-00754-x ↗
24. Li, K. et al. Probing out-of-distribution generalization in machine learning for materials. Commun. Mater 6, 9 (2025).10.1038/s43246-024-00731-w ↗
25. Schultz, L. E., Wang, Y., Jacobs, R. & Morgan, D. A general approach for determining applicability domain of machine learning models. npj Comput. Mater. 11, 95 (2025).10.1038/s41524-025-01573-x ↗
26. Netanyahu, A., Gupta, A., Simchowitz, M., Zhang, K. & Agrawal, P. Learning to extrapolate: A transductive approach. In International Conference on Learning Representations (2023).
27. Oliynyk, A. O. et al. High-throughput machine-learning-driven synthesis of full-heusler compounds. Chem. Mater. 28, 7324–7331 (2016).10.1021/acs.chemmater.6b02724 ↗
28. Goodall, R. E. & Lee, A. A. Predicting materials properties without crystal structure: deep representation learning from stoichiometry. Nat. Commun. 11, 6280 (2020).10.1038/s41467-020-19964-7 ↗
29. Jha, D. et al. Elemnet: Deep learning the chemistry of materials from only elemental composition. Sci. Rep. 8, 17593 (2018).10.1038/s41598-018-35934-y ↗
30. Curtarolo, S. et al. Aflow: An automatic framework for high-throughput materials discovery. Comput. Mater. Sci. 58, 218–226 (2012).10.1016/j.commatsci.2012.02.005 ↗
31. G., C. & S., B. Mechanical properties of some steels https://citrination.com/datasets/153092/show_files/ (2017).
32. Jain, A. et al. Commentary: The materials project: A materials genome approach to accelerating materials innovation. APL materials1 (2013).10.1063/1.4812323 ↗
33. Petousis, I. et al. High-throughput screening of inorganic compounds for the discovery of novel dielectric and optical materials. Sci. data 4, 1–12 (2017).10.1038/sdata.2016.134 ↗
34. Efron, B. Bootstrap methods: another look at the jackknife. In Breakthroughs in statistics: Methodology and distribution, 569–593 (Springer, 1992).10.1007/978-1-4612-4380-9_41 ↗
35. Weininger, D. Smiles, a chemical language and information system. 1. introduction to methodology and encoding rules. J. Chem. Inf. Computer Sci. 28, 31–36 (1988).10.1021/ci00057a005 ↗
36. Ramsundar, B. et al. Deep Learning for the Life Sciences (O’Reilly Media, 2019).
37. Breiman, L. Random forests. Mach. Learn. 45, 5–32 (2001).10.1023/A:1010933404324 ↗
38. Rdkit: Open-source cheminformatics. https://www.rdkit.org.
39. Heid, E. et al. Chemprop: a machine learning package for chemical property prediction. J. Chem. Inf. Modeling 64, 9–17 (2023).10.1021/acs.jcim.3c01250 ↗
40. Damewood, J. et al. Representations of materials for machine learning. Annu. Rev. Mater. Res. 53, 399–426 (2023).10.1146/annurev-matsci-080921-085947 ↗
41. Shimodaira, H. Improving predictive inference under covariate shift by weighting the log-likelihood function. J. Stat. Plan. inference 90, 227–244 (2000).10.1016/S0378-3758(00)00115-4 ↗
42. Shimodaira, H. et al. Dataset Shift in Machine Learning, 201–205. Neural Information Processing Series (Yale University Press in association with the Museum of London, 2009).10.7551/mitpress/7921.003.0017 ↗
43. Gardner, M. W. & Dorling, S. Artificial neural networks (the multilayer perceptron)-a review of applications in the atmospheric sciences. Atmos. Environ. 32, 2627–2636 (1998).10.1016/S1352-2310(97)00447-0 ↗