Integrating transfer learning and uncertainty quantification for data-efficient materials discovery
Source abstract
Abstract
Abstract A major challenge in machine learning for materials lies in the simultaneous use of large, lower-accuracy datasets and small, high-accuracy datasets for data-efficient screening. Here, we show that the combination of transfer learning and uncertainty quantification enables highly efficient multi-fidelity materials screening. Using band gap prediction as a representative application, a model pre-trained on generalized gradient approximation density functional theory (GGA-DFT) data was fine-tuned on experimental and higher-level DFT datasets. The transfer learning model reduced the MAE by approximately 39% on the experimental dataset (0.833 ± 0.104 eV–0.502 ± 0.063 eV) and by 54% on the strongly constrained and appropriately normed (SCAN) dataset (0.716 ± 0.093 eV–0.331 ± 0.031 eV) relative to the respective target models trained from scratch, and matched or exceeded the best accuracy reported in the literature without requiring feature engineering. Ensemble-based uncertainty estimates guide the screening process and minimize the need for new calculations. In a photovoltaic case study, only six additional meta-GGA calculations are required to identify multiple DFT-validated candidate materials with band gaps near the target value. More broadly, this work establishes a general, data-efficient strategy applicable for accelerating materials discovery by leveraging heterogeneous datasets.
Source: crossref · Quality: baseline
Research context
OpenAlex topics: Machine Learning in Materials Science · Advanced Electron Microscopy Techniques and Applications · X-ray Diffraction in Crystallography
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
Affiliations
Tulane University
Funding
National Science Foundation
References (53)
Show source-provided references
1. Artificial intelligence for materials discovery, development, and optimization10.1021/acsnano.5c04200 ↗
2. Machine learning‐enhanced prediction of inorganic semiconductor bandgaps for advancing optoelectronic technologies10.1002/adts.202400190 ↗
3. Advancing solid-state band gap predictions10.1073/pnas.2113648118 ↗
4. Accurate prediction of band gap of materials using stacking machine learning model10.1016/j.commatsci.2021.110899 ↗
5. Predicting the band gaps of inorganic solids by machine learning10.1021/acs.jpclett.8b00124 ↗
6. Moving closer to experimental level materials property prediction using AI10.1038/s41598-022-15816-0 ↗
7. Transfer learning: a new promising techniques10.58496/MJBD/2023/004 ↗
8. Cross-property deep transfer learning framework for enhanced predictive analytics on small materials data10.1038/s41467-021-26921-5 ↗
9. Structure-aware graph neural network based deep transfer learning framework for enhanced predictive analytics on diverse materials datasets10.1038/s41524-023-01185-3 ↗
10. Optimal pre-train/fine-tune strategies for accurate material property predictions10.1038/s41524-024-01486-1 ↗
11. Transfer learning with graph neural networks for improved molecular property prediction in the multi-fidelity setting10.1038/s41467-024-45566-8 ↗
12. Predicting materials properties with little data using shotgun transfer learning10.1021/acscentsci.9b00804 ↗
13. Enhancing materials property prediction by leveraging computational and experimental data using deep transfer learning10.1038/s41467-019-13297-w ↗
14. Materials representation and transfer learning for multi-property prediction10.1063/5.0047066 ↗
15. Application of deep transfer learning to predicting crystal structures of inorganic substances10.1016/j.commatsci.2021.110476 ↗
16. Transfer learning for materials informatics using crystal graph convolutional neural network10.1016/j.commatsci.2021.110314 ↗
17. Transfer learning on large datasets for the accurate prediction of material properties10.1039/D3DD00030C ↗
18. Pretraining strategies for structure agnostic material property prediction10.1021/acs.jcim.3c00919 ↗
19. A transfer learning approach for microstructure reconstruction and structure-property predictions10.1038/s41598-018-31571-7 ↗
20. Uncertainty-quantified hybrid machine learning/density functional theory high throughput screening method for crystals10.1021/acs.jcim.0c00003 ↗
21. Clarifying trust of materials property predictions using neural networks with distribution-specific uncertainty quantification10.1088/2632-2153/accace ↗
22. Uncertainty-informed deep learning models enable high-confidence predictions for digital histopathology10.1038/s41467-022-34025-x ↗
23. A review of uncertainty quantification in deep learning: techniques, applications and challenges10.1016/j.inffus.2021.05.008 ↗
24. Advances in variational inference10.1109/TPAMI.2018.2889774 ↗
25. Accelerating high-entropy alloy discovery: efficient exploration via active learning10.1016/j.scriptamat.2024.116180 ↗
26. A fundamental overview of ensemble deep learning models and applications: systematic literature and state of the art10.1007/s10479-024-06444-0 ↗
27. Methods for comparing uncertainty quantifications for material property predictions10.1088/2632-2153/ab7e1a ↗
28. A universal similarity based approach for predictive uncertainty quantification in materials science10.1038/s41598-022-19205-5 ↗
29. Uncertainty quantification in multivariable regression for material property prediction with Bayesian neural networks10.1038/s41598-024-61189-x ↗
30. Enhanced thermophysical property prediction with uncertainty quantification using group contribution-Gaussian process regression10.1039/D5ME00126A ↗
31. Volcano-seismic transfer learning and uncertainty quantification with bayesian neural networks10.1109/TGRS.2019.2941494 ↗
32. Data imbalance uncertainty quantification, and transfer learning in data‐driven parameterizations: lessons from the emulation of gravity wave momentum transport in WACCM10.1029/2023MS004145 ↗
33. An uncertainty-aware transfer learning-based framework for COVID-19 diagnosis10.1109/TNNLS.2021.3054306 ↗
34. Application of deep transfer learning and uncertainty quantification for process identification in powder bed fusion10.1115/1.4051748 ↗
35. Electronic structure prediction of multi-million atom systems through uncertainty quantification enabled transfer learning10.1038/s41524-024-01305-7 ↗
36. The materials project: a materials genome approach to accelerating materials innovation10.1063/1.4812323 ↗
37. Large-scale benchmark of exchange–correlation functionals for the determination of electronic band gaps of solids10.1021/acs.jctc.9b00322 ↗
38. Physical content of the exact Kohn-Sham orbital energies: band gaps and derivative discontinuities10.1103/PhysRevLett.51.1884 ↗
39. Machine learning approach for screening alloy surfaces for stability in catalytic reaction conditions10.1088/2515-7655/aca122 ↗
40. PROFiT-net: property-networking deep learning model for materials10.1021/jacs.4c05159 ↗
41. Tensorflow: large-scale machine learning on heterogeneous distributed systems
42. ElemNet: deep learning the chemistry of materials from only elemental composition10.1038/s41598-018-35934-y ↗
43. Uncertainty toolbox: an open-source library for assessing, visualizing, and improving uncertainty quantification
44. Autodeuq: automated deep ensemble with uncertainty quantification
45. Efficiency of Ab-initio total energy calculations for metals and semiconductors using a plane-wave basis set10.1016/0927-0256(96)00008-0 ↗
46. From ultrasoft pseudopotentials to the projector augmented-wave method10.1103/PhysRevB.59.1758 ↗
47. Generalized gradient approximation made simple10.1103/PhysRevLett.77.3865 ↗
48. Strongly constrained and appropriately normed semilocal density functional10.1103/PhysRevLett.115.036402 ↗
49. Machine learning band gaps from the electron density10.1103/PhysRevMaterials.5.083802 ↗
50. A simple denoising approach to exploit multi-fidelity data for machine learning materials propertieS10.1038/s41524-022-00925-1 ↗
51. Tabulated values of the Shockley–Queisser limit for single junction solar cells10.1016/j.solener.2016.02.015 ↗
52. Solar materials find their band gap10.1016/j.joule.2020.05.001 ↗
53. Growth and photovoltaic device using Cu3VS4 films prepared via co-sputtering from Cu–V and V targets10.1016/j.matchemphys.2021.125547 ↗