journal article·2020-09

Extracting Knowledge from DFT: Experimental Band Gap Predictions Through Ensemble Learning

Steven K. Kauwe, Taylor Welker, Taylor D. Sparks

Publisher page

Abstract

The field of materials science has seen an explosion in the amount of accessible high quality data. With this sudden surge of data, the application of machine learning (ML) onto materials data has led to great results. Particular success has been found in training models based on chemical formula. Such models have traditionally focused on learning from density functional theory (DFT) or experimental data. Though some researchers have explored the use of DFT calculated properties as features for learning, this has not gained much traction since the machine learning predictions would be limited by the DFT computation time and accuracy. In this work, we explore the use of a stacked ensemble learning system that combines machine learning from DFT calculations to improve learning on experimental data. This is accomplished by handling the DFT and experimental data separately, training distinct models for each. The DFT models are used to generate a "predicted DFT" value for the formulae in the experimental data. A meta-learner-trained using predictions generated by the experimental models combined with predictions from the DFT models-is shown to improve root-mean-squared-error by over 9% in the test data, when compared to a baseline model that only learns from the training data.
Source: openaire · Quality: candidate unverified · Source record ↗

Research context

OpenAlex topics: Machine Learning in Materials Science · Hydrogen embrittlement and corrosion behaviors in metals · Surface and Thin Film Phenomena

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

References (36)

Show source-provided references
1. Jain A, Ong SP, Hautier G, Chen W, Richards WD, Dacek S, Cholia S, Gunter D, Skinner D, Ceder G et al (2013) Commentary: the materials project: a materials genome approach to accelerating materials innovation. Apl Mater 1:01100210.1063/1.4812323 ↗
2. Jain A, Persson KA, Ceder G (2016) Research update: the materials genome initiative: data sharing and the impact of collaborative ab initio databases. APL Mater 4:05310210.1063/1.4944683 ↗
3. Seshadri R, Sparks TD (2016) Perspective: interactive material property databases through aggregation of literature data. APL Mater 4:05320610.1063/1.4944682 ↗
4. Jain A, Hautier G, Ong SP, Persson K (2016) New opportunities for materials informatics: resources and data mining techniques for uncovering hidden relationships. J Mater Res 31:977–99410.1557/jmr.2016.80 ↗
5. Hautier G, Fischer CC, Jain A, Mueller T, Ceder G (2010) Finding nature’s missing ternary oxide compounds using machine learning and density functional theory. Chem Mater 22:3762–376710.1021/cm100795d ↗
6. Chen W, Pöhls J-H, Hautier G, Broberg D, Bajaj S, Aydemir U, Gibbs ZM, Zhu H, Asta M, Snyder GJ et al (2016) Understanding thermoelectric properties from high-throughput calculations: trends, insights, and comparisons with experiment. J Mater Chem C 4:4414–442610.1039/C5TC04339E ↗
7. Hautier G, Jain A, Ong SP (2012) From the computer to the laboratory: materials discovery and design using first-principles calculations. J Mater Sci 47:7317–734010.1007/s10853-012-6424-0 ↗
8. Curtarolo S, Hart GLW, Nardelli MB, Mingo N, Sanvito S, Levy O (2013) The high-throughput highway to computational materials design. Nat Mater 12:19110.1038/nmat3568 ↗
9. Isaacs EB, Wolverton C (2018) Inverse band structure design via materials database screening: application to square planar thermoelectrics. Chem Mater 30:1540–154610.1021/acs.chemmater.7b04496 ↗
10. Meredig B, Agrawal A, Kirklin S, Saal JE, Doak JW, Thompson A, Zhang K, Choudhary A, Wolverton C (2014) Combinatorial screening for new materials in unconstrained composition space with machine learning. Phys Rev B 89:09410410.1103/PhysRevB.89.094104 ↗
11. Schütt KT, Glawe H, Brockherde F, Sanna A, Müller KR, Gross EKU (2014) How to represent crystal structures for machine learning: towards fast prediction of electronic properties. Phys Rev B 89:20511810.1103/PhysRevB.89.205118 ↗
12. Citrine (2018). https://citrination.com. Accessed 20 Dec 2019
13. Curtarolo S et al (2012) AFLOW: an automatic framework for high-throughput materials discovery. Comp Mater Sci 58:218–22610.1016/j.commatsci.2012.02.005 ↗
14. Kauwe SK, Graser J, Vazquez A, Sparks TD (2018) Machine learning prediction of heat capacity for solid inorganics. Integr Mater Manuf Innov 7:1–910.1007/s40192-018-0108-9 ↗
15. Ward L, Agrawal A, Choudhary A, Wolverton C (2016) A general-purpose machine learning framework for predicting properties of inorganic materials. NPJ Comput Mater 2:1602810.1038/npjcompumats.2016.28 ↗
16. Kauwe SK (2019) “kaaiian/ensemble_band_gap_prediction: Supplementary code for” Extracting knowledge from DFT: experimental band gap predictions through ensemble learning. https://doi.org/10.5281/zenodo.265666910.5281/zenodo.2656669 ↗
17. Oliynyk AO, Mar A (2017) Discovery of intermetallic compounds from traditional to machine-learning approaches. Acc Chem Res 51:59–6810.1021/acs.accounts.7b00490 ↗
18. Oliynyk AO, Adutwum LA, Rudyk BW, Pisavadia H, Lotfi S, Hlukhyy V, Harynuk JJ, Mar A, Brgoch J (2017) Disentangling structural confusion through machine learning: structure prediction and polymorphism of equiatomic ternary phases ABC. J Am Chem Soc 139:17870–1788110.1021/jacs.7b08460 ↗
19. Carrete J, Li W, Mingo N, Wang S, Curtarolo S (2014) Finding unprecedentedly low-thermal-conductivity half-Heusler semiconductors via high-throughput materials modeling. Phys Rev X 4:011019
20. Mansouri Tehrani A, Oliynyk AO, Parry M, Rizvi Z, Couper S, Lin F, Miyagi L, Sparks TD, Brgoch J (2018) Machine learning directed search for ultraincompressible, superhard materials. J Am Chem Soc 140:9844–985310.1021/jacs.8b02717 ↗
21. Graser J, Kauwe SK, Sparks TD (2018) Machine learning and energy minimization approaches for crystal structure predictions: a review and new horizons. Chem Mater 30:3601–361210.1021/acs.chemmater.7b05304 ↗
22. Huo H, Rupp M (2017) Unified representation of molecules and crystals for machine learning. arXiv:1704.06439
23. Isayev O, Oses C, Toher C, Gossett E, Curtarolo S, Tropsha A (2017) Universal fragment descriptors for predicting properties of inorganic crystals. Nat Commun 8:1567910.1038/ncomms15679 ↗
24. Faber F, Lindmaa A, Lilienfeld OA, Armiento R (2015) Crystal structure representations for machine learning models of formation energies. Int J Quantum Chem 115:1094–110110.1002/qua.24917 ↗
25. Faber FA, Christensen AS, Huang B, Lilienfeld OA (2018) Alchemical and structural distribution based representation for universal quantum machine learning. J Chem Phys 148:24171710.1063/1.5020710 ↗
26. Jha D, Ward L, Paul A, Liao W-K, Choudhary A, Wolverton C, Agrawal A (2018) Elemnet: deep learning the chemistry of materials from only elemental composition. Sci Rep 8:1759310.1038/s41598-018-35934-y ↗
27. Lee J, Seko A, Shitara K, Nakayama K, Tanaka I (2016) Prediction model of band gap for inorganic compounds by combination of density functional theory calculations and machine learning techniques. Phys Rev B 93:11510410.1103/PhysRevB.93.115104 ↗
28. Seko A, Maekawa T, Tsuda K, Tanaka I (2014) Machine learning with systematic density-functional theory calculations: application to melting temperatures of single-and binary-component solids. Phys Rev B 89:05430310.1103/PhysRevB.89.054303 ↗
29. Hutchinson ML, Antono E, Gibbons BM, Paradiso S, Ling J, Meredig B (2017) Overcoming data scarcity with transfer learning. arXiv:1711.05099
30. Ramakrishnan R, Dral PO, Rupp M, von Lilienfeld OA (2015) Big data meets quantum chemistry approximations: the Δ-machine learning approach. J Chem Theory Comput 11:2087–209610.1021/acs.jctc.5b00099 ↗
31. Zaspel P, Huang B, Harbrecht H, Lilienfeld OA (2018) Boosting quantum machine learning models with multi-level combination technique: pople diagrams revisited. J Chem Theory Comput 15(3):1546–155910.1021/acs.jctc.8b00832 ↗
32. Pilania G, Gubernatis JE, Lookman T (2017) Multi-fidelity machine learning models for accurate bandgap predictions of solids. Comput Mater Sci 129:156–16310.1016/j.commatsci.2016.12.004 ↗
33. Zhuo Y, Mansouri Tehrani A, Brgoch J (2018) Predicting the band gaps of inorganic solids by machine learning. J Phys Chem Lett 9:1668–167310.1021/acs.jpclett.8b00124 ↗
34. DeCost BL, Francis T, Holm EA (2017) Exploring the microstructure manifold: image texture representations applied to ultrahigh carbon steel microstructures. Acta Mater 133:30–4010.1016/j.actamat.2017.05.014 ↗
35. Kauwe SK (2019) Ensemble band gap data. https://figshare.com/articles/Ensemble_Band_Gap_Data/8295503. Accessed 1 Feb 2020
36. Pedregosa F, Varoquaux G, Gramfort A, Michel V, Thirion B, Grisel O, Blondel M, Prettenhofer P, Weiss R, Dubourg V, Vanderplas J, Passos A, Cournapeau D, Brucher M, Perrot M, Duchesnay E (2011) Scikit-learn: machine learning in python. J Mach Learn Res 12:2825–2830