Active learning in materials science with emphasis on adaptive sampling using uncertainties for targeted design
Source abstract
Abstract
Abstract One of the main challenges in materials discovery is efficiently exploring the vast search space for targeted properties as approaches that rely on trial-and-error are impractical. We review how methods from the information sciences enable us to accelerate the search and discovery of new materials. In particular, active learning allows us to effectively navigate the search space iteratively to identify promising candidates for guiding experiments and computations. The approach relies on the use of uncertainties and making predictions from a surrogate model together with a utility function that prioritizes the decision making process on unexplored data. We discuss several utility functions and demonstrate their use in materials science applications, impacting both experimental and computational research. We summarize by indicating generalizations to multiple properties and multifidelity data, and identify challenges, future directions and opportunities in the emerging field of materials informatics.
Source: crossref · Quality: baseline
Research context
OpenAlex topics: Machine Learning in Materials Science · Machine Learning and Algorithms · Computational Drug Discovery Methods
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
References (100+)
Show source-provided references
1. OSTP. Materials Genome Initiative for Global Competitiveness (https://www.whitehouse.gov/sites/default/files/microsites/ostp/materials_genome_initiative-final.pdf) (2011).
2. Curtarolo, S. et al. AFLOWLIB.ORG: a distributed materials property repository from high-throughput ab initio calculations. Comput. Mater. Sci. 58, 227–235 (2012).10.1016/j.commatsci.2012.02.002 ↗
3. Jain, A. et al. Commentary: The Materials Project: a materials genome approach to accelerating materials innovation. APL Mater. 1 (2013).10.1063/1.4812323 ↗
4. Saal, J. E., Kirklin, S., Aykol, M., Meredig, B. & Wolverton, C. Materials design and discovery with high-throughput density functional theory: The Open Quantum Materials Database (OQMD). JOM 65, 1501–1509 (2013).10.1007/s11837-013-0755-4 ↗
5. Green, M. L. et al. Fulfilling the promise of the materials genome initiative with high-throughput experimental methodologies. Appl. Phys. Rev. 4, 011105 (2017).10.1063/1.4977487 ↗
6. Atkinson, A. & Donev, A. Optimum Experimental Designs. (Oxford University Press, Oxford, 1992).10.1093/oso/9780198522546.001.0001 ↗
7. Park, J.-M. & Hu, Y. H. On-line learning for active pattern recognition. IEEE Signal Process. Lett. 3, 301–303 (1996).10.1109/97.542161 ↗
8. Menache, I., Mannor, S. & Shimkin, N. Basis function adaptation in temporal difference reinforcement learning. Ann. Oper. Res. 134, 215–238 (2005).10.1007/s10479-005-5732-z ↗
9. Kaelbling, L. Learning in Embedded Systems. (MIT Press, Cambridge, MA, 1993).10.7551/mitpress/4168.001.0001 ↗
10. Murphy, R. F. An active role for machine learning in drug development. Nat. Chem. Biol. 7, 327 (2011).10.1038/nchembio.576 ↗
11. Mohamed, T. P., Carbonell, J. G. & Ganapathiraju, M. K. Active learning for human protein–protein interaction prediction. BMC Bioinform. 11, S57 (2010).10.1186/1471-2105-11-S1-S57 ↗
12. Stegle, O., Payet, L., Mergny, J.-L., MacKay, D. J. C. & Huppert, J. L. Predicting and understanding the stability of G-quadruplexes. Bioinformatics 25, i374–i1382 (2009).10.1093/bioinformatics/btp210 ↗
13. Liu, Y. Active learning with support vector machine applied to gene expression data for cancer classification. J. Chem. Inf. Comput. Sci. 44, 1936–1941 (2004).10.1021/ci049810a ↗
14. Forrester, A. I. J., Sóbester, A. & Keane, A. J. Engineering Design via Surrogate Modelling: A Practical Guide (Wiley, Hoboken, 2008).10.1002/9780470770801 ↗
15. Nishijima, M. et al. Accelerated discovery of cathode materials with prolonged cycle life for lithium-ion battery. Nat. Commun. 5, 4553 (2014).10.1038/ncomms5553 ↗
16. Sanvito, S. et al. Accelerated discovery of new magnets in the Heusler alloy family. Sci. Adv. 3 (2017).10.1126/sciadv.1602241 ↗
17. Sharma, V. et al. Rational design of all organic polymer dielectrics. Nat. Commun. 5, 4845 (2014).10.1038/ncomms5845 ↗
18. Sparks, T. D., Gaultois, M. W., Oliynyk, A., Brgoch, J. & Meredig, B. Data mining our way to the next generation of thermoelectrics. Scr. Mater. 111, 10–15 (2016).10.1016/j.scriptamat.2015.04.026 ↗
19. Rajan, K. Materials informatics: the materials “gene” and big data. Annu. Rev. Mater. Res. 45, 153–169 (2015).10.1146/annurev-matsci-070214-021132 ↗
20. Kalidindi, S. R. & Graef, M. D. Materials data science: current status and future outlook. Annu. Rev. Mater. Res. 45, 171–193 (2015).10.1146/annurev-matsci-070214-020844 ↗
21. Ramprasad, R., Batra, R., Pilania, G., Mannodi-Kanakkithodi, A. & Kim, C. Machine learning in materials informatics: recent applications and prospects. npj Comput. Mater. 3, 54 (2017).10.1038/s41524-017-0056-5 ↗
22. Hill, J. et al. Materials science with large-scale data and informatics: unlocking new opportunities. MRS Bull. 41, 399–409 (2016).10.1557/mrs.2016.93 ↗
23. Ward, L. & Wolverton, C. Atomistic calculations and materials informatics: a review. Curr. Opin. Solid State Mater. Sci. 21, 167–176 (2017).10.1016/j.cossms.2016.07.002 ↗
24. Lookman, T., Balachandran, P. V., Xue, D., Hogden, J. & Theiler, J. Statistical inference and adaptive design for materials discovery. Curr. Opin. Solid State Mater. Sci. 21, 121–128 (2017).10.1016/j.cossms.2016.10.002 ↗
25. Aggarwal, R., Demkowicz, M. J. & Marzouk, Y. M. Information-Driven Experimental Design in Materials Science, 13–44 (Springer, New York, 2016).10.1007/978-3-319-23871-5_2 ↗
26. Balachandran, P. V., Young, J., Lookman, T. & Rondinelli, J. M. Learning from data to design functional materials without inversion symmetry. Nat. Commun. 8, 14282 (2017).10.1038/ncomms14282 ↗
27. Xue, D. et al. Accelerated search for materials with targeted properties by adaptive design. Nat. Commun. 7, 11241 (2016).10.1038/ncomms11241 ↗
28. Dehghannasiri, R. et al. Optimal experimental design for materials discovery. Comput. Mater. Sci. 129, 311–322 (2017).10.1016/j.commatsci.2016.11.041 ↗
29. Xue, D. et al. An informatics approach to transformation temperatures of NiTi-based shape memory alloys. Acta Mater. 125, 532–541 (2017).10.1016/j.actamat.2016.12.009 ↗
30. Xue, D. et al. Accelerated search for BaTiO3-based piezoelectrics with vertical morphotropic phase boundary using Bayesian learning. Proc. Natl Acad. Sci. 113, 13301–13306 (2016).10.1073/pnas.1607412113 ↗
31. Rouet-Leduc, B., Barros, K., Lookman, T. & Humphreys, C. J. Optimisation of gan leds and the reduction of efficiency droop using active machine learning. Sci. Rep. 6, 24862 (2016).10.1038/srep24862 ↗
32. Rouet-Leduc, B., Hulbert, C., Barros, K., Lookman, T. & Humphreys, C. J. Automatized convergence of optoelectronic simulations using active machine learning. Appl. Phys. Lett. 111, 043506 (2017).10.1063/1.4996233 ↗
33. Ueno, T., Rhone, T. D., Hou, Z., Mizoguchi, T. & Tsuda, K. COMBO: an efficient Bayesian optimization library for materials science. Mater. Discov. 4, 18–21 (2016).10.1016/j.md.2016.04.001 ↗
34. Ling, J., Hutchinson, M., Antono, E., Paradiso, S. & Meredig, B. High-dimensional materials and process optimization using data-driven experimental design with well-calibrated uncertainty estimates. Integr. Mater. Manuf. Innov. 6, 207–217 (2017).10.1007/s40192-017-0098-z ↗
35. Yuan, R. et al. Accelerated discovery of large electrostrains in BaTiO3-based piezoelectrics using active learning. Adv. Mater. 1702884 (2018).10.1002/adma.201702884 ↗
36. Balachandran, P. V., Kowalski, B., Sehirlioglu, A. & Lookman, T. Experimental search for high-temperature ferroelectric perovskites guided by two-step machine learning. Nat. Commun. 9, 1668 (2018).10.1038/s41467-018-03821-9 ↗
37. McDowell, D. L. et al. Integrated Design of Multiscale, Multifunctional Materials and Products (Butterworth-Heinemann, 2009).
38. Jones, D. R., Schonlau, M. & Welch, W. J. Efficient global optimization of expensive black-box functions. J. Glob. Optim. 13, 455–492 (1998).10.1023/A:1008306431147 ↗
39. Casciato, M. J., Kim, S., Lu, J. C., Hess, D. W. & Grover, M. A. Optimization of a carbon dioxide-assisted nanoparticle deposition process using sequential experimental design with adaptive design space. Ind. Eng. Chem. Res. 51, 4363–4370 (2012).10.1021/ie2028574 ↗
40. Brochu, E., Cora, V. M. & de Freitas, N. A tutorial on Bayesian optimization of expensive cost functions, with application to active user modeling and hierarchical reinforcement learning. ArXiv e-prints (2010).
41. Chaloner, K. & Verdinelli, I. Bayesian experimental design: a review. Stat. Sci. 10, 273–304 (1995).10.1214/ss/1177009939 ↗
42. Lindley, D. V. On a measure of the information provided by an experiment. Ann. Math. Stat. 27, 986–1005 (1956).10.1214/aoms/1177728069 ↗
43. Frazier, P., Powell, W. & Dayanik, S. The knowledge gradient policy for correlated normal beliefs. INFORMS J. Comput. 21, 599–613 (2009).10.1287/ijoc.1080.0314 ↗
44. Huan, X. & Marzouk, Y. M. Simulation-based optimal Bayesian experimental design for nonlinear systems. J. Comput. Phys. 232, 288–317 (2013).10.1016/j.jcp.2012.08.013 ↗
45. Cavazzuti, M. Optimization Methods. (Springer, Berlin, Heidelberg, 2013).10.1007/978-3-642-31187-1 ↗
46. Fisher, R. The Design of Experiments, 5th ed. (Oliver & Boyd, Oxford, 1949).
47. Box, G. E. P. & Wilson, K. B. On the experimental attainment of optimum conditions. J. R. Stat. Soc. Ser. B (Methodol.) 13, 1–45 (1951).10.1111/j.2517-6161.1951.tb00067.x ↗
48. Kackar, R. N. Off-line quality control, parameter design, and the Taguchi method. J. Qual. Technol. 17, 176–188 (1985).10.1080/00224065.1985.11978964 ↗
49. Kushner, H. A new method of locating the maximum of an arbitrary multi- peak curve in the presence of noise. J. Basic Eng. 86, 97–106 (1964).10.1115/1.3653121 ↗
50. Mockus, J., Tiesis, V. & Zilinskas, A. in Towards Global Optimisation, Vol. 2 (eds Dixon, L. & Szego, G.) 117–129 (Elsevier Science Ltd., North Holland, Amsterdam, 1978).
51. Snoek, J., Larochelle, H. & Adams, R. Practical bayesian optimization of machine learning algorithms. Adv. Neural Inf. Process. Syst. 2951–2959 (2012).
52. Howard, R. Information value theory. IEEE Trans. Syst. Sci. Cybern. 2, 22–26 (1966).10.1109/TSSC.1966.300074 ↗
53. Lindley, D. V. & Smith, A. F. M. Bayes estimates for the linear model. J. R. Stat. Soc. Ser. B 34, 1–41 (1972).10.1111/j.2517-6161.1972.tb00885.x ↗
54. Clyde, M. A. Experimental design: a Bayesian perspective (2007).
55. O’Hagan, A. & Kingman, J. F. C. Curve fitting and optimal design for prediction. J. R. Stat. Soc. Ser. B 40, 1–42 (1978).10.1111/j.2517-6161.1978.tb01643.x ↗
56. Mockus, J. Application of Bayesian approach to numerical methods of global and stochastic optimization. J. Glob. Optim. 4, 347–365 (1994).10.1007/BF01099263 ↗
57. Kaelbling, L. P., Littman, M. L. & Moore, A. W. Reinforcement learning: a survey. J. Artif. Intell. Res. 4, 237–285 (1996).10.1613/jair.301 ↗
58. Sutton, R. S. Learning to predict by the methods of temporal differences. Mach. Learn. 3, 9–44 (1988).
59. Powell, W. B. & Ryzhov, I. O. Optimal Learning (Wiley, Hoboken, 2012).10.1002/9781118309858 ↗
60. Scott, W., Frazier, P. I. & Powell, W. The correlated knowledge gradient for simulation optimization of continuous parameters using gaussian process regression. SIAM J. Optim. 21, 996–1026 (2011).10.1137/100801275 ↗
61. Letham, B., Karrery, B., Ottoniz, G. & Bakshyx, E. Constrained Bayesian optimization with noisy experiments abs/1706.07094v1 (2017).
62. Yoon, B. J., Qian, X. & Dougherty, E. R. Quantifying the objective cost of uncertainty in complex dynamical systems. IEEE Trans. Signal Process. 61, 2256–2266 (2013).10.1109/TSP.2013.2251336 ↗
63. Dehghannasiri, R., Yoon, B.-J. & Dougherty, E. R. Optimal experimental design for gene regulatory networks in the presence of uncertainty. IEEE/ACM Trans. Comput. Biol. Bioinform. 12, 938–950 (2015).10.1109/TCBB.2014.2377733 ↗
64. Dehghannasiri, R., Yoon, B.-J. & Dougherty, E. R. Efficient experimental design for uncertainty reduction in gene regulatory networks. BMC Bioinform. 16, S2 (2015).10.1186/1471-2105-16-S13-S2 ↗
65. Efron, B. & Gong, G. A leisurely look at the bootstrap, the jackknife, and cross-validation. Am. Stat. 37, 36–48 (1983).10.1080/00031305.1983.10483087 ↗
66. Piprek, J. Nitride Semiconductor Devices: Principles and Simulation (Wiley, Hoboken, 2007).10.1002/9783527610723 ↗
67. Wild, S. M., Sarich, J. & Schunck, N. Derivative-free optimization for parameter estimation in computational nuclear physics. J. Phys. G 42, 034031 (2015).10.1088/0954-3899/42/3/034031 ↗
68. Pang, G., Perdikaris, P., Cai, W. & Karniadakis, G. E. Discovering variable fractional orders of advection–dispersion equations from field data using multi-fidelity bayesian optimization. J. Comput. Phys. 348, 694–714 (2017).10.1016/j.jcp.2017.07.052 ↗
69. Gosavi, A. Simulation-based Optimization: Parametric Optimization Techniques and Reinforcement Learning. (Operations Research/Computer Science Interfaces Series, ISBN-13: 978-1489974907, Second Edition 2015).10.1007/978-1-4899-7491-4 ↗
70. Sacks, J., Welch, W. J., Mitchell, T. J. & Wynn, H. P. Design and analysis of computer experiments. Stat. Sci. 4, 1–11 (2018).
71. Hutter, F., Hoos, H. H. & Leyton-Brown, K. Sequential model-based optimization for general algorithm configuration. in International Conference on Learning and Intelligent Optimization, 507–523 (Springer, 2011).10.1007/978-3-642-25566-3_40 ↗
72. Bergstra, J. S., Bardenet, R., Bengio, Y. & Kégl, B. Algorithms for hyper-parameter optimization. in Advances in Neural Information Processing Systems, 2546–2554 (2011).
73. de Jong, M. et al. A statistical learning framework for materials science: application to elastic moduli of k-nary inorganic polycrystalline compounds. Sci. Rep. 6, 34256 (2016).10.1038/srep34256 ↗
74. Ward, L., Agrawal, A., Choudhary, A. & Wolverton, C. A general-purpose machine learning framework for predicting properties of inorganic materials. npj Comput. Mater. 2, 16028 (2016).10.1038/npjcompumats.2016.28 ↗
75. Seko, A., Hayashi, H., Nakayama, K., Takahashi, A. & Tanaka, I. Representation of compounds for machine-learning prediction of physical properties. Phys. Rev. B 95, 144110 (2017).10.1103/PhysRevB.95.144110 ↗
76. Balachandran, P. V., Shearman, T., Theiler, J. & Lookman, T. Predicting displacements of octahedral cations in ferroelectric perovskites using machine learning. Acta Crystallogr. Sect. B 73, 962–967 (2017).10.1107/S2052520617011945 ↗
77. Balachandran, P. V. et al. in Materials Discovery and Design, 59–79 (Springer, New York, 2018).10.1007/978-3-319-99465-9_3 ↗
78. White, T., Ferraris, C., Kim, J. & Madhavi, S. Apatite—an adaptive framework structure. Rev. Mineral. Geochem. 57, 307–401 (2005).10.2138/rmg.2005.57.10 ↗
79. Shannon, R. D. Revised effective ionic radii and systematic studies of interatomic distances in halides and chalcogenides. Acta Cryst. A 32, 751–767 (1976).10.1107/S0567739476001551 ↗
80. Seko, A., Maekawa, T., Tsuda, K. & Tanaka, I. Machine learning with systematic density-functional theory calculations: Application to melting temperatures of single- and binary-component solids. Phys. Rev. B 89, 054303 (2014).10.1103/PhysRevB.89.054303 ↗
81. Seko, A. et al. Prediction of low-thermal-conductivity compounds with first-principles anharmonic lattice-dynamics calculations and bayesian optimization. Phys. Rev. Lett. 115, 205901 (2015).10.1103/PhysRevLett.115.205901 ↗
82. Kiyohara, S., Oda, H., Tsuda, K. & Mizoguchi, T. Acceleration of stable interface structure searching using a kriging approach. Jpn J. Appl. Phys. 55, 045502 (2016).10.7567/JJAP.55.045502 ↗
83. Wager, S., Hastie, T. & Efron, B. Confidence intervals for random forests: the jackknife and the infinitesimal jackknife. J. Mach. Learn. Res. 15, 1625–1651 (2014).
84. Xue, D., Tian, Y., Yuan, R. & Lookman, T. Bayesian optimization in designing shape memory alloy. (eds. Foiles, S., McDowell, D., Strachan, A.). Model. Simul. Mater. Sci. Eng. (2019).
85. Yamawaki, M., Ohnishi, M., Ju, S. & Shiomi, J. Multifunctional structural design of graphene thermoelectrics by Bayesian optimization. Sci. Adv. 4, 1–8 (2018).10.1126/sciadv.aar4192 ↗
86. Herbol, H. C., Hu, W., Frazier, P., Clancy, P. & Poloczek, M. Efficient search of compositional space for hybrid organic–inorganic perovskites via Bayesian optimization. npj Comput. Mater. 4, 51 (2018).10.1038/s41524-018-0106-7 ↗
87. Ren, F. et al. Accelerated discovery of metallic glasses through iteration of machine learning and high-throughput experiments. Sci. Adv. 4, 1–11 (2018).10.1126/sciadv.aaq1566 ↗
88. Chen, S., Reyes, K., Gupta, M., McAlpine, M. & Powell, W. Optimal learning in experimental design using the knowledge gradient policy with application to characterizing nanoemulsion stability. SIAM/ASA J. Uncertainty Quant. 3, 320–345 (2015).
89. Wang, Y., Reyes, K., Brown, K., Mirkin, C. & Powell, W. Nested-batch-mode learning and stochastic optimization with an application to sequential multistage testing in materials science. SIAM J. Sci. Comput. 37, B361–B381 (2015).10.1137/140971117 ↗
90. Wang, Y. et al. Identifying interphase properties in polymer nanocomposites using adaptive optimization. Compos. Sci. Technol. 162, 146–155 (2018).10.1016/j.compscitech.2018.04.017 ↗
91. Mannodi-Kanakkithodi, A., Pilania, G., Huan, T. D., Lookman, T. & Ramprasad, R. Machine learning strategy for accelerated design of polymer dielectrics. Sci. Rep. 6, 20952 EP (2016).10.1038/srep20952 ↗
92. Podryabinkin, E. V. & Shapeev, A. V. Active learning of linearly parametrized interatomic potentials. Comput. Mater. Sci. 140, 171–180 (2017).10.1016/j.commatsci.2017.08.031 ↗
93. Smith, J. S., Nebgen, B., Lubbers, N., Isayev, O. & Roitberg, A. E. Less is more: sampling chemical space with active learning. J. Chem. Phys. 148, 241733 (2018).10.1063/1.5023802 ↗
94. Garud, S. S., Karimi, I. A. & Kraft, M. Design of computer experiments: a review. Comput. Chem. Eng. 106, 71–95 (2017).10.1016/j.compchemeng.2017.05.010 ↗
95. Santner, T. J., Williams, B. J. & Notz, W. I. The Design and Analysis of Computer Experiments (Springer, New York, 2018, ISBN: 978-1-4939-8845-7, first edition 2003).
96. Bursztyn, D. & Steinberg, D. M. Comparison of designs for computer experiments. J. Stat. Plan. Inference 136, 1103–1119 (2006).10.1016/j.jspi.2004.08.007 ↗
97. Theiler, J. & Zimmer, B. G. Selecting the selector: comparison of update rules for discrete global optimization. Stat. Anal. Data Min. 10, 211–229 (2017).10.1002/sam.11343 ↗
98. Picheny, V., Ginsbourger, D., Richet, Y. & Caplin, G. Quantile-based optimization of noisy computer experiments with tunable precision. Technometrics 55, 2–13 (2013).10.1080/00401706.2012.707580 ↗
99. Balachandran, P. V., Xue, D., Theiler, J., Hogden, J. & Lookman, T. Adaptive strategies for materials design using uncertainties. Sci. Rep. 6, 19660 (2016).10.1038/srep19660 ↗
100. Keane, A. J. Statistical improvement criteria for use in multiobjective design optimization. AIAA J. 44, 879–891 (2006).10.2514/1.16875 ↗