Recent advances and applications of machine learning in solid-state materials science
Source abstract
Abstract
Abstract One of the most exciting tools that have entered the material science toolbox in recent years is machine learning. This collection of statistical methods has already proved to be capable of considerably speeding up both fundamental and applied research. At present, we are witnessing an explosion of works that develop and apply machine learning to solid-state systems. We provide a comprehensive overview and analysis of the most recent research in this topic. As a starting point, we introduce machine learning principles, algorithms, descriptors, and databases in materials science. We continue with the description of different machine learning approaches for the discovery of stable materials and the prediction of their crystal structure. Then we discuss research in numerous quantitative structure–property relationships and various approaches for the replacement of first-principle methods by machine learning. We review how active learning and surrogate-based optimization can be applied to improve the rational design process and related examples of applications. Two major questions are always the interpretability of and the physical understanding gained from machine learning models. We consider therefore the different facets of interpretability and their importance in materials science. Finally, we propose solutions and future research paths for various challenges in computational materials science.
Source: crossref · Quality: baseline
Research context
OpenAlex topics: Machine Learning in Materials Science · X-ray Diffraction in Crystallography · Computational Drug Discovery Methods
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
References (100+)
Show source-provided references
1. Marsland, S. Machine Learning (CRC Press, Taylor & Francis Inc., Boca Raton, FL, 2014).
2. Silver, D. et al. Mastering the game of go with deep neural networks and tree search. Nature 529, 484–489 (2016).10.1038/nature16961 ↗
3. Bojarski, M. et al. End to end learning for self-driving cars. Preprint at arXiv:1604.07316 (2016).
4. He, K., Zhang, X., Ren, S. & Sun, J. Delving deep into rectifiers: surpassing human-level performance on ImageNet classification. In 2015 IEEE International Conference on Computer Vision (ICCV) (eds Bajcsy, R. & Hager, G.) 1026–1034 (IEEE, Piscataway, NJ, 2015).10.1109/ICCV.2015.123 ↗
5. Liu, S.-S. & Tian, Y.-T. Facial expression recognition method based on gabor wavelet features and fractional power polynomial kernel PCA. In Advances in Neural Networks - ISNN 2010 (eds Zhang, L., Lu, B.-L. & Kwok, J.) 144–151 (Springer, Berlin, Heidelberg, 2010).10.1007/978-3-642-13318-3_19 ↗
6. Waibel, A. & Lee, K.-F. (eds) Readings in Speech Recognition (Morgan Kaufmann, Burlington, MA, 1990).
7. Pazzani, M. & Billsus, D. Learning and revising user profiles: the identification of interesting web sites. Mach. Learn. 27, 313–331 (1997).10.1023/A:1007369909943 ↗
8. Chan, P. K. & Stolfo, S. J. Toward scalable learning with non-uniform class and cost distributions: a case study in credit card fraud detection. In KDD’98 Proc. Fourth International Conference on Knowledge Discovery and Data Mining (eds Agrawal, R., Stolorz, P. & Piatetsky, G.) 164–168 (AAAI Press, New York, NY, 1998).
9. Guzella, T. S. & Caminhas, W. M. A review of machine learning approaches to spam filtering. Expert Syst. Appl. 36, 10206–10222 (2009).10.1016/j.eswa.2009.02.037 ↗
10. Huang, C.-L., Chen, M.-C. & Wang, C.-J. Credit scoring with a data mining approach based on support vector machines. Expert Syst. Appl. 33, 847–856 (2007).10.1016/j.eswa.2006.07.007 ↗
11. Baldi, P. & Brunak, S. Bioinformatics: The Machine Learning Approach (The MIT Press, Cambridge, MA, 2001).
12. Noordik, J. H. Cheminformatics Developments: History, Reviews and Current Research (IOS Press, Amsterdam, 2004).
13. Rajan, K. Materials informatics. Mater. Today 8, 38–45 (2005).10.1016/S1369-7021(05)71123-8 ↗
14. Martin, R. M. Electronic Structure: Basic Theory and Practical Methods (Cambridge University Press, Cambridge, 2008).
15. Hohenberg, P. & Kohn, W. Inhomogeneous electron gas. Phys. Rev. 136, B864–B871 (1964).10.1103/PhysRev.136.B864 ↗
16. Kohn, W. & Sham, L. J. Self-consistent equations including exchange and correlation effects. Phys. Rev. 140, A1133–A1138 (1965).10.1103/PhysRev.140.A1133 ↗
17. Olson, G. B. Designing a new material world. Science 288, 993–998 (2000).10.1126/science.288.5468.993 ↗
18. Oganov, A. R. (ed.) Modern Methods of Crystal Structure Prediction (Wiley-VCH Verlag GmbH & Co. KGaA, Weinheim, 2010).
19. Oganov, A. R. & Glass, C. W. Crystal structure prediction using ab initio evolutionary techniques: principles and applications. J. Chem. Phys. 124, 244704 (2006).10.1063/1.2210932 ↗
20. Newnham, R. E. Properties of materials: anisotropy, symmetry, structure (Oxford University Press, Oxford, 2005).10.1093/oso/9780198520757.003.0005 ↗
21. Curtarolo, S. et al. The high-throughput highway to computational materials design. Nat. Mater. 12, 191–201 (2013).10.1038/nmat3568 ↗
22. Green, M. L. et al. Fulfilling the promise of the materials genome initiative with high-throughput experimental methodologies. Appl. Phys. Rev. 4, 011105 (2017).10.1063/1.4977487 ↗
23. Koinuma, H. & Takeuchi, I. Combinatorial solid-state chemistry of inorganic materials. Nat. Mater. 3, 429–438 (2004).10.1038/nmat1157 ↗
24. Suram, S. K., Haber, J. A., Jin, J. & Gregoire, J. M. Generating information-rich high-throughput experimental materials genomes using functional clustering via multitree genetic programming and information theory. ACS Comb. Sci. 17, 224–233 (2015).10.1021/co5001579 ↗
25. Potyrailo, R. et al. Combinatorial and high-throughput screening of materials libraries: review of state of the art. ACS Comb. Sci. 13, 579–633 (2011).10.1021/co200007w ↗
26. Walsh, A. The quest for new functionality. Nat. Chem. 7, 274–275 (2015).10.1038/nchem.2213 ↗
27. Lookman, T., Eidenbenz, S., Alexander, F. & Barnes, C. (eds) Materials Discovery and Design by Means of Data Science and Optimal Learning (Springer International Publishing, Basel, 2018).10.1007/978-3-319-99465-9 ↗
28. Ryan, K., Lengyel, J. & Shatruk, M. Crystal structure prediction via deep learning. J. Am. Chem. Soc. 140, 10158–10168 (2018).10.1021/jacs.8b03913 ↗
29. Nouira, A., Sokolovska, N. & Crivello, J.-C. Crystalgan: learning to discover crystallographic structures with generative adversarial networks. Preprint at arXiv:1810.11203 (2018).
30. Graser, J., Kauwe, S. K. & Sparks, T. D. Machine learning and energy minimization approaches for crystal structure predictions: a review and new horizons. Chem. Mater. 30, 3601–3612 (2018).10.1021/acs.chemmater.7b05304 ↗
31. Balachandran, P. V., Kowalski, B., Sehirlioglu, A. & Lookman, T. Experimental search for high-temperature ferroelectric perovskites guided by two-step machine learning. Nat. Commun. 9, 1668 (2018).10.1038/s41467-018-03821-9 ↗
32. Oliynyk, A. O., Adutwum, L. A., Harynuk, J. J. & Mar, A. Classifying crystal structures of binary compounds AB through cluster resolution feature selection and support vector machine analysis. Chem. Mater. 28, 6672–6681 (2016).10.1021/acs.chemmater.6b02905 ↗
33. Li, W., Jacobs, R. & Morgan, D. Predicting the thermodynamic stability of perovskite oxides using machine learning models. Comput. Mater. Sci. 150, 454–463 (2018).10.1016/j.commatsci.2018.04.033 ↗
34. Ward, L. et al. Including crystal structure attributes in machine learning models of formation energies via Voronoi tessellations. Phys. Rev. B 96, 024104 (2017).10.1103/PhysRevB.96.024104 ↗
35. Faber, F. A., Lindmaa, A., von Lilienfeld, O. A. & Armiento, R. Machine learning energies of 2 million elpasolite (ABC2D6) crystals. Phys. Rev. Lett. 117, 135502 (2016).10.1103/PhysRevLett.117.135502 ↗
36. Zheng, X., Zheng, P. & Zhang, R.-Z. Machine learning material properties from the periodic table using convolutional neural networks. Chem. Sci. 9, 8426–8432 (2018).10.1039/C8SC02648C ↗
37. Carrete, J., Li, W., Mingo, N., Wang, S. & Curtarolo, S. Finding unprecedentedly low-thermal-conductivity half-Heusler semiconductors via high-throughput materials modeling. Phys. Rev. X 4, 011019 (2014).
38. Kim, C., Pilania, G. & Ramprasad, R. From organized high-throughput data to phenomenological theory using machine learning: the example of dielectric breakdown. Chem. Mater. 28, 1304–1311 (2016).10.1021/acs.chemmater.5b04109 ↗
39. Seko, A., Maekawa, T., Tsuda, K. & Tanaka, I. Machine learning with systematic density-functional theory calculations: application to melting temperatures of single- and binary-component solids. Phys. Rev. B 89, 054303 (2014).10.1103/PhysRevB.89.054303 ↗
40. Xie, T. & Grossman, J. C. Crystal graph convolutional neural networks for an accurate and interpretable prediction of material properties. Phys. Rev. Lett. 120, 145301 (2018).10.1103/PhysRevLett.120.145301 ↗
41. Isayev, O. et al. Universal fragment descriptors for predicting properties of inorganic crystals. Nat. Commun. 8, 15679 (2017).10.1038/ncomms15679 ↗
42. Furmanchuk, A., Agrawal, A. & Choudhary, A. Predictive analytics for crystalline materials: bulk modulus. RSC Adv. 6, 95246–95251 (2016).10.1039/C6RA19284J ↗
43. Kauwe, S. K., Graser, J., Vazquez, A. & Sparks, T. D. Machine learning prediction of heat capacity for solid inorganics. Integr. Mater. Manuf. Innov. 7, 43–51 (2018).10.1007/s40192-018-0108-9 ↗
44. Kim, C., Pilania, G. & Ramprasad, R. Machine learning assisted predictions of intrinsic dielectric breakdown strength of ABX3 perovskites. J. Phys. Chem. C 120, 14575–14580 (2016).10.1021/acs.jpcc.6b05068 ↗
45. Yuan, F. & Mueller, T. Identifying models of dielectric breakdown strength from high-throughput data via genetic programming. Sci. Rep. 7, 17594 (2017).10.1038/s41598-017-17535-3 ↗
46. Gaultois, M. W. et al. Perspective: Web-based machine learning models for real-time screening of thermoelectric materials properties. APL Mater. 4, 053213 (2016).10.1063/1.4952607 ↗
47. Ju, S. et al. Designing nanostructures for phonon transport via Bayesian optimization. Phys. Rev. X 7, 021024 (2017).
48. Seko, A., Hayashi, H., Nakayama, K., Takahashi, A. & Tanaka, I. Representation of compounds for machine-learning prediction of physical properties. Phys. Rev. B 95, 144110 (2017).10.1103/PhysRevB.95.144110 ↗
49. Sosso, G. C., Deringer, V. L., Elliott, S. R. & Csányi, G. Understanding the thermal properties of amorphous solids using machine-learning-based interatomic potentials. Mol. Simul. 44, 866–880 (2018).10.1080/08927022.2018.1447107 ↗
50. Wei, H., Zhao, S., Rong, Q. & Bao, H. Predicting the effective thermal conductivities of composite materials and porous media by machine learning methods. Int. J. Heat. Mass Tran. 127, 908–916 (2018).10.1016/j.ijheatmasstransfer.2018.08.082 ↗
51. Wu, Y.-J., Sasaki, M., Goto, M., Fang, L. & Xu, Y. Electrically conductive thermally insulating Bi–Si nanocomposites by interface design for thermal management. ACS Appl. Nano Mater. 1, 3355–3363 (2018).10.1021/acsanm.8b00575 ↗
52. Jalem, R. et al. Bayesian-driven first-principles calculations for accelerating exploration of fast ion conductors for rechargeable battery application. Sci. Rep. 8, 5845 (2018).10.1038/s41598-018-23852-y ↗
53. Rosenblatt, F. The perceptron: a probabilistic model for information storage and organization in the brain. Psychol. Rev. 65, 386 (1958).10.1037/h0042519 ↗
54. McCulloch, W. S. & Pitts, W. A logical calculus of the ideas immanent in nervous activity. Bull. Math. Biophys. 5, 115–133 (1943).10.1007/BF02478259 ↗
55. LeCun, Y., Bengio, Y. & Hinton, G. Deep learning. Nature 521, 436–444 (2015).10.1038/nature14539 ↗
56. Ye, W., Chen, C., Wang, Z., Chu, I.-H. & Ong, S. P. Deep neural networks for accurate predictions of crystal stability. Nat. Commun. 9, 3800 (2018).10.1038/s41467-018-06322-x ↗
57. Ren, Z. & Lee, Y. J. Cross-domain self-supervised multi-task feature learning using synthetic imagery. In 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition (eds Bai, Y., Zhang, Y., Ding, M. & Ghanem, B.) 762–771 (IEEE, Piscataway, NJ, 2018).10.1109/CVPR.2018.00086 ↗
58. Rajan, K. Materials informatics: the materials gene and big data. Annu. Rev. Mater. Res. 45, 153–169 (2015).10.1146/annurev-matsci-070214-021132 ↗
59. Mueller, T., Kusne, A. G. & Ramprasad, R. in Reviews in Computational Chemistry (eds Parrill, A. L. & Lipkowitz, K. B.) Ch. 4 (John Wiley & Sons, Inc., Hoboken, NJ, 2016).
60. Correa-Baena, J.-P. et al. Accelerating materials development via automation, machine learning, and high-performance computing. Joule 2, 1410–1420 (2018).10.1016/j.joule.2018.05.009 ↗
61. Liu, Y., Zhao, T., Ju, W. & Shi, S. Materials discovery and design using machine learning. J. Mater. 3, 159–177 (2017).
62. Ward, L. et al. Strategies for accelerating the adoption of materials informatics. MRS Bull. 43, 683–689 (2018).10.1557/mrs.2018.204 ↗
63. Butler, K. T., Davies, D. W., Cartwright, H., Isayev, O. & Walsh, A. Machine learning for molecular and materials science. Nature 559, 547–555 (2018).10.1038/s41586-018-0337-2 ↗
64. Butler, K. T., Frost, J. M., Skelton, J. M., Svane, K. L. & Walsh, A. Computational materials design of crystalline solids. Chem. Soc. Rev. 45, 6138–6146 (2016).10.1039/C5CS00841G ↗
65. Shi, S. et al. Multi-scale computation methods: Their applications in lithium-ion battery research and development. Chin. Phys. B 25, 018212 (2016).10.1088/1674-1056/25/1/018212 ↗
66. Ward, L. & Wolverton, C. Atomistic calculations and materials informatics: a review. Curr. Opin. Solid State Mater. Sci. 21, 167–176 (2017).10.1016/j.cossms.2016.07.002 ↗
67. Alpaydin, E. Introduction to Machine Learning (The MIT Press, Cambridge, MA, 2014).
68. Sutton, R. S. & Barto, A. G. Reinforcement Learning (The MIT Press, Cambridge, MA, 2018).
69. Nguyen, H., Maeda, S.-i. & Oono, K. Semi-supervised learning of hierarchical representations of molecules using neural message passing. Preprint at arXiv:1711.10168 (2017).
70. Geman, S., Bienenstock, E. & Doursat, R. Neural networks and the bias/variance dilemma. Neural Comput. 4, 1–58 (1992).10.1162/neco.1992.4.1.1 ↗
71. Sammut, C. & Webb, G. I. Encyclopedia of Machine Learning and Data Mining (Springer Publishing Company, Incorporated, New York, NY, 2017).10.1007/978-1-4899-7687-1 ↗
72. Picard, R. R. & Cook, R. D. Cross-validation of regression models. J. Am. Stat. Assoc. 79, 575–583 (1984).10.1080/01621459.1984.10478083 ↗
73. Meredig, B. et al. Can machine learning identify the next high-temperature superconductor? Examining extrapolation performance for materials discovery. Mol. Syst. Des. Eng. 3, 819–825 (2018).10.1039/C8ME00012C ↗
74. Tropsha, A., Gramatica, P. & Gombar, V. K. The importance of being earnest: validation is the absolute essential for successful application and interpretation of QSPR models. QSAR Comb. Sci. 22, 69–77 (2003).10.1002/qsar.200390007 ↗
75. Golbraikh, A. & Tropsha, A. Beware of q2. J. Mol. Graph. Modell. 20, 269–276 (2002).10.1016/S1093-3263(01)00123-1 ↗
76. Stanev, V. et al. Machine learning modeling of superconducting critical temperature. npj Comput. Mater. 4, 29 (2018).10.1038/s41524-018-0085-8 ↗
77. Zhang, Y. & Ling, C. A strategy to apply machine learning to small datasets in materials science. npj Comput. Mater. 4, 25 (2018).10.1038/s41524-018-0081-z ↗
78. Jain, A. et al. Commentary: The materials project: a materials genome approach to accelerating materials innovation. APL Mater. 1, 011002 (2013).10.1063/1.4812323 ↗
79. F. H. Allen, G. G. & Sievers, R. (eds) Crystallographic Databases (International Union of Crystallography, Chester, 1987).
80. Saal, J. E., Kirklin, S., Aykol, M., Meredig, B. & Wolverton, C. Materials design and discovery with high-throughput density functional theory: the open quantum materials database (OQMD). JOM 65, 1501–1509 (2013).10.1007/s11837-013-0755-4 ↗
81. Kirklin, S. et al. The open quantum materials database (OQMD): assessing the accuracy of DFT formation energies. npj Comput. Mater. 1, 15010 (2015).10.1038/npjcompumats.2015.10 ↗
82. Groom, C. R., Bruno, I. J., Lightfoot, M. P. & Ward, S. C. The Cambridge structural database. Acta Crystallogr. Sect. B Struct. Sci. Cryst. Eng. Mater. 72, 171–179 (2016).10.1107/S2052520616003954 ↗
83. Hachmann, J. et al. The Harvard clean energy project: large-scale computational screening and design of organic photovoltaics on the world community grid. J. Phys. Chem. Lett. 2, 2241–2251 (2011).10.1021/jz200866s ↗
84. Puchala, B. et al. The materials commons: a collaboration platform and information repository for the global materials community. JOM 68, 2035–2044 (2016).10.1007/s11837-016-1998-7 ↗
85. Mullin, R. Citrine informatics. CEN Glob. Enterp. 95, 34–34 (2017).
86. de Jong, M. et al. Charting the complete elastic properties of inorganic crystalline compounds. Sci. Data 2, 150009 (2015).10.1038/sdata.2015.9 ↗
87. Zakutayev, A. et al. An open experimental database for exploring inorganic materials. Sci. Data 5, 180053 (2018).10.1038/sdata.2018.53 ↗
88. Villars, P., Okamoto, H. & Cenzual, K. ASM Alloy Phase Diagrams Database (ASM International, Materials Park, OH, 2006).
89. Gražulis, S. et al. Crystallography open database (COD): an open-access collection of crystal structures and platform for world-wide collaboration. Nucleic Acids Res. 40, D420–D427 (2011).10.1093/nar/gkr900 ↗
90. Villars, P. et al. The Pauling file, binaries edition. J. Alloy. Comp. 367, 293–297 (2004).10.1016/j.jallcom.2003.08.058 ↗
91. Gorai, P. et al. TE design lab: a virtual laboratory for thermoelectric material design. Comput. Mater. Sci. 112, 368–376 (2016).10.1016/j.commatsci.2015.11.006 ↗
92. Haastrup, S. et al. The Computational 2D Materials Database: high-throughput modeling and discovery of atomically thin crystals. 2D Mater. 5, 042002 (2018).10.1088/2053-1583/aacfc1 ↗
93. Wilkinson, M. D. et al. The FAIR guiding principles for scientific data management and stewardship. Sci. Data 3, 160018 (2016).10.1038/sdata.2016.18 ↗
94. Draxl, C. & Scheffler, M. NOMAD: the FAIR concept for big data-driven materials science. MRS Bull. 43, 676–682 (2018).10.1557/mrs.2018.208 ↗
95. Raccuglia, P. et al. Machine-learning-assisted materials discovery using failed experiments. Nature 533, 73–76 (2016).10.1038/nature17439 ↗
96. Ghiringhelli, L. M., Vybiral, J., Levchenko, S. V., Draxl, C. & Scheffler, M. Big data of materials science: critical role of the descriptor. Phys. Rev. Lett. 114, 105503 (2015).10.1103/PhysRevLett.114.105503 ↗
97. Bengio, Y., Courville, A. & Vincent, P. Representation learning: a review and new perspectives. IEEE Trans. Pattern Anal. Mach. Intell. 35, 1798–1828 (2013).10.1109/TPAMI.2013.50 ↗
98. Bellman, R. E. Adaptive Control Processes: A Guided Tour (Princeton University Press, Princeton, NJ, 2015).
99. Schmidt, J. et al. Predicting the thermodynamic stability of solids combining density functional theory and machine learning. Chem. Mater. 29, 5090–5103 (2017).10.1021/acs.chemmater.7b00156 ↗
100. Bartók, A. P., Kondor, R. & Csányi, G. On representing chemical environments. Phys. Rev. B 87, 184115 (2013).10.1103/PhysRevB.87.184115 ↗