Fast and interpretable classification of small X-ray diffraction datasets using data augmentation and deep neural networks
Source abstract
Abstract
Abstract X-ray diffraction (XRD) data acquisition and analysis is among the most time-consuming steps in the development cycle of novel thin-film materials. We propose a machine learning-enabled approach to predict crystallographic dimensionality and space group from a limited number of thin-film XRD patterns. We overcome the scarce data problem intrinsic to novel materials development by coupling a supervised machine learning approach with a model-agnostic, physics-informed data augmentation strategy using simulated data from the Inorganic Crystal Structure Database (ICSD) and experimental data. As a test case, 115 thin-film metal-halides spanning three dimensionalities and seven space groups are synthesized and classified. After testing various algorithms, we develop and implement an all convolutional neural network, with cross-validated accuracies for dimensionality and space group classification of 93 and 89%, respectively. We propose average class activation maps, computed from a global average pooling layer, to allow high model interpretability by human experimentalists, elucidating the root causes of misclassification. Finally, we systematically evaluate the maximum XRD pattern step size (data acquisition rate) before loss of predictive accuracy occurs, and determine it to be 0.16° 2θ, which enables an XRD pattern to be obtained and classified in 5.5 min or less.
Source: crossref · Quality: baseline
Research context
OpenAlex topics: Machine Learning in Materials Science · X-ray Diffraction in Crystallography · Advanced Condensed Matter Physics
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
References (56)
Show source-provided references
1. Tabor, A., Roch, D. & Saikin, L. Lawrence Berkeley National Laboratory recent work title accelerating the discovery of materials for clean energy in the era of smart automation. Nat Rev Mater. https://doi.org/10.1038/s41578-018-0005-z (2018).10.1038/s41578-018-0005-z ↗
2. Correa-Baena, J.-P. et al. Accelerating materials development via automation, machine learning, and high-performance computing. Joule 2, 1410–1420 (2018).10.1016/j.joule.2018.05.009 ↗
3. Dinnebier, R. E. Powder Diffraction: Theory and Practice. (RSC Publ, Cambridge, 2009).10.1039/9781847558237 ↗
4. Rietveld, H. M. A profile refinement method for nuclear and magnetic structures. J. Appl. Crystallogr. 2, 65–71 (1969).10.1107/S0021889869006558 ↗
5. Carr, D. A., Lach-hab, M., Yang, S., Vaisman, I. I. & Blaisten-Barojas, E. Machine learning approach for structure-based zeolite classification. Microporous Mesoporous Mater. 117, 339–349 (2009).10.1016/j.micromeso.2008.07.027 ↗
6. Baumes, L. A., Moliner, M., Nicoloyannis, N. & Corma, A. A reliable methodology for high throughput identification of a mixture of crystallographic phases from powder X-ray diffraction data. CrystEngComm 10, 1321–1324 (2008).10.1039/b812395k ↗
7. Baumes, L. A., Moliner, M. & Corma, A. Design of a full-profile-matching solution for high-throughput analysis of multiphase samples through powder X-ray diffraction. Chem. - A Eur. J. 15, 4258–4269 (2009).10.1002/chem.200802683 ↗
8. Stanev, V. et al. Unsupervised phase mapping of X-ray diffraction data by nonnegative matrix factorization integrated with custom clustering. npj Comput. Mater. 4, 43 (2018).10.1038/s41524-018-0099-2 ↗
9. Kusne, A. G., Keller, D., Anderson, A., Zaban, A. & Takeuchi, I. High-throughput determination of structural phase diagram and constituent phases using GRENDEL. Nanotechnology 26, 444002 (2015).10.1088/0957-4484/26/44/444002 ↗
10. Park, W. B. et al. Classification of crystal structure using a convolutional neural network. IUCrJ. 4, 486–494 (2017).10.1107/S205225251700714X ↗
11. Park, W. B., Singh, S. P., Yoon, C. & Sohn, K. S. Combinatorial chemistry of oxynitride phosphors and discovery of a novel phosphor for use in light emitting diodes, Ca1.5Ba0.5Si5N6O3:Eu2+. J. Mater. Chem. C. 1, 1832–1839 (2013).10.1039/c2tc00731b ↗
12. Rybakov, V. B., Babaev, E. V., Pasichnichenko, K. Y. & Sonneveld, E. J. X-ray mapping in heterocyclic design: VI. X-ray diffraction study of 3-(isonicotinoyl)-2-oxooxazolo[3,2-a]pyridine and the product of its hydrolysis. Crystallogr. Rep. 47, 473–477 (2002).
13. Hirosaki, N., Takeda, T., Funahashi, S. & Xie, R. J. Discovery of new nitridosilicate phosphors for solid state lighting by the single-particle-diagnosis approach. Chem. Mater. 26, 4280–4288 (2014).10.1021/cm501866x ↗
14. Suram, S. K. et al. Automated phase mapping with AgileFD and its application to light absorber discovery in the V-Mn-Nb oxide system. ACS Comb. Sci. 19, 37–46 (2017).10.1021/acscombsci.6b00153 ↗
15. Ren, F. et al. Accelerated discovery of metallic glasses through iteration of machine learning and high-throughput experiments. Sci. Adv. 4, eaaq1566 (2018).10.1126/sciadv.aaq1566 ↗
16. Bunn, J. K. et al. Generalized machine learning technique for automatic phase attribution in time variant high-throughput experimental studies. J. Mater. Res. 30, 879–889 (2015).10.1557/jmr.2015.80 ↗
17. Kusne, A. G. et al. On-the-fly machine-learning for high-throughput experiments: search for rare-earth-free permanent magnets. Sci. Rep. 4, 1–7 (2014).10.1038/srep06367 ↗
18. Vecsei, P. M. et al. Neural network-based classification of crystal symmetries from X-ray diffraction patterns. arXiv preprint arXiv:1812.05625 (2018).10.1103/PhysRevB.99.245120 ↗
19. Ziletti, A., Kumar, D., Scheffler, M. & Ghiringhelli, L. M. Insightful classification of crystal structures using deep learning. Nat. Commun. 9, 1–10 (2018).10.1038/s41467-018-05169-6 ↗
20. Ke, T. W. et al. A convolutional neural network-based screening tool for X-ray serial crystallography. J. Synchrotron Radiat. 25, 655–670 (2018).10.1107/S1600577518004873 ↗
21. Ziatdinov, M. et al. Deep learning of atomically resolved scanning transmission electron microscopy images: chemical identification and tracking local transformations. ACS Nano. 11, 12742–12752 (2017).10.1021/acsnano.7b07504 ↗
22. Le Bras, R. et al. A computational challenge problem in materials discovery: synthetic problem generator and real-world datasets. Proceedings of the Twenty-Eighth AAAI Conference of Artifical Intelligence System, pp. 438–443 (2014).10.1609/aaai.v28i1.8770 ↗
23. LeBras, R. et al. Constraint reasoning and kernel clustering for pattern decomposition with scaling. in Principles and Practice of Constraint Programming – CP 2011 (ed. Lee, J.) 508–522 (Springer, Berlin, Heidelberg, 2011).10.1007/978-3-642-23786-7_39 ↗
24. Järvinen, M. Application of symmetrized harmonics expansion to correction of the preferred orientation effect. J. Appl. Crystallogr. 26, 525–531 (1993).10.1107/S0021889893001219 ↗
25. Fewster, P. F., Langford, J. I. & Fewster, P. F. Reports on progress in physics related content X-ray analysis of thin films and multilayers. 59, 11 (1996).10.1088/0034-4885/59/11/001 ↗
26. Iwasaki, Y., Kusne, A. G. & Takeuchi, I. Comparison of dissimilarity measures for cluster analysis of X-ray diffraction data from combinatorial libraries. npj Comput. Mater. 3, 1–8 (2017).10.1038/s41524-017-0006-2 ↗
27. Belkly, A., Helderman, M., Karen, V. L. & Ulkch, P. New developments in the Inorganic Crystal Structure Database (ICSD): accessibility in support of materials research and design. Acta Crystallogr. Sect. B Struct. Sci. 58, 364–369 (2002).10.1107/S0108768102006948 ↗
28. Eperon, G. E. et al. Formamidinium lead trihalide: a broadly tunable perovskite for efficient planar heterojunction solar cells. Energy Environ. Sci. 7, 982–988 (2014).10.1039/c3ee43822h ↗
29. Lee, M. M., Teuscher, J., Miyasaka, T., Murakami, T. N. & Snaith, H. J. Efficient hybrid solar cells based on meso-superstructured organometal halide perovskites. Sci. (80-.) 338, 643–647 (2012).10.1126/science.1228604 ↗
30. Hoye, R. L. Z. et al. Perovskite-inspired photovoltaic materials: toward best practices in materials characterization and calculations. Chem. Mater. 29, 1964–1988 (2017).10.1021/acs.chemmater.6b03852 ↗
31. Springenberg, J. T. et al. Striving for simplicity: the all convolutional net. arXiv preprint arXiv:1412.6806. (2014).
32. Zhou, B. et al. Learning deep features for discriminative localization. Proceedings of the IEEE conference on computer vision and pattern recognition. https://doi.org/10.1109/CVPR.2016.319 (2016).10.1109/CVPR.2016.319 ↗
33. Etgar, L. The merit of perovskite’s dimensionality; Can this replace the 3D halide perovskite? Energy Environ. Sci. 11, 234–242 (2018).10.1039/C7EE03397D ↗
34. Xiao, Z., Meng, W., Wang, J., Mitzi, D. B. & Yan, Y. Searching for promising new perovskite-based photovoltaic absorbers: the importance of electronic dimensionality. Mater. Horiz. https://doi.org/10.1039/C6MH00519E (2017).10.1039/C6MH00519E ↗
35. Zhang, T., Long, M., Liu, P., Xie, W. & Xu, J.-B. Stable and efficient 3D-2D perovskite-perovskite planar heterojunction solar cell without organic hole transport layer. Joule https://doi.org/10.1016/j.joule.2018.09.022 (2018).10.1016/j.joule.2018.09.022 ↗
36. Kurchin, R. C., Gorai, P., Buonassisi, T. & Stevanović, V. Structural and chemical features giving rise to defect tolerance of binary semiconductors. Chem. Mater. 30, 5583–5592 (2018).10.1021/acs.chemmater.8b01505 ↗
37. Baikie, T. et al. Synthesis and crystal chemistry of the hybrid perovskite (CH3NH3)PbI3 for solid-state sensitised solar cell applications. J. Mater. Chem. A 1, 5628–5641 (2013).10.1039/c3ta10518k ↗
38. Sun, S. et al. Synthesis, crystal structure, and properties of a perovskite-related bismuth phase, (NH4)3Bi2I9. APL Mater. 4, 031101 (2016).10.1063/1.4943680 ↗
39. Coelho, A. A. TOPAS-Academic, Version 6: technical reference. (Coelho Software. Brisbane, Australia, 2016).
40. Shijing Sun, et al. Accelerating photovoltaic materials development via high-throughput experiments and machine-learning-assisted diagnosis. Joule 2, 1410–1420 (2018).10.1016/j.joule.2018.05.009 ↗
41. Ermon, S. et al. Pattern decomposition with complex combinatorial constraints: application to materials discovery. AAAI'15 Proceedings of the Twenty-Ninth AAAI Conference on Artificial Intelligence. (2014).10.1609/aaai.v29i1.9233 ↗
42. Zhao, J. et al. Strained hybrid perovskite thin films and their impact on the intrinsic stability of perovskite solar cells. Sci. Adv. 3, eaao5616 (2017).10.1126/sciadv.aao5616 ↗
43. Hernández-García, A. & König, P. Data augmentation instead of explicit regularization. arXiv preprint arXiv:1806.03852 (2018).
44. Goodfellow, I., Bengio, Y., Courville, A. & Bengio, Y. Deep Learning. 1 (MIT Press, Cambridge, 2016).
45. Pedregosa, F. et al. Scikit-learn: machine learning in {P}ython. J. Mach. Learn. Res. 12, 2825–2830 (2011).
46. Friedman, J., Hastie, T. & Tibshirani, R. The Elements of Statistical Learning. 1 (Springer Series in Statistics, New York, NY, USA, 2001).10.1007/978-0-387-21606-5_1 ↗
47. Salvador, S. & Chan, P. FastDTW: toward accurate dynamic time warping in linear time and space. Time 11, 70–80 (2004).
48. Haixiang, G. et al. Learning from class-imbalanced data: review of methods and applications. Expert Syst. Appl. 73, 220–239 (2017).10.1016/j.eswa.2016.12.035 ↗
49. Chawla, N. V., Bowyer, K. W., Hall, L. O. & Kegelmeyer, W. P. SMOTE: synthetic minority over-sampling technique. J. Artif. Intell. Res. 16, 321–357 (2002).10.1613/jair.953 ↗
50. Lin, M., Chen, Q. & Yan, S. Network in network. arXiv preprint arXiv:1312.4400. (2013).
51. Yoon, C. H. et al. Unsupervised classification of single-particle X-ray diffraction snapshots by spectral clustering. Opt. Express 19, 16542 (2011).10.1364/OE.19.016542 ↗
52. Wang, Z., Yan, W. & Oates, T. Time series classification from scratch with deep neural networks: a strong baseline. Proc. Int. Jt. Conf. Neural Netw. 2017, 1578–1585 (2017).
53. Kobayashi, S. & Inaba, K. X-ray thin-film measurement techniques. Mass Spectrosc. Equipped a Ski. Interface 28, 8 (2012).
54. Press, W. H. & Teukolsky, S. A. Savitzky-Golay smoothing filters. Comput. Phys. 4, 669 (1990).10.1063/1.4822961 ↗
55. Hill, R. J. & Howard, C. J. Quantitative phase analysis from neutron powder diffraction data using the Rietveld method. J. Appl. Crystallogr. 20, 467–474 (1987).10.1107/S0021889887086199 ↗
56. Degen, T., Sadki, M., Bron, E., König, U. & Nénert, G. The HighScore suite. Powder Diffr. 29, S13–S18 (2014).10.1017/S0885715614000840 ↗