Semi-supervised machine-learning classification of materials synthesis procedures
Source abstract
Abstract
Abstract Digitizing large collections of scientific literature can enable new informatics approaches for scientific analysis and meta-analysis. However, most content in the scientific literature is locked-up in written natural language, which is difficult to parse into databases using explicitly hard-coded classification rules. In this work, we demonstrate a semi-supervised machine-learning method to classify inorganic materials synthesis procedures from written natural language. Without any human input, latent Dirichlet allocation can cluster keywords into topics corresponding to specific experimental materials synthesis steps, such as “grinding” and “heating”, “dissolving” and “centrifuging”, etc. Guided by a modest amount of annotation, a random forest classifier can then associate these steps with different categories of materials synthesis, such as solid-state or hydrothermal synthesis. Finally, we show that a Markov chain representation of the order of experimental steps accurately reconstructs a flowchart of possible synthesis procedures. Our machine-learning approach enables a scalable approach to unlock the large amount of inorganic materials synthesis information from the literature and to process it into a standardized, machine-readable database.
Source: crossref · Quality: baseline
Research context
OpenAlex topics: Machine Learning in Materials Science · X-ray Diffraction in Crystallography · Catalysis and Oxidation Reactions
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
References (47)
Show source-provided references
1. Jain, A., Shin, Y. & Persson, K. A. Computational predictions of energy materials using density functional theory. Nat. Rev. Mater. 1, 15004 (2016).10.1038/natrevmats.2015.4 ↗
2. Curtarolo, S. et al. The high-throughput highway to computational materials design. Nat. Mater. 12, 191 (2013).10.1038/nmat3568 ↗
3. Jain, A. et al. Commentary: The Materials Project: a materials genome approach to accelerating materials innovation. APL Mater. 1, 011002 (2013).10.1063/1.4812323 ↗
4. Sun, W. et al. The thermodynamic scale of inorganic crystalline metastability. Sci. Adv. 2, e1600225 (2016).10.1126/sciadv.1600225 ↗
5. Jiang, Z., Ramanathan, A. & Shoemaker, D. P. In situ identification of kinetic factors that expedite inorganic crystal formation and discovery. J. Mater. Chem. C. 5, 5709–5717 (2017).10.1039/C6TC04931A ↗
6. Martinolich, A. J. & Neilson, J. R. Toward reaction-by-design: achieving kinetic control of solid state chemistry with metathesis. Chem. Mater. 29, 479–489 (2017).10.1021/acs.chemmater.6b04861 ↗
7. Sun, W., Jayaraman, S., Chen, W., Persson, K. A. & Ceder, G. Nucleation of metastable aragonite CaCO3 in seawater. Proc. Natl. Acad. Sci. 112, 3199–3204 (2015).10.1073/pnas.1423898112 ↗
8. Chen, B.-R. et al. Understanding crystallization pathways leading to manganese oxide polymorph formation. Nat. Commun. 9, 2553 (2018).10.1038/s41467-018-04917-y ↗
9. Sun, W. et al. Thermodynamic routes to novel metastable nitrogen-rich nitrides. Chem. Mater. 29, 6936–6946 (2017).10.1021/acs.chemmater.7b02399 ↗
10. Raccuglia, P. et al. Machine-learning-assisted materials discovery using failed experiments. Nature 533, 73 (2016).10.1038/nature17439 ↗
11. Xu, R. J. et al. Understanding structural adaptability: a reactant informatics approach to experiment design. Mol. Syst. Des. Eng. 3, 473–484 (2018).10.1039/C7ME00127D ↗
12. Segler, M. H. S., Preuss, M. & Waller, M. P. Planning chemical syntheses with deep neural networks and symbolic AI. Nature 555, 604 (2018).10.1038/nature25978 ↗
13. Feng, F., Lai, L. & Pei, J. Computational chemical synthesis analysis and pathway design. Front. Chem. 6 (2018).10.3389/fchem.2018.00199 ↗
14. Wei, J. N., Duvenaud, D. & Aspuru-Guzik, A. Neural networks for the prediction of organic chemistry reactions. ACS Cent. Sci. 2, 725–732 (2016).10.1021/acscentsci.6b00219 ↗
15. Kim, E. et al. Materials synthesis insights from scientific literature via text extraction and machine learning. Chem. Mater. 29, 9436–9444 (2017).10.1021/acs.chemmater.7b03500 ↗
16. Kim, E. et al. Machine-learned and codified synthesis parameters of oxide materials. Sci. Data 4, 170127 (2017).10.1038/sdata.2017.127 ↗
17. Kim, E., Huang, K., Jegelka, S. & Olivetti, E. Virtual screening of inorganic materials synthesis parameters with deep learning. npj Computational. Materials 3, 53 (2017).
18. Young, S. R. et al. Data mining for better material synthesis: the case of pulsed laser deposition of complex oxides. J. Appl. Phys. 123, 115303 (2018).10.1063/1.5009942 ↗
19. Wasow, T., Perfors, A. & Beaver, D. The puzzle of ambiguity. Morphology and the web of grammar: Essays in memory of Steven G. Lapointe, 265–282 (2005).
20. Manning, C. D. & Schütze, H. Foundations of statistical natural language processing. (MIT press, 1999).
21. Nickel, M., Murphy, K., Tresp, V. & Gabrilovich, E. A review of relational machine learning for knowledge graphs. Proc. IEEE 104, 11–33 (2016).10.1109/JPROC.2015.2483592 ↗
22. Maas, A. L. et al. Learning word vectors for sentiment analysis. In Proceedings of the 49th annual meeting of the association for computational linguistics: Human language technologies-volume 1. 142–150 (Association for Computational Linguistics).
23. Pang, B., Lee, L. & Vaithyanathan, S. Thumbs up?: sentiment classification using machine learning techniques. In Proceedings of the ACL-02 conference on Empirical methods in natural language processing-Volume 10. 79–86 (Association for Computational Linguistics).
24. Krallinger, M., Rabal, O., Lourenco, A., Oyarzabal, J. & Valencia, A. Information retrieval and text mining technologies for chemistry. Chem. Rev. 117, 7673–7761 (2017).10.1021/acs.chemrev.6b00851 ↗
25. Domingos, P. A few useful things to know about machine learning. Commun. ACM 55, 78–87 (2012).10.1145/2347736.2347755 ↗
26. Halevy, A., Norvig, P. & Pereira, F. The unreasonable effectiveness of data. IEEE Intell. Syst. 24, 8–12 (2009).10.1109/MIS.2009.36 ↗
27. Goodfellow, I. et al. Generative adversarial nets. In Advances in neural information processing systems. 2672–2680.
28. Chapelle, O., Scholkopf, B. & Zien, A. Semi-supervised learning (chapelle, o. et al., eds.; 2006) [book reviews]. IEEE Trans. Neural Netw. 20, 542–542 (2009).10.1109/TNN.2009.2015974 ↗
29. Blei, D. M., Ng, A. Y. & Jordan, M. I. Latent dirichlet allocation. J. Mach. Learn. Res. 3, 993–1022 (2003).
30. Breiman, L. Random forests. Mach. Learn. 45, 5–32 (2001).10.1023/A:1010933404324 ↗
31. Blei, D. M. Probabilistic topic models. Commun. ACM 55, 77–84 (2012).10.1145/2133806.2133826 ↗
32. McCallum, A. K. Mallet: a machine learning for language toolkit (2002).
33. Zhao, W., Zuo, R. & Fu, J. Temperature-insensitive large electrostrains and electric field induced intermediate phases in (0.7−x) Bi (Mg1/2Ti1/2) O3–xPb (Mg1/3Nb2/3) O3–0.3 PbTiO3 ceramics. J. Eur. Ceram. Soc. 34, 4235–4245 (2014).10.1016/j.jeurceramsoc.2014.07.017 ↗
34. Denil, M., Matheson, D. & de Freitas, N. Narrowing the gap: random forests in theory and in practice. In International conference on machine learning (ICML).
35. Jurafsky, D. & Martin, J. H. Speech and language processing. (Pearson, London, 2014).
36. Pedregosa, F. et al. Scikit-learn: machine learning in Python. J. Mach. Learn. Res. 12, 2825–2830 (2011).
37. Mysore, S. et al. Automatically extracting action graphs from materials science synthesis procedures. arXiv preprint arXiv:1711.06872 (2017).
38. Cheng, X., Yan, X., Lan, Y. & Guo, J. Btm: topic modeling over short texts. IEEE Transactions on Knowledge & Data Engineering 26, 2928–2941 (2014).10.1109/TKDE.2014.2313872 ↗
39. Xie, P. & Xing, E. P. Integrating document clustering and topic modeling. arXiv preprint arXiv:1309.6874 (2013).
40. Yi, X. & Allan, J. A comparative study of utilizing topic models for information retrieval. In European conference on information retrieval. 29–41 (Springer).10.1007/978-3-642-00958-7_6 ↗
41. Kim, H., Sun, Y., Hockenmaier, J. & Han, J. Etm: Entity topic models for mining documents associated with entities. In 2012 IEEE 12th International Conference on Data Mining. 349–358 (IEEE).10.1109/ICDM.2012.107 ↗
42. Guo, H. et al. Domain adaptation with latent semantic association for named entity recognition. In Proceedings of Human Language Technologies: The 2009 Annual Conference of the North American Chapter of the Association for Computational Linguistics. 281–289 (Association for Computational Linguistics).10.3115/1620754.1620795 ↗
43. Swain, M. C. & Cole, J. M. ChemDataExtractor: a toolkit for automated extraction of chemical information from the scientific literature. J. Chem. Inf. Model. 56, 1894–1904 (2016).10.1021/acs.jcim.6b00207 ↗
44. Zhu, S., Fahrenholtz, W. G., Hilmas, G. E. & Zhang, S. C. Pressureless sintering of zirconium diboride using boron carbide and carbon additions. J. Am. Ceram. Soc. 90, 3660–3663 (2007).10.1111/j.1551-2916.2007.01936.x ↗
45. Xiao, X. et al. Influence of temperature and hydrogen pressure on the hydriding/dehydriding behavior of Ti-doped sodium aluminum hydride. Int. J. Hydrog. Energy 32, 3954–3958 (2007).10.1016/j.ijhydene.2007.05.015 ↗
46. Liang, C., Wei, M.-C., Tseng, H.-H. & Shu, E.-C. Synthesis and characterization of the acidic properties and pore texture of Al-SBA-15 supports for the canola oil transesterification. Chem. Eng. J. 223, 785–794 (2013).10.1016/j.cej.2013.03.065 ↗
47. Li, G. et al. Highly selective hydrodecarbonylation of oleic acid into n-heptadecane over a supported Nickel/Zinc oxide–alumina catalyst. ChemCatChem 7, 2646–2653 (2015).10.1002/cctc.201500418 ↗