journal article·2018-12-03Open access

Deep-learning-based inverse design model for intelligent discovery of organic molecules

Kyungdoc Kim, Seokho Kang, Jiho Yoo, Youngchun Kwon, Youngmin Nam, Dongseon Lee, Inkoo Kim, Youn-Suk Choi, Yongsik Jung, Sangmo Kim, Won-Joon Son, Jhunmo Son, Hyo Sug Lee, Sunghan Kim, Jaikwang Shin, Sungwoo Hwang

npj Computational Materials· Volume 4· Issue 1

Abstract

Abstract The discovery of high-performance functional materials is crucial for overcoming technical issues in modern industries. Extensive efforts have been devoted toward accelerating and facilitating this process, not only experimentally but also from the viewpoint of materials design. Recently, machine learning has attracted considerable attention, as it can provide rational guidelines for efficient material exploration without time-consuming iterations or prior human knowledge. In this regard, here we develop an inverse design model based on a deep encoder-decoder architecture for targeted molecular design. Inspired by neural machine language translation, the deep neural network encoder extracts hidden features between molecular structures and their material properties, while the recurrent neural network decoder reconstructs the extracted features into new molecular structures having the target properties. In material design tasks, the proposed fully data-driven methodology successfully learned design rules from the given databases and generated promising light-absorbing molecules and host materials for a phosphorescent organic light-emitting diode by creating new ligands and combinatorial rules.
Source: crossref · Quality: baseline

Research context

OpenAlex topics: Machine Learning in Materials Science · Computational Drug Discovery Methods · Conducting polymers and applications

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

References (43)

Show source-provided references
1. Pyzer-Knapp, E. O., Suh, C., Gómez-Bombarelli, R., Aguilera-Iparraguirre, J. & Aspuru-Guzik, A. What is high-throughput virtual screening? A perspective from organic materials discovery. Annu. Rev. Mater. Res. 45, 195–216 (2015).10.1146/annurev-matsci-070214-020823 ↗
2. Schneider, G. Virtual screening: An endless staircase? Nat. Rev. Drug Discov. 9, 273–276 (2010).10.1038/nrd3139 ↗
3. Gómez-Bombarelli, R. et al. Design of efficient molecular organic light-emitting diodes by a high-throughput virtual screening and experimental approach. Nat. Mater. 15, 1120–1127 (2016).10.1038/nmat4717 ↗
4. Shoichet, B. K. Virtual screening of chemical libraries. Nature 432, 862–865 (2004).10.1038/nature03197 ↗
5. Curtarolo, S. et al. The high-throughput highway to computational materials design. Nat. Mater. 12, 191–201 (2013).10.1038/nmat3568 ↗
6. Foscato, M., Occhipinti, G., Venkatraman, V., Alsberg, B. K. & Jensen, V. R. Automated design of realistic organometallic molecules from fragments. J. Chem. Inf. Model. 54, 767–780 (2014).10.1021/ci4007497 ↗
7. Mauser, H. & Stahl, M. Chemical fragment spaces for de novo design. J. Chem. Inf. Model. 47, 318–324 (2007).10.1021/ci6003652 ↗
8. Yu, M. J. Natural product-like virtual libraries: Recursive atom-based enumeration. J. Chem. Inf. Model. 51, 541–557 (2011).10.1021/ci1002087 ↗
9. Hautier, G., Jain, A. & Ong, S. P. From the computer to the laboratory: Materials discovery and design using first-principles calculations. J. Mater. Sci. 47, 7317–7340 (2012).10.1007/s10853-012-6424-0 ↗
10. Varnek, A. & Baskin, I. Machine learning methods for property prediction in chemoinformatics: Quo vadis? J. Chem. Inf. Model. 52, 1413–1437 (2012).10.1021/ci200409x ↗
11. Ramakrishnan, R., Dral, P. O., Rupp, M. & von Lilienfeld, O. A. Big data meets quantum chemistry approximations: The Δ-machine learning approach. J. Chem. Theory Comput. 11, 2087–2096 (2015).10.1021/acs.jctc.5b00099 ↗
12. Bolton, E. E., Wang, Y., Thiessen, P. A. & Bryant, S. H. PubChem: Integrated platform of small molecules and biological activities. Annu. Rep. Comput. Chem. 4, 217–241 (2008).10.1016/S1574-1400(08)00012-1 ↗
13. Irwin, J. J., Sterling, T., Mysinger, M. M., Bolstad, E. S. & Coleman, R. G. ZINC: A free tool to discover chemistry for biology. J. Chem. Inf. Model. 52, 1757–1768 (2012).10.1021/ci3001277 ↗
14. De Vleeschouwer, F., Yang, W., Beratan, D. N., Geerlings, P. & De Proft, F. Inverse design of molecules with optimal reactivity properties: Acidity of 2-naphthol derivatives. Phys. Chem. Chem. Phys. 14, 16002–16013 (2012).10.1039/c2cp42623d ↗
15. Brown, N., McKay, B. & Gasteiger, J. A novel workflow for the inverse QSPR problem using multiobjective optimization. J. Comput. Aided Mol. Des. 20, 333–341 (2006).10.1007/s10822-006-9063-1 ↗
16. Nicolaou, C. A., Apostolakis, J. & Pattichis, C. S. De novo drug design using multiobjective evolutionary graphs. J. Chem. Inf. Model. 49, 295–307 (2009).10.1021/ci800308h ↗
17. Miyao, T., Arakawa, M. & Funatsu, K. Exhaustive structure generation for inverse‐QSPR/QSAR. Mol. Inf. 29, 111–125 (2010).10.1002/minf.200900038 ↗
18. Miyao, T., Kaneko, H. & Funatsu, K. Inverse QSPR/QSAR analysis for chemical structure generation (from y to x). J. Chem. Inf. Model. 56, 286–299 (2016).10.1021/acs.jcim.5b00628 ↗
19. Martin, S. Lattice enumeration for inverse molecular design using the signature descriptor. J. Chem. Inf. Model. 52, 1787–1797 (2012).10.1021/ci3001748 ↗
20. Ñeco, R. P. & Forcada, M. L. Asynchronous translations with recurrent neural nets. Proc. Int. Conf. Neural Netw. 4, 2535–2540 (1997).10.1109/ICNN.1997.614693 ↗
21. Bengio, Y., Ducharme, R., Vincent, P. & Jauvin, C. A neural probabilistic language model. J. Mach. Learn. Res. 3, 1137–1155 (2003).
22. Kalchbrenner, N. & Blunsom, P. Recurrent continuous translation models. In Proc. Empirical Methods in Natural Language Processing 1700–1709 (Association for Computational Linguistics, Seattle, Washinton, USA, 2013).10.18653/v1/D13-1176 ↗
23. Sutskever, I., Vinyals, O. & Le, Q. V. Sequence to sequence learning with neural networks. Proc. Adv. Neural Inf. Process. Syst. 27, 3104–3112 (2014).
24. Cho, K. et al. Learning phrase representations using RNN encoder-decoder for statistical machine translation. In Proc. Empirical Methods in Natural Language Processing 1724–1734 (Association for Computational Linguistics, Doha, Qutar, 2014).10.3115/v1/D14-1179 ↗
25. LeCun, Y., Bengio, Y. & Hinton, G. Deep learning. Nature 521, 436–444 (2015).10.1038/nature14539 ↗
26. Lipton, Z. C., Berkowitz, J. & Elkan, C. A critical review of recurrent neural networks for sequence learning. Preprint at http://arXiv.org/abs/1506.00019 (2015).
27. Gómez-Bombarelli, R. et al. Automatic chemical design using a data-driven continuous representation of molecules. ACS Cent. Sci. 4, 268–276 (2018).10.1021/acscentsci.7b00572 ↗
28. Rogers, D. & Hahn, M. Extended-connectivity fingerprints. J. Chem. Inf. Model. 50, 742–754 (2010).10.1021/ci100050t ↗
29. Weininger, D. SMILES, a chemical language and information system. 1. Introduction to methodology and encoding rules. J. Chem. Inf. Comput. Sci. 28, 31–36 (1988).10.1021/ci00057a005 ↗
30. Weininger, D., Weininger, A. & Weininger, J. L. SMILES. 2. Algorithm for generation of unique SMILES notation. J. Chem. Inf. Comput. Sci. 29, 97–101 (1989).10.1021/ci00062a008 ↗
31. Bengio, Y., Courville, A. & Vincent, P. Representation learning: A review and new perspectives. IEEE Trans. Pattern Anal. Mach. Intell. 35, 1798–1828 (2013).10.1109/TPAMI.2013.50 ↗
32. Ma, J., Sheridan, R. P., Liaw, A., Dahl, G. E. & Svetnik, V. Deep neural nets as a method for quantitative structure–activity relationships. J. Chem. Inf. Model. 55, 263–274 (2015).10.1021/ci500747n ↗
33. Hochreiter, S. & Schmidhuber, J. Long short-term memory. Neural Comput. 9, 1735–1780 (1997).10.1162/neco.1997.9.8.1735 ↗
34. Mikolov, T., Karafiát, M., Burget, L., Cernocký, J. & Khudanpur, S. Recurrent neural network based language model. In Proc. INTERSPEECH, 1045−1048 (International Speech Communication Association, Makuhari, Chiba, Japan, 2010).10.21437/Interspeech.2010-343 ↗
35. Gendreau, M. & Potvin, J. Y. Metaheuristics in combinatorial optimization. Ann. Oper. Res. 140, 189–213 (2005).10.1007/s10479-005-3971-7 ↗
36. Brütting, W. & Adachi, C. Physics of Organic Semiconductors (John Wiley & Sons, 2012).10.1002/9783527654949 ↗
37. Yersin, H. Highly Efficient OLEDs with Phosphorescent Materials (John Wiley & Sons, 2008).10.1002/9783527621309 ↗
38. Kingma, D. & Ba, J. Adam: A method for stochastic optimization. Preprint at http://arXiv.org/abs/1412.6980 (2014).
39. Chollet, F. et al. Keras. https://keras.io (2018)
40. Al-Rfou, R. et al. Theano: A python framework for fast computation of mathematical expressions. Preprint at https://arxiv.org/abs/1605.02688 (2016)
41. Frisch, M. J. et al. in Gaussian 09, Revision E.01 Fox. (D. J. Gaussian, Inc., Wallingford CT, 2009)..
42. Becke, A. D. J. Density-functional thermochemistry. III. The role of exact exchange. Chem. Phys. 98, 5648–5652 (1993).
43. Lee, C., Yang, W. & Parr, R. G. Development of the Colle-Salvetti correlation-energy formula into a functional of the electron density. Phys. Rev. B 37, 785–789 (1988).10.1103/PhysRevB.37.785 ↗