journal article·2026-03Open access

Multi‐View Biomedical Foundation Models for Molecule‐Target and Property Prediction

Parthasarathy Suryanarayanan, Yunguang Qiu, Shreyans Sethi, Diwakar Mahajan, Hongyang Li, Yuxin Yang, Elif Eyigoz, Aldo Guzmán‐Sáenz, Daniel E. Platt, Timothy H. Rumbell, Kenney Ng, Sanjoy Dey, Myson Burch, Bum Chul Kwon, Pablo Meyer, Feixiong Cheng, Jianying Hu, Joseph A. Morrone

Advanced Science· Volume 13· Issue 14

Abstract

ABSTRACT Molecular foundation models hold promise to provide accurate predictions for a large and diverse set of downstream tasks in bio‐medical research. Quality molecular representations are key and foundation model development has typically focused on a single representation or molecular view, which may have strengths or weaknesses on a given task. We develop Multi‐view Molecular Embedding with Late Fusion (MMELON), an approach that integrates pre‐trained graph, image and text foundation models and may be readily extended to additional views and models. The multi‐view model performs robustly and is validated on over 120 tasks, including molecular solubility, ADME properties, and activity against G Protein‐Coupled receptors (GPCRs). The GPCR model array is leveraged to perform a virtual screen in search of ligands binding to Alzheimer's disease related GPCRs. We identify a number of such targets and employ the multi‐view model to select strong binders from a compound screen. Predictions are validated through structure‐based modeling and identification of key binding motifs.
Source: crossref · Quality: baseline

Research context

OpenAlex topics: Computational Drug Discovery Methods · Receptor Mechanisms and Signaling · Machine Learning in Bioinformatics

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

IBM TJ Watson Research Center 1101 Kitchawan Rd. Yorktown Heights NY USA

Cleveland Clinic Genome Center, Lerner Research Institute Cleveland Clinic Cleveland OH USA

Genomic Medicine Institute, Lerner Research Institute Cleveland Clinic Cleveland OH USA

IBM Research ‐ Almaden 650 Harry Rd San Jose CA USA

IBM Research 314 Main St Cambridge MA USA

Department of Molecular Medicine Cleveland Clinic Lerner College of Medicine Case Western Reserve University Cleveland OH USA

References (91)

Show source-provided references
1. 10.1111/j.1476-5381.2010.01127.x10.1111/j.1476-5381.2010.01127.x ↗
2. 10.1016/j.xcrm.2022.10079410.1016/j.xcrm.2022.100794 ↗
3. 10.1016/j.xcrm.2023.10137910.1016/j.xcrm.2023.101379 ↗
4. 10.3390/molecules1801073510.3390/molecules18010735 ↗
5. 10.1038/s41573-019-0024-510.1038/s41573-019-0024-5 ↗
6. 10.1039/D0CS00098A10.1039/D0CS00098A ↗
7. 10.1002/wcms.160310.1002/wcms.1603 ↗
8. W. X.Zhao K.Zhou J.Li et al. “A Survey of Large Language Models ” arXiv Preprint arXiv:2303.18223 (2023).
9. S.Chithrananda G.Grand andB.Ramsundar “ChemBERTa: Large‐Scale Self‐Supervised Pretraining for Molecular Property Prediction ” Oct.2020 arXiv:2010.09885.
10. W.Ahmad E.Simon S.Chithrananda G.Grand andB.Ramsundar “ChemBERTa‐2: Towards Chemical Foundation Models ”arXiv Preprint arXiv:2209.01712(2022).
11. G.Chilingaryan H.Tamoyan A.Tevosyan et al. “BARTSmiles: Generative Masked Language Models for Molecular Representations ” Nov.2022 arXiv:2211.16349 [cs q‐bio].
12. 10.1038/s42256-022-00580-710.1038/s42256-022-00580-7 ↗
13. 10.1038/s42256-021-00418-810.1038/s42256-021-00418-8 ↗
14. Duvenaud D. K. · 2015
15. 10.1021/acscentsci.6b0036710.1021/acscentsci.6b00367 ↗
16. 10.1021/acs.jcim.9b0092710.1021/acs.jcim.9b00927 ↗
17. 10.1016/j.ddtec.2020.11.00910.1016/j.ddtec.2020.11.009 ↗
18. J.Kim T. D.Nguyen S.Min et al. “Pure Transformers Are Powerful Graph Learners ” Oct.2022 arXiv:2207.02505 [cs].10.52202/068431-1060 ↗
19. L.Müller M.Galkin C.Morris andL.Rampášek “Attending to Graph Transformers ” (Feb.2023) arXiv:2302.04181 [cs].
20. G. B.Goh C.Siegel A.Vishnu N. O.Hodas andN.Baker “Chemception: A Deep Neural Network with Minimal Chemistry Knowledge Matches the Performance of Expert‐Developed QSAR/QSPR Models ” (2017).
21. 10.1038/s42256-022-00557-610.1038/s42256-022-00557-6 ↗
22. S.Liu H.Wang W.Liu J.Lasenby H.Guo andJ.Tang “Pre‐Training Molecular Graph Representation with 3D Geometry ” (May2022) arXiv:2110.07728 [cs eess q‐bio].
23. 10.1145/3534678.353936810.1145/3534678.3539368 ↗
24. Y.Zhu D.Chen Y.Du Y.Wang Q.Liu andS.Wu “Improving Molecular Pretraining with Complementary Featurizations ” Sept.2022 arXiv:2209.15101 [physics q‐bio].
25. 10.1093/bib/bbac56010.1093/bib/bbac560 ↗
26. 10.1186/s13321-024-00846-910.1186/s13321-024-00846-9 ↗
27. 10.1093/bib/bbae25610.1093/bib/bbae256 ↗
28. 10.1016/j.csbj.2024.04.03010.1016/j.csbj.2024.04.030 ↗
29. 10.1016/j.compbiomed.2023.10791110.1016/j.compbiomed.2023.107911 ↗
30. 10.1016/j.inffus.2023.10209210.1016/j.inffus.2023.102092 ↗
31. 10.1109/JBHI.2023.334779410.1109/JBHI.2023.3347794 ↗
32. 10.1093/bib/bbad40410.1093/bib/bbad404 ↗
33. 10.1093/bib/bbac40810.1093/bib/bbac408 ↗
34. J.Hu M.Rosen‐Zvi W.Cornell J.Kozloski Y.Shimoni andE.Hexter “Biomedical Foundation Models ” (2023) https://www.research.ibm.com/projects/biomedical‐foundation‐models.
35. 10.1021/ci200028n10.1021/ci200028n ↗
36. 10.1039/C7SC02664A10.1039/C7SC02664A ↗
37. 10.1038/nbt.199010.1038/nbt.1990 ↗
38. 10.1021/acs.jcim.3c0016010.1021/acs.jcim.3c00160 ↗
39. 10.1093/nar/gkr77710.1093/nar/gkr777 ↗
40. 10.1093/bioinformatics/btv30210.1093/bioinformatics/btv302 ↗
41. “2024 Alzheimer's Disease Facts and Figures ”Alzheimers & Dementia (New York NY)20 no.5(2024):3708–3821.10.1002/alz.13809 ↗
42. 10.1002/trc2.1246510.1002/trc2.12465 ↗
43. 10.1016/j.sbi.2024.10277610.1016/j.sbi.2024.102776 ↗
44. 10.1016/j.celrep.2022.11171710.1016/j.celrep.2022.111717 ↗
45. 10.1038/nrn297710.1038/nrn2977 ↗
46. 10.1016/j.crmeth.2024.10086510.1016/j.crmeth.2024.100865 ↗
47. 10.1145/3649476.366037710.1145/3649476.3660377 ↗
48. 10.1093/nar/gkx103710.1093/nar/gkx1037 ↗
49. 10.1093/nar/gkac95610.1093/nar/gkac956 ↗
50. 10.1021/acs.jcim.2c0125310.1021/acs.jcim.2c01253 ↗
51. 10.1016/S0169-409X(00)00129-010.1016/S0169-409X(00)00129-0 ↗
52. M.FeyandJ. E.Lenssen “Fast Graph Representation Learning with PyTorch Geometric ” arXiv preprint arXiv:1903:02428 (2019).
53. 10.3390/ijms22231280810.3390/ijms222312808 ↗
54. 10.1016/j.jinorgbio.2024.11262210.1016/j.jinorgbio.2024.112622 ↗
55. R.Rao J.Meier T.Sercu S.Ovchinnikov andA.Rives “Transformer Protein Language Models Are Unsupervised Structure Learners ”bioRxiv(2020).10.1101/2020.12.15.422761 ↗
56. 10.1021/acs.jcim.8b0071210.1021/acs.jcim.8b00712 ↗
57. 10.1021/acs.jcim.3c0120810.1021/acs.jcim.3c01208 ↗
58. 10.1038/nrd.2017.17810.1038/nrd.2017.178 ↗
59. 10.1016/j.celrep.2024.11412810.1016/j.celrep.2024.114128 ↗
60. 10.1038/s41588-018-0311-910.1038/s41588-018-0311-9 ↗
61. 10.1038/s41588-021-00921-z10.1038/s41588-021-00921-z ↗
62. 10.1186/s13195-020-00760-w10.1186/s13195-020-00760-w ↗
63. 10.1038/s41586-021-03707-910.1038/s41586-021-03707-9 ↗
64. 10.1080/19490976.2022.207378410.1080/19490976.2022.2073784 ↗
65. 10.3389/fmicb.2020.0100810.3389/fmicb.2020.01008 ↗
66. 10.1016/bs.vh.2022.09.00210.1016/bs.vh.2022.09.002 ↗
67. R. L.GouldandR.Pazdro “Impact of Supplementary Amino Acids Micronutrients and Overall Diet on Glutathione Homeostasis ”Nutrients11 no.5(2019):1056.10.3390/nu11051056 ↗
68. 10.3233/JAD-18105410.3233/JAD-181054 ↗
69. 10.1126/science.abm613110.1126/science.abm6131 ↗
70. 10.1371/journal.pone.027827610.1371/journal.pone.0278276 ↗
71. L.Zhang A.Golts andV.Lopez Garcia “Molecular Representations for Drug Discovery ” (2024) accepted.10.1007/978-3-031-81728-1_48 ↗
72. G.Zhou Z.Gao Q.Ding et al. “Uni‐Mol: A Universal 3D Molecular Representation Learning Framework ” (2023) ChemRxiv doi:10.26434/chemrxiv‐2022‐jjm0j‐v4.10.26434/chemrxiv-2022-jjm0j-v3 ↗
73. 10.1038/s41467-024-53742-z10.1038/s41467-024-53742-z ↗
74. 10.1021/acs.jcim.4c0005510.1021/acs.jcim.4c00055 ↗
75. J.Kaplan S.McCandlish T.Henighan et al. “Scaling Laws for Neural Language Models ”arXiv Preprint arXiv:2001.08361(2020).
76. W.Hu B.Liu J.Gomes et al. “Strategies for Pre‐Training Graph Neural Networks ” Feb.2020 arXiv:1905.12265 [cs stat].
77. G.Landrum RDKit: Open‐Source Cheminformatics.
78. 10.1021/ci00057a00510.1021/ci00057a005 ↗
79. 10.1039/C8SC02339E10.1039/C8SC02339E ↗
80. K.He X.Zhang S.Ren andJ.Sun “Deep Residual Learning for Image Recognition ” inProceedings of the IEEE Conference on Computer Vision and Pattern Recognition(2016) pp.770–778.10.1109/CVPR.2016.90 ↗
81. 10.1016/j.neucom.2023.12706310.1016/j.neucom.2023.127063 ↗
82. Katharopoulos A. · 2020 · 5156
83. 10.1021/jm960292810.1021/jm9602928 ↗
84. R.Liaw E.Liang R.Nishihara P.Moritz J. E.Gonzalez andI.Stoica “Tune: A Research Platform for Distributed Model Selection and Training ”arXiv Preprint arXiv:1807.05118(2018).
85. “BERT Loves Chemistry ”https://github.com/seyonechithrananda/bert‐loves‐chemistry(2022).
86. 10.1038/s41586-021-03819-210.1038/s41586-021-03819-2 ↗
87. 10.1021/acs.jcim.1c0020310.1021/acs.jcim.1c00203 ↗
88. 10.1021/ci00054a00810.1021/ci00054a008 ↗
89. 10.1021/ci00046a00210.1021/ci00046a002 ↗
90. 10.1021/ci010132r10.1021/ci010132r ↗
91. 10.1021/ci100050t10.1021/ci100050t ↗