journal article·2025-10Open access

Designing lipid nanoparticles using a transformer-based neural network

Alvin Chan, Ameya R. Kirtane, Qing Rui Qu, Xisha Huang, Jonathan Woo, Deepak A. Subramanian, Rajib Dey, Rika Semalty, Joshua D. Bernstock, Taksim Ahmed, Rowan Honeywell, Charles Hanhurst, Isaac Diaz Becdach, Leah S. Prizant, Ashley K. Brown, Hao Song, Justin Law Cobb, Louis B. DeRidder, Bruna Santos, Miguel Jimenez, Michelle Sun, Yuebin Huang, Ceara Byrne, Giovanni Traverso

Nature Nanotechnology· Volume 20· Issue 10

Abstract

Abstract The RNA medicine revolution has been spurred by lipid nanoparticles (LNPs). The effectiveness of an LNP is determined by its lipid components and their ratios; however, experimental optimization is laborious and does not explore the full design space. Computational approaches such as deep learning can be greatly beneficial, but the composite nature of LNPs limits the effectiveness of existing single molecule-based algorithms to LNPs. Addressing this, our approach integrates the multi-component and multimodal features of composite formulations such as LNPs to predict their performance in an end-to-end manner. Here we generate one of the largest LNP datasets (LANCE) by varying LNP formulations to train our deep learning model, COMET. This transformer-based neural network not only accurately predicts the efficacy of LNPs but is adaptable to non-canonical LNP formulations such as those with two ionizable lipids and polymeric materials. Furthermore, COMET can predict LNP performance in a cell line outside of LANCE and predict LNP stability during lyophilization using only small training datasets. Experimental validation showed that our approach can identify LNPs that exhibit strong protein expression in vitro and in vivo, promising accelerated development of nucleic acid therapies with extensive potential across therapeutic and manufacturing applications.
Source: crossref · Quality: baseline

Research context

OpenAlex topics: Lipid Membrane Structure and Behavior · Computational Drug Discovery Methods · SARS-CoV-2 and COVID-19 Research

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

References (58)

Show source-provided references
1. Cheng, Q. et al. Selective organ targeting (SORT) nanoparticles for tissue-specific mRNA delivery and CRISPR–Cas gene editing. Nat. Nanotechnol. 15, 313–320 (2020).10.1038/s41565-020-0669-6 ↗
2. Ball, R. L., Bajaj, P. & Whitehead, K. A. Achieving long-term stability of lipid nanoparticles: examining the effect of pH, temperature, and lyophilization. Int. J. Nanomed. 12, 305–315 (2016).10.2147/IJN.S123062 ↗
3. Abramson, A. et al. Oral mRNA delivery using capsule-mediated gastrointestinal tissue injections. Matter 5, 975–987 (2022).10.1016/j.matt.2021.12.022 ↗
4. Reker, D. et al. ‘Inactive’ ingredients in oral medications. Sci. Transl. Med. 11, 6753 (2019).10.1126/scitranslmed.aau6753 ↗
5. Dahlman, J. E. et al. Barcoded nanoparticles for high throughput in vivo discovery of targeted therapeutics. Proc. Natl Acad. Sci. USA 114, 2060–2065 (2017).10.1073/pnas.1620874114 ↗
6. Sago, C. D. et al. High-throughput in vivo screen of functional mRNA delivery identifies nanoparticles for endothelial cell gene editing. Proc. Natl Acad. Sci. USA https://doi.org/10.1073/pnas.1811276115 (2018).10.1073/pnas.1811276115 ↗
7. Guimaraes, P. P. G. et al. Ionizable lipid nanoparticles encapsulating barcoded mRNA for accelerated in vivo delivery screening. J. Control. Release 316, 404–417 (2019).10.1016/j.jconrel.2019.10.028 ↗
8. Rhym, L. H., Manan, R. S., Koller, A., Stephanie, G. & Anderson, D. G. Peptide-encoding mRNA barcodes for the high-throughput in vivo screening of libraries of lipid nanoparticles for mRNA delivery. Nat. Biomed. Eng. 7, 901–910 (2023).10.1038/s41551-023-01030-4 ↗
9. Yang, K. et al. Analyzing learned molecular representations for property prediction. J. Chem. Inf. Model. 59, 3370–3388 (2019).10.1021/acs.jcim.9b00237 ↗
10. Ross, J. et al. Large-scale chemical language representations capture molecular structure and properties. Nat. Mach. Intell. 4, 1256–1264 (2022).10.1038/s42256-022-00580-7 ↗
11. Zhou, G. et al. Uni-Mol: a universal 3D molecular representation learning framework. In The Eleventh International Conference on Learning Representations (2023).10.26434/chemrxiv-2022-jjm0j-v4 ↗
12. Hou, X., Zaks, T., Langer, R. & Dong, Y. Lipid nanoparticles for mRNA delivery. Nat. Rev. Mater. 6, 1078–1094 (2021).10.1038/s41578-021-00358-0 ↗
13. Han, X. et al. An ionizable lipid toolbox for RNA delivery. Nat. Commun. 12, 7233 (2021).
14. Mitchell, M. J. et al. Engineering precision nanoparticles for drug delivery. Nat. Rev. Drug Discov. 20, 101–124 (2021).10.1038/s41573-020-0090-8 ↗
15. Baden, L. R. et al. Efficacy and safety of the mRNA-1273 SARS-CoV-2 vaccine. N. Engl. J. Med. 384, 403–416 (2021).10.1056/NEJMoa2035389 ↗
16. Polack, F. P. et al. Safety and efficacy of the BNT162b2 mRNA Covid-19 vaccine. N. Engl. J. Med. 383, 2603–2615 (2020).10.1056/NEJMoa2034577 ↗
17. Swingle, K. L., Hamilton, A. G. & Mitchell, M. J. Lipid nanoparticle-mediated delivery of mRNA therapeutics and vaccines. Trends Mol. Med. 27, 616–617 (2021).10.1016/j.molmed.2021.03.003 ↗
18. Chaudhary, N., Weissman, D. & Whitehead, K. A. mRNA vaccines for infectious diseases: principles, delivery and clinical translation. Nat. Rev. Drug Discov. 20, 817–838 (2021).10.1038/s41573-021-00283-5 ↗
19. Tenchov, R., Bird, R., Curtze, A. E. & Zhou, Q. Lipid nanoparticles—from liposomes to mRNA vaccine delivery, a landscape of research diversity and advancement. ACS Nano 15, 16982–17015 (2021).10.1021/acsnano.1c04996 ↗
20. Kauffman, K. J. et al. Optimization of lipid nanoparticle formulations for mRNA delivery in vivo with fractional factorial and definitive screening designs. Nano Lett. 15, 7300–7306 (2015).10.1021/acs.nanolett.5b02497 ↗
21. Hassett, K. J. et al. Optimization of lipid nanoparticles for intramuscular administration of mRNA vaccines. Mol. Ther. Nucleic Acids 15, 1–11 (2019).10.1016/j.omtn.2019.01.013 ↗
22. Lokugamage, M. P. et al. Optimization of lipid nanoparticles for the delivery of nebulized therapeutic mRNA to the lungs. Nat. Biomed. Eng. 5, 1059–1068 (2021).10.1038/s41551-021-00786-x ↗
23. Melamed, J. R. et al. Ionizable lipid nanoparticles deliver mRNA to pancreatic β cells via macrophage-mediated gene transfer. Sci. Adv. 9, 1444 (2023).10.1126/sciadv.ade1444 ↗
24. Reker, D. et al. Computationally guided high-throughput design of self-assembling drug nanoparticles. Nat. Nanotechnol. 16, 725–733 (2021).10.1038/s41565-021-00870-y ↗
25. Xu, Y. et al. AGILE platform: a deep learning powered approach to accelerate LNP development for mRNA delivery. Nat. Commun. 15, 6305 (2024).10.1038/s41467-024-50619-z ↗
26. Li, B. et al. Accelerating ionizable lipid discovery for mRNA delivery using machine learning and combinatorial chemistry. Nat. Mater. https://doi.org/10.1038/s41563-024-01867-3 (2024).10.1038/s41563-024-01867-3 ↗
27. Cheng, L. et al. Machine learning elucidates design features of plasmid deoxyribonucleic acid lipid nanoparticles for cell type-preferential transfection. ACS Nano 18, 28735–28747 (2024).10.1021/acsnano.4c07615 ↗
28. Ding, D. Y., Zhang, Y., Jia, Y. & Sun, J. Machine learning-guided lipid nanoparticle design for mRNA delivery. In 2023 ICML Workshop on Computational Biology (2023).
29. Lewis, M. M., Beck, T. J. & Ghosh, D. Applying machine learning to identify ionizable lipids for nanoparticle-mediated delivery of mRNA. Preprint at bioRxiv https://doi.org/10.1101/2023.11.09.565872 (2023).10.1101/2023.11.09.565872 ↗
30. Achiam, J. et al. GPT-4 technical report. Preprint at https://arxiv.org/abs/2303.08774 (2023).
31. Gemini Team Google et al. Gemini: a family of highly capable multimodal models. Preprint at https://arxiv.org/abs/2312.11805 (2023).
32. Vaswani, A. et al. Attention is all you need. In Proc. 31st International Conference on Neural Information Processing Systems 6000–6010 (2017).
33. Liu, B., Liu, X., Jin, X., Stone, P. & Liu, Q. Conflict-averse gradient descent for multi-task learning. Adv. Neural Inf. Process. Syst. 34, 18878–18890 (2021).
34. Dietterich, T. G. Ensemble methods in machine learning. In International Workshop on Multiple Classifier Systems 1–15 (Springer, 2000).10.1007/3-540-45014-9_1 ↗
35. Ganaie, M. A., Hu, M., Malik, A., Tanveer, M. & Suganthan, P. Ensemble deep learning: a review. Eng. Appl. Artif. Intell. 115, 105151 (2022).10.1016/j.engappai.2022.105151 ↗
36. Patel, S. et al. Naturally-occurring cholesterol analogues in lipid nanoparticles induce polymorphic shape and enhance intracellular delivery of mRNA. Nat. Commun. 11, 983 (2020).
37. Zhu, X. et al. Surface de-PEGylation controls nanoparticle-mediated siRNA delivery in vitro and in vivo. Theranostics 7, 1990 (2017).10.7150/thno.18136 ↗
38. Zhang, Y. & Yang, Q. A survey on multi-task learning. IEEE Trans. Knowl. Data Eng. 34, 5586–5609 (2021).10.1109/TKDE.2021.3070203 ↗
39. Schoenmaker, L. et al. mRNA-lipid nanoparticle COVID-19 vaccines: structure and stability. Int. J. Pharm. 601, 120586 (2021).10.1016/j.ijpharm.2021.120586 ↗
40. Adams, D. et al. Patisiran, an RNAi therapeutic, for hereditary transthyretin amyloidosis. N. Engl. J. Med. 379, 11–21 (2018).10.1056/NEJMoa1716153 ↗
41. Akinc, A., Anderson, D. G., Lynn, D. M. & Langer, R. Synthesis of poly(β-amino ester)s optimized for highly effective gene delivery. Bioconjug. Chem. 14, 979–988 (2003).10.1021/bc034067y ↗
42. Eygeris, Y., Patel, S., Jozic, A. & Sahay, G. Deconvoluting lipid nanoparticle structure for messenger RNA delivery. Nano Lett. 20, 4543–4549 (2020).10.1021/acs.nanolett.0c01386 ↗
43. Medjmedj, A. et al. In cellulo and in vivo comparison of cholesterol, beta-sitosterol and dioleylphosphatidylethanolamine for lipid nanoparticle formulation of mRNA. Nanomaterials 12, 2446 (2022).10.3390/nano12142446 ↗
44. Douka, S. et al. Lipid nanoparticle-mediated messenger RNA delivery for ex vivo engineering of natural killer cells. J. Control. Release 361, 455–469 (2023).10.1016/j.jconrel.2023.08.014 ↗
45. Sundararajan, M., Taly, A. & Yan, Q. Axiomatic attribution for deep networks. In International Conference on Machine Learning 3319–3328 (PMLR, 2017).
46. Akinc, A. et al. A combinatorial library of lipid-like materials for delivery of RNAi therapeutics. Nat. Biotechnol. 26, 561–569 (2008).10.1038/nbt1402 ↗
47. Whitehead, K. A. et al. Degradable lipid nanoparticles with predictable in vivo siRNA delivery activity. Nat. Commun. 5, 4277 (2014).10.1038/ncomms5277 ↗
48. Jiang, A. Y. et al. Combinatorial development of nebulized mRNA delivery formulations for the lungs. Nat. Nanotechnol. 19, 364–375 (2024).10.1038/s41565-023-01548-3 ↗
49. Paunovska, K. et al. A direct comparison of in vitro and in vivo nucleic acid delivery mediated by hundreds of nanoparticles reveals a weak correlation. Nano Lett. 18, 2148–2157 (2018).10.1021/acs.nanolett.8b00432 ↗
50. Miao, L. et al. Delivery of mRNA vaccines with heterocyclic lipids increases anti-tumor efficacy by STING-mediated immune cell activation. Nat. Biotechnol. 37, 1174–1185 (2019).10.1038/s41587-019-0247-3 ↗
51. Zhu, Y. et al. Multi-step screening of DNA/lipid nanoparticles and co-delivery with siRNA to enhance and prolong gene expression. Nat. Commun. 13, 4282 (2022).
52. Li, B. et al. Combinatorial design of nanoparticles for pulmonary mRNA delivery and genome editing. Nat. Biotechnol. 41, 1410–1415 (2023).10.1038/s41587-023-01679-x ↗
53. Shuaibi, M. et al. Rotation invariant graph neural networks using spin convolutions. Preprint at https://arxiv.org/abs/2106.09575 (2021).
54. Devlin, J., Chang, M.-W., Lee, K. & Toutanova, K. BERT: pre-training of deep bidirectional transformers for language understanding. In Proc. NAACL-HLT Vol. 1, 2 (2019).
55. Xiong, R. et al. On layer normalization in the transformer architecture. In International Conference on Machine Learning 10524–10533 (PMLR, 2020).
56. Ouyang, L. et al. Training language models to follow instructions with human feedback. Adv. Neural Inf. Process. Syst. 35, 27730–27744 (2022).
57. Touvron, H. et al. Llama 2: open foundation and fine-tuned chat models. Preprint at https://arxiv.org/abs/2307.09288 (2023).
58. Whitehead, K. A. et al. Synergistic silencing: combinations of lipid-like materials for efficacious siRNA delivery. Mol. Ther. 19, 1688–1694 (2011).10.1038/mt.2011.141 ↗