journal article·2020-06-05Open access

Neural network learns physical rules for copolymer translocation through amphiphilic barriers

Marco Werner, Yachong Guo, Vladimir A. Baulin

npj Computational Materials· Volume 6· Issue 1

Abstract

Abstract Recent developments in computer processing power lead to new paradigms of how problems in many-body physics and especially polymer physics can be addressed. Parallel processors can be exploited to generate millions of molecular configurations in complex environments at a second, and concomitant free-energy landscapes can be estimated. Databases that are complete in terms of polymer sequences and architecture form a powerful training basis for cross-checking and verifying machine learning-based models. We employ an exhaustive enumeration of polymer sequence space to benchmark the prediction made by a neural network. In our example, we consider the translocation time of a copolymer through a lipid membrane as a function of its sequence of hydrophilic and hydrophobic units. First, we demonstrate that massively parallel Rosenbluth sampling for all possible sequences of a polymer allows for meaningful dynamic interpretation in terms of the mean first escape times through the membrane. Second, we train a multi-layer neural network on logarithmic translocation times and show by the reduction of the training set to a narrow window of translocation times that the neural network develops an internal representation of the physical rules for sequence-controlled diffusion barriers. Based on the narrow training set, the network result approximates the order of magnitude of translocation times in a window that is several orders of magnitude wider than the training window. We investigate how prediction accuracy depends on the distance of unexplored sequences from the training window.
Source: crossref · Quality: baseline

Research context

OpenAlex topics: Advanced Physical and Chemical Molecular Interactions · Force Microscopy Techniques and Applications · Electrostatics and Colloid Interactions

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

References (68)

Show source-provided references
1. Lutz, J.-F., Ouchi, M., Liu, D. R. & Sawamoto, M. Sequence-controlled polymers. Science 341, 1238149 (2013).10.1126/science.1238149 ↗
2. Lutz, J.-F. Defining the field of sequence-controlled polymers. Macromol. Rapid Commun. 38, 1700582 (2017).10.1002/marc.201700582 ↗
3. Rahman, M. A. et al. Macromolecular-clustered facial amphiphilic antimicrobials. Nat. Commun. 9, 5231 (2018).10.1038/s41467-018-07651-7 ↗
4. Guo, Y. & Baulin, V. A. GPU implementation of the Rosenbluth generation method for static Monte Carlo simulations. Comput. Phys. Commun. 216, 95–101 (2017).10.1016/j.cpc.2017.03.006 ↗
5. Ren, Y. & Müller, M. Kinetics of pattern formation in symmetric diblock copolymer melts. J. Chem. Phys. 148, 204908 (2018).10.1063/1.5027741 ↗
6. Behler, J. & Parrinello, M. Generalized neural-network representation of high-dimensional potential-energy surfaces. Phys. Rev. Lett. 98, 146401 (2007).10.1103/PhysRevLett.98.146401 ↗
7. Bartók, A. P., Payne, M. C., Kondor, R. & Csányi, G. Gaussian approximation potentials: the accuracy of quantum mechanics, without the electrons. Phys. Rev. Lett. 104, 136403 (2010).10.1103/PhysRevLett.104.136403 ↗
8. Carrasquilla, J. & Melko, R. G. Machine learning phases of matter. Nat. Phys. 13, 431 (2017).10.1038/nphys4035 ↗
9. Wei, Q., Melko, R. G. & Chen, J. Z. Y. Identifying polymer states by machine learning. Phys. Rev. E 95, 032504 (2017).10.1103/PhysRevE.95.032504 ↗
10. Iten, R., Metger, T., Wilming, H., delRio, L. & Renner, R. Discovering physical concepts with neural networks. Phys. Rev. Lett. 124, 010508 (2020).10.1103/PhysRevLett.124.010508 ↗
11. AlQuraishi, M. End-to-end differentiable learning of protein structure. Cell Syst. 8, 292–301 (2019).10.1016/j.cels.2019.03.006 ↗
12. Hoffmann, C., Menichetti, R., Kanekal, K. H. & Bereau, T. Controlled exploration of chemical space by machine learning of coarse-grained representations. Phys. Rev. E 100, 033302 (2019).10.1103/PhysRevE.100.033302 ↗
13. Wilbraham, L., Sprick, R. S., Jelfs, K. E. & Zwijnenburg, M. A. Mapping binary copolymer property space with neural networks. Chem. Sci. 10, 4973–4984 (2019).10.1039/C8SC05710A ↗
14. St.John, P. C. et al. Message-passing neural networks for high-throughput polymer screening. J. Chem. Phys. 150, 234111 (2019).10.1063/1.5099132 ↗
15. Muthukumar, M. Polymer translocation through a hole. J. Chem. Phys. 111, 10371 (1999).10.1063/1.480386 ↗
16. Muthukumar, M. Translocation of a confined polymer through a hole. Phys. Rev. Lett. 86, 3188–3191 (2001).10.1103/PhysRevLett.86.3188 ↗
17. Muthukumar, M. Theory of sequence effects on DNA translocation through proteins and nanopores. Electrophoresis 23, 1417–1420 (2002).10.1002/1522-2683(200205)23:10<1417::AID-ELPS1417>3.0.CO;2-O ↗
18. Mirigian, S., Wang, Y. & Muthukumar, M. Translocation of a heterogeneous polymer. J. Chem. Phys. 137, 064904 (2012).10.1063/1.4742970 ↗
19. Wong, C. T. A. & Muthukumar, M. Polymer translocation through a cylindrical channel. J. Chem. Phys. 128, 154903 (2008).10.1063/1.2897932 ↗
20. Sun, L.-Z., Wang, C.-H., Luo, M.-B. & Li, H. Trapped and non-trapped polymer translocations through a spherical pore. J. Chem. Phys. 150, 024904 (2019).10.1063/1.5063331 ↗
21. Kasianowicz, J. J., Brandin, E., Branton, D. & Deamer, D. W. Characterization of individual polynucleotide molecules using a membrane channel. Proc. Natl Acad. Sci. USA 93, 13770–13773 (1996).10.1073/pnas.93.24.13770 ↗
22. Li, J., Gershow, M., Stein, D., Brandin, E. & Golovchenko, J. A. DNA molecules and configurations in a solid-state nanopore microscope. Nat. Mater. 2, 611–615 (2003).10.1038/nmat965 ↗
23. Clarke, J. et al. Continuous base identification for single-molecule nanopore DNA sequencing. Nat. Nanotechnol. 4, 265–270 (2009).10.1038/nnano.2009.12 ↗
24. Katz, Y. & Diamond, J. M. A method for measuring nonelectrolyte partition coefficients between liposomes and water. J. Membr. Biol. 17, 69–86 (1974).10.1007/BF01870173 ↗
25. Diamond, J. M. & Katz, Y. Interpretation of nonelectrolyte partition coefficients between dimyristoyl lecithin and water. J. Membr. Biol. 17, 121–154 (1974).10.1007/BF01870176 ↗
26. Sommer, J.-U., Werner, M. & Baulin, V. A. Critical adsorption controls translocation of polymer chains through lipid bilayers and permeation of solvent. Europhys. Lett. 98, 18003 (2012).10.1209/0295-5075/98/18003 ↗
27. Werner, M., Bathmann, J., Baulin, V. A. & Sommer, J.-U. Thermal tunneling of homopolymers through amphiphilic membranes. ACS Macro Lett. 6, 247–251 (2017).10.1021/acsmacrolett.6b00980 ↗
28. Werner, M., Sommer, J.-U. & Baulin, V. A. Homo-polymers with balanced hydrophobicity translocate through lipid bilayers and enhance local solvent permeability. Soft Matter 8, 11714–11722 (2012).10.1039/c2sm26008e ↗
29. Stepanow, S., Bauerschafer, U. & Sommer, J. U. Adsorption of polymers at interfaces and extended defects. Phys. Rev. E 54, 3899–3905 (1996).10.1103/PhysRevE.54.3899 ↗
30. Soteros, C. E. & Whittington, S. G. The statistical mechanics of random copolymers. J. Phys. A Math. Gen. 37, R279 (2004).10.1088/0305-4470/37/41/R01 ↗
31. Werner, M. & Sommer, J.-U. Translocation and induced permeability of random amphiphilic copolymers interacting with lipid bilayer membranes. Biomacromolecules 16, 125–135 (2015).10.1021/bm501266x ↗
32. Goda, T., Goto, Y. & Ishihara, K. Cell-penetrating macromolecules: direct penetration of amphipathic phospholipid polymers across plasma membrane of living cells. Biomaterials 31, 2380–2387 (2010).10.1016/j.biomaterials.2009.11.095 ↗
33. Goda, T., Ishihara, K. & Miyahara, Y. Critical update on 2-methacryloyloxyethyl phosphorylcholine (MPC) polymer science. J. Appl. Polym. Sci. 132, 41766 (2015).10.1002/app.41766 ↗
34. Goda, T. et al. Translocation mechanisms of cell-penetrating polymers identified by induced proton dynamics. Langmuir 35, 8167–8173 (2019).10.1021/acs.langmuir.9b00856 ↗
35. Marks, J. R., Placone, J., Hristova, K. & Wimley, W. C. Spontaneous membrane-translocating peptides by orthogonal high-throughput screening. J. Am. Chem. Soc. 133, 8995–9004 (2011).10.1021/ja2017416 ↗
36. Kauffman, W. B., Fuselier, T., He, J. & Wimley, W. C. Mechanism matters: a taxonomy of cell penetrating peptides. Trends Biochem. Sci. 40, 749–764 (2015).10.1016/j.tibs.2015.10.004 ↗
37. Fuselier, T. & Wimley, W. C. Spontaneous membrane translocating peptides: the role of leucine-arginine consensus motifs. Biophys. J. 113, 835–846 (2017).10.1016/j.bpj.2017.06.070 ↗
38. Kauffman, W. B., Guha, S. & Wimley, W. C. Synthetic molecular evolution of hybrid cell penetrating peptides. Nat. Commun. 9, 2568 (2018).10.1038/s41467-018-04874-6 ↗
39. Joyce, S. J., Osguthorpe, D. J., Padgett, J. A. & Price, G. J. Neural network prediction of glass-transition temperatures from monomer structure. J. Chem. Soc. Faraday Trans. 91, 2491–2496 (1995).10.1039/ft9959102491 ↗
40. Ulmer II, C. W., Smith, D. A., Sumpter, B. G. & Noid, D. I. Computational neural networks and the rational design of polymeric materials: the next generation polycarbonates. Comput. Theor. Polym. Sci. 8, 311–321 (1998).10.1016/S1089-3156(98)00035-X ↗
41. Mattioni, B. E. & Jurs, P. C. Prediction of glass transition temperatures from monomer and repeat unit structure using computational neural networks. J. Chem. Inf. Comput. Sci. 42, 232–240 (2002).10.1021/ci010062o ↗
42. Duce, C., Micheli, A., Starita, A., Tiné, M. R. & Solaro, R. Prediction of polymer properties from their structure by recursive neural networks. Macromol. Rapid Commun. 27, 711–715 (2006).10.1002/marc.200600026 ↗
43. Duce, C., Micheli, A., Solaro, R., Starita, A. & Tiné, M. R. Recursive neural networks prediction of glass transition temperature from monomer structure: an application to acrylic and methacrylic polymers. J. Math. Chem. 46, 729–755 (2009).10.1007/s10910-009-9547-z ↗
44. Molina, J., Laroche, A., Richard, J.-V., Schuller, A.-S. & Rolando, C. Neural networks are promising tools for the prediction of the viscosity of unsaturated polyester resins. Front. Chem. 7, 375 (2019).10.3389/fchem.2019.00375 ↗
45. Bernazzani, L., Duce, C., Micheli, A., Mollica, V. & Tiné, M. R. Quantitative structure-property relationship (QSPR) prediction of solvation gibbs energy of bifunctional compounds by recursive neural networks. J. Chem. Eng. Data 55, 5425–5428 (2010).10.1021/je100535p ↗
46. Funahashi, K.-I. On the approximate realization of continuous mappings by neural networks. Neural Netw. 2, 183–192 (1989).10.1016/0893-6080(89)90003-8 ↗
47. Cybenko, G. Approximation by superpositions of a sigmoidal function. Math. Control Signal Syst. 2, 303–314 (1989).10.1007/BF02551274 ↗
48. Caruana, R. Multitask learning. Mach. Learn. 28, 41–75 (1997).10.1023/A:1007379606734 ↗
49. Dahl, G. E., Jaitly, N. & Salakhutdinov, R. Multi-task neural networks for QSAR predictions. Preprint at https://arxiv.org/abs/1406.1231 (2014).
50. Ma, J., Sheridan, R. P., Liaw, A., Dahl, G. E. & Svetnik, V. Deep neural nets as a method for quantitative structure-activity relationships. J. Chem. Inf. Model. 55, 263–274 (2015).10.1021/ci500747n ↗
51. Ramsundar, B. et al. Massively multitask networks for drug discovery. Preprint at https://arxiv.org/abs/1502.02072 (2015).
52. Hughes, T. B., Dang, N. L., Miller, G. P. & Swamidass, S. J. Modeling reactivity to biological macromolecules with a deep multitask network. ACS Cent. Sci. 2, 529–537 (2016).10.1021/acscentsci.6b00162 ↗
53. Rosenbluth, M. N. & Rosenbluth, A. W. Monte Carlo calculation of the average extension of molecular chains. J. Chem. Phys. 23, 356–359 (1955).10.1063/1.1741967 ↗
54. Shaffer, J. S. Effects of chain topology on polymer dynamics: bulk melts. J. Chem. Phys. 101, 4205 (1994).10.1063/1.467470 ↗
55. Dotera, T. & Hatano, A. The diagonal bond method: a new lattice polymer model for simulation study of block copolymers. J. Chem. Phys. 105, 8413–8427 (1996).10.1063/1.472696 ↗
56. Pontryagin, L., Andronov, A. & Vitt, A. On the statistical investigation of dynamic systems. Zh. Eksper. Teor. Fiz. 3, 165–180 (1933).
57. Rumelhart, D. E., Hinton, G. E. & Williams, R. J. Learning representations by back-propagating errors. Nature 323, 533 (1986).10.1038/323533a0 ↗
58. Grassberger, P. Monte Carlo simulation of 3D self-avoiding walks. J. Phys. A Math. Gen. 26, 2769 (1993).10.1088/0305-4470/26/12/017 ↗
59. Duplantier, B. Polymer network of fixed topology: renormalization, exact critical exponent γ in two dimensions, and d = 4 − ϵ. Phys. Rev. Lett. 57, 941–944 (1986).10.1103/PhysRevLett.57.941 ↗
60. De Gennes, P.-G. Scaling Concepts in Polymer Physics, 1st edn (Cornell University Press, Ithaca, NY, 1979).
61. Hegger, R. & Grassberger, P. Chain polymers near an adsorbing surface. J. Phys. A Math. Gen. 27, 4069 (1994).10.1088/0305-4470/27/12/015 ↗
62. Grassberger, P. Simulations of grafted polymers in a good solvent. J. Phys. A Math. Gen. 38, 323 (2005).10.1088/0305-4470/38/2/003 ↗
63. Clisby, N., Conway, A. R. & Guttmann, A. J. Three-dimensional terminally attached self-avoiding walks bridges. J. Phys. A Math. Theor. 49, 015004 (2016).10.1088/1751-8113/49/1/015004 ↗
64. Hsu, H.-P., Nadler, W. & Grassberger, P. Scaling of star polymers with 1-80 arms. Macromolecules 37, 4658–4663 (2004).10.1021/ma0355958 ↗
65. Schram, R. D., Barkema, G. T. & Bisseling, R. H. Exact enumeration of self-avoiding walks. Theory Exp. 2011, P06019 (2011).
66. Clisby, N., Liang, R. & Slade, G. Self-avoiding walk enumeration via the lace expansion. J. Phys. A Math. Theor. 40, 10973 (2007).10.1088/1751-8113/40/36/003 ↗
67. Marrink, S.-J. & Berendsen, H. J. C. Permeation process of small molecules across lipid membranes studied by molecular dynamics simulations. J. Phys. Chem. 100, 16729–16738 (1996).10.1021/jp952956f ↗
68. Pogodin, S. & Baulin, V. A. Can a carbon nanotube pierce through a phospholipid bilayer? ACS Nano 4, 5293–5300 (2010).10.1021/nn1016549 ↗