journal article·2022-03-01Open access

Predicting micro-bubble dynamics with semi-physics-informed deep learning

Hanfeng Zhai, Quan Zhou, Guohui Hu

AIP Advances· Volume 12· Issue 3

Abstract

Utilizing physical information to improve the performance of the conventional neural networks is becoming a promising research direction in scientific computing recently. For multiphase flows, it would require significant computational resources for neural network training due to the large gradients near the interface between the two fluids. Based on the idea of the physics-informed neural networks (PINNs), a modified deep learning framework BubbleNet is proposed to overcome this difficulty in the present study. The deep neural network (DNN) with separate sub-nets is adopted to predict physics fields, with the semi-physics-informed part encoding the continuity equation and the pressure Poisson equation P for supervision and the time discretized normalizer to normalize field data per time step before training. Two bubbly flows, i.e., single bubble flow and multiple bubble flow in a microchannel, are considered to test the algorithm. The conventional computational fluid dynamics software is applied to obtain the training dataset. The traditional DNN and the BubbleNet(s) are utilized to train the neural network and predict the flow fields for the two bubbly flows. Results indicate the BubbleNet frameworks are able to successfully predict the physics fields, and the inclusion of the continuity equation significantly improves the performance of deep NNs. The introduction of the Poisson equation also has slightly positive effects on the prediction results. The results suggest that constructing semi-PINNs by flexibly considering the physical information into neural networks will be helpful in the learning of complex flow problems.
Source: crossref · Quality: baseline

Research context

OpenAlex topics: Lattice Boltzmann Simulation Studies · Fluid Dynamics and Turbulent Flows · Model Reduction and Neural Networks

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

Shanghai Key Laboratory of Mechanics in Energy Engineering, School of Mechanics and Engineering Science, Shanghai Institute of Applied Mathematics and Mechanics, Shanghai University 1 , Shanghai 200072, People’s Republic of China

Sibley School of Mechanical and Aerospace Engineering, Cornell University 2 , Ithaca, New York 14850, USA

Funding

National Natural Science Foundation of China · Key Research Project of Zhejiang Laboratory

References (64)

Show source-provided references
1. 1997
2. Mastering the game of Go with deep neural networks and tree search10.1038/nature16961 ↗
3. Mastering the game of Go without human knowledge10.1038/nature24270 ↗
4. Improved protein structure prediction using potentials from deep learning10.1038/s41586-019-1923-7 ↗
5. MinePath: Mining for phenotype differential sub-paths in molecular pathways10.1371/journal.pcbi.1005187 ↗
6. Automated machine learning: Review of the state-of-the-art and opportunities for healthcare10.1016/j.artmed.2020.101822 ↗
7. Artificial intelligence and big data in public health10.3390/ijerph15122796 ↗
8. Artificial intelligence: Opportunities and risks for public health10.1016/s2589-7500(19)30002-0 ↗
9. Prediction of disease progression in patients with COVID-19 by artificial intelligence assisted lesion quantification10.1038/s41598-020-79097-1 ↗
10. N. S. Punn , S. K.Sonbhadra, and S.Agarwal, “COVID-19 epidemic analysis using machine learning and deep learning algorithms,” medRxiv:2020.04.08.20057679v1 (2020).10.1101/2020.04.08.20057679 ↗
11. Deep learning in Alzheimer’s disease: Diagnostic classification and prognostic prediction using neuroimaging data10.3389/fnagi.2019.00220 ↗
12. Data-driven modeling and prediction of blood glucose dynamics: Machine learning applications in type 1 diabetes10.1016/j.artmed.2019.07.007 ↗
13. Artificial intelligence for the detection of COVID-19 pneumonia on chest CT using multinational datasets10.1038/s41467-020-17971-2 ↗
14. AI-driven quantification, staging and outcome prediction of COVID-19 pneumonia10.1016/j.media.2020.101860 ↗
15. Deep learning velocity signals allow quantifying turbulence intensity10.1126/sciadv.aba7281 ↗
16. Deep model predictive flow control with limited sensor data and online learning10.1007/s00162-020-00520-4 ↗
17. Using deep learning to learn physics of conduction heat transfer10.1007/s10973-020-09875-6 ↗
18. Deep learning based monitoring of furnace combustion state and measurement of heat release rate10.1016/j.energy.2017.05.012 ↗
19. Sparse identification of nonlinear dynamics10.1073/pnas.1517384113 ↗
20. Data-driven discovery of partial differential equations10.1126/sciadv.1602614 ↗
21. Z. Li , N.Kovachki, K.Azizzadenesheli, “Neural operator: Graph Kernelnetwork for partial differential equations,” ICLR 2020 Workshop on Integration of Deep Neural Models and Differential Equations (2020).
22. Z. Li , N.Kovachki, K.Azizzadenesheli, “Fourier neural operator for parametric partial differential equations,” International Conference on Learning Representations, 2021.
23. C. Jiang , S.Esmaeilzadeh, K.Azizzadenesheli, “MESHFREEFLOWNET: A physics-constrained deep continuous space-time super-resolution framework,” SC20: International Conference for High Performance Computing, Networking, Storage and Analysis, 2020, 1–15.10.1109/SC41405.2020.00013 ↗
24. Deep potential molecular dynamics: A scalable model with the accuracy of quantum mechanics10.1103/physrevlett.120.143001 ↗
25. DeePMD-kit: A deep learning package for many-body potential energy representation and molecular dynamics10.1016/j.cpc.2018.03.016 ↗
26. DeePCG: Constructing coarse-grained models via deep neural networks10.1063/1.5027645 ↗
27. Physics-informed neural networks: A deep learning framework for solving forward and inverse problems involving nonlinear partial differential equations10.1016/j.jcp.2018.10.045 ↗
28. M. Raissi , P.Perdikaris, and G. E.Karniadakis, “Physics informed deep learning (Part I): Data-driven solutions of nonlinear partial differential equations,” arXiv:1711.10561 (2019).
29. M. Raissi , P.Perdikaris, and G. E.Karniadakis, “Physics informed deep learning (Part II): Data-driven discovery of nonlinear partial differential equations,” arXiv:1711.10566 (2019).
30. L. Lu , X.Meng, Z.Mao, and G. E.Karniadakis, “DeepXDE: A deep learning library for solving differential equations,” SIAM Review 63(1), 208–228 (2021).10.1137/19M1274067 ↗
31. DeepONet: Learning nonlinear operators for identifying differential equations based on the universal approximation theorem of operators10.1038/s42256-021-00302-5 ↗
32. Universal approximation to nonlinear operators by neural networks with arbitrary activation functions and its application to dynamical systems10.1109/72.392253 ↗
33. DeepM&Mnet: Inferring the electroconvection multiphysics fields based on operator approximation by neural networks10.1016/j.jcp.2021.110296 ↗
34. DeepM&Mnet for hypersonics: Predicting the coupled flow and finite-rate chemistry behind a normal shock using neural-network approximation of operators10.1016/j.jcp.2021.110698 ↗
35. Conservative physics-informed neural networks on discrete domains for conservation laws: Applications to forward and inverse problems10.1016/j.cma.2020.113028 ↗
36. Extended physics-informed neural networks (XPINNs): A generalized space-time domain decomposition based deep learning framework for nonlinear partial differential equations10.4208/cicp.OA-2020-0164 ↗
37. PPINN: Parareal physics-informed neural network for time-dependent PDEs10.1016/j.cma.2020.113250 ↗
38. Physics-informed deep learning for incompressible laminar flows10.1016/j.taml.2020.01.039 ↗
39. Physics-informed neural networks for high-speed flows10.1016/j.cma.2019.112789 ↗
40. Towards physics-informed deep learning for turbulent flow prediction
41. Operator learning for predicting multiscale bubble growth dynamics10.1063/5.0041203 ↗
42. Informed machine learning—A taxonomy and survey of integrating prior knowledge into learning systems
43. Ultrasonic excitation of a bubble inside a deformable tube: Implications for ultrasonically induced hemorrhage10.1121/1.2967488 ↗
44. Mechanisms of microbubble–vessel interactions and induced stresses: A numerical study10.1121/1.4817843 ↗
45. Microbubbles and blood brain barrier opening: A numerical study on acoustic emissions and wall stress predictions10.1109/tbme.2014.2385651 ↗
46. Expanding 3D geometry for enhanced on-chip microbubble production and single step formation of liposome modified microbubbles10.1039/c2lc40634a ↗
47. Circulatory bubble dynamics: From physical to biological aspects10.1016/j.cis.2014.01.017 ↗
48. Role of the channel geometry on the bubble pinch-off in flow-focusing devices10.1103/PhysRevLett.100.034504 ↗
49. Analysis of the dripping–jetting transition in compound capillary jets10.1017/s0022112010000443 ↗
50. Microbubble formation and pinch-off scaling exponent in flow-focusing devices10.1063/1.3631323 ↗
51. Production of microbubbles from axisymmetric flow focusing in the jetting regime for moderate Reynolds numbers10.1103/PhysRevE.89.063012 ↗
52. Forced wetting transition and bubble pinch-off in a capillary tube10.1103/PhysRevLett.120.084501 ↗
53. Maintaining monodispersity in a microbubble population formed by flow-focusing10.1021/la703065v ↗
54. Microbubble flows in superwettable fluidic channels10.1039/c9ra04212a ↗
55. Automatic differentiation in machine learning: A survey
56. 2020 · 203
57. 2005
58. 1997
59. Interstitial fluid pressure10.1152/physrev.1971.51.3.527 ↗
60. Red blood cell deformation in microconfined flow10.1039/b904584h ↗
61. Interactions between gas—Liquid mass transfer and bubble behaviours10.1098/rsos.190136 ↗
62. Physics-informed machine learning10.1038/s42254-021-00314-5 ↗
63. R. Wang , K.Kashinath, M.Mustafa, “Towards physics-informed deep learning for turbulent flow prediction,” OpenReview, https://openreview.net/forum?id=Hkg5lAEtvS.
64. H. Zhai (2021). “Data for BubbleNet code & micro-bubbles system dynamics simulation (v.0.0),” Zenodo. https://doi.org/10.5281/zenodo.4769081