journal article·2023-06-07Open access

A Taxonomic Survey of Physics-Informed Machine Learning

Joseph Pateras, Pratip Rana, Preetam Ghosh

Applied Sciences· Volume 13· Issue 12

Abstract

Physics-informed machine learning (PIML) refers to the emerging area of extracting physically relevant solutions to complex multiscale modeling problems lacking sufficient quantity and veracity of data with learning models informed by physically relevant prior information. This work discusses the recent critical advancements in the PIML domain. Novel methods and applications of domain decomposition in physics-informed neural networks (PINNs) in particular are highlighted. Additionally, we explore recent works toward utilizing neural operator learning to intuit relationships in physics systems traditionally modeled by sets of complex governing equations and solved with expensive differentiation techniques. Finally, expansive applications of traditional physics-informed machine learning and potential limitations are discussed. In addition to summarizing recent work, we propose a novel taxonomic structure to catalog physics-informed machine learning based on how the physics-information is derived and injected into the machine learning process. The taxonomy assumes the explicit objectives of facilitating interdisciplinary collaboration in methodology, thereby promoting a wider characterization of what types of physics problems are served by the physics-informed learning machines and assisting in identifying suitable targets for future work. To summarize, the major twofold goal of this work is to summarize recent advancements and introduce a taxonomic catalog for applications of physics-informed machine learning.
Source: crossref · Quality: baseline

Research context

OpenAlex topics: Model Reduction and Neural Networks · Magnetic Properties and Applications · Nuclear Engineering Thermal-Hydraulics

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

Department of Computer Science, Virginia Commonwealth University, Richmond, VA 23284, USA

Bennett Aerospace, Raleigh, NC 27603, USA

Funding

NSF CBET

References (56)

Show source-provided references
1. Physics-informed machine learning10.1038/s42254-021-00314-5 ↗
2. Physics-informed neural networks (PINNs) for fluid mechanics: A review10.1007/s10409-021-01148-1 ↗
3. Physics-Informed Neural Networks for Heat Transfer Problems10.1115/1.4050542 ↗
4. Modeling, Analysis and Physics Informed Neural Network approaches for studying the dynamics of COVID-19 involving human-human and human-pathogen interaction10.1515/cmb-2022-0001 ↗
5. Fractional SEIR model and data-driven predictions of COVID-19 dynamics of Omicron variant10.1063/5.0099450 ↗
6. Physics-Informed Neural Networks for Cardiac Activation Mapping10.3389/fphy.2020.00042 ↗
7. Machine learning in cardiovascular flows modeling: Predicting arterial blood pressure from non-invasive 4D flow MRI data using physics-informed neural networks10.1016/j.cma.2019.112623 ↗
8. Grandits, T., Pezzuto, S., Costabal, F.S., Perdikaris, P., Pock, T., Plank, G., and Krause, R. (2021). Learning Atrial Fiber Orientations and Conductivity Tensors from Intracardiac Maps Using Physics-Informed Neural Networks. Funct. Imaging Model. Heart, 650–658.10.1007/978-3-030-78710-3_62 ↗
9. Scientific Machine Learning through Physics-Informed Neural Networks: Where we are and What’s Next10.1007/s10915-022-01939-z ↗
10. Deep learning of vortex-induced vibrations10.1017/jfm.2018.872 ↗
11. Hidden physics models: Machine learning of nonlinear partial differential equations10.1016/j.jcp.2017.11.039 ↗
12. Deep Hidden physics-Models: Deep Learning of Nonlinear Partial Differential Equations
13. Raissi, M., Perdikaris, P., and Karniadakis, G.E. (2018). Multistep Neural Networks for Data-driven Discovery of Nonlinear Dynamical Systems. arXiv.
14. Physics-informed neural networks: A deep learning framework for solving forward and inverse problems involving nonlinear partial differential equations10.1016/j.jcp.2018.10.045 ↗
15. Physics-informed machine learning approach for reconstructing Reynolds stress modeling discrepancies based on DNS data10.1103/PhysRevFluids.2.034603 ↗
16. DGM: A deep learning algorithm for solving partial differential equations10.1016/j.jcp.2018.08.029 ↗
17. Solving high-dimensional partial differential equations using deep learning10.1073/pnas.1718942115 ↗
18. Data-driven discovery of partial differential equations10.1126/sciadv.1602614 ↗
19. Long, Z., Lu, Y., Ma, X., and Dong, B. (2018, January 10–15). PDE-Net: Learning PDEs from Data. Proceedings of the 35th International Conference on Machine Learning, Stockholm, Sweden. Available online: http://proceedings.mlr.press/v80/long18a.html?ref=https://githubhelp.com.
20. Deep Theory of Functional Connections: A New Method for Estimating the Solutions of Partial Differential Equations10.3390/make2010004 ↗
21. Physics-informed machine learning approach for augmenting turbulence models: A comprehensive framework10.1103/PhysRevFluids.3.074602 ↗
22. Extended Physics-Informed Neural Networks (XPINNs): A Generalized Space-Time Domain Decomposition Based Deep Learning Framework for Nonlinear Partial Differential Equations10.4208/cicp.OA-2020-0164 ↗
23. When Do Extended Physics-Informed Neural Networks (XPINNs) Improve Generalization?10.1137/21M1447039 ↗
24. Parallel physics-informed neural networks via domain decomposition10.1016/j.jcp.2021.110683 ↗
25. Conservative physics-informed neural networks on discrete domains for conservation laws: Applications to forward and inverse problems10.1016/j.cma.2020.113028 ↗
26. Physics-informed neural networks for inverse problems in supersonic flows10.1016/j.jcp.2022.111402 ↗
27. A computational framework for the indirect estimation of interface thermal resistance of composite materials using XPINNs10.1016/j.ijheatmasstransfer.2022.123420 ↗
28. Hu, Z., Jagtap, A.D., Karniadakis, G.E., and Kawaguchi, K. (2022). Augmented Physics-Informed Neural Networks (APINNs): A gating network-based soft domain decomposition methodology. arXiv.
29. Xu, K., Zhu, W., and Darve, E. (2020). Distributed Machine Learning for Computational Engineering using MPI. arXiv.
30. Learning Nonlinear Constitutive Laws Using Neural Network Models Based on Indirectly Measurable Data10.1115/1.4047036 ↗
31. Physics constrained learning for data-driven inverse modeling from sparse observations10.1016/j.jcp.2021.110938 ↗
32. Li, Z., Kovachki, N., Azizzadenesheli, K., Liu, B., Bhattacharya, K., Stuart, A., and An kumar, A. (2020). Fourier Neural Operator for Parametric Partial Differential Equations. arXiv.
33. On Universal Approximation and Error Bounds for Fourier Neural Operators
34. Deng, B., Shin, Y., Lu, L., Zhang, Z., and Karniadakis, G.E. (2023). Convergence rate of DeepONets for learning operators arising from advection-diffusion equations. arXiv.10.1016/j.neunet.2022.06.019 ↗
35. Li, Z., Zheng, H., Kovachki, N., Jin, D., Chen, H., Liu, B., Azizzadenesheli, K., and An kumar, A. (2022). Physics-Informed Neural Operator for Learning Partial Differential Equations. arXiv.
36. Learning the solution operator of parametric partial differential equations with physics-informed DeepONets10.1126/sciadv.abi8605 ↗
37. Goswami, S., Bora, A., Yu, Y., and Karniadakis, G.E. (2022). Physics-Informed Deep Neural Operator Networks. arXiv.
38. Extreme theory of functional connections: A fast physics-informed neural network method for solving ordinary and partial differential equations10.1016/j.neucom.2021.06.015 ↗
39. Adaptive activation functions accelerate convergence in deep and physics-informed neural networks10.1016/j.jcp.2019.109136 ↗
40. Stiff-PINN: Physics-Informed Neural Network for Stiff Chemical Kinetics10.1021/acs.jpca.1c05102 ↗
41. Multiscale Physics-Informed Neural Networks for Stiff Chemical Kinetics10.1021/acs.jpca.2c06513 ↗
42. fPINNs: Fractional Physics-Informed Neural Networks10.1137/18M1229845 ↗
43. Deep learning of inverse water waves problems using multi-fidelity data: Application to Serre-Green-Naghdi equations10.1016/j.oceaneng.2022.110775 ↗
44. McClenny, L., and Braga-Neto, U. (2022). Self-Adaptive Physics-Informed Neural Networks using a Soft Attention Mechanism. arXiv.10.2139/ssrn.4086448 ↗
45. Physics-informed attention-based neural network for hyperbolic partial differential equations: Application to the Buckley-Leverett problem10.1038/s41598-022-11058-2 ↗
46. Physics-informed neural networks for the point kinetics equations for nuclear reactor dynamics10.1016/j.anucene.2021.108833 ↗
47. Physics-Informed Neural Networks for Optimal Planar Orbit Transfers10.2514/1.A35138 ↗
48. Physics-informed neural networks for rarefied-gas dynamics: Thermal creep flow in the Bhatnagar-Gross-Krook approximation10.1063/5.0046181 ↗
49. De Ryck, T., Jagtap, A.D., and Mishra, S. (2022). Error estimates for physics informed neural networks approximating the Navier-Stokes equations. arXiv.10.1093/imanum/drac085 ↗
50. hp-VPINNs: Variational physics-informed neural networks with domain decomposition10.1016/j.cma.2020.113547 ↗
51. Lu, L., Jin, P., and Karniadakis, G.E. (2019). Deeponet: Learning nonlinear operators for identifying differential equations based on the universal approximation theorem of operators. arXiv.
52. A comprehensive study of non-adaptive and residual-based adaptive sampling for physics-informed neural networks10.1016/j.cma.2022.115671 ↗
53. On the eigenvector bias of Fourier feature networks: From regression to solving multi-scale PDEs with physics-informed neural networks10.1016/j.cma.2021.113938 ↗
54. When and why PINNs fail to train: A neural tangent kernel perspective10.1016/j.jcp.2021.110768 ↗
55. Estimates on the generalization error of physics-informed neural networks for approximating a class of inverse problems for PDEs10.1093/imanum/drab032 ↗
56. Krishnapriyan, A., Gholami, A., Zhe, S., Kirby, R., and Mahoney, M.W. (2021). Characterizing possible failure modes in physics-informed neural networks. Adv. Neural Inf. Process. Syst., 34, Available online: https://proceedings.neurips.cc/paper/2021/hash/df438e5206f31600e6ae4af72f2725f1-Abstract.html.