journal article·2023-12-25Open access

A Hard-Constraint Wide-Body Physics-Informed Neural Network Model for Solving Multiple Cases in Forward Problems for Partial Differential Equations

Simin Chen, Zhixiang Liu, Wenbo Zhang, Jinkun Yang

Applied Sciences· Volume 14· Issue 1

Abstract

In the fields of physics and engineering, it is crucial to understand phase transition dynamics. This field involves fundamental partial differential equations (PDEs) such as the Allen–Cahn, Burgers, and two-dimensional (2D) wave equations. In alloys, the evolution of the phase transition interface is described by the Allen–Cahn equation. Vibrational and wave phenomena during phase transitions are modeled using the Burgers and 2D wave equations. The combination of these equations gives comprehensive information about the dynamic behavior during a phase transition. Numerical modeling methods such as finite difference method (FDM), finite volume method (FVM) and finite element method (FEM) are often applied to solve phase transition problems that involve many partial differential equations (PDEs). However, physical problems can lead to computational complexity, increasing computational costs dramatically. Physics-informed neural networks (PINNs), as new neural network algorithms, can integrate physical law constraints with neural network algorithms to solve partial differential equations (PDEs), providing a new way to solve PDEs in addition to the traditional numerical modeling methods. In this paper, a hard-constraint wide-body PINN (HWPINN) model based on PINN is proposed. This model improves the effectiveness of the approximation by adding a wide-body structure to the approximation neural network part of the PINN architecture. A hard constraint is used in the physically driven part instead of the traditional practice of PINN constituting a residual network with boundary or initial conditions. The high accuracy of HWPINN for solving PDEs is verified through numerical experiments. One-dimensional (1D) Allen–Cahn, one-dimensional Burgers, and two-dimensional wave equation cases are set up for numerical experiments. The properties of the HWPINN model are inferred from the experimental data. The solution predicted by the model is compared with the FDM solution for evaluating the experimental error in the numerical experiments. HWPINN shows great potential for solving the PDE forward problem and provides a new approach for solving PDEs.
Source: crossref · Quality: baseline

Research context

OpenAlex topics: Model Reduction and Neural Networks · Magnetic Properties and Applications · Neural Networks and Applications

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

College of Information Technology, Shanghai Ocean University, Shanghai 201306, China

National Marine Data and Information Service, Tianjin 300171, China

Funding

National Key Research and Development Program of China · National Natural Science Foundation of China · Shanghai Sailing Program · hanghai Key Laboratory of Trustworthy Computing · Startup Foundation forYoung Teachers of Shanghai Ocean University

References (41)

Show source-provided references
1. Zienkiewicz, O.C., Taylor, R.L., and Zhu, J.Z. (2010). The Finite Element Method: Its Basis and Fundamentals, Elsevier. [6th ed.].
2. Finite Difference Method for Numerical Computation of Discontinuous Solutions of the Equations of Fluid Dynamics
3. Finite Volume Methods
4. Nürnberger, G., Schmidt, J.W., and Walz, G. (1997). Multivariate Approximation and Splines, Birkhäuser Basel.10.1007/978-3-0348-8871-4 ↗
5. ML-LBM: Predicting and Accelerating Steady State Flow Simulation in Porous Media with Convolutional Neural Networks10.1007/s11242-021-01590-6 ↗
6. Regularized Thermal Lattice Boltzmann Method for Natural Convection with Large Temperature Differences10.1016/j.ijheatmasstransfer.2018.05.051 ↗
7. Karniadakis, G., Beskok, A., and Aluru, N. (2006). Microflows and Nanoflows: Fundamentals and Simulation, Springer Science & Business Media.
8. Mahony, N.O., Campbell, S., Carvalho, A., Harapanahalli, S., Velasco-Hernandez, G., Krpalkova, L., Riordan, D., and Walsh, J. (2020). Advances in Intelligent Systems and Computing, Springer.
9. Speech Recognition Using Deep Neural Networks: A Systematic Review10.1109/ACCESS.2019.2896880 ↗
10. Chowdhury, G.G. (2020). Fundamentals of Artificial Intelligence, Springer.10.1007/978-81-322-3972-7 ↗
11. Deep Learning for Object Detection and Scene Perception in Self-Driving Cars: Survey, Challenges, and Open Issues10.1016/j.array.2021.100057 ↗
12. Deep Learning for Hyperspectral Image Classification: An Overview10.1109/TGRS.2019.2907932 ↗
13. Dai, Y., Wu, Y., Zhou, F., and Barnard, K. (2021, January 3–8). Asymmetric Contextual Modulation for Infrared Small Target Detection. Proceedings of the IEEE Winter Conference on Applications of Computer Vision (WACV), Waikoloa, HI, USA.10.1109/WACV48630.2021.00099 ↗
14. Deep Semantic Segmentation of Natural and Medical Images: A Review10.1007/s10462-020-09854-1 ↗
15. Yang, S., Wang, Y., and Chu, X. (2020). A Survey of Deep Learning Techniques for Neural Machine Translation. arXiv.
16. Artificial Neural Networks (the Multilayer Perceptron)—A Review of Applications in the Atmospheric Sciences10.1016/S1352-2310(97)00447-0 ↗
17. A Survey of Convolutional Neural Networks: Analysis, Applications, and Prospects10.1109/TNNLS.2021.3084827 ↗
18. Salehinejad, H., Sankar, S., Barfett, J., Colak, E., and Valaee, S. (2018). Recent Advances in Recurrent Neural Networks. arXiv.
19. Neural-Network-Based Approximations for Solving Partial Differential Equations10.1002/cnm.1640100303 ↗
20. Physics-Informed Neural Networks: A Deep Learning Framework for Solving Forward and Inverse Problems Involving Nonlinear Partial Differential Equations10.1016/j.jcp.2018.10.045 ↗
21. Raissi, M., Perdikaris, P., and Karniadakis, G.E. (2017). Physics Informed Deep Learning (Part I): Data-Driven Solutions of Nonlinear Partial Differential Equations. arXiv.
22. Raissi, M., Perdikaris, P., and Karniadakis, G.E. (2017). Physics Informed Deep Learning (Part II): Data-Driven Discovery of Nonlinear Partial Differential Equations. arXiv.
23. Liu, Z., Chen, Y., Song, G., Song, W., and Xu, J. (2023). Combination of Physics-Informed Neural Networks and Single-Relaxation-Time Lattice Boltzmann Method for Solving Inverse Problems in Fluid Mechanics. Mathematics, 11.10.20944/preprints202309.0642.v1 ↗
24. Physics-Informed Neural Networks for Solving Forward and Inverse Flow Problems via the Boltzmann-BGK Formulation10.1016/j.jcp.2021.110676 ↗
25. Stiff-PINN: Physics-Informed Neural Network for Stiff Chemical Kinetics10.1021/acs.jpca.1c05102 ↗
26. Applications of Physics-Informed Neural Networks in Power Systems—A Review10.1109/TPWRS.2022.3162473 ↗
27. Low-Temperature Plasma Simulation Based on Physics-Informed Neural Networks: Frameworks and Preliminary Applications10.1063/5.0106506 ↗
28. Physics-Informed Neural Networks of the Saint-Venant Equations for Downscaling a Large-Scale River Model10.1029/2022WR033168 ↗
29. Moseley, B., Markham, A., and Nissen-Meyer, T. (2020). Solving the Wave Equation with Physics-Informed Deep Learning. arXiv.
30. Physics-Informed Neural Networks with Hard Constraints for Inverse Design10.1137/21M1397908 ↗
31. Fultz, B. (2020). Phase Transitions in Materials, Cambridge University Press.10.1017/9781108641449 ↗
32. Solution of Burgers’ Equation Appears in Fluid Mechanics by Multistage Optimal Homotopy Asymptotic Method10.2298/TSCI210302343W ↗
33. An Augmented Lagrangian Method for Optimization Problems with Structured Geometric Constraints10.1007/s10107-022-01870-z ↗
34. Periodic Boundary Condition and Its Numerical Implementation Algorithm for the Evaluation of Effective Mechanical Properties of the Composites with Complicated Micro-Structures10.1016/j.compositesb.2018.10.053 ↗
35. Comparison of Min-Max Normalization and Z-Score Normalization in the K-Nearest Neighbor (KNN) Algorithm to Test the Accuracy of Types of Breast Cancer10.47738/ijiis.v4i1.73 ↗
36. Datta, L. (2020). A Survey on Activation Functions and Their Relation with Xavier and He Normal Initialization. arXiv.
37. Kingma, D.P., and Ba, J. (2014). Adam: A Method for Stochastic Optimization. arXiv.
38. RES: Regularized Stochastic BFGS Algorithm10.1109/TSP.2014.2357775 ↗
39. Time-Fractional Allen-Cahn Equations: Analysis and Numerical Methods10.1007/s10915-020-01351-5 ↗
40. Phase Transitions in Particle Physics—Results and Perspectives from Lattice Quantum Chromo-Dynamics10.1016/j.ppnp.2023.104070 ↗
41. Physics Informed Machine Learning: Seismic Wave Equation10.1016/j.gsf.2020.07.007 ↗