Novel Method to Improve the Convergence of Physics-Informed Neural Networks for Complex Thermal Simulations
Source abstract
Abstract
In the context of developing PINN methods for real-time digital twins in manufacturing processes, we propose a new approach that combines two complementary weighting strategies to significantly improve their convergence. The first method, called SD-PINN, balances the loss terms associated with the governing equations, boundary conditions, and initial conditions, ensuring that their contributions are dimensionally consistent and therefore comparable in magnitude. The second method, called SDFEET-PINN, rescales the terms of the governing equations during the early stages of training. This facilitates learning by temporarily modifying the equations to make terms comparable in amplitude, and then progressively restoring the original formulation, thereby preserving the influence of lower-magnitude terms that are often neglected in standard PINN approaches. We apply these methods to transient thermal problems, which are critical for predicting defects in Powder Bed Fusion (PBF). A range of 2D configurations with complex boundary conditions is used to test robustness, and a practical case study is carried out on heat transfer in a complex 3D geometry previously investigated both numerically and experimentally in PBF. Results show that the combined SD-PINN and SDFEET-PINN approach achieves higher predictive accuracy and stability compared to classical PINNs. Furthermore, we introduce an Adaptive Learning Rate strategy that reduces the step size after initial stabilization, further enhancing predictive performance and enabling efficient convergence across all test cases.
Source: crossref · Quality: baseline
Research context
OpenAlex topics: Additive Manufacturing Materials and Processes · Model Reduction and Neural Networks · Machine Learning in Materials Science
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
Affiliations
Laboratoire Génie de Production (LGP), Université de Technologie Tarbes Occitanie Pyrénées (UTTOP), Université de Toulouse, 47 avenue d’Azereix, 65016 Tarbes, France
References (34)
Show source-provided references
1. Additive manufacturing of alloys with programmable microstructure and properties10.1038/s41467-023-42326-y ↗
2. Steels in additive manufacturing: A review of their microstructure and properties10.1016/j.msea.2019.138633 ↗
3. Influence of Si precipitates on fracture mechanisms of AlSi10Mg parts processed by Selective Laser Melting10.1016/j.actamat.2019.06.013 ↗
4. Computer simulation of microstructure development in powder-bed additive manufacturing with crystallographic texture10.1088/1361-651X/ac03a6 ↗
5. Khdoudi, A., Masrour, T., Hassani, I.E., and Mazgualdi, C.E. (2024). A Deep-Reinforcement-Learning-Based Digital Twin for Manufacturing Process Optimization. Systems, 12.10.3390/systems12020038 ↗
6. Machine learning for metal additive manufacturing: Predicting temperature and melt pool fluid dynamics using physics-informed neural networks10.1007/s00466-020-01952-9 ↗
7. Probabilistic Digital Twin for Additive Manufacturing Process Design and Control10.1115/1.4054521 ↗
8. Physics-informed neural network-based surrogate model for a virtual thermal sensor with real-time simulation10.1016/j.ijheatmasstransfer.2023.124392 ↗
9. Knowledge-driven digital twin manufacturing cell towards intelligent manufacturing10.1080/00207543.2019.1607978 ↗
10. Global-to-local simulation of the thermal history in the laser powder bed fusion process based on a multiscale finite element approach10.1007/s00170-023-11427-9 ↗
11. Substitution de modèle et approche multifidélité en expérimentation numérique [Surrogate modeling and multifidelity approach in computer experimentation]
12. Physics Informed Neural Networks towards the real-time calculation of heat fluxes at W7-X10.1016/j.nme.2023.101401 ↗
13. Physics-informed neural networks: A deep learning framework for solving forward and inverse problems involving nonlinear partial differential equations10.1016/j.jcp.2018.10.045 ↗
14. Weak form theory-guided neural network (TgNN-wf) for deep learning of subsurface single- and two-phase flow10.1016/j.jcp.2021.110318 ↗
15. A Lagrangian dual-based theory-guided deep neural network10.1007/s40747-022-00738-1 ↗
16. A self-adaptive physics-informed neural networks method for large strain consolidation analysis10.1016/j.compgeo.2025.107131 ↗
17. Enhancing PINNs for solving PDEs via adaptive collocation point movement and adaptive loss weighting10.1007/s11071-023-08654-w ↗
18. An efficient framework for solving forward and inverse problems of nonlinear Partial Differential Equations via enhanced physics-informed neural network based on adaptive learning10.1063/5.0168390 ↗
19. Self-adaptive loss balanced Physics-informed neural networks10.1016/j.neucom.2022.05.015 ↗
20. An improved physics-informed neural network with adaptive weighting and mixed differentiation for solving the incompressible Navier–Stokes equations10.1007/s11071-024-09856-6 ↗
21. Physics-informed neural networks with adaptive loss weighting algorithm for solving partial differential equations10.1016/j.camwa.2025.01.007 ↗
22. Sequencing Initial Conditions in Physics-Informed Neural Networks10.56946/jce.v3i1.345 ↗
23. Hemodynamics modeling with physics-informed neural networks: A progressive boundary complexity approach10.1016/j.cma.2025.117851 ↗
24. Curriculum-Transfer-Learning Based Physics-Informed Neural Networks for Long-Term Simulation of Physical and Mechanical Behaviors
25. Münzer, M., and Bard, C. (2022, January 3). A Curriculum-Training-Based Strategy for Distributing Collocation Points during Physics-Informed Neural Network Training. Proceedings of the Machine Learning and the Physical Sciences Workshop, New Orleans, LA, USA.
26. Multi-layer thermal simulation using physics-informed neural network
27. Ghungrad, S., Gould, B., Wolff, S., and Haghighi, A. (2022). Physics-Informed Artificial Intelligence for Temperature Prediction in Metal Additive Manufacturing: A Comparative Study. Volume 1: Additive Manufacturing Biomanufacturing; Life Cycle Engineering; Manufacturing Equipment and Automation; Nano/Micro/Meso Manufacturing, American Society of Mechanical Engineers.10.1115/MSEC2022-85159 ↗
28. Solving free-surface problems for non-shallow water using boundary and initial conditions-free physics-informed neural network (bif-PINN)10.1016/j.jcp.2023.112003 ↗
29. Physics-informed PointNet: A deep learning solver for steady-state incompressible flows and thermal fields on multiple sets of irregular geometries10.1016/j.jcp.2022.111510 ↗
30. Physics informed neural network for dynamic stress prediction10.1007/s10489-023-04923-8 ↗
31. Numerical modelling of parts distortion and beam supports breakage during selective laser melting (SLM) additive manufacturing10.1007/s00170-021-08501-5 ↗
32. Benoist, V., Arnaud, L., Baili, M., and Faye, P. (2018, January 17–18). Topological optimization design for additive manufacturing, taking into account flexion and vibrations during machining post processing operations. Proceedings of the 14th International Conference on High Speed Machining, San Sebastián, Spain.
33. Physics-informed neural networks for solving forward and inverse flow problems via the Boltzmann-BGK formulation10.1016/j.jcp.2021.110676 ↗
34. Solving partial differential equations with hybridized physic-informed neural network and optimization approach: Incorporating genetic algorithms and L-BFGS for improved accuracy10.1016/j.aej.2023.06.047 ↗