Mesh-Free Surrogate Models for Structural Mechanic FEM Simulation: A Comparative Study of Approaches
Source abstract
Abstract
The technical world of today fundamentally relies on structural analysis in the form of design and structural mechanic simulations. A traditional and robust simulation method is the physics-based finite element method (FEM) simulation. FEM simulations in structural mechanics are known to be very accurate; however, the higher the desired resolution, the more computational effort is required. Surrogate modeling provides a robust approach to address this drawback. Nonetheless, finding the right surrogate model and its hyperparameters for a specific use case is not a straightforward process. In this paper, we discuss and compare several classes of mesh-free surrogate models based on traditional and thriving machine learning (ML) and deep learning (DL) methods. We show that relatively simple algorithms (such as k-nearest neighbor regression) can be competitive in applications with low geometrical complexity and extrapolation requirements. With respect to tasks exhibiting higher geometric complexity, our results show that recent DL methods at the forefront of literature (such as physics-informed neural networks) are complicated to train and to parameterize and thus, require further research before they can be put to practical use. In contrast, we show that already well-researched DL methods, such as the multi-layer perceptron, are superior with respect to interpolation use cases and can be easily trained with available tools. With our work, we thus present a basis for the selection and practical implementation of surrogate models.
Source: crossref · Quality: baseline
Research context
OpenAlex topics: Model Reduction and Neural Networks · Structural Health Monitoring Techniques · Probabilistic and Robust Engineering Design
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
Affiliations
Know-Center GmbH, Research Center for Data-Driven Business & Big Data Analytics, Inffeldgasse 13, 8010 Graz, Austria
Institute of Interactive Systems and Data Science, Graz University of Technology, Inffeldgasse 16c, 8010 Graz, Austria
Funding
Austrian Research Promotion Agency
References (54)
Show source-provided references
1. Reddy, J.N. (2019). Introduction to the Finite Element Method, McGraw Hill Education. Mechanical Engineering.
2. Computational Optimization, Modelling and Simulation: Recent Trends and Challenges10.1016/j.procs.2013.05.250 ↗
3. Prediction of damage evolution in forged aluminium metal matrix composites using a neural network approach10.1016/S0924-0136(98)00153-8 ↗
4. Modeling of manufacturing processes with ANNs for intelligent manufacturing10.1016/S0890-6955(99)00094-2 ↗
5. Prediction of the response under impact of steel armours using a multilayer perceptron10.1007/s00521-006-0050-1 ↗
6. Generalizable surrogate model features to approximate stress in 3D trusses10.1016/j.engappai.2018.01.006 ↗
7. An integrated FEM and ANN methodology for metal-formed product design10.1016/j.engappai.2008.04.001 ↗
8. Neural Network Multiobjective Optimization of Hot Forging10.1016/j.procir.2017.12.251 ↗
9. A neural network-assisted finite element analysis of cold flat rolling10.1016/j.engappai.2006.10.001 ↗
10. Real-time biomechanical modeling of the liver using Machine Learning models trained on Finite Element Method simulations10.1016/j.eswa.2019.113083 ↗
11. Prediction and optimization of mechanical properties of composites using convolutional neural networks10.1016/j.compstruct.2019.111264 ↗
12. Pfaff, T., Fortunato, M., Sanchez-Gonzalez, A., and Battaglia, P.W. (May, January 26). Learning Mesh-Based Simulation with Graph Networks. Proceedings of the International Conference on Learning Representations (ICLR), Addis Ababa, Ethiopia.
13. Loghin, A., and Ismonov, S. (2019, January 14ߝ19). Augmenting Generic Fatigue Crack Growth Models Using 3D Finite Element Simulations and Gaussian Process Modeling. Proceedings of the ASME 2019 Pressure Vessels & Piping Conference, San Antonio, TX, USA.10.1115/PVP2019-93153 ↗
14. A hybrid process model for EDM based on finite-element method and Gaussian process regression10.1007/s00170-014-5989-y ↗
15. Metamodel-based lightweight design of B-pillar with TWB structure via support vector regression10.1016/j.compstruc.2009.07.008 ↗
16. Uncertainty optimization of dental implant based on finite element method, global sensitivity analysis and support vector regression. Proceedings of the Institution of Mechanical Engineers10.1177/0954411918819116 ↗
17. Modelling and Simulation of Milling Forces Using an Arbitrary Lagrangian–Eulerian Finite Element Method and Support Vector Regression10.1007/s10957-011-9927-y ↗
18. A finite element-based machine learning approach for modeling the mechanical behavior of the breast tissues under compression in real-time10.1016/j.compbiomed.2017.09.019 ↗
19. Zhang, W., Zhang, R., Wu, C., Goh, A.T.C., and Wang, L. (2020). Assessment of basal heave stability for braced excavations in anisotropic clay using extreme gradient boosting and random forest regression. Undergr. Space.
20. Prediction of mechanical properties of carbon fiber based on cross-scale FEM and machine learning10.1016/j.compstruct.2019.01.042 ↗
21. SciANN: A Keras/TensorFlow wrapper for scientific computations and physics-informed deep learning using artificial neural networks10.1016/j.cma.2020.113552 ↗
22. A physics-informed deep learning framework for inversion and surrogate modeling in solid mechanics10.1016/j.cma.2021.113741 ↗
23. On the Convergence of Physics Informed Neural Networks for Linear Second-Order Elliptic and Parabolic Type PDEs10.4208/cicp.OA-2020-0193 ↗
24. Non-invasive Inference of Thrombus Material Properties with Physics-Informed Neural Networks10.1016/j.cma.2020.113603 ↗
25. State–space modeling for control based on physics-informed neural networks10.1016/j.engappai.2021.104195 ↗
26. A physics-informed machine learning approach for solving heat transfer equation in advanced manufacturing and engineering applications10.1016/j.engappai.2021.104232 ↗
27. A tutorial on solving ordinary differential equations using Python and hybrid physics-informed neural network10.1016/j.engappai.2020.103996 ↗
28. NSFnets (Navier-Stokes flow nets): Physics-informed neural networks for the incompressible Navier-Stokes equations10.1016/j.jcp.2020.109951 ↗
29. Physics-informed neural networks for high-speed flows10.1016/j.cma.2019.112789 ↗
30. Bayesian Neural Networks: An Introduction and Survey10.1007/978-3-030-42553-1_3 ↗
31. Dy, J., and Krause, A. (2018, January 10–15). Conditional Neural Processes. Proceedings of the 35th International Conference on Machine Learning, Stockholm, Sweden.
32. Wang, S., Teng, Y., and Perdikaris, P. (2020). Understanding and mitigating gradient pathologies in physics-informed neural networks. arXiv.10.1137/20M1318043 ↗
33. fPINNs: Fractional Physics-Informed Neural Networks10.1137/18M1229845 ↗
34. Adversarial uncertainty quantification in physics-informed neural networks10.1016/j.jcp.2019.05.027 ↗
35. Physics-informed neural networks: A deep learning framework for solving forward and inverse problems involving nonlinear partial differential equations10.1016/j.jcp.2018.10.045 ↗
36. Ngatchou, P., Zarei, A., and El-Sharkawi, A. (2005, January 6–10). Pareto Multi Objective Optimization. Proceedings of the 13th International Conference on Intelligent Systems Application to Power Systems, Arlington, VA, USA.
37. Pettit, C.L., and Wilson, D.K. (2020, January 7–11). A physics-informed neural network for sound propagation in the atmospheric boundary layer. Proceedings of the 179th Meeting of the Acoustical Society of America, Acoustics Virtually Everywhere.10.1121/2.0001383 ↗
38. Lihua, L. (2021). Simulation physics-informed deep neural network by adaptive Adam optimization method to perform a comparative study of the system. Eng. Comput., 1–20.
39. McClenny, L., and Braga-Neto, U. (2020). Self-Adaptive Physics-Informed Neural Networks using a Soft Attention Mechanism. arXiv.
40. Adaptive activation functions accelerate convergence in deep and physics-informed neural networks10.1016/j.jcp.2019.109136 ↗
41. (2020, November 05). 1.11. Ensemble Methods—Scikit-Learn 0.24.1 Documentation (2021.000Z). Available online: https://scikit-learn.org/stable/modules/ensemble.html.
42. Greedy Function Approximation: A Gradient Boosting Machine10.1214/aos/1013203451 ↗
43. (2020, November 05). 1.6. Nearest Neighbors—Scikit-Learn 0.24.1 Documentation (2021.000Z). Available online: https://scikit-learn.org/stable/modules/neighbors.html.
44. A tutorial on Gaussian process regression: Modelling, exploring, and exploiting functions10.1016/j.jmp.2018.03.001 ↗
45. Rasmussen, C.E., and Williams, C.K.I. (2008). Gaussian Processes for Machine Learning, MIT Press. [3rd ed.]. Adaptive Computation and Machine Learning.
46. Awad, M., and Khanna, R. (2015). Support Vector Regression. Efficient Learning Machines. Theories, Concepts, and Applications for Engineers and System Designers, Apress Open. The Expert’s Voice in Machine Learning.10.1007/978-1-4302-5990-9 ↗
47. A tutorial on support vector regression10.1023/B:STCO.0000035301.49549.88 ↗
48. Introduction to multi-layer feed-forward neural networks10.1016/S0169-7439(97)00061-0 ↗
49. Multilayer feedforward networks with a nonpolynomial activation function can approximate any function10.1016/S0893-6080(05)80131-5 ↗
50. Lu, Z., Pu, H., Wang, F., Hu, Z., and Wang, L. (2017, January 4–9). The Expressive Power of Neural Networks: A View from the Width. Proceedings of the 31st International Conference on Neural Information Processing Systems, Long Beach, CA, USA.
51. Multilayer feedforward networks are universal approximators10.1016/0893-6080(89)90020-8 ↗
52. Artificial neural networks (the multilayer perceptron)—A review of applications in the atmospheric sciences10.1016/S1352-2310(97)00447-0 ↗
53. Learning representations by back-propagating errors10.1038/323533a0 ↗
54. Lu, L., Pestourie, R., Yao, W., Wang, Z., Verdugo, F., and Johnson, S.G. (2021). Physics-informed neural networks with hard constraints for inverse design. arXiv.10.1137/21M1397908 ↗