journal article·2023-11

An encoder-decoder model with embedded attention-mechanism for efficient meshfree prediction of slope failure

Jun Chen, Dongdong Wang, Like Deng, Jijun Ying

Publisher page

Abstract

The particle-based meshfree methods provide an effective means for large deformation simulation of the slope failure. Despite the advances of various efficient meshfree algorithmic developments, the computational efficiency still limits the application of meshfree methods for practical problems. This study aims at accelerating the meshfree prediction of the slope failure through introducing an encoder-decoder model, which is particularly enhanced by the attention-mechanism. The encoder-decoder model is designed to capture the long sequence character of meshfree slope failure analysis. The discretization flexibility of meshfree methods offers an easy match between the meshfree particles and machine learning samples and thus the resulting surrogate model for meshfree slope failure prediction has a quite wide applicability. In the meantime, the embedding of the attention-mechanism into the encoder-decoder neural network not only enables a significant reduction of the number of meshfree model parameters, but also maintains the key features of meshfree simulation and effectively alleviates the information dilution issue. It is shown that the proposed encoder-decoder model with embedded attention mechanism gives a more favorable prediction on the meshfree slope failure simulation in comparison to the general encoder-decoder formalism.
Source: crossref · Quality: baseline

Research context

OpenAlex topics: Landslides and related hazards · Geotechnical Engineering and Analysis · Soil and Unsaturated Flow

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

Fujian Key Laboratory of Digital Simulations for Coastal Civil Engineering, Department of Civil Engineering, Institute of Artificial Intelligence, Xiamen University, Xiamen, China

Funding

National Natural Science Foundation of China · Natural Science Foundation of Fujian Province of China

References (59)

Show source-provided references
1. 10.1186/s40323-022-00233-910.1186/s40323-022-00233-9 ↗
2. Bahdanau D, Cho K, andBengio Y (2014) Neural machine translation by jointly learning to align and translate. In: International conference on learning representations arXiv: 1409.0473.
3. 10.1016/S0045-7825(96)01078-X10.1016/S0045-7825(96)01078-X ↗
4. 10.1109/TPAMI.2012.8910.1109/TPAMI.2012.89 ↗
5. 10.1061/(ASCE)EM.1943-7889.000117610.1061/(ASCE)EM.1943-7889.0001176 ↗
6. 10.1002/nme.451210.1002/nme.4512 ↗
7. 10.1016/S0045-7825(96)01083-310.1016/S0045-7825(96)01083-3 ↗
8. Chen J · Chinese Journal of Theoretical and Applied Mechanics · 2022 · 54 · 732
9. 10.1002/(SICI)1097-0207(20000310)47:7<1303::AID-NME826>3.0.CO;2-510.1002/(SICI)1097-0207(20000310)47:7<1303::AID-NME826>3.0.CO;2-5 ↗
10. 10.1002/1097-0207(20010120)50:2<435::AID-NME32>3.0.CO;2-A10.1002/1097-0207(20010120)50:2<435::AID-NME32>3.0.CO;2-A ↗
11. 10.1002/nme.33810.1002/nme.338 ↗
12. Cho K · Conference on empirical methods in natural language processing · 2014
13. 10.1007/s12665-015-4923-410.1007/s12665-015-4923-4 ↗
14. 10.1016/j.cma.2022.11578210.1016/j.cma.2022.115782 ↗
15. 10.1146/annurev.ne.18.030195.00120510.1146/annurev.ne.18.030195.001205 ↗
16. 10.1007/s10346-012-0326-810.1007/s10346-012-0326-8 ↗
17. 10.1016/j.cma.2012.07.01910.1016/j.cma.2012.07.019 ↗
18. 10.1016/j.compgeo.2007.06.00410.1016/j.compgeo.2007.06.004 ↗
19. 10.1093/mnras/181.3.37510.1093/mnras/181.3.375 ↗
20. 10.1016/j.mechmat.2009.01.03010.1016/j.mechmat.2009.01.030 ↗
21. 10.1007/s41095-022-0271-y10.1007/s41095-022-0271-y ↗
22. 10.1016/j.enggeo.2017.01.01610.1016/j.enggeo.2017.01.016 ↗
23. 10.1109/34.73055810.1109/34.730558 ↗
24. 10.1016/j.neucom.2015.08.11810.1016/j.neucom.2015.08.118 ↗
25. 10.1016/j.actaastro.2022.02.02910.1016/j.actaastro.2022.02.029 ↗
26. 10.1016/0020-7683(89)90015-210.1016/0020-7683(89)90015-2 ↗
27. 10.1061/(ASCE)0733-9399(1989)115:11(2507)10.1061/(ASCE)0733-9399(1989)115:11(2507) ↗
28. 10.1177/105678951140736010.1177/1056789511407360 ↗
29. 10.1007/s12205-013-0550-310.1007/s12205-013-0550-3 ↗
30. 10.1090/S0025-5718-1981-0616367-110.1090/S0025-5718-1981-0616367-1 ↗
31. 10.1109/TII.2020.299384210.1109/TII.2020.2993842 ↗
32. Li S · 2004
33. 10.1016/j.enggeo.2014.11.01410.1016/j.enggeo.2014.11.014 ↗
34. 10.1201/978142008210410.1201/9781420082104 ↗
35. 10.1002/fld.165020082410.1002/fld.1650200824 ↗
36. 10.1016/j.enggeo.2021.10649410.1016/j.enggeo.2021.106494 ↗
37. 10.1086/11216410.1086/112164 ↗
38. 10.1007/s40571-019-00253-010.1007/s40571-019-00253-0 ↗
39. Mnih V · Advances in Neural Information Processing Systems · 2014 · 3
40. Simo JC · 1998
41. 10.1016/0020-7683(87)90083-710.1016/0020-7683(87)90083-7 ↗
42. 10.1109/JBHI.2020.298692610.1109/JBHI.2020.2986926 ↗
43. 10.1177/105678951245593810.1177/1056789512455938 ↗
44. 10.1016/j.enganabound.2013.09.00110.1016/j.enganabound.2013.09.001 ↗
45. 10.1007/s11431-010-4287-710.1007/s11431-010-4287-7 ↗
46. 10.1007/s11709-018-0467-510.1007/s11709-018-0467-5 ↗
47. 10.1016/j.cma.2019.02.02910.1016/j.cma.2019.02.029 ↗
48. 10.3390/rs1306105510.3390/rs13061055 ↗
49. 10.1109/CVPR42600.2020.0115510.1109/CVPR42600.2020.01155 ↗
50. 10.1007/s00466-016-1299-610.1007/s00466-016-1299-6 ↗
51. 10.1016/j.cma.2020.11363110.1016/j.cma.2020.113631 ↗
52. 10.2113/gseegeosci.17.3.26710.2113/gseegeosci.17.3.267 ↗
53. 10.1007/s10346-018-01127-x10.1007/s10346-018-01127-x ↗
54. 10.1109/ICYCS.2008.16310.1109/ICYCS.2008.163 ↗
55. 10.1016/j.dsp.2021.10313910.1016/j.dsp.2021.103139 ↗
56. Zhang X · 2004
57. 10.1016/j.ijmst.2022.02.00410.1016/j.ijmst.2022.02.004 ↗
58. 10.1007/s10346-018-1022-010.1007/s10346-018-1022-0 ↗
59. Zienkiewicz OC · 2014