journal article·2025-12-26Open access

Res-FormerNet: A Residual–Transformer Fusion Network for 2-D Magnetotelluric Inversion

Junhu Yu, Xingong Tang, Zhitao Xiong

Applied Sciences· Volume 16· Issue 1

Abstract

We propose Res-FormerNet, an improved inversion network that integrates a lightweight Transformer encoder into a ResNet50 backbone to enhance two-dimensional magnetotelluric (MT) inversion. The model is designed to jointly leverage residual convolutional structures for local feature extraction and global attention mechanisms for capturing long-range spatial dependencies in geoelectrical resistivity models. To evaluate the effectiveness of the proposed architecture, more than 100,000 synthetic models generated by a two-dimensional staggered-grid finite-difference forward solver are used to construct training and validation datasets for TE and TM apparent resistivity responses, with realistic noise levels applied to simulate field acquisition conditions. A smoothness-aware loss function is further introduced to improve inversion stability and structural continuity. Results from synthetic tests demonstrate that incorporating the Transformer encoder substantially enhances the recovery of large-scale anomalies, structural boundaries, and resistivity contrasts compared with the original ResNet50. The proposed method also exhibits strong generalization capability when applied to real MT field data from southern Africa, producing inversion results highly consistent with those obtained using the nonlinear conjugate gradient (NLCG) method. These findings confirm that the Res-FormerNet architecture provides an effective and robust framework for MT inversion and illustrate the potential of hybrid convolution–attention networks for advancing data-driven electromagnetic inversion.
Source: crossref · Quality: baseline

Research context

OpenAlex topics: Geophysical and Geoelectrical Methods · Seismic Waves and Analysis · Seismic Imaging and Inversion Techniques

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

Key Laboratory of Exploration Technologies for Oil and Gas Resources of MOE, Yangtze University, Wuhan 430100, China

College of Geophysics and Petroleum Resources, Yangtze University, Wuhan 430100, China

Funding

National Natural Science Foundation of China · Open Fund of the Key Laboratory of Oil and Gas Resources and Exploration Technology

References (48)

Show source-provided references
1. On determination of electrical characteristics of the deep layers of the Earth’s crust
2. Basic theory of the magneto-telluric method of geophysical prospecting10.1190/1.1437915 ↗
3. Three-dimensional parallel distributed inversion of CSEM data using a direct forward solver10.1093/gji/ggt055 ↗
4. De La Kethulle De Ryhove, S., and Mittet, R. Full-Jacobian Gauss-Newton 3D marine magnetotelluric inversion. SEG Technical Program Expanded Abstracts, Proceedings of the SEG International Exposition and 86th Annual Meeting, Dallas, TX, USA, 16–21 October 2016, Society of Exploration Geophysicists.10.1190/segam2016-13507508.1 ↗
5. A comparison of the Gauss–Newton and quasi-Newton methods in resistivity imaging inversion10.1016/S0926-9851(01)00106-9 ↗
6. A limited-memory quasi-Newton inversion for 1D magnetotellurics10.1190/1.2236381 ↗
7. 3D magnetotelluric inversion using a limited-memory quasi-Newton optimization10.1190/1.3114023 ↗
8. Comparison of TE and TM inversions in the framework of the Gauss-Newton method10.1109/TAP.2010.2041156 ↗
9. Three-dimensional magnetotelluric inversion using conjugate gradients10.1111/j.1365-246X.1993.tb05600.x ↗
10. Nonlinear conjugate gradients algorithm for 2-D magnetotelluric inversion10.1190/1.1444893 ↗
11. Three-dimensional magnetotelluric inversion using non-linear conjugate gradients10.1046/j.1365-246x.2000.00007.x ↗
12. ModEM: A modular system for inversion of electromagnetic geophysical data10.1016/j.cageo.2014.01.010 ↗
13. An efficient data-subspace inversion method for 2-D magnetotelluric data10.1190/1.1444778 ↗
14. Data space conjugate gradient inversion for 2-D magnetotelluric data10.1111/j.1365-246X.2007.03478.x ↗
15. Image restoration using a neural network10.1109/29.1641 ↗
16. Deep convolutional neural network for inverse problems in imaging10.1109/TIP.2017.2713099 ↗
17. Convolutional neural networks for inverse problems in imaging: A review10.1109/MSP.2017.2739299 ↗
18. Using deep neural networks for inverse problems in imaging: Beyond analytical methods10.1109/MSP.2017.2760358 ↗
19. Deep learning techniques for inverse problems in imaging10.1109/JSAIT.2020.2991563 ↗
20. Seismic fault detection with convolutional neural network10.1190/geo2017-0666.1 ↗
21. Convolutional neural networks for automated seismic interpretation10.1190/tle37070529.1 ↗
22. Building realistic structure models to train convolutional neural networks for seismic structural interpretation10.1190/geo2019-0375.1 ↗
23. Seismic stratigraphy interpretation by deep convolutional neural networks: A semisupervised workflow10.1190/geo2019-0433.1 ↗
24. High-resolution seismic faults interpretation based on adversarial neural networks with a regularization technique10.1190/geo2021-0383.1 ↗
25. Using relative geologic time to constrain convolutional neural network-based seismic interpretation and property estimation10.1190/geo2021-0257.1 ↗
26. Convolutional neural network for seismic impedance inversion10.1190/geo2018-0838.1 ↗
27. Inversion of low-to-medium-frequency velocities and densities from AVO data using invertible neural networks10.1190/geo2021-0450.1 ↗
28. Removal of multisource noise in airborne electromagnetic data based on deep learning10.1190/geo2019-0555.1 ↗
29. Denoising of transient electromagnetic data based on the long short-term memory-autoencoder10.1093/gji/ggaa424 ↗
30. Research on noise suppression of magnetotelluric signal based on recurrent neural network
31. IncepTCN: A new deep temporal convolutional network combined with dictionary learning for strong cultural noise elimination of controlled-source electromagnetic data10.1190/geo2022-0317.1 ↗
32. Deep-learning-based sferics recognition for audio magnetotelluric data processing in the dead band10.1190/geo2022-0695.1 ↗
33. Magnetotelluric noise suppression via convolutional neural network10.1190/geo2022-0258.1 ↗
34. Magnetotelluric data denoising method combining two deep-learning-based models10.1190/geo2021-0449.1 ↗
35. Inversion using adaptive physics-based neural network: Application to magnetotelluric inversion10.1111/1365-2478.13215 ↗
36. MT2DInv-Unet: A 2D magnetotelluric inversion method based on deep-learning technology10.1190/geo2023-0004.1 ↗
37. Feature-based magnetotelluric inversion by variational autoencoder using a subdomain encoding scheme10.1190/geo2022-0774.1 ↗
38. Deep learning electromagnetic inversion with convolutional neural networks10.1093/gji/ggz204 ↗
39. Two-dimensional deep learning inversion of magnetotelluric sounding data10.1093/jge/gxab040 ↗
40. Deep learning audio magnetotellurics inversion using residual-based deep convolution neural network10.1016/j.jappgeo.2021.104309 ↗
41. Smooth deep learning magnetotelluric inversion based on physics-informed Swin transformer and multiwindow Savitzky–Golay filter
42. Flexible and accurate prior model construction based on deep learning for 2-D magnetotelluric data inversion
43. Liu, W., Wang, H., Xi, Z., and Wang, L. (2024). Physics-informed deep learning inversion with application to noisy magnetotelluric measurements. Remote Sens., 16.10.3390/rs16010062 ↗
44. Two-dimensional magnetotelluric inversion based on residual neural networks
45. He, K., Zhang, X., Ren, S., and Sun, J. (2016, January 27–30). Deep residual learning for image recognition. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Las Vegas, NV, USA.10.1109/CVPR.2016.90 ↗
46. Chave, A.D., and Jones, A.G. (2012). The Magnetotelluric Method: Theory and Practice, Cambridge University Press.10.1017/CBO9781139020138 ↗
47. The problem of overfitting10.1021/ci0342472 ↗
48. Lithospheric structure of an Archean craton and adjacent mobile belt revealed from 2-D and 3-D inversion of magnetotelluric data: Example from southern Congo craton in northern Namibia10.1002/jgrb.50258 ↗