journal article·2023-04-23Open access

An Attention-Based Residual Neural Network for Efficient Noise Suppression in Signal Processing

Tianwei Lan, Liguo Han, Zhaofa Zeng, Jingwen Zeng

Applied Sciences· Volume 13· Issue 9

Abstract

The incorporation of effective denoising techniques is a crucial requirement for seismic data processing during the acquisition phase due to the inherent susceptibility of the seismic data acquisition process to various forms of interference, such as random and coherent noise. For random noise, the Residual Neural Network (Resnet), with its notable ability to effectively suppress noise in seismic data, has garnered widespread utilization in removing unwanted disturbances or interference due to its elegant simplicity and outstanding performance. Despite the considerable advancements achieved by conventional Resnet in the field of suppressing noise, it is irrefutable that there is still room for amelioration in their ability to filter out unwanted disturbances. As a result, this paper puts forth a novel attention-based methodology for Resnet, intended to overcome the present constraints and attain an optimal seismic signal enhancement. Specifically, we add the convolutional block attention module (CBAM) after the convolutional layer of the residual module and add channel attention on the shortcut connections to filter out the disturbance. We replace the commonly used ReLU activation function in the network with ELU, which is better suited for suppressing seismic noise. Empirical assessments conducted on both synthetic and authentic datasets have demonstrated the efficacy of the proposed methodology in amplifying the denoising prowess of Resnet. Our proposed method remains stable even when dealing with seismic data that has complex waveforms. The findings of this investigation evince that the recommended approach furnishes a substantial augmentation in the signal-to-noise ratio (SNR), thereby facilitating the efficient and robust extraction of the underlying signal from the noisy observations.
Source: crossref · Quality: baseline

Research context

OpenAlex topics: Seismic Imaging and Inversion Techniques · Seismic Waves and Analysis · Underwater Acoustics Research

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

College of Geoexploration Science and Technology, Jilin University, Changchun 130026, China

Funding

National Natural Science Foundation of China

References (30)

Show source-provided references
1. Expand dimensional of seismic data and random noise attenuation using low-rank estimation10.1109/JSTARS.2022.3162763 ↗
2. Random Noise Attenuation in Seismic Data Using Hankel Sparse Low-Rank Approximation10.1016/j.cageo.2021.104802 ↗
3. Guan, X.Z., Wang, J.X., Wang, X.J., Xue, D., and Sun, W.B. (2021, January 27–29). Research on intelligent denoising technology of marine seismic data based on Resnet. Proceedings of the Chinese Petroleum Society 2021 Geophysical Exploration Technology Seminar, Chengdu, China.
4. An Efficient Undersampled High-Resolution Radon Transform for Exploration Seismic Data Processing10.1109/TGRS.2016.2618848 ↗
5. Comparisons of Wavelets, Contourlets and Curvelets in Seismic Denoising10.1016/j.jappgeo.2009.08.002 ↗
6. Seismic random noise attenuation using shearlet and total generalized variation10.1088/1742-2132/12/6/1024 ↗
7. Signal and noise separation in prestack seismic data using velocity-dependent seislet transform10.1190/geo2014-0234.1 ↗
8. Double-Sparsity Dictionary for Seismic Noise Attenuation10.1190/geo2014-0525.1 ↗
9. EMD-seislet transform10.1190/geo2017-0554.1 ↗
10. New idea for seismic wave filed separation and denoising by singular value decomposition (SVD)
11. Adaptive singular spectrum analysis for seismic denoising and interpolation10.1190/geo2018-0350.1 ↗
12. Seismic data interpolation using deep learning with generative adversarial networks10.1111/1365-2478.13055 ↗
13. Automatic First Arrival Picking via Deep Learning With Human Interactive Learning10.1109/TGRS.2019.2946118 ↗
14. Seismic Velocity Inversion Based on CNN-LSTM Fusion Deep Neural Network10.1007/s11770-021-0913-3 ↗
15. Fault Detection Using a Convolutional Neural Network Trained with Point-Spread Function-Convolution-Based Samples10.1190/geo2021-0824.1 ↗
16. Dnresnext network for desert seismic data denoising
17. Wang, X.T., Yu, K., Wu, S.X., Gu, J.J., Liu, Y.H., Dong, C., Qiao, Y., and Loy, C.C. (2018, January 8–14). ESRGAN: Enhanced Super-Resolution Generative Adversarial Networks. Proceedings of the European Conference on Computer Vision, Munich, Germany.10.1007/978-3-030-11021-5_5 ↗
18. Seismic Random Noise Suppression by Using Deep Residual U-Net10.1016/j.petrol.2021.109901 ↗
19. Multi-Head Attention Fusion Networks for Multi-Modal Speech Emotion Recognition10.1016/j.cie.2022.108078 ↗
20. MRDDANet: A Multiscale Residual Dense Dual Attention Network for SAR Image Denoising
21. Channel and Space Attention Neural Network for Image Denoising10.1109/LSP.2021.3057544 ↗
22. Multiscale Spatial Attention Network for Seismic Data Denoising10.1109/TGRS.2022.3178212 ↗
23. PID Controller-Guided Attention Neural Network Learning for Fast and Effective Real Photographs Denoising10.1109/TNNLS.2020.3048031 ↗
24. EPick: Attention-based multi-scale UNet for earthquake detection and seismic phase picking10.3389/feart.2022.953007 ↗
25. Oktay, O., Schlemper, J., Folgoc, L.L., Lee, M., Heinrich, M., Misawa, K., Mori, K., McDonagh, S., Hammerla, N.Y., and Kainz, B. (2018). Attention U-Net: Learning where to look for the pancreas. arXiv.
26. Woo, S., Park, J., Lee, J.Y., and Kweon, I.S. (2018, January 8–14). CBAM: Convolutional block attention module. Proceedings of the European Conference on Computer Vision, Munich, Germany.10.1007/978-3-030-01234-2_1 ↗
27. Cortes, C., Lawrence, N., Lee, D., Sugiyama, M., and Garnett, R. (2016). Annual Conference on Advances in Neural Information Processing Systems 28, Proceedings of the 29th Annual Conference on Neural Information Processing Systems, Montreal, QC, Canada, 7–12 December 2015, Curran Associates, Inc.
28. Hu, J., Shen, L., and Sun, G. (2018, January 18–23). Squeeze-and-excitation networks. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Salt Lake City, UT, USA.10.1109/CVPR.2018.00745 ↗
29. Random noise attenuation based on residual convolutional neural network in seismic datasets10.1109/ACCESS.2020.2972464 ↗
30. Stanford EArthquake Dataset (STEAD): A Global dataset of Seismic Signals for AI10.1109/ACCESS.2019.2947848 ↗