journal article·2025-06

An Ultrasonic Echo Defect Recognition Method for Oil and Gas Pipelines Combining CNN-LSTM and Multi-Head Self-Attention Mechanism

Zhanming Zhang, Minghui Wei, Zheng Wang

Publisher page

Abstract

Abstract Oil and gas pipelines are crucial infrastructures in the oil and gas industry, responsible for transporting resources and connecting supply and demand. However, the complex operational environment, influenced by external and internal factors, leads to varying degrees of damage or structural failures as service time increases. If these defects are not identified and repaired promptly, they can result in serious safety incidents, endangering lives and property. To address the problems of uneven recognition accuracy and insufficient generalization ability of traditional oil and gas pipeline defect recognition and classification methods under different working conditions, the paper utilizes convolutional neural network (CNN) to extract spatial features from the ultrasonic echo sequences, which are then cascaded to long short-term memory (LSTM) network to mine the temporal features hidden within the ultrasonic echo sequences. Next, by employing a multi-head self-attention mechanism to dynamically adjust weights based on feature importance, the accuracy of defect identification and classification is improved. Validation using actual ultrasonic echo data from pipeline defects shows that the accuracy rates for identifying and classifying signals with no defects, as well as with defects at depths of 2, 5, and 8 mm, are 94, 89, 100, and 100%, respectively. The corresponding precision, recall, and F1-score all exceed 90%, significantly outperforming traditional methods. Furthermore, under the multi-condition noise resistance and generalization validation, the model consistently maintains an accuracy rate of over 90%, demonstrating robust noise resistance and strong generalization capabilities.
Source: openalex_inverted_index · Quality: baseline

Research context

OpenAlex topics: Ultrasonics and Acoustic Wave Propagation · Non-Destructive Testing Techniques · Geophysical Methods and Applications

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

References (40)

Show source-provided references
1. Yang, Z.H., Zhang, Y.T., Bai, Y., et al., The application of deep learning in pipeline inspection: Current status and challenges, Ships Offshore Struct., 2024, vol. 12.10.1080/17445302.2024.2373561 ↗
2. Xiao, R. and Xiong, C.Q., Predictive modeling for gas transmission pipeline failure cause and consequence analysis, Process Saf. Environ. Prot., 2025, vol. 195, p. 13.10.1016/j.psep.2025.106812 ↗
3. Gao, Y.Q., Luo, Z.S., Bi, A.R., et al., A New method for evaluating natural gas pipelines based on ICEEMDAN-LMS: A view of noise reduction in defective pipelines, Appl. Sci.-Basel, 2023, vol. 13, no. 17, p. 18.
4. Ling, J.T., Feng, K., Wang, T., et al., Data modeling techniques for pipeline integrity assessment: A state-of-the-art survey, IEEE Trans. Instrum. Meas., 2023, vol. 72, p. 17.10.1109/TIM.2023.3279910 ↗
5. Liang, H.B., Cheng, G., Zhang, Z.D., et al., Research on ultrasonic defect identification method of well control manifold pipeline based on IAFSA-SVM, Measurement, 2022, vol. 194, p. 10.10.1016/j.measurement.2022.110854 ↗
6. Xu, G.L., Zhou, Z.H., Xin, S., et al., Intelligent identification method for pipeline ultrasonic internal inspection, Nondestr. Test. Eval., 2024, p. 22.
7. Bouden, T., Djerfi, F., and Nibouche, M., Adaptive split spectrum processing for ultrasonic signal in the pulse echo test, Russ. J. Nondestr. Test., 2015, vol. 51, no. 4, pp. 245–257.10.1134/S1061830915040038 ↗
8. Bazulin, A.E., Bazulin, E.G., Vopilkin, A.K., et al., Testing samples made of polymer composite materials using ultrasonic antenna arrays, Russ. J. Nondestr. Test., 2022, vol. 58, no. 6, pp. 411–424.10.1134/S1061830922060031 ↗
9. Lu, H.F., Xu, Z.D., Zang, X.L., et al., Leveraging machine learning for pipeline condition assessment, J. Pipeline Syst. Eng. Pract., 2023, vol. 14, no. 3, p. 13.10.1061/JPSEA2.PSENG-1464 ↗
10. Ma, C.H., Liu, X.Y., Cao, Y., et al., Faster MLP efficient vision networks combining attention mechanisms and wavelet downsampling, Sci. Rep., 2025, vol. 15, no. 1, p. 14.10.1038/s41598-024-80698-3 ↗
11. Zhang, J., Wan, H.P., Sun, F.Y., et al., Laser ultrasonic inspection of surface and subsurface defects in materials based on deep learning, Nondestr. Test. Eval., 2024, p. 20.
12. Shen, Y. and Zhou, W., Development of a convolutional neural network model to predict the size and location of corrosion defects on pipelines based on magnetic flux leakage signals, Int. J. Press. Vessels Pip., 2024, vol. 207, p. 13.10.1016/j.ijpvp.2023.105123 ↗
13. Sun, D., Zhu, W.J., Xiang, Y.X., et al., Decoding nonlinear ultrasonic time-frequency characteristics for fatigue crack quantification and localisation via CNN, Nondestr. Test. Eval., 2024, p. 20.
14. Zhi, Z., Liu, L.S., Liu, D.T., et al., Fault detection of the harmonic reducer based on CNN-LSTM with a novel denoising algorithm, IEEE Sens. J., 2022, vol. 22, no. 3, pp. 2572–2581.10.1109/JSEN.2021.3137992 ↗
15. Song, X.B., Yang, F.F., Wang, D., et al., Combined CNN-LSTM network for state-of-charge estimation of lithium-ion batteries, IEEE Access, 2019, vol. 7, pp. 88894–88902.10.1109/ACCESS.2019.2926517 ↗
16. Shang, L., Zhang, Z., Tang, F.J., et al., CNN-LSTM hybrid model to promote signal processing of ultrasonic guided Lamb waves for damage detection in metallic pipelines, Sensors, 2023, vol. 23, no. 16.10.3390/s23167059 ↗
17. Hao, S.J., Ge, F.X., Li, Y.M., et al., Multisensor bearing fault diagnosis based on one-dimensional convolutional long short-term memory networks, Measurement, 2020, vol. 159, p. 8.10.1016/j.measurement.2020.107802 ↗
18. Dao, F., Zeng, Y., and Qian, J., Fault diagnosis of hydro-turbine via the incorporation of Bayesian algorithm optimized CNN-LSTM neural network, Energy, 2024, vol. 290, p. 18.10.1016/j.energy.2024.130326 ↗
19. Jing, J., Qin, Y.M., Zhu, X.H., et al., Identification and prediction of casing collar signal based on CNN-LSTM, Arab. J. Sci. Eng., 2024, p. 15.10.1007/s13369-024-09440-5 ↗
20. Wei, L.P., Peng, X.Y., and Cao, Y.P., Enhanced fault diagnosis of rolling bearings using an improved inception-LSTM network, Nondestr. Test. Eval., 2024.10.1080/10589759.2024.2402549 ↗
21. Gao, B.X., Zhao, H., and Miao, X.Y., A novel multi-model cascade framework for pipeline defects detection based on machine vision, Measurement, 2023, vol. 220, p. 14.10.1016/j.measurement.2023.113374 ↗
22. Lang, X.M. and Wang, Z., A Multisensor feature fusion attention convolutional neural network for complex magnetic leakage, IEEE Trans. Instrum. Meas., 2024, vol. 73, p. 9.10.1109/TIM.2024.3493872 ↗
23. Pan, S.W., Yang, B., Wang, S.K., et al., Oil well production prediction based on CNN-LSTM model with self-attention mechanism, Energy, 2023, vol. 284, p. 16.10.1016/j.energy.2023.128701 ↗
24. Chen, J.C., Zheng, L., Che, W.Y., et al., A method for measuring carbon emissions from power plants using a CNN-LSTM-attention model with Bayesian optimization, Case Stud. Therm. Eng., 2024, vol. 63, p. 10.10.1016/j.csite.2024.105334 ↗
25. Zhang, Q.R., Guo, C.Z., Cheng, G.G. et al., Ultrasonic signal classification for composite materials via deep convolutional neural networks, Nondestr. Test. Eval., 2024, p. 18.
26. Zhang, Q., Wei, X.H., Wang, Y., et al., Convolutional neural network with attention mechanism and visual vibration signal analysis for bearing fault diagnosis, Sensors, 2024, vol. 24, no. 6, p. 16.10.1109/JSEN.2023.3332131 ↗
27. Liu, Q., Wang, J.X., Dai, H.L., et al., Bridge structural damage identification based on parallel multi-head self-attention mechanism and bidirectional long and short-term memory network, Arab. J. Sci. Eng., 2025, vol. 50, no. 3, pp. 1803–1815.10.1007/s13369-024-09035-0 ↗
28. Ghazimoghadam, S. and Hosseinzadeh, S.A.A., A novel unsupervised deep learning approach for vibration-based damage diagnosis using a multi-head self-attention LSTM autoencoder, Measurement, 2024, vol. 229, p. 16.10.1016/j.measurement.2024.114410 ↗
29. Sun, J.W., Ren, H.X., Duan, Y.T., et al., Fusion of multi-layer attention mechanisms and CNN-LSTM for fault prediction in marine diesel engines, J. Mar. Sci. Eng., 2024, vol. 12, no. 6, p. 24.10.3390/jmse12060990 ↗
30. Zhang, J., Sun, M., Qin, L., et al., In-line inspection methods and tools for oil and gas pipeline: A review, Int. J. Press. Vessels Pip., 2025, vol. 214.10.1016/j.ijpvp.2024.105409 ↗
31. Lin, L., Zhou, K.H., Li, D.G. et al., Experimental study on train axle fatigue crack acoustic emission signals recognition based on a one-dimensional convolutional neural network, Nondestr. Test. Eval., 2024, p. 32.
32. Liu, S.W., Hua, X., Liu, Y., et al., Accurate wire rope defect MFL detection using improved Hilbert transform and LSTM neural network, Nondestr. Test. Eval., 2024, p. 30.
33. Zhang, Q.L., Lian, X.W., Qin, J.Y., et al., Research of turbine rotor fault diagnosis based on improved auxiliary classification generative adversarial network, Measurement, 2025, vol. 248, p. 12.10.1016/j.measurement.2025.116991 ↗
34. You, K.S., Lian, Z.W., Chen, R.H., et al., A novel rolling bearing fault diagnosis method based on time-series fusion transformer with interpretability analysis, Nondestr. Test. Eval., 2024, p. 27.
35. Abuassal, A., Kang, L., Martinho, L., et al., A Review of recent advances in unidirectional ultrasonic guided wave techniques for nondestructive testing and evaluation, Sensors, 2025, vol. 25, no. 4, p. 32.10.3390/s25041050 ↗
36. Parlak, B.O. and Yavasoglu, H.A., A Comprehensive analysis of in-line inspection tools and technologies for steel oil and gas pipelines, Sustainability, 2023, vol. 15, no. 3, p. 25.10.3390/su15032783 ↗
37. Al-Sabaeei, A.M., Alhussian, H., Abdulkadir, S.J., et al., Prediction of oil and gas pipeline failures through machine learning approaches: A systematic review, Energy Rep., 2023, vol. 10, pp. 1313–1338.10.1016/j.egyr.2023.08.009 ↗
38. De-Leon-Escobedo, D., Risk-based maintenance time for oil and gas steel pipelines under corrosion including uncertainty on the corrosion rate and consequence-based target reliability, Int. J. Press. Vessels Pip., 2023, vol. 203, p. 7.10.1016/j.ijpvp.2023.104927 ↗
39. Hocine, A., Achira, F.S.K., Habbar, G., et al., Structural integrity assessment of corroded pipelines repaired with composite materials - Literature review, Int. J. Press. Vessels Pip., 2024, vol. 210, p. 23.10.1016/j.ijpvp.2024.105253 ↗
40. Waqar, M., Memon, A.M., Sabih, M., et al., Composite pipelines: Analyzing defects and advancements in non-destructive testing techniques, Eng. Fail. Anal., 2024, vol. 157, p. 36.10.1016/j.engfailanal.2023.107914 ↗