Explainable Ensemble Learning Model for Residual Strength Forecasting of Defective Pipelines
Source abstract
Abstract
The accurate prediction of the residual strength of defective pipelines is a critical prerequisite for ensuring the safe operation of oil and gas pipelines, and it holds significant implications for the pipeline’s remaining service life and preventive maintenance. Traditional machine learning algorithms often fail to comprehensively account for the correlative factors influencing the residual strength of defective pipelines, exhibit limited capability in extracting nonlinear features from data, and suffer from insufficient predictive accuracy. Furthermore, the predictive models typically lack interpretability. To address these issues, this study proposes a hybrid prediction model for the residual strength of defective pipelines based on Bayesian optimization (BO) and eXtreme Gradient Boosting (XGBoost). This approach resolves the issues of excessive iterations and high computational costs associated with conventional hyperparameter optimization methods, significantly enhancing the model’s predictive performance. The model’s prediction performance is evaluated using mainstream metrics such as the Mean Absolute Percentage Error (MAPE), Coefficient of Determination (R2), Root Mean Square Error (RMSE), robustness analysis, overfitting analysis, and grey relational analysis. To enhance the interpretability of the model’s predictions, reveal the significance of features, and confirm prior domain knowledge, Shapley additive explanations (SHAP) are employed to conduct the relevant research. The results indicate that, compared with Random Forest, LightGBM, Support Vector Machine, gradient boosting regression tree, and Multi-Layer Perceptron, the BO-XGBoost model exhibits the best prediction performance, with MAPE, R2, and RMSE values of 5.5%, 0.971, and 1.263, respectively. Meanwhile, the proposed model demonstrates the highest robustness, the least tendency for overfitting, and the most significant grey relation degree value. SHAP analysis reveals that the factors influencing the residual strength of defective pipelines, ranked in descending order of importance, are defect depth (d), wall thickness (t), yield strength (σy), external diameter (D), defect length (L), tensile strength (σu), and defect width (w). The development of this model contributes to improving the integrity management of oil and gas pipelines and provides decision support for the intelligent management of defective pipelines in oil and gas fields.
Source: crossref · Quality: baseline
Research context
OpenAlex topics: Structural Integrity and Reliability Analysis · Material Properties and Failure Mechanisms · Geotechnical Engineering and Underground Structures
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
Affiliations
School of Human Settlements and Civil Engineering, Xi’an Jiaotong University, Xi’an 710049, China
Shaanxi Provincial Natural Gas Co., Ltd., Xi’an 710016, China
References (49)
Show source-provided references
1. The research progress and prospect of data mining methods on corrosion prediction of oil and gas pipelines10.1016/j.engfailanal.2022.106951 ↗
2. A Copula-Bayesian approach for risk assessment of decommissioning operation of aging subsea pipelines10.1016/j.psep.2022.09.019 ↗
3. An investigation on the collapse response of subsea pipelines with interacting corrosion defects10.1016/j.engstruct.2024.118911 ↗
4. UV/thermal dual-cured MWCNTs composites for pipeline rehabilitation: Mechanical properties and damage analysis10.1016/j.conbuildmat.2024.138602 ↗
5. Failure pressure estimation for an aged and corroded oil and gas pipeline: A finite element study10.1016/j.jngse.2022.104532 ↗
6. Analysis of machine learning models and data sources to forecast burst pressure of petroleum corroded pipelines: A comprehensive review10.1016/j.engfailanal.2023.107747 ↗
7. Visualization and Analysis of Oil and Gas Pipeline Corrosion Research: A Bibliometric Data-Mining Approach10.1061/JPSEA2.PSENG-1605 ↗
8. Global and local parameters for characterizing and modeling external corrosion in underground coated steel pipelines: A review of critical factors10.1016/j.jpse.2021.01.010 ↗
9. Residual strength prediction of X80 steel pipelines containing group corrosion defects10.1016/j.oceaneng.2023.114077 ↗
10. Treatment of residual stress in fracture assessment: Background to the advice given in BS 7910, 201310.1016/j.ijpvp.2018.11.005 ↗
11. Novel method for residual strength prediction of defective pipelines based on HTLBO-DELM model10.1016/j.ress.2023.109369 ↗
12. Markov approach to early diagnostics, reliability assessment, residual life and optimal maintenance of pipeline systems10.1016/j.strusafe.2015.05.006 ↗
13. Analyzing joint efficiency in storage tanks: A comparative study of API 650 standard and API 579 using finite element analysis for enhanced reliability10.1016/j.ijpvp.2023.105113 ↗
14. Wei, W.L., Zhang, R., Zhang, Y.W., Cheng, J.R., Cao, Y.P., and Fang, F.Y. (2024). Study on the Residual Strength of Nonlinear Fatigue-Damaged Pipeline Structures. Appl. Sci., 14.10.3390/app14020754 ↗
15. Li, X.L., Chen, G.T., Liu, X.Y., Ji, J., and Han, L.F. (2021). Analysis and Evaluation on Residual Strength of Pipelines with Internal Corrosion Defects in Seasonal Frozen Soil Region. Appl. Sci., 11.10.3390/app112412141 ↗
16. Burst pressure strength of corroded subsea pipelines repaired with composite fiber-reinforced polymer patches10.1016/j.engfailanal.2022.106204 ↗
17. Predicting failure pressure of the corroded offshore pipelines using an efficient finite element based algorithm and machine learning techniques10.1016/j.oceaneng.2022.111382 ↗
18. Residual strength prediction of corroded pipelines using multilayer perceptron and modified feedforward neural network10.1016/j.ress.2022.108980 ↗
19. A data-driven methodology for predicting residual strength of subsea pipeline with double corrosion defects10.1016/j.oceaneng.2023.114530 ↗
20. Kumar, S.D.V., Kai, M.L.Y., Arumugam, T., and Karuppanan, S. (2021). A Review of Finite Element Analysis and Artificial Neural Networks as Failure Pressure Prediction Tools for Corroded Pipelines. Materials, 14.10.3390/ma14206135 ↗
21. Research on residual strength of pipeline with defects based on SVR
22. Data-driven collapse strength modelling for the screen pipes with internal corrosion defect based on finite element analysis and tree-based machine learning10.1016/j.oceaneng.2023.114400 ↗
23. Fast and accurate prediction of failure pressure of oil and gas defective pipelines using the deep learning model10.1016/j.ress.2021.108016 ↗
24. Bergstra, J., Yamins, D., and Cox, D. (2013, January 24–29). Hyperopt: A Python Library for Optimizing the Hyperparameters of Machine Learning Algorithms. Proceedings of the Python in Science Conference, Austin, TX, USA.10.25080/Majora-8b375195-003 ↗
25. A novel framework for lung cancer classification using lightweight convolutional neural networks and ridge extreme learning machine model with SHapley Additive exPlanations (SHAP)10.1016/j.eswa.2024.123392 ↗
26. Integrating multiple data sources for improved flight delay prediction using explainable machine learning
27. A hybrid strategy of AutoML and SHAP for automated and explainable concrete strength prediction
28. Optimized synthetic data and semi-supervised learning for Derived Cetane Number prediction10.1016/j.combustflame.2023.113184 ↗
29. A KPCA-BRANN based data-driven approach to model corrosion degradation of subsea oil pipelines10.1016/j.envpol.2022.120685 ↗
30. Explainable ensemble learning model for predicting steel section-concrete bond strength10.1016/j.conbuildmat.2022.129239 ↗
31. Dataset level explanation of heat demand forecasting ANN with SHAP10.1016/j.energy.2022.125075 ↗
32. Random forest10.1023/A:1010933404324 ↗
33. Ke, G. (2017, January 4–9). Light GBM: A hightly efficient grasient boosting decision tree. Proceedings of the 31st Conference on Neural Information Processing Systems (NIPS 2017), Long Beach, CA, USA.
34. Vapnik, V. (1995). The Nature of Statistical Learning Theory, Springer.10.1007/978-1-4757-2440-0 ↗
35. Friedman, J.H. (2021). Greedy function approximation: A gradient boosting machine. Ann. Stat., 1189–1232.
36. Multilayer feedforward networks with a nonpolynomial activation function can approximate any function10.1016/S0893-6080(05)80131-5 ↗
37. Chen, T., and Guestrin, C. (2016, January 13–17). XGBoost: A scalable tree boosting system. Proceedings of the KDD’16: The 22nd ACM SIGKDD International Conferenceon Knowledge Discovery and Data Mining, San Francisco, CA, USA.10.1145/2939672.2939785 ↗
38. Survey on Bayesian Optimization Methods for Hyper-Parameter Tuning10.1007/s10915-022-02050-z ↗
39. K Analytical prediction of failure pressure for pipeline with long corrosion defect10.1016/j.oceaneng.2019.106497 ↗
40. Computational time reduction for credit scoring: An integrated approach based on support vector machine and stratified sampling method10.1016/j.eswa.2011.12.057 ↗
41. Xu, L., Yu, J., Zhu, Z.Y., Man, J.F., Yu, P.F., Li, C.J., Wang, X.T., and Zhao, Y.Q. (2023). Research and Application for Corrosion Rate Prediction of Natural Gas Pipelines Based on a Novel Hybrid Machine Learning Approach. Coatings, 13.10.3390/coatings13050856 ↗
42. Theory and Machine Learning Modeling for Burst Pressure Estimation of Pipeline with Multipoint Corrosion10.1061/JPSEA2.PSENG-1481 ↗
43. Deeppipe: Theory-guided prediction method based automatic machine learning for maximum pitting corrosion depth of oil and gas pipeline10.1016/j.ces.2023.118927 ↗
44. Committee machine learning: A breakthrough in the precise prediction of CO2 storage mass and oil production volumes in unconventional reservoirs10.1016/j.geoen.2024.213533 ↗
45. Study on statistical rule of surface corrosion depth of Q235 steel
46. Residual life prediction method of corroded pipelines based on normal distribution
47. Carbon dioxide storage and cumulative oil production predictions in unconventional reservoirs applying optimized machine-learning models10.1016/j.petsci.2024.09.015 ↗
48. Grey relational analysis of static tensile properties of structural steel subjected to urban industrial atmospheric corrosion and accelerated corrosion10.1016/j.conbuildmat.2021.125706 ↗
49. Explainable machine learning rapid approach to evaluate coal ash content based on X-ray fluorescence10.1016/j.fuel.2022.125991 ↗