Rate of Penetration Prediction Using an ExtraTrees Model Optimized by an Improved Harris Hawks Algorithm
Source abstract
Abstract
Rate of penetration (ROP) is a key indicator of drilling efficiency, governed by nonlinear coupling among mechanical, hydraulic, drilling fluid, and formation factors. This study develops an ExtraTrees model optimized by an improved Harris hawks optimization algorithm (IHHO-ET) using field while drilling data from Well Z in the Tarim Oilfield. A preprocessing workflow involving drilling section identification, abnormal condition filtering, 3 × IQR outlier removal, Savitzky–Golay smoothing, and standardization is combined with correlation and gray relational analysis under engineering mechanism constraints to select 14 input features. Logistic chaotic initialization, adaptive Gaussian mutation, and dynamic weighting are introduced into HHO, with validation set RMSE as the fitness function. To reduce the influence of random splitting and initialization, all comparison models are evaluated with repeated seeds and validation set tuning. Using R2 and RMSE as primary criteria, IHHO-ET achieves R2 = 0.910 ± 0.004 and RMSE = 0.871 ± 0.019 on the same-well test set. Its improvement over HHO-ET is small and not significant (p = 0.109), indicating that the IHHO strategies mainly refine search stability. Same-region leave-one-well-out validation gives an average R2 = 0.696, suggesting that the model suits same-region trend prediction rather than direct closed-loop control. The proposed workflow provides a practical reference for ROP prediction.
Source: crossref · Quality: baseline
Research context
OpenAlex topics: Drilling and Well Engineering · Hydraulic Fracturing and Reservoir Analysis · Hydrocarbon exploration and reservoir analysis
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
Affiliations
School of Oil & Natural Gas Engineering, Southwest Petroleum University, Chengdu 610500, China
References (47)
Show source-provided references
1. International Energy Agency (2023). World Energy Outlook 2023, IEA. Available online: https://www.iea.org/reports/world-energy-outlook-2023.10.1787/827374a6-en ↗
2. Organization of the Petroleum Exporting Countries (2025). World Oil Outlook 2025, OPEC. Available online: https://www.opec.org/assets/assetdb/woo-2025.pdf.
3. Ben Aoun, M.A., and Madarász, T. (2022). Applying machine learning to predict the rate of penetration for geothermal drilling located in the Utah FORGE site. Energies, 15.10.3390/en15124288 ↗
4. Du, S., Huang, C., Ma, X., and Fan, H. (2024). A review of data-driven intelligent monitoring for geological drilling processes. Processes, 12.10.3390/pr12112478 ↗
5. Real-time predictive capabilities of analytical and machine learning rate of penetration (ROP) models10.1016/j.petrol.2018.08.083 ↗
6. Analysis of rate of penetration (ROP) prediction in drilling using physics-based and data-driven models10.1016/j.petrol.2017.09.020 ↗
7. Real-time optimization of drilling parameters based on mechanical specific energy for rotating drilling with positive displacement motor in the hard formation10.1016/j.jngse.2016.09.019 ↗
8. Shah, M. (2018). Rate of penetration prediction utilizing hydromechanical specific energy. Drilling, IntechOpen.
9. Coupling rate of penetration and mechanical specific energy to improve the efficiency of drilling gas wells10.1016/j.jngse.2020.103558 ↗
10. Use of machine learning and data analytics to increase drilling efficiency for nearby wells10.1016/j.jngse.2017.02.019 ↗
11. Machine learning methods applied to drilling rate of penetration prediction and optimization—A review10.1016/j.petrol.2019.106332 ↗
12. Comparison of accuracy and computational performance between the machine learning algorithms for rate of penetration in directional drilling well
13. Real-time prediction of rate of penetration by combining attention-based gated recurrent unit network and fully connected neural networks10.1016/j.petrol.2022.110396 ↗
14. Chen, T., and Guestrin, C. (2016, January 13–17). XGBoost: A scalable tree boosting system. Proceedings of the 22nd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, San Francisco, CA, USA.10.1145/2939672.2939785 ↗
15. Scikit-Learn Developers (2026, May 31). ExtraTreesRegressor API Reference. Scikit-Learn Documentation, Version 1.5. Available online: https://scikit-learn.org/stable/modules/generated/sklearn.ensemble.ExtraTreesRegressor.html.
16. A random forest guided tour10.1007/s11749-016-0481-7 ↗
17. Montesinos-López, O.A., Montesinos-López, A., and Crossa, J. (2022). Support vector machines and support vector regression. Multivariate Statistical Machine Learning Methods for Genomic Prediction, Springer.10.1007/978-3-030-89010-0 ↗
18. Particle swarm optimization: A survey of historical and recent developments with hybridization perspectives10.3390/make1010010 ↗
19. A review on genetic algorithm: Past, present, and future10.1007/s11042-020-10139-6 ↗
20. Grey wolf optimizer: A review of recent variants and applications10.1007/s00521-017-3272-5 ↗
21. Hutter, F., Kotthoff, L., and Vanschoren, J. (2019). Hyperparameter optimization. Automated Machine Learning: Methods, Systems, Challenges, Springer.10.1007/978-3-030-05318-5 ↗
22. Harris hawks optimization: Algorithm and applications10.1016/j.future.2019.02.028 ↗
23. Metaheuristic research: A comprehensive survey10.1007/s10462-017-9605-z ↗
24. A comprehensive literature review on Harris hawks optimization techniques
25. Reference dataset for rate of penetration benchmarking10.1016/j.petrol.2020.108069 ↗
26. Alsaihati, A., Elkatatny, S., Gamal, H., and Abdulraheem, A. (2022). Data-driven prediction of rate of penetration while drilling complex lithology using random forest. Sustainability, 14.
27. Real-time prediction of rate of penetration while drilling complex lithologies using artificial intelligence techniques10.1016/j.asej.2020.05.014 ↗
28. Shokry, K., Elsayed, M., Abdulwahab, H., Shawky, A., Helmy, M., Ali, T., Elkatatny, S., and Abdulraheem, A. (2023). Real-time prediction of rate of penetration during drilling operation in a motorized bottom-hole assembly using different artificial intelligence techniques. Processes, 11.
29. Jiao, X., Gan, C., Cao, W., and Wu, M. (2024). Physics-data fusion prediction of rate of penetration based on multiple empirical equations. Processes, 12.
30. Bai, X., Liu, M., Zhang, Z., Wang, H., and Zhao, J. (2024). ROP optimization method based on CBT-LSTM and machine learning. Energies, 17.
31. Xiong, Y., Zheng, B., Zhao, R., Su, J., and Dong, J. (2024). Penetration rate prediction and parameter optimization based on improved sparrow search algorithm and BiLSTM neural network. Processes, 12.
32. Huang, T., Ali, M., Liu, W., Zhang, L., and Xu, H. (2025). Research on ROP prediction based on machine learning algorithm. Energies, 18.
33. Rate of penetration prediction in drilling operations: A comparative study of AI models and meta-heuristic approaches
34. An outliers detection and elimination framework in classification task of data mining10.1016/j.dajour.2023.100164 ↗
35. SciPy 1.0: Fundamental algorithms for scientific computing in Python10.1038/s41592-019-0686-2 ↗
36. Correlation coefficients: Appropriate use and interpretation10.1213/ANE.0000000000002864 ↗
37. User’s guide to correlation coefficients10.1016/j.tjem.2018.08.001 ↗
38. Liu, S., Forrest, J., and Yang, Y. (2024). Grey Systems Analysis: Methods, Models and Applications, Springer. [2nd ed.].
39. Ensemble learning: A survey10.1002/widm.1249 ↗
40. Hyperparameters and tuning strategies for random forest10.1002/widm.1301 ↗
41. A comparative analysis of gradient boosting algorithms
42. Goodfellow, I., Bengio, Y., and Courville, A. (2016). Deep Learning, MIT Press.
43. Guido, R., Ferrisi, S., Lofaro, D., and Conforti, D. (2024). An overview on the advancements of support vector machine models in healthcare applications: A review. Information, 15.10.3390/info15040235 ↗
44. Adam, S.P., Alexandropoulos, S.-A.N., Pardalos, P.M., and Vrahatis, M.N. (2019). No free lunch theorem: A review. Approximation and Optimization: Algorithms, Complexity and Applications, Springer.10.1007/978-3-030-12767-1_5 ↗
45. Hyperparameter optimization: Foundations, algorithms, best practices, and open challenges10.1002/widm.1484 ↗
46. Scikit-Learn Developers (2026, May 31). User Guide: Scikit-Learn Machine Learning in Python, Version 1.5. Available online: https://scikit-learn.org/stable/user_guide.html.
47. Raschka, S. (2018). Model evaluation, model selection, and algorithm selection in machine learning. arXiv.