Heterogeneous stacking strategy for modeling flowing bottom-hole pressure of oil wells
DOI:
https://doi.org/10.1016/j.uncres.2026.100331Keywords:
Flowing bottom hole pressure; Machine learning; Stacking model; Artificial intelligence; Production optimizationAbstract
Accurately predicting Flowing Bottom-Hole Pressure (FBHP) is critical for optimizing oil and gas production. Existing predictive methods often rely on oversimplified or complex, yet computationally expensive, models that fail to capture the intrinsic nonlinearities of well dynamics, leading to inaccurate predictions and potential economic losses. This paper introduces a three-layer heterogeneous stacking ensemble model to address the latter challenge. In particular, the key novelty of the developed work is a hierarchical architecture that integrates five distinct Machine Learning (ML) base learners, two meta-learners, and a final super-learner, i.e., an additional meta-model that combines the outputs of the meta-learners to capture complex, non-linear relationships in the data. When evaluated on a field dataset (total dataset samples N=795; test set samples N=199), the proposed Super Learner Stacking model (ST-S) demonstrated superior predictive performance on the independent test set, achieving R-squared (R2) = 0.857±0.006 and Root Mean Squared Error (RMSE) = 146.382±2.806. In addition, the ST-S model outperformed all individual models and simpler stacking ensembles reported in the article. As a result, the developed ST-S model provides a robust, data-driven tool for FBHP prediction, achieving high predictive accuracy without resorting to computationally expensive methods, thereby supporting improved well management and production optimization.
References
1. O. Adekomaya, A.A. Fadairo, O. Falode, "Predictive tool for bottom-hole pressure in multiphase flowing wells," Pet. Coal, vol. 50, no. 3, pp. 67-73, 2008.
2. K. Aziz, G.W. Govier, "Pressure drop in wells producing oil and gas," J. Can. Pet. Technol., vol. 11, 1972.
3. E. Eltahan, R. Ganjdanesh, W. Yu, K. Sepehrnoori, R. Williams, J. Nohavitsa, "Machine learning approach to improve calculated bottom-hole pressure," in Proceedings of the 9th Unconventional Resources Technology Conference, URTeC 2021, American Association of Petroleum Geologists, 2021.
4. D. Molinari, S. Sankaran, "Merging physics and data-driven methods for field-wide bottomhole pressure estimation in unconventional wells," in Unconventional Resources Technology Conference, Houston, Texas, 26–28 July 2021, Art. no. D031S074R004, 2021.
5. E. Kanin, A. Osiptsov, A.L. Vainshtein, E. Burnaev, "A predictive model for steady-state multiphase pipe flow: Machine learning on lab data," J. Pet. Sci. Eng., vol. 180, pp. 727-746, 2019.
6. A.E. Dukler, M.G. Hubbard, "A model for gas-liquid slug flow in horizontal and near horizontal tubes," Ind. Eng. Chem. Fundam., vol. 14, no. 4, pp. 337-347, 1975.
7. M.A. Fernandes, E. Gildin, M.A. Sampaio, "Data-driven estimation of flowing bottom-hole pressure in petroleum wells using long short-term memory," in 2024 International Conference on Machine Learning and Applications, ICMLA, pp. 1530-1537, 2024.
8. A.A. Al-Ghamdi, R.N. Gajbhiye, "Development of an AI model to estimate flowing bottom-hole pressure in high-pressure high-temperature gas well," in International Petroleum Technology Conference, 24IPTC, IPTC, 2024.
9. M. Jin, H. Emami-Meybodi, "An integrated machine learning algorithm for unconventional flowing bottomhole pressure prediction during dynamic gas lift operation," SPE J., vol. 30, no. 5, pp. 2726-2737, 2025.
10. E. Nnaemeka, V. M. Chinyereugo, "Predictive modelling of flowing bottom hole pressure in sandstone reservoir formations using machine learning," in SPE Nigeria Annual International Conference and Exhibition, 25NAIC, SPE, 2025.
11. M. Jin, H. Emami-Meybodi, "Prediction of flowing bottomhole pressure in gas-lifted wells using LSTM-ANN models," Energy Fuels, vol. 39, no. 31, pp. 14992-15002, 2025.
12. B. Abdullahi, M. Ezeh, "Production optimization in oil and gas wells: A gated recurrent unit approach to bottom hole flowing pressure prediction," in SPE Nigeria Annual International Conference and Exhibition, SPE, Art. no. D021S007R004, 2024.
13. O.E. Agwu, S. Alatefi, A. Alkouh, R.R. Suppiah, "Modelling the flowing bottom hole pressure of oil and gas wells using multivariate adaptive regression splines," J. Pet. Explor. Prod. Technol., vol. 15, no. 2, p. 22, 2025.
14. D. Campos, D.D.K. Wayo, R.B. De Santis, D.A. Martyushev, Z.M. Yaseen, U.I. Duru, C.M. Saporetti, L. Goliatt, "Evolutionary automated radial basis function neural network for multiphase flowing bottom-hole pressure prediction," Fuel, vol. 377, Art. no. 132666, 2024.
15. L. Goliatt, R.S. Mohammad, S.I. Abba, Z.M. Yaseen, "Development of hybrid computational data-intelligence model for flowing bottom-hole pressure of oil wells: New strategy for oil reservoir management and monitoring," Fuel, vol. 350, Art. no. 128623, 2023.
16. A. Lasisi, N. Attoh-Okine, "Machine learning ensembles and rail defects prediction: Multilayer stacking methodology," ASCE-ASME J. Risk Uncertain. Eng. Syst. Part A: Civ. Eng., vol. 5, no. 4, Art. no. 04019016, 2019.
17. X. Wang, T. Han, "Transformer fault diagnosis based on stacking ensemble learning," IEEJ Trans. Electr. Electron. Eng., vol. 15, no. 12, pp. 1734-1739, 2020.
18. S.A. El-Shorbagy, W.M. El-Gammal, W.M. Abdelmoez, "Using SMOTE and heterogeneous stacking in ensemble learning for software defect prediction," in Proceedings of the 7th International Conference on Software and Information Engineering, ICSIE '18, Association for Computing Machinery, New York, NY, USA, pp. 44-47, 2018.
19. N. Kardani, A. Zhou, M. Nazem, S.-L. Shen, "Improved prediction of slope stability using a hybrid stacking ensemble method based on finite element analysis and field data," J. Rock Mech. Geotech. Eng., vol. 13, no. 1, pp. 188-201, 2021.
20. D.-N. Truong, J.-S. Chou, "Fuzzy adaptive jellyfish search-optimized stacking machine learning for engineering planning and design," Autom. Constr., vol. 143, Art. no. 104579, 2022.
21. R. Huang, C. Wei, B. Wang, J. Yang, X. Xu, S. Wu, S. Huang, "Well performance prediction based on long short-term memory (LSTM) neural network," J. Pet. Sci. Eng., vol. 208, Art. no. 109686, 2022.
22. N.M. Ibrahim, A.A. Alharbi, T.A. Alzahrani, A.M. Abdulkarim, I.A. Alessa, A.M. Hameed, A.S. Albabtain, D.A. Alqahtani, M.K. Alsawwaf, A.A. Almuqhim, "Well performance classification and prediction: Deep learning and machine learning long term regression experiments on oil, gas, and water production," Sensors, vol. 22, no. 14, p. 5326, 2022.
23. F.I. Syed, S. Alnaqbi, T. Muther, A.K. Dahaghi, S. Negahban, "Smart shale gas production performance analysis using machine learning applications," Pet. Res., vol. 7, no. 1, pp. 21-31, 2022.
24. C.C. Nwanwe, U.I. Duru, "An adaptive neuro-fuzzy inference system white-box model for real-time multiphase flowing bottom-hole pressure prediction in wellbores," Petroleum, vol. 9, no. 4, pp. 629-646, 2023.
25. L. Goliatt, C. Saporetti, E. Pereira, "Super learner approach to predict total organic carbon using stacking machine learning models based on well logs," Fuel, vol. 353, Art. no. 128682, 2023.
26. M. Zolfagharroshan, E. Khamehchi, "Accurate artificial intelligence-based methods in predicting bottom-hole pressure in multiphase flow wells, a comparison approach," Arab. J. Geosci., vol. 14, p. 284, 2021.
27. H. Zhang, Y. Ren, Y. Zhang, S. Zheng, "Intelligent prediction method for fracture pressure based on stacking ensemble algorithm," Geomech. Geophys. Geo-Energy Geo-Resources, vol. 9, no. 1, p. 149, 2023.
28. S.A. Marfo, S. Asante-Okyere, Y.Y. Ziggah, "A new flowing bottom hole pressure prediction model using M5 prime decision tree approach," Model. Earth Syst. Environ., vol. 8, no. 2, pp. 2065-2073, 2021.
29. A. Shammari, "Prediction of Pressure Drop for Two-Phase Flow in Vertical Pipes Using Artificial Intelligence," Master's Thesis, King Fahd University of Petroleum and Minerals, 2011.
30. T. Cover, P. Hart, "Nearest neighbor pattern classification," IEEE Trans. Inform. Theory, vol. 13, no. 1, pp. 21-27, 1967.
31. X. Su, X. Yan, C.-L. Tsai, "Linear regression," Wiley Interdiscip. Rev.: Comput. Stat., vol. 4, no. 3, pp. 275-294, 2012.
32. Q.-Y. Zhu, A. Qin, P. Suganthan, G.-B. Huang, "Evolutionary extreme learning machine," Pattern Recognit., vol. 38, no. 10, pp. 1759-1763, 2005.
33. L. Breiman, "Random forests," Mach. Learn., vol. 45, no. 1, pp. 5-32, 2001.
34. V. Vapnik, "Estimation of Dependences Based on Empirical Data," Springer New York, 2006.
35. I.D. Mienye, Y. Sun, "A survey of ensemble learning: Concepts, algorithms, applications, and prospects," IEEE Access, vol. 10, pp. 99129-99149, 2022.
36. N. Liu, H. Gao, Z. Zhao, Y. Hu, L. Duan, "A stacked generalization ensemble model for optimization and prediction of the gas well rate of penetration: a case study in Xinjiang," J. Pet. Explor. Prod. Technol., vol. 12, no. 6, pp. 1595-1608, 2021.
37. K.-L. Du, B. Jiang, J. Lu, J. Hua, M. Swamy, "Exploring kernel machines and support vector machines: Principles, techniques, and future directions," Mathematics, vol. 12, no. 24, p. 3935, 2024.
38. R. Isnaeni, S. Sudarmin, Z. Rais, "Analisis support vector regression (Svr) dengan kernel radial basis function (Rbf) untuk memprediksi laju inflasi di Indonesia," VARIANSI: J. Stat. Appl. Teach. Res., vol. 4, no. 1, pp. 30-38, 2022.
39. R. Gupta, S.J. Nanda, "Solving dynamic many-objective TSP using NSGA-III equipped with SVR-RBF kernel predictor," in 2021 IEEE Congress on Evolutionary Computation, CEC, IEEE, pp. 95-102, 2021.
40. S. Young, T. Abdou, A. Bener, "Deep super learner: A deep ensemble for classification problems," in Bagheri E., Cheung J.C. (Eds.), Advances in Artificial Intelligence, Springer International Publishing, Cham, pp. 84-95, 2018.
41. W. McKinney, et al., "Pandas: a foundational Python library for data analysis and statistics," Python High Perform. Sci. Comput., vol. 14, no. 9, pp. 1-9, 2011.
42. F. Pedregosa, G. Varoquaux, A. Gramfort, V. Michel, B. Thirion, O. Grisel, M. Blondel, P. Prettenhofer, R. Weiss, V. Dubourg, J. Vanderplas, A. Passos, D. Cournapeau, M. Brucher, M. Perrot, É. Duchesnay, "Scikit-learn: Machine learning in Python," J. Mach. Learn. Res., vol. 12, no. 85, pp. 2825-2830, 2011.
43. L. Goliatt, Z.M. Yaseen, "Development of a hybrid computational intelligent model for daily global solar radiation prediction," Expert Syst. Appl., vol. 212, Art. no. 118295, 2023.
44. R.M. El-Saghier, M. Abu El Ela, A. El-Banbi, "A model for calculating bottom-hole pressure from simple surface data in pumped wells," J. Pet. Explor. Prod. Technol., vol. 10, no. 5, pp. 2069-2077, 2020.
45. M. Jin, H. Emami-Meybodi, M. Ahmadi, "Flowing bottomhole pressure during gas lift in unconventional oil wells," SPE J., vol. 29, no. 5, pp. 2432-2444, 2024.
46. S.M. Lundberg, S.-I. Lee, "A unified approach to interpreting model predictions," in Guyon I., Luxburg U.V., Bengio S., Wallach H., Fergus R., Vishwanathan S., Garnett R. (Eds.), Advances in Neural Information Processing Systems, vol. 30, Curran Associates, Inc., 2017.
47. B. Izgec, A.R. Hasan, D. Lin, C.S. Kabir, "Flow-rate estimation from wellhead-pressure and temperature data," SPE Prod. Oper., vol. 25, no. 1, pp. 31-39, 2009.
48. S. Hari, S. Krishna, M. Patel, P. Bhatia, R.K. Vij, "Influence of wellhead pressure and water cut in the optimization of oil production from gas lifted wells," Pet. Res., vol. 7, no. 2, pp. 253-262, 2022.
49. Z. Tariq, et al., "Real-time prognosis of flowing bottom-hole pressure in a vertical well for a multiphase flow using computational intelligence techniques," J. Pet. Explor. Prod. Technol., 2020.
50. Z. Song, G. Han, Z. Ren, H. Su, S. Jia, T. Cheng, M. Li, J. Liang, "Research on oil–water two-phase flow patterns in wellbore of heavy oil wells with medium-high water cut," Processes, vol. 12, no. 11, p. 2404, 2024.
51. X. Zhou, et al., "Determination of reasonable bottom-hole pressure in unconventional tight oil reservoirs: A field case investigation," Lithosphere, vol. 2022, no. 12, pp. 1-15, 2022.
52. R. Chen, et al., "Influence factors of the bottom hole flow pressure in a high-pressure and high-temperature condensate gas reservoir: Applicability analysis," Front. Energy Res., vol. 10, Art. no. 857354, 2022.
53. S.M. Lundberg, S.-I. Lee, "A unified approach to interpreting model predictions," Adv. Neural Inf. Process. Syst., vol. 30, 2017.
54. S. Cui, Y. Yin, D. Wang, Z. Li, Y. Wang, "A stacking-based ensemble learning method for earthquake casualty prediction," Appl. Soft Comput., vol. 101, Art. no. 107038, 2021.
55. J. Shi, C. Li, X. Yan, "Artificial intelligence for load forecasting: A stacking learning approach based on ensemble diversity regularization," Energy, vol. 262, Art. no. 125295, 2023.
56. J. Figueroa, P. Baraldi, I. Chouybat, F. Ursini, E. Vignati, E. Zio, "Estimation of real-time bottomhole parameters in CO2 injection wells during operations by means of an ensemble of neural networks," in SPE Europe Energy Conference and Exhibition, 24EURO, SPE, 2024.
57. S. Bian, W. Wang, "On diversity and accuracy of homogeneous and heterogeneous ensembles," Int. J. Hybrid Intell. Syst., vol. 4, no. 2, pp. 103-128, 2007.
58. W. Wang, P. Jones, D. Partridge, "Diversity between neural networks and decision trees for building multiple classifier systems," in Multiple Classifier Systems, Springer Berlin Heidelberg, Berlin, Heidelberg, pp. 240-249, 2000.
59. J.R. Rice, "The algorithm selection problem," in Rubinoff M., Yovits M.C. (Eds.), Advances in Computers, vol. 15, Elsevier, pp. 65-118, 1976.
60. H.J.P. Weerts, A.C. Mueller, J. Vanschoren, "Importance of tuning hyperparameters of machine learning algorithms," 2020. [Online]. Available: arXiv:2007.07588
61. S. García, J. Luengo, F. Herrera, "Data Preprocessing in Data Mining," Springer International Publishing, 2015.
62. G. Seni, J.F. Elder, "Ensemble Methods in Data Mining: Improving Accuracy Through Combining Predictions," Springer International Publishing, 2010.
63. E. Kasuya, "On the use of r and r squared in correlation and regression," Ecol. Res., vol. 34, no. 1, pp. 235-236, 2019.
64. N.O. Nikitin, I. Revin, A. Hvatov, P. Vychuzhanin, A.V. Kalyuzhnaya, "Hybrid and automated machine learning approaches for oil fields development: The case study of volve field, north sea," Comput. Geosci., vol. 161, Art. no. 105061, 2022.
65. N.O. Nikitin, M. Pinchuk, V. Pokrovskii, P. Shevchenko, A. Getmanov, Y. Aksenkin, I. Revin, A. Stebenkov, V. Latypov, E. Poslavskaya, et al., "Integration of evolutionary automated machine learning with structural sensitivity analysis for composite pipelines," Knowl.-Based Syst., vol. 302, Art. no. 112363, 2024.
66. M.T. Ribeiro, S. Singh, C. Guestrin, "Why should I trust you? Explaining the predictions of any classifier," in Proceedings of the 22nd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, pp. 1135-1144, 2016.
67. Z. Xu, H. Liu, J. Sun, et al., "A drilling wellbore pressure calculation model considering the effect of gas dissolution and suspension," Front. Earth Sci., 2022.
68. X. Chen, Y. Zhang, H. Li, et al., "Further study on oil/water relative permeability ratio model and waterflooding performance prediction model for high water-cut oilfields sustainable development," J. Pet. Explor. Prod. Technol., 2024.
69. M.A.A. El-Moniem, A.H. El-Banbi, "Effects of production, PVT and pipe roughness on multiphase flow correlations in gas wells," J. Pet. Explor. Prod. Technol., 2020.
70. S. Beheshtian, S.K. Roodbari, H. Ghorbani, M. Azodinia, M. Mudabbir, A.R. Varkonyi-Koczy, "Comparative evaluation of machine learning and Bayesian deep learning methods for estimating ultimate recovery in shale well reservoirs," in 2024 IEEE 11th International Conference on Computational Cybernetics and Cyber-Medical Systems, ICCC, pp. 000017-000024, 2024.
71. S. Beheshtian, S.K. Roodbari, H. Ghorbani, M. Azodinia, M. Mudabbir, A.R. Varkonyi-Koczy, "Advanced machine learning methods for accurate prediction of loss circulation in drilling well log," in 2024 IEEE 11th International Conference on Computational Cybernetics and Cyber-Medical Systems, ICCC, pp. 000031-000036, 2024.
72. X. Lu, Z. Wang, M. Zhao, S. Peng, S. Geng, H. Ghorbani, "Data-driven insights into climate change effects on groundwater levels using machine learning," Water Resour. Manag., vol. 39, no. 7, pp. 3521-3536, 2025.
