A Hybrid Transfer Learning Framework for Enhanced Oil Production Time Series Forecasting
DOI:
https://doi.org/10.32604/cmc.2025.059869Keywords:
Time series , forecasting , gaussian transformation , quantile transformation , long short-term memory , gated recurrent unitsAbstract
Accurate forecasting of oil production is essential for optimizing resource management and minimizing operational risks in the energy sector. Traditional time-series forecasting techniques, despite their widespread application, often encounter difficulties in handling the complexities of oil production data, which is characterized by non-linear patterns, skewed distributions, and the presence of outliers. To overcome these limitations, deep learning methods have emerged as more robust alternatives. However, while deep neural networks offer improved accuracy, they demand substantial amounts of data for effective training. Conversely, shallow networks with fewer layers lack the capacity to model complex data distributions adequately. To address these challenges, this study introduces a novel hybrid model called Transfer LSTM to GRU (TLTG), which combines the strengths of deep and shallow networks using transfer learning. The TLTG model integrates Long Short-Term Memory (LSTM) networks and Gated Recurrent Units (GRU) to enhance predictive accuracy while maintaining computational efficiency. Gaussian transformation is applied to the input data to reduce outliers and skewness, creating a more normal-like distribution. The proposed approach is validated on datasets from various wells in the Tahe oil field, China. Experimental results highlight the superior performance of the TLTG model, achieving 100% accuracy and faster prediction times (200 s) compared to eight other approaches, demonstrating its effectiveness and efficiency.References
Abbasimehr, H., Behboodi, A., & Bahrini, A. (2024). A novel hybrid model to forecast seasonal and chaotic time series. Expert Systems with Applications, 239, Article 122461. https://doi.org/10.1016/j.eswa.2023.122461
AL-Alimi, D., AlRassas, A. M., Al-qaness, M. A. A., Cai, Z., Aseeri, A. O., & Abd Elaziz, M. (2023). TLIA: Time-series forecasting model using long short-term memory integrated with artificial neural networks for volatile energy markets. Applied Energy, 343, Article 121230. https://doi.org/10.1016/j.apenergy.2023.121230
Alalimi, A., Pan, L., Al-qaness, M. A. A., Ewees, A. A., Wang, X., & Abd Elaziz, M. (2021). Optimized random vector functional link network to predict oil production from Tahe oil field in China. Oil & Gas Science and Technology – Revue d’IFP Energies nouvelles, 76, Article 3. https://doi.org/10.2516/ogst/2021011
Al-Mudhafar, W. J. (2017). Integrating well log interpretations for lithofacies classification and permeability modeling through advanced machine learning algorithms. Journal of Petroleum Exploration and Production Technology, 7(4), 1023–1033. https://doi.org/10.1007/s13202-017-0360-x
AlRassas, A. M., Al-qaness, M. A. A., Ewees, A. A., Ren, S., Abd Elaziz, M., & Damaševičius, R. (2021). Optimized ANFIS model using Aquila optimizer for oil production forecasting. Processes, 9(7), Article 1194. https://doi.org/10.3390/pr9071194
Bacanin, N., Stoean, C., Zivkovic, M., Rakic, M., Strulak-Wójcikiewicz, R., & Stoean, R. (2023). On the benefits of using metaheuristics in the hyperparameter tuning of deep learning models for energy load forecasting. Energies, 16(3), Article 1434. https://doi.org/10.3390/en16031434
Bhardwaj, S., Chandrasekhar, E., Padiyar, P., & Gadre, V. M. (2020). A comparative study of wavelet-based ANN and classical techniques for geophysical time-series forecasting. Computers & Geosciences, 138, Article 104461. https://doi.org/10.1016/j.cageo.2020.104461
Bokde, N. D., Tranberg, B., & Andresen, G. B. (2020). Short-term CO2 emissions forecasting based on decomposition approaches and its impact on electricity market scheduling. Applied Energy, 281, Article 116061. https://doi.org/10.1016/j.apenergy.2020.116061
Bokde, N. D., Salih, S. Q., Shende, M. K., Scholz, M., Oudah, A. Y., & Yaseen, Z. M. (2022). Natural time series parameters forecasting: Validation of the pattern-sequence-based forecasting (PSF) algorithm; a new Python package. Applied Sciences, 12(12), Article 6194. https://doi.org/10.3390/app12126194
Cho, K., Van Merriënboer, B., Gulcehre, C., Bahdanau, D., Bougares, F., & Schwenk, H. (2014). Learning phrase representations using RNN encoder-decoder for statistical machine translation. arXiv preprint. https://doi.org/10.48550/arXiv.1406.1078
Clarkson, C. R., Williams-Kovacs, J. D., Qanbari, F., Behmanesh, H., & Sureshjani, M. H. (2015). History-matching and forecasting tight/shale gas condensate wells using combined analytical, semi-analytical, and empirical methods. Journal of Natural Gas Science and Engineering, 26, 1620–1647. https://doi.org/10.1016/j.jngse.2015.06.052
Edalatpanah, S. A., Hassani, F. S., Smarandache, F., Sorourkhah, A., Pamucar, D., & Cui, B. (2024). A hybrid time series forecasting method based on neutrosophic logic with applications in financial issues. Engineering Applications of Artificial Intelligence, 129, Article 107531. https://doi.org/10.1016/j.engappai.2023.107531
Eren, Y., & Küçükdemiral, İ. (2024). A comprehensive review on deep learning approaches for short-term load forecasting. Renewable and Sustainable Energy Reviews, 189, Article 114031. https://doi.org/10.1016/j.rser.2023.114031
Erzurum Cicek, Z. I., & Kamisli Ozturk, Z. (2021). Optimizing the artificial neural network parameters using a biased random key genetic algorithm for time series forecasting. Applied Soft Computing, 102, Article 107091. https://doi.org/10.1016/j.asoc.2021.107091
Fernández, A., García, S., Galar, M., Prati, R. C., Krawczyk, B., & Herrera, F. (2018). Learning from imbalanced data sets. Springer International Publishing. https://doi.org/10.1007/978-3-319-98074-4
Iturrarán-Viveros, U., & Parra, J. C. (2014). Artificial Neural Networks applied to estimate permeability, porosity and intrinsic attenuation using seismic attributes and well-log data. Journal of Applied Geophysics, 107, 45–54. https://doi.org/10.1016/j.jappgeo.2014.05.010
Kalra, S., Tian, W., & Wu, X. (2018). A numerical simulation study of CO2 injection for enhancing hydrocarbon recovery and sequestration in liquid-rich shales. Petroleum Science, 15(1), 103–115. https://doi.org/10.1007/s12182-017-0210-4
Kokko, H. (2024). Who is afraid of modelling time as a continuous variable? Methods in Ecology and Evolution, 15(10), 1736–1756. https://doi.org/10.1111/2041-210X.14397
Le, T., Vo, M. T., Kieu, T., Hwang, E., Rho, S., & Baik, S. W. (2020). Multiple electric energy consumption forecasting using a cluster-based strategy for transfer learning in smart building. Sensors, 20(9), Article 2668. https://doi.org/10.3390/s20092668
LeCun, Y., Bengio, Y., & Hinton, G. (2015). Deep learning. Nature, 521(7553), 436–444. https://doi.org/10.1038/nature14539
Liang, B., Liu, J., You, J., Jia, J., Pan, Y., & Jeong, H. (2023). Hydrocarbon production dynamics forecasting using machine learning: A state-of-the-art review. Fuel, 337, Article 127067. https://doi.org/10.1016/j.fuel.2022.127067
Liu, W., Liu, W. D., & Gu, J. (2020). Forecasting oil production using ensemble empirical model decomposition based Long Short-Term Memory neural network. Journal of Petroleum Science and Engineering, 189, Article 107013. https://doi.org/10.1016/j.petrol.2020.107013
Lu, J., Behbood, V., Hao, P., Zuo, H., Xue, S., & Zhang, G. (2015). Transfer learning using computational intelligence: A survey. Knowledge-Based Systems, 80, 14–23. https://doi.org/10.1016/j.knosys.2015.01.010
Male, F. (2019). Using a segregated flow model to forecast production of oil, gas, and water in shale oil plays. Journal of Petroleum Science and Engineering, 180, 48–61. https://doi.org/10.1016/j.petrol.2019.05.011
Nikitin, N. O., Revin, I., Hvatov, A., Vychuzhanin, P., & Kalyuzhnaya, A. V. (2022). Hybrid and automated machine learning approaches for oil fields development: The case study of Volve field, North Sea. Computers & Geosciences, 161, Article 105061. https://doi.org/10.1016/j.cageo.2022.105061
Ning, Y., Kazemi, H., & Tahmasebi, P. (2022). A comparative machine learning study for time series oil production forecasting: ARIMA, LSTM, and Prophet. Computers & Geosciences, 164, Article 105126. https://doi.org/10.1016/j.cageo.2022.105126
Raju, V. N. G., Lakshmi, K. P., Jain, V. M., Kalidindi, A., & Padma, V. (2020). Study the influence of normalization/transformation process on the accuracy of supervised classification. Proceedings of the International Conference on Smart Electronics and Communication (ICOSEC), 729–735. https://doi.org/10.1109/ICOSEC49089.2020.9215319
Sagheer, A., & Kotb, M. (2019). Time series forecasting of petroleum production using deep LSTM recurrent networks. Neurocomputing, 323, 203–213. https://doi.org/10.1016/j.neucom.2018.09.082
Song, X., Liu, Y., Xue, L., Wang, J., Zhang, J., & Wang, J. (2020). Time-series well performance prediction based on Long Short-Term Memory (LSTM) neural network model. Journal of Petroleum Science and Engineering, 186, Article 106682. https://doi.org/10.1016/j.petrol.2019.106682
Tealab, A. (2018). Time series forecasting using artificial neural networks methodologies: A systematic review. Future Computing and Informatics Journal, 3(2), 334–340. https://doi.org/10.1016/j.fcij.2018.10.003
Wang, J., Cao, J., & Yuan, S. (2020). Shear wave velocity prediction based on adaptive particle swarm optimization optimized recurrent neural network. Journal of Petroleum Science and Engineering, 194, Article 107466. https://doi.org/10.1016/j.petrol.2020.107466
Ye, R., & Dai, Q. (2018). A novel transfer learning framework for time series forecasting. Knowledge-Based Systems, 156, 74–99. https://doi.org/10.1016/j.knosys.2018.05.021
Zhang, Z., & Moore, J. C. (2015). Mathematical and physical fundamentals of climate change. In Z. Zhang & J. C. Moore (Eds.), Mathematical and Physical Fundamentals of Climate Change (pp. 239–290). Elsevier. https://doi.org/10.1016/B978-0-12-800066-4.00008-0
Zolotukhin, A. B., & Gayubov, A. T. (2019). Machine learning in reservoir permeability prediction and modelling of fluid flow in porous media. IOP Conference Series: Materials Science and Engineering, 700(1), Article 012023. https://doi.org/10.1088/1757-899X/700/1/012023
Downloads
Published
License
Copyright (c) 2025 CC BY 4.0
This work is licensed under a Creative Commons Attribution 4.0 International License.
