TMRE: Novel Algorithm for Computing Daily Reference Evapotranspiration Using Transformer-Based Models
Source abstract
Abstract
Reference Evapotranspiration (ETo) is widely used to assess total water loss between land and atmosphere due to its importance in maintaining the atmospheric water balance, especially in agricultural and environmental management. Accurate estimation of ETo is challenging due to its dependency on multiple climatic variables, including temperature, humidity, and solar radiation, making it a complex multivariate time-series problem. Traditional machine learning and deep learning models have been applied to forecast ETo, achieving moderate success. However, the introduction of transformer-based architectures in time-series forecasting has opened new possibilities for more precise ETo predictions. In this study, a novel algorithm for ETo forecasting is proposed, focusing on four transformer-based models: Vanilla Transformer, Informer, Autoformer, and FEDformer (Frequency Enhanced Decomposed Transformer), applied to an ETo dataset from the Andalusian region. The novelty of the proposed algorithm lies in determining optimized window sizes based on seasonal trends and variations, which were then used with each model to enhance prediction accuracy. This custom window-sizing method allows the models to capture ETo’s unique seasonal patterns more effectively. Finally, results demonstrate that the Informer model outperformed other transformer-based models, achieving mean square error (MSE) values of 0.1404 and 0.1445 for forecast windows (15,7) and (30,15), respectively. The Vanilla Transformer also showed strong performance, closely following the Informer model. These findings suggest that the proposed optimized window-sizing approach, combined with transformer-based architectures, is highly effective for ETo modelling. This novel strategy has the potential to be adapted in other multivariate time-series forecasting tasks that require seasonality-sensitive approaches.
Source: openalex_inverted_index · Quality: baseline
Research context
OpenAlex topics: Plant Water Relations and Carbon Dynamics · Urban Stormwater Management Solutions · Hydrology and Watershed Management Studies
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
References (22)
Show source-provided references
1. Federated learning based reference evapotranspiration estimation for distributed crop fields10.1371/journal.pone.0314921 ↗
2. Management of irrigation requirements using FAO-CROPWAT 8.0 model: a case study of Egypt10.1007/s40808-021-01268-4 ↗
3. Chapter 2—FAO Penman-Monteith equation
4. Comparison of ELM, GANN, WNN and empirical models for estimating reference evapotranspiration in humid region of Southwest China10.1016/j.jhydrol.2016.02.053 ↗
5. Evapotranspiration modeling using different tree based ensembled machine learning algorithm10.1007/s11269-022-03067-7 ↗
6. Enhancing irrigation water management based on ETo prediction using machine learning to mitigate climate change
7. Reference evapotranspiration estimation and modeling of the Punjab Northern India using deep learning10.1016/j.compag.2018.11.031 ↗
8. Modelling monthly reference evapotranspiration estimation using machine learning approach in data-scarce North Western Himalaya region (Almora)
9. Estimation of monthly reference evapotranspiration using novel hybrid machine learning approaches10.1080/02626667.2019.1678750 ↗
10. Estimating daily reference evapotranspiration based on limited meteorological data using deep learning and classical machine learning methods10.1016/j.jhydrol.2020.125286 ↗
11. Context aware evapotranspiration (ETs) for saline soils reclamation10.1109/ACCESS.2022.3206009 ↗
12. Salahudin · Hydrology · 2023 Aug · 10 · 16910.3390/hydrology10080169 ↗
13. DeepEvap: deep reinforcement learning based ensemble approach for estimating reference evapotranspiration10.1016/j.asoc.2022.109113 ↗
14. Attention is all you need
15. Dosovitskiy A, Beyer L, Kolesnikov A, Weissenborn D, Zhai X, Unterthiner T, et al. An image is worth 16x16 words: transformers for image recognition at scale. [cited 2024 Mar 26]. Available from: https://arxiv.org/abs/2010.11929
16. DynamicViT: efficient vision transformers with dynamic token sparsification
17. Adversarial sparse transformer for time series forecasting
18. Are transformers effective for time series forecasting?
19. A regional machine learning method to outperform temperature-based reference evapotranspiration estimations in Southern Spain10.1016/j.agwat.2022.107955 ↗
20. Informer: beyond efficient transformer for long sequence time-series forecasting
21. Autoformer: decomposition transformers with auto-correlation for long-term series forecasting
22. FEDformer: frequency enhanced decomposed transformer for long-term series forecasting