Statistical missing data interpolation algorithm for water and soil conservation engineering of overhead transmission lines based on time series characteristics and GRU model
Source abstract
Abstract
The statistical data of water and soil conservation works for overhead transmission lines often suffer from incompleteness due to variations in project scale. To address this data gap, this study proposes an innovative interpolation algorithm that combines time-series characteristics with a Gated Recurrent Unit (GRU) model to accurately estimate missing values in water and soil conservation statistics. The proposed methodology first analyzes the types of statistical data involved and collects multi-source information to construct the initial dataset. The Isolation Forest algorithm is then employed to detect and remove outliers from the raw data during the preprocessing stage. A novel feature extraction approach integrates self-attention mechanisms into convolutional neural networks to effectively identify and focus on crucial temporal patterns. The developed GRU model, trained on these extracted time-series features, generates reliable predictions for missing data points. Experimental results demonstrate the algorithm's effectiveness, achieving an impressive explained variance score of 0.92 and a Pearson correlation coefficient of 0.94 across different missing data rates. This approach not only ensures data completeness and accuracy but also provides a solid foundation for planning and management decisions in water and soil conservation projects for transmission line infrastructure. The successful implementation of this technique offers a robust solution to a persistent challenge in infrastructure monitoring and maintenance data management.
Source: crossref · Quality: baseline
Research context
OpenAlex topics: Hydrological Forecasting Using AI · Hydrology and Watershed Management Studies · Soil Moisture and Remote Sensing
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
Affiliations
State Grid Fujian Economic Research Institute , Fuzhou 350013,
References (20)
Show source-provided references
1. Indigenous practices of soil and water conservation for sustainable hill agriculture and improving livelihood security10.1007/s00267-022-01602-1 ↗
2. Prioritization of sub-watersheds for soil conservation management using morphometric, biophysical and socioeconomic characteristics: A fuzzy AHP approach10.1007/s12665-023-11410-3 ↗
3. Characterizing the effects of dry antecedent soil moisture conditions, channel transmission losses, and variable precipitation on peak flow scaling10.1016/j.advwatres.2021.104061 ↗
4. Changing characteristics of regional and site-based frequency distribution under the non-stationary process10.1007/s12205-022-0651-y ↗
5. Robust smoothing of one-dimensional data with missing and/or outlier values10.1049/sil2.12033 ↗
6. Imputation of missing measurements in PV production data within constrained environments10.1016/j.eswa.2023.119510 ↗
7. Empirical Bayesian Kriging, a robust method for spatial data interpolation of a large groundwater quality dataset from the Western Netherlands10.3390/w16182581 ↗
8. Reconstructing missing data by comparing interpolation techniques: Applications for long-term water quality data10.1002/lom3.10556 ↗
9. KNN-ST: Exploiting spatio-temporal correlation for missing data inference in environmental crowd sensing10.1109/jsen.2020.3024976 ↗
10. Missing trace reconstruction for 2D land seismic data with randomized sparse sampling10.1190/geo2020-0683.1 ↗
11. Seismic data interpolation using deep learning with generative adversarial networks10.1111/1365-2478.13055 ↗
12. Asymmetric heavy-tailed vector auto-regressive processes with application to financial data10.1080/00949655.2019.1680675 ↗
13. On the asymptotic distribution for the periodograms of almost periodically correlated (cyclostationary) processes10.1016/j.dsp.2018.07.004 ↗
14. Hashed, binned a-buffer for real-time outlier removal and rendering of noisy point clouds10.1007/s00371-023-02888-w ↗
15. Toward feature selection in big data preprocessing based on hybrid cloud-based model10.1007/s11227-021-03970-7 ↗
16. EvoImputer: An evolutionary approach for missing data imputation and feature selection in the context of supervised learning10.1016/j.knosys.2021.107734 ↗
17. Dictionary learning with convolutional structure for seismic data denoising and interpolation10.1190/geo2019-0689.1 ↗
18. DeepDFML-NILM: A new CNN-based architecture for detection, feature extraction and multi-label classification in NILM signals10.1109/jsen.2021.3127322 ↗
19. Intrinsic and extrinsic techniques for quantification uncertainty of an interpretable GRU deep learning model used to predict atmospheric total suspended particulates (TSP) in Zabol, Iran during the dusty period of 120-days wind10.1016/j.envpol.2023.123082 ↗
20. Sequence-based modeling of deep learning with LSTM and GRU networks for structural damage detection of floating offshore wind turbine blades10.1016/j.renene.2021.04.025 ↗