Research on Interpolation Method for Missing Electricity Consumption Data
Source abstract
Abstract
Missing value is one of the main factors that cause dirty data. Without high-quality data, there will be no reliable analysis results and precise decision-making. Therefore, the data warehouse needs to integrate high-quality data consistently. In the power system, the electricity consumption data of some large users cannot be normally collected resulting in missing data, which affects the calculation of power supply and eventually leads to a large error in the daily power line loss rate. For the problem of missing electricity consumption data, this study proposes a group method of data handling (GMDH) based data interpolation method in distribution power networks and applies it in the analysis of actually collected electricity data. First, the dependent and independent variables are defined from the original data, and the upper and lower limits of missing values are determined according to prior knowledge or existing data information. All missing data are randomly interpolated within the upper and lower limits. Then, the GMDH network is established to obtain the optimal complexity model, which is used to predict the missing data to replace the last imputed electricity consumption data. At last, this process is implemented iteratively until the missing values do not change. Under a relatively small noise level (α = 0.25), the proposed approach achieves a maximum error of no more than 0.605%. Experimental findings demonstrate the efficacy and feasibility of the proposed approach, which realizes the transformation from incomplete data to complete data. Also, this proposed data interpolation approach provides a strong basis for the electricity theft diagnosis and metering fault analysis of electricity enterprises.
Source: openalex_inverted_index · Quality: baseline
Research context
OpenAlex topics: Smart Grid and Power Systems · Power Systems and Technologies
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
References (34)
Show source-provided references
1. Research on abnormal line loss data system in power grid through abnormal identification of line loss index
2. A power line loss analysis method based on boost clustering10.1007/s11227-022-04777-w ↗
3. The analysis method of line loss for planning grid
4. Research on diagnosis of abnormal line loss of 10kV transmission line based on factor analysis
5. Research of power load prediction based on boost clustering10.1007/s00500-021-05632-5 ↗
6. Nagayama · Structural health monitoring using smart sensors · 2007
7. Deep learning based missing data recovery of non-stationary wind velocity10.1016/j.jweia.2022.104962 ↗
8. Identification of chilling and heat requirements of cherry trees—A statistical approach10.1007/s00484-012-0594-y ↗
9. Quality control in bio-monitoring networks, Spanish Aerobiology Network10.1016/j.scitotenv.2012.11.040 ↗
10. Modulo 9 model-based learning for missing data imputation10.1016/j.asoc.2021.107167 ↗
11. An experimental survey of missing data imputation algorithms
12. Imputation of missing data in time series for air pollutants10.1016/j.atmosenv.2014.11.049 ↗
13. Chilling and heat requirements for flowering in temperate fruit trees10.1007/s00484-013-0714-3 ↗
14. Missing value imputation for multi-view urban statistical data via spatial correlation learning
15. V. Todorov, “rrcovNA: Scalable robust estimators with high breakdown point for incomplete data,” R package version 0.4-15, 2020.
16. Nearest neighbor selection for iteratively kNN imputation10.1016/j.jss.2012.05.073 ↗
17. Interpolation of missing wind data based on ANFIS10.1016/j.renene.2010.08.033 ↗
18. Application of a multi-stage neural network approach for time-series landfill gas modeling with missing data imputation10.1016/j.wasman.2020.07.034 ↗
19. BiLSTM-A: A missing value imputation method for PM2. 5 prediction
20. MissForest—Non-parametric missing value imputation for mixed-type data10.1093/bioinformatics/btr597 ↗
21. Methods for interpolating missing data in aerobiological databases10.1016/j.envres.2021.111391 ↗
22. Data pre-processing using neural processes for modeling personalized vital-sign time-series data10.1109/JBHI.2021.3107518 ↗
23. Comparison of missing data imputation methods in time series forecasting
24. Data interpolation of traffic flow algorithm using wavelet transform for traffic generative modeling10.1109/JRFID.2022.3217084 ↗
25. Missing interpolation model for wind power data based on the improved CEEMDAN method and generative adversarial interpolation network10.1016/j.gloei.2023.10.001 ↗
26. Pixelwise dynamic convolution neural network for LiDAR depth data interpolation10.1109/JSEN.2021.3124325 ↗
27. Comparative variance and multiple imputation used for missing values in land price dataSet
28. Scattered data interpolation using rational quartic triangular patches with three parameters10.1109/ACCESS.2020.2978173 ↗
29. Irregularly sampled seismic data interpolation via wavelet-based convolutional block attention deep learning
30. Mueller · Self-Organising Data Mining: An Intelligent Approach to Extract Knowledge From Data · 2000
31. A turning point prediction method of stock price based on RVFL-GMDH and chaotic time series analysis10.1007/s10115-021-01602-3 ↗
32. Optimal cooperation between external criterion and data division in GMDH10.1080/00207720701750816 ↗
33. Statistical learning networks: A unifying view
34. A classifier ensemble model based on GMDH-type neural network for customer targeting