journal article·2023-08-28Open access

Electric Load Forecasting Based on Deep Ensemble Learning

Aoqiang Wang, Qiancheng Yu, Jinyun Wang, Xulong Yu, Zhici Wang, Zhiyong Hu

Applied Sciences· Volume 13· Issue 17

Abstract

Short-to-medium-term electric load forecasting is crucial for grid planning, transformation, and load scheduling for power supply departments. Various complex and ever-changing factors such as weather, seasons, regional economic structures, and enterprise production cycles exert uncontrollable effects on the electric grid load. While the causal convolutional neural network can significantly enhance long-term sequence prediction, it may suffer from problems such as vanishing gradients and overfitting due to extended time series. To address this issue, this paper introduces a new power load data anomaly detection method, which leverages a convolutional neural network (CNN) to extract temporal and spatial information from the load data. The features extracted are then processed using a bidirectional long short-term memory network (BiLSTM) to capture the temporal dependencies in the data more adeptly. An enhanced random forest (RF) classifier is employed for anomaly detection in electric load data. Furthermore, the paper proposes a new model framework for electricity load forecasting that combines a dilated causal convolutional neural network with ensemble learning. This combination addresses issues such as vanishing gradients encountered in causal convolutional neural networks with long time series. Extreme gradient boosting (XGBoost), category boosting (CATBoost), and light gradient boosting machine (LightGBM) models act as the base learners for ensemble modeling to comprehend deep cross-features, and the prediction results generated by ensemble learning serve as a new feature set for secondary ensemble modeling. The dilated convolutional neural network broadens the receptive field of the convolutional kernel. All acquired feature values are concatenated and input into the dilated causal convolutional neural network for training, achieving short-to-medium-term electric load forecasting. Experimental results indicate that compared to existing models, its root mean squared error (RMSE) and mean squared error (MSE) in short-term and mid-term electricity load forecasting are reduced by 4.96% and 12.31%, respectively, underscoring the efficacy of the proposed framework.
Source: crossref · Quality: baseline

Research context

OpenAlex topics: Energy Load and Power Forecasting · Traffic Prediction and Management Techniques · Smart Grid and Power Systems

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

The College of Computer Science and Engineering, North Minzu University, Ningxia 750021, China

The Key Laboratory of Images and Graphics Intelligent Processing of State Ethnic Affairs Commission, North Minzu University, Yinchuan 750021, China

The School of Business, North Minzu University, Ningxia 750021, China

Funding

2022 Ningxia Autonomous Region Key Research and Development Plan (Talent Introduction Special) Project · Ningxia Key Research and Development Plan (Key Project) · The 2022 University Research Platform “Digital Agriculture Empowering Ningxia Rural Revitalization Innovation Team” of North Minzu University · The major key project of school-enterprise joint innovation in Yinchuan 2022

References (34)

Show source-provided references
1. Multi-space collaboration framework based optimal model selection for power load forecasting10.1016/j.apenergy.2022.118937 ↗
2. Optimal design of the gear ratio of a power reflux hydraulic transmission system based on data mining10.1016/j.mechmachtheory.2019.103600 ↗
3. Online coherency identification and stability condition for large interconnected power systems using an unsupervised data mining technique10.1049/iet-gtd.2018.6315 ↗
4. Gong, F., Gong, T., Yu, Y., Sheng, Y., Liu, K., and Kong, X. (2021, January 28–30). An Electricity Load Forecasting Algorithm Based on Kernel Lasso Regression. Proceedings of the 2021 IEEE 4th International Electrical and Energy Conference (CIEEC), Wuhan, China.10.1109/CIEEC50170.2021.9510772 ↗
5. Hierarchical parameter optimization based support vector regression for power load forecasting10.1016/j.scs.2021.102937 ↗
6. Chodakowska, E., and Nazarko, J. (2021). Nazarko, ARIMA Models in Electrical Load Forecasting and Their Robustness to Noise. Energies, 14.10.3390/en14237952 ↗
7. Yan, K., Wang, X., Du, Y., Jin, N., Huang, H., and Zhou, H. (2018). Multi-Step Short-Term Power Consumption Forecasting with a Hybrid Deep Learning Strategy. Energies, 11.10.3390/en11113089 ↗
8. Research on the Forecast Model of Electricity Power Industry Loan Based on GA-BP Neural Network
9. Research on short-term load forecasting of power system based on gradient lifting tree10.1504/IJPEC.2022.130951 ↗
10. Short term electricity load forecasting using hybrid prophet-LSTM model optimized by BPNN10.1016/j.egyr.2021.12.067 ↗
11. An attention-based CNN-LSTM-BiLSTM model for short-term electric load forecasting in integrated energy system10.1002/2050-7038.12637 ↗
12. Aguilar Madrid, E., and Antonio, N. (2021). Short-Term Electricity Load Forecasting with Machine Learning. Information, 12.10.3390/info12020050 ↗
13. Short-term load forecasting based on LSTM networks considering attention mechanism10.1016/j.ijepes.2021.107818 ↗
14. Short-term electric power load forecasting using random forest and gated recurrent unit10.1007/s00202-021-01376-5 ↗
15. Short-term power load forecasting based on VMD-LSTM-LightGBM with multi-feature integration
16. Short-term power load forecasting based on CNN-GRU-MLR with multi-frequency combination
17. Li, C., Chen, Z., Liu, J., Li, D., Gao, X., Di, F., Li, L., and Ji, X. (2019, January 26–28). Power Load Forecasting Based on the Combined Model of LSTM and XGBoost. Proceedings of the 2019 the International Conference on Pattern Recognition and Artificial Intelligence (PRAI’19). Association for Computing Machinery, Wenzhou, China.10.1145/3357777.3357792 ↗
18. Wang, Z., Shao, E., and Wang, C. (2022, January 24–26). Conv-AdaRNN: A Power Load Forecasting Method Based on CNN and AdaRNN. Proceedings of the 2022 5th International Conference on Hot Information-Centric Networking (HotICN), Guangzhou, China.
19. A novel regression method for harmonic analysis of time series10.1016/j.isprsjprs.2022.01.006 ↗
20. Kohavi, R. (1995). International Joint Conference on Artificial Intelligence, Morgan Kaufmann Publishers Inc.
21. Hu, L., Wang, J., Guo, Z., and Zheng, T. (2023). Load Forecasting Based on LVMD-DBFCM Load Curve Clustering and the CNN-IVIA-BLSTM Model. Appl. Sci., 13.10.3390/app13127332 ↗
22. Deep learning10.1038/nature14539 ↗
23. A New Global Pooling Method for Deep Neural Networks: Global Average of Top-K Max-Pooling10.18280/ts.400216 ↗
24. Siami-Namini, S., Tavakoli, N., and Namin, A.S. (2019, January 9–12). The performance of LSTM and BiLSTM in forecasting time series. Proceedings of the 2019 IEEE International Conference on Big Data (Big Data), Los Angeles, CA, USA.10.1109/BigData47090.2019.9005997 ↗
25. Random Forests10.1023/A:1010933404324 ↗
26. A comparison of random forest variable selection methods for classification prediction modeling10.1016/j.eswa.2019.05.028 ↗
27. Improved Random Forest for Classification10.1109/TIP.2018.2834830 ↗
28. An improved random forest classifier for multi-class classification
29. An evolutionary ensemble model based on GA for epidemic transmission prediction10.3233/JIFS-222683 ↗
30. A survey on ensemble learning10.1007/s11704-019-8208-z ↗
31. Cho, J., Yoon, Y., Son, Y., Kim, H., Ryu, H., and Jang, G. (2022). A Study on Load Forecasting of Distribution Line Based on Ensemble Learning for Mid- to Long-Term Distribution Planning. Energies, 15.10.3390/en15092987 ↗
32. Improved boosting algorithms using confidence-rated predictions10.1023/A:1007614523901 ↗
33. Bai, S., Kolter, J.Z., and Koltun, V. (2018). An empirical evaluation of generic convolutional and recurrent networks for sequence modeling. arXiv.
34. Medium-term power load forecasting based on XGBOOST-DNN