A Multivariate Time Series Analysis of Electrical Load Forecasting Based on a Hybrid Feature Selection Approach and Explainable Deep Learning
Source abstract
Abstract
In the smart grid paradigm, precise electrical load forecasting (ELF) offers significant advantages for enhancing grid reliability and informing energy planning decisions. Specifically, mid-term ELF is a key priority for power system planning and operation. Although statistical methods were primarily used because ELF is a time series problem, deep learning (DL)-based forecasting approaches are more commonly employed and successful in achieving precise predictions. However, these DL-based techniques, known as black box models, lack interpretability. When interpreting the DL model, employing explainable artificial intelligence (XAI) yields significant advantages by extracting meaningful information from the DL model outputs and the causal relationships among various factors. On the contrary, precise load forecasting necessitates employing feature engineering to identify pertinent input features and determine optimal time lags. This research study strives to accomplish a mid-term forecast of ELF study load utilizing aggregated electrical load consumption data, while considering the aforementioned critical aspects. A hybrid framework for feature selection and extraction is proposed for electric load forecasting. Technical term abbreviations are explained upon first use. The feature selection phase employs a combination of filter, Pearson correlation (PC), embedded random forest regressor (RFR) and decision tree regressor (DTR) methods to determine the correlation and significance of each feature. In the feature extraction phase, we utilized a wrapper-based technique called recursive feature elimination cross-validation (RFECV) to eliminate redundant features. Multi-step-ahead time series forecasting is conducted utilizing three distinct long-short term memory (LSTM) models: basic LSTM, bi-directional LSTM (Bi-LSTM) and attention-based LSTM models to accurately predict electrical load consumption thirty days in advance. Through numerous studies, a reduction in forecasting errors of nearly 50% has been attained. Additionally, the local interpretable model-agnostic explanations (LIME) methodology, which is an explainable artificial intelligence (XAI) technique, is utilized for explaining the mid-term ELF model. As far as the authors are aware, XAI has not yet been implemented in mid-term aggregated energy forecasting studies utilizing the ELF method. Quantitative and detailed evaluations have been conducted, with the experimental results indicating that this comprehensive approach is entirely successful in forecasting multivariate mid-term loads.
Source: crossref · Quality: baseline
Research context
OpenAlex topics: Energy Load and Power Forecasting · Stock Market Forecasting Methods · Image and Signal Denoising Methods
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
Affiliations
Information Systems Engineering Department, Bucak Technology Faculty, Mehmet Akif Ersoy University, Burdur 15300, Türkiye
References (46)
Show source-provided references
1. Pattern Similarity-Based Machine Learning Methods for Mid-Term Load Forecasting: A Comparative Study10.1016/j.asoc.2021.107223 ↗
2. A new hybrid model based on secondary decomposition, reinforcement learning and SRU network for wind turbine gearbox oil temperature forecasting10.1016/j.measurement.2021.109347 ↗
3. Yan, G., Yu, C., and Bai, Y. (2021). A New Hybrid Ensemble Deep Learning Model for Train Axle Temperature Short Term Forecasting. Machines, 9.10.3390/machines9120312 ↗
4. Yu, C., Wang, F., Shao, Z., Sun, T., Wu, L., and Xu, Y. (2023, January 21–25). DSformer: A Double Sampling Transformer for Multivariate Time Series Long-term Prediction. Proceedings of the 32nd ACM International Conference on Information and Knowledge Management, Birmingham, UK.10.1145/3583780.3614851 ↗
5. Interpretable Modeling for Short- and Medium-Term Electricity Demand Forecasting10.3389/fenrg.2021.724780 ↗
6. N-BEATS Neural Network for Mid-Term Electricity Load Forecasting10.1016/j.apenergy.2021.116918 ↗
7. A Hybrid Method of Exponential Smoothing and Recurrent Neural Networks for Time Series Forecasting10.1016/j.ijforecast.2019.03.017 ↗
8. Son, N., Yang, S., and Na, J. (2020). Deep Neural Network and Long Short-Term Memory for Electric Power Load Forecasting. Appl. Sci., 10.10.3390/app10186489 ↗
9. Shirzadi, N., Nizami, A., Khazen, M., and Nik-Bakht, M. (2021). Medium-Term Regional Electricity Load Forecasting through Machine Learning and Deep Learning. Designs, 5.10.3390/designs5020027 ↗
10. Bouktif, S., Fiaz, A., Ouni, A., and Serhani, M.A. (2018). Optimal Deep Learning LSTM Model for Electric Load Forecasting Using Feature Selection and Genetic Algorithm: Comparison with Machine Learning Approaches. Energies, 11.10.3390/en11071636 ↗
11. Bouktif, S., Fiaz, A., Ouni, A., and Serhani, M.A. (2019). Single and Multi-Sequence Deep Learning Models for Short and Medium Term Electric Load Forecasting. Energies, 12.10.3390/en12010149 ↗
12. Masood, Z., Gantassi, R., and Choi, Y. (2022). A Multi-Step Time-Series Clustering-Based Seq2Seq LSTM Learning for a Single Household Electricity Load Forecasting. Energies, 15.10.3390/en15072623 ↗
13. Cho, J., Yoon, Y., Son, Y., Kim, H., Ryu, H., and Jang, G. (2022). A Study on Load Forecasting of Distribution Line Based on Ensemble Learning for Mid-to Long-Term Distribution Planning. Energies, 15.10.3390/en15092987 ↗
14. Kumar, S., Hussain, L., Banarjee, S., Reza, M., Tech, B., and Students, Y. (2018, January 12–13). Energy Load Forecasting Using Deep Learning Approach-LSTM and GRU in Spark Cluster. Proceedings of the Fifth International Conference on Emerging Applications of Information Technology (EAIT), Kolkata, India.10.1109/EAIT.2018.8470406 ↗
15. Enhanced Deep Networks for Short-Term and Medium-Term Load Forecasting10.1109/ACCESS.2018.2888978 ↗
16. Khalid, A., Abbas, S., and Iqbal, S. (2022). Deep LSTM-BiGRU Model for Electricity Load and Price Forecasting in Smart Grids Deep LSTM-BiGRU Model for Electrcity Load and Price Forecasting in Smart Grids. EasyChair Prepr., 8663. Available online: https://easychair.org/publications/preprint/NcTd.
17. Jin, B., Zeng, G., Lu, Z., Peng, H., Luo, S., Yang, X., Zhu, H., and Liu, M. (2022). Hybrid LSTM–BPNN-to-BPNN Model Considering Multi-Source Information for Forecasting Medium- and Long-Term Electricity Peak Load. Energies, 15.10.3390/en15207584 ↗
18. Cheng, Z., Wang, L., and Yang, Y. (2023). A Hybrid Feature Pyramid CNN-LSTM Model with Seasonal Inflection Month Correction for Medium- and Long-Term Power Load Forecasting. Energies, 16.10.3390/en16073081 ↗
19. Mid-Term Electricity Load Prediction Using CNN and Bi-LSTM10.1007/s11227-021-03686-8 ↗
20. Deep Learning for Load Forecasting: Sequence to Sequence Recurrent Neural Networks with Attention10.1109/ACCESS.2020.2975738 ↗
21. Construction and Application of Short-Term and Mid-Term Power System Load Forecasting Model Based on Hybrid Deep Learning10.1109/ACCESS.2023.3266783 ↗
22. Intelligence Based Accurate Medium and Long Term Load Forecasting System10.1080/08839514.2022.2088452 ↗
23. A CNN and LSTM-Based Multi-Task Learning Architecture for Short and Medium-Term Electricity Load Forecasting10.1016/j.epsr.2023.109507 ↗
24. A Multivariate Ensemble Learning Method for Medium-Term Energy Forecasting10.1007/s00521-023-08777-6 ↗
25. Comparison of Robust Machine-Learning and Deep-Learning Models for Midterm Electrical Load Forecasting
26. Cordeiro-Costas, M., Villanueva, D., Eguía-Oller, P., Martínez-Comesaña, M., and Ramos, S. (2023). Load Forecasting with Machine Learning and Deep Learning Methods. Appl. Sci., 13.10.3390/app13137933 ↗
27. Ayub, N., Irfan, M., Awais, M., Ali, U., Ali, T., Hamdi, M., Alghamdi, A., and Muhammad, F. (2020). Big Data Analytics for Short and Medium-Term Electricity Load Forecasting Using an AI Techniques Ensembler. Energies, 13.10.3390/en13195193 ↗
28. Novel Deep Supervised ML Models with Feature Selection Approach for Large-Scale Utilities and Buildings Short and Medium-Term Load Requirement Forecasts10.1016/j.energy.2020.118477 ↗
29. Mid-Term Interval Load Forecasting Using Multi-Output Support Vector Regression with a Memetic Algorithm for Feature Selection10.1016/j.energy.2015.03.054 ↗
30. Explainable Artificial Intelligence (XAI) Techniques for Energy and Power Systems: Review, Challenges and Opportunities10.1016/j.egyai.2022.100169 ↗
31. Introducing Explainability in Sequence-to-Sequence Learning for Short-Term Load Forecasting10.1016/j.epsr.2022.108366 ↗
32. Mouakher, A., Inoubli, W., Ounoughi, C., and Ko, A. (2022). EXPECT: EXplainable Prediction Model for Energy ConsumpTion. Mathematics, 10.10.3390/math10020248 ↗
33. Explainable Prediction of Electric Energy Demand Using a Deep Autoencoder with Interpretable Latent Space10.1016/j.eswa.2021.115842 ↗
34. Toward Explainable Electrical Load Forecasting of Buildings: A Comparative Study of Tree-Based Ensemble Methods with Shapley Values
35. Chen, Y., and Fu, Z. (2023). Multi-Step Ahead Forecasting of the Energy Consumed by the Residential and Commercial Sectors in the United States Based on a Hybrid CNN-BiLSTM Model. Sustainability, 15.10.3390/su15031895 ↗
36. Freeborough, W., and van Zyl, T. (2022). Investigating Explainability Methods in Recurrent Neural Network Architectures for Financial Time Series Data. Appl. Sci., 12.10.3390/app12031427 ↗
37. Long Short-term Memory10.1162/neco.1997.9.8.1735 ↗
38. Reddybattula, K.D., Nelapudi, L.S., Moses, M., Devanaboyina, V.R., Ali, M.A., Jamjareegulgarn, P., and Panda, S.K. (2022). Ionospheric TEC Forecasting over an Indian Low Latitude Location Using Long Short-Term Memory (LSTM) Deep Learning Network. Universe, 8.10.3390/universe8110562 ↗
39. Vankadara, R.K., Mosses, M., Siddiqui, M.I.H., Ansari, K., and Panda, S.K. (2023). Ionospheric Total Electron Content Forecasting at a Low-Latitude Indian Location Using a Bi-Long Short-Term Memory Deep Learning Approach. IEEE Trans. Plasma Sci., 1–11.10.1109/TPS.2023.3325457 ↗
40. Shahin, A.I., and Almotairi, S. (2021). A Deep Learning BiLSTM Encoding-Decoding Model for COVID-19 Pandemic Spread Forecasting. Fractal Fract., 5.10.3390/fractalfract5040175 ↗
41. Bi-Directional Long Short-Term Memory Method Based on Attention Mechanism and Rolling Update for Short-Term Load Forecasting10.1016/j.ijepes.2019.02.022 ↗
42. AT-LSTM: An Attention-Based LSTM Model for Financial Time Series Prediction10.1088/1757-899X/569/5/052037 ↗
43. A Comprehensive Survey on the Process, Methods, Evaluation, and Challenges of Feature Selection10.1109/ACCESS.2022.3205618 ↗
44. Designing a Feature Selection Method Based on Explainable Artificial Intelligence10.1007/s12525-022-00608-1 ↗
45. Pudjihartono, N., Fadason, T., Kempa-Liehr, A.W., and O’Sullivan, J.M. (2022). A Review of Feature Selection Methods for Machine Learning-Based Disease Risk Prediction. Front. Bioinform., 2.10.3389/fbinf.2022.927312 ↗
46. Deterministic Local Interpretable Model-Agnostic Explanations for Stable Explainability