Stackade Ensemble Learning for Resilient Forecasting Against Missing Values, Adversarial Attacks, and Concept Drift
Source abstract
Abstract
Machine learning is often implemented in smart grids to help with electricity load forecasts, which are challenging to process or compute using conventional approaches. However, most of the proposed techniques were created with the assumption that the data was clean with a consistent distribution. However, this is not always the case because there can be missing data due to distributed denial-of-service attacks, changes in data patterns that make predictions less accurate, and small perturbations from adversarial attacks that trick the machine learning into making wrong forecasts. While several approaches have been suggested, they are limited to a trivial solution, and the sequential operation needed to correct the input will accumulate errors from inadequate correction. This research proposes a novel approach called Stackade Ensemble Learning. It works by cascading the dependent input corrections with enhanced forecasting models to reduce the error accumulation. Then, the outputs were stacked to combine the results and improve the forecast. The results show 348.4002% of mean absolute error score improvement against the federated solution and 30.3783% against the trivial solution on compounded problem, proving its effectiveness.
Source: crossref · Quality: baseline
Research context
OpenAlex topics: Data Stream Mining Techniques · Traffic Prediction and Management Techniques · Anomaly Detection Techniques and Applications
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
Affiliations
Department of Intelligent System Engineering, National Institute of Technology, Ube College, Yamaguchi 755-8555, Japan
Graduate School of Sciences and Technology for Innovation, Yamaguchi University, Yamaguchi 753-8511, Japan
Funding
Interface Corporation, Japan
References (60)
Show source-provided references
1. Time-Varying Price Elasticity of Demand Estimation for Demand-Side Smart Dynamic Pricing10.1016/j.apenergy.2022.119520 ↗
2. A Deep LSTM Network for the Spanish Electricity Consumption Forecasting10.1007/s00521-021-06773-2 ↗
3. A Hybrid Framework for Forecasting Power Generation of Multiple Renewable Energy Sources10.1016/j.rser.2022.113046 ↗
4. Rodrigues, F., Cardeira, C., Calado, J.M.F., and Melicio, R. (2023). Short-Term Load Forecasting of Electricity Demand for the Residential Sector Based on Modelling Techniques: A Systematic Review. Energies, 16.10.20944/preprints202304.0328.v1 ↗
5. The Effects of Data Quality on Machine Learning Performance on Tabular Data10.1016/j.is.2025.102549 ↗
6. A Low-Rate Ddos Detection and Mitigation for SDN Using Renyi Entropy with Packet Drop
7. Bin Kamilin, M.H., and Yamaguchi, S. (2024). Resilient Electricity Load Forecasting Network with Collective Intelligence Predictor for Smart Cities. Electronics, 13.10.3390/electronics13040718 ↗
8. Couldflare (2025, May 16). Record-Breaking 5.6 Tbps DDoS Attack and Global DDoS Trends for 2024 Q4. Available online: https://blog.cloudflare.com/ddos-threat-report-for-2024-q4/.
9. IBM X-Force (2025, May 20). X-Force Threat Intelligence Index 2025. Available online: https://www.ibm.com/reports/threat-intelligence.
10. Liang, H., He, E., Zhao, Y., Jia, Z., and Li, H. (2022). Adversarial Attack and Defense: A Survey. Electronics, 11.10.3390/electronics11081283 ↗
11. Bin Kamilin, M.H., Yamaguchi, S., and Bin Ahmadon, M.A. (2024, January 7–8). Leveraging Trusted Input Framework to Correct and Forecast the Electricity Load in Smart City Zones Against Adversarial Attacks. Proceedings of the 2024 International Conference on Future Technologies for Smart Society (ICFTSS), Kuala Lumpur, Malaysia.10.1109/ICFTSS61109.2024.10690268 ↗
12. From Concept Drift to Model Degradation: An Overview on Performance-Aware Drift Detectors10.1016/j.knosys.2022.108632 ↗
13. Radian Scaling and Its Application to Enhance Electricity Load Forecasting in Smart Cities Against Concept Drift10.3390/smartcities7060133 ↗
14. Constructing Bibliometric Networks: A Comparison Between Full and Fractional Counting
15. The Impact of Wind Power and Electricity Demand on the Relevance of Different Short-Term Electricity Markets: The Nordic Case10.1016/j.apenergy.2020.116063 ↗
16. Quantifying the Impact of Building Load Forecasts on Optimizing Energy Storage Systems10.1016/j.enbuild.2024.113913 ↗
17. Miller, D., and Kim, J.-M. (2021). Univariate and Multivariate Machine Learning Forecasting Models on the Price Returns of Cryptocurrencies. J. Risk Financ. Manag., 14.10.3390/jrfm14100486 ↗
18. Cascade Ensemble Learning for Multi-Level Reliability Evaluation10.1016/j.ast.2024.109101 ↗
19. Abdellatif, A., Mubarak, H., Ahmad, S., Ahmed, T., Shafiullah, G.M., Hammoudeh, A., Abdellatef, H., Rahman, M.M., and Gheni, H.M. (2022). Forecasting Photovoltaic Power Generation with a Stacking Ensemble Model. Sustainability, 14.10.3390/su141711083 ↗
20. Djuitcheu, H., Shah, T., Tammen, M., and Schotten, H.D. (2023, January 13–15). DDoS Impact Assessment on 5G System Performance. Proceedings of the 2023 IEEE Future Networks World Forum (FNWF), Baltimore, MD, USA.10.1109/FNWF58287.2023.10520536 ↗
21. DoS and DDoS attacks in Software Defined Networks: A survey of existing solutions and research challenges10.1016/j.future.2021.03.011 ↗
22. Couldflare (2025, June 04). DDoS Threat Report for 2025 Q1. Available online: https://radar.cloudflare.com/reports/ddos-2025-q1.
23. Chaddad, A., Jiang, Y., Daqqaq, T.S., and Kateb, R. (2025). EAMAPG: Explainable Adversarial Model Analysis via Projected Gradient Descent. Comput. Biol. Med., 188.10.1016/j.compbiomed.2025.109788 ↗
24. Adversarial Attack Detection Approach for Intrusion Detection Systems10.1109/ACCESS.2024.3520406 ↗
25. Efficient Short-Term Electricity Load Forecasting for Effective Energy Management
26. Model-based Explanations of Concept Drift10.1016/j.neucom.2023.126640 ↗
27. New York State Climate Impacts Assessment Chapter 06: Energy10.1111/nyas.15191 ↗
28. Array programming with NumPy10.1038/s41586-020-2649-2 ↗
29. NumPy (2025, June 13). numpy.histogram. Available online: https://numpy.org/doc/stable/reference/generated/numpy.histogram.html.
30. Hou, Z., and Liu, J. (2024). Enhancing Smart Grid Sustainability: Using Advanced Hybrid Machine Learning Techniques While Considering Multiple Influencing Factors for Imputing Missing Electric Load Data. Sustainability, 16.10.3390/su16188092 ↗
31. CC-GAIN: Clustering and Classification-Based Generative Adversarial Imputation Network for Missing Electricity Consumption Data Imputation10.1016/j.eswa.2024.124507 ↗
32. Li, D., Yang, P., and Zou, Y. (2024). Optimizing Insulator Defect Detection with Improved DETR Models. Mathematics, 12.10.3390/math12101507 ↗
33. Robust Load Forecasting Towards Adversarial Attacks via Bayesian Learning10.1109/TPWRS.2022.3175252 ↗
34. Electric Load Forecasting Under False Data Injection Attacks via Denoising Deep Learning and Generative Adversarial Networks10.1049/gtd2.13273 ↗
35. Mitigating Concept Drift Challenges in Evolving Smart Grids: An Adaptive Ensemble LSTM for Enhanced Load Forecasting10.1016/j.egyr.2024.12.078 ↗
36. Load Forecasting Under Concept Drift: Online Ensemble Learning with Recurrent Neural Network and ARIMA10.1109/ACCESS.2021.3095420 ↗
37. Double Robust Federated Digital Twin Modeling in Smart Grid10.1109/JIOT.2024.3450433 ↗
38. Electricity Load Forecasting using Hybrid Datasets with Linear Interpolation and Synthetic Data10.48084/etasr.8577 ↗
39. Milan Kummaya, A., Joseph, A., Rajamani, K., and Ghinea, G. (2025). Fed-Hetero: A Self-Evaluating Federated Learning Framework for Data Heterogeneity. Appl. Syst. Innov., 8.10.3390/asi8020028 ↗
40. Missing data imputation: A comprehensive review10.4236/jcc.2024.1211004 ↗
41. Stevens, A., Smedt, J.D., Peeperkorn, J., and Weerdt, J.D. (2022, January 23–28). Assessing the Robustness in Predictive Process Monitoring through Adversarial Attacks. Proceedings of the 2022 4th International Conference on Process Mining (ICPM), Bolzano, Italy.10.1109/ICPM57379.2022.9980753 ↗
42. Adversarial Concept Drift Detection under Poisoning Attacks for Robust Data Stream Mining10.1007/s10994-022-06177-w ↗
43. Systematic Review of Using Machine Learning in Imputing Missing Values10.1109/ACCESS.2022.3160841 ↗
44. Gupta, V., and Hewett, R. (2019, January 20–22). Adaptive Normalization in Streaming Data. Proceedings of the 3rd International Conference on Big Data Research (ICBDR 2019), Cergy-Pontoise, France.10.1145/3372454.3372466 ↗
45. A Lightweight Concept Drift Detection and Adaptation Framework for IoT Data Streams10.1109/IOTM.0001.2100012 ↗
46. Mitigating Accuracy-Robustness Trade-Off via Balanced Multi-Teacher Adversarial Distillation10.1109/TPAMI.2024.3416308 ↗
47. Zhang, Y., Liu, J., and Shen, W. (2022). A Review of Ensemble Learning Algorithms Used in Remote Sensing Applications. Appl. Sci., 12.10.3390/app12178654 ↗
48. New York Independent System Operator (2025, May 02). Load Data. Available online: https://www.nyiso.com/load-data/.
49. McKinney, W. (July, January 28). Data Structures for Statistical Computing in Python. Proceedings of the 9th Annual Scientific Computing with Python Conference (SciPy 2010), Austin, TX, USA.10.25080/Majora-92bf1922-00a ↗
50. The Pandas Development Team (2025, June 03). pandas.Series.interpolate. Available online: https://pandas.pydata.org/pandas-docs/stable/reference/api/pandas.Series.interpolate.html.
51. Seabold, S., and Perktold, J. (July, January 28). Statsmodels: Econometric and Statistical Modeling with Python. Proceedings of the 9th Annual Scientific Computing with Python Conference (SciPy 2010), Austin, TX, USA.10.25080/Majora-92bf1922-011 ↗
52. Statsmodels (2025, June 03). statsmodels.tsa.seasonal.seasonal_decompose. Available online: https://www.statsmodels.org/dev/generated/statsmodels.tsa.seasonal.seasonal_decompose.html.
53. Learning Under Concept Drift for Regression—A Systematic Literature Review10.1109/ACCESS.2022.3169785 ↗
54. Myths About Linear and Monotonic Associations: Pearson’s r, Spearman’s ρ, and Kendall’s τ10.1080/00031305.2021.2004922 ↗
55. Dehghani, A., Sarbishei, O., Glatard, T., and Shihab, E. (2019). A Quantitative Comparison of Overlapping and Non-Overlapping Sliding Windows for Human Activity Recognition Using Inertial Sensors. Sensors, 19.10.3390/s19225026 ↗
56. A Privacy-Preserving Heterogeneous Federated Learning Framework with Class Imbalance Learning for Electricity Theft Detection10.1016/j.apenergy.2024.124789 ↗
57. Zhang, Y., Song, Y., Liang, J., Bai, K., and Yang, Q. (2020, January 6–10). Two sides of the same coin: White-Box and Black-Box Attacks for Transfer Learning. Proceedings of the 26th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining, Virtual Event.10.1145/3394486.3403349 ↗
58. Survey of Load-Altering Attacks Against Power Grids: Attack Impact, Detection, and Mitigation10.1109/OAJPE.2025.3562052 ↗
59. Gao, S., Zou, Y., and Feng, L. (2025). A Lightweight Double-Deep Q-Network for Energy Efficiency Optimization of Industrial IoT Devices in Thermal Power Plants. Electronics, 14.10.3390/electronics14132569 ↗
60. Sarmas, E., Dimitropoulos, N., Marinakis, V., Mylona, Z., and Doukas, H. (2022). Transfer learning strategies for solar power forecasting under data scarcity. Sci. Rep., 12.10.1038/s41598-022-18516-x ↗