journal article·2023-07-06Open access

Load Forecasting with Machine Learning and Deep Learning Methods

Moisés Cordeiro-Costas, Daniel Villanueva, Pablo Eguía-Oller, Miguel Martínez-Comesaña, Sérgio Ramos

Applied Sciences· Volume 13· Issue 13

Abstract

Characterizing the electric energy curve can improve the energy efficiency of existing buildings without any structural change and is the basis for controlling and optimizing building performance. Artificial Intelligence (AI) techniques show much potential due to their accuracy and malleability in the field of pattern recognition, and using these models it is possible to adjust the building services in real time. Thus, the objective of this paper is to determine the AI technique that best forecasts electrical loads. The suggested techniques are random forest (RF), support vector regression (SVR), extreme gradient boosting (XGBoost), multilayer perceptron (MLP), long short-term memory (LSTM), and temporal convolutional network (Conv-1D). The conducted research applies a methodology that considers the bias and variance of the models, enhancing the robustness of the most suitable AI techniques for modeling and forecasting the electricity consumption in buildings. These techniques are evaluated in a single-family dwelling located in the United States. The performance comparison is obtained by analyzing their bias and variance by using a 10-fold cross-validation technique. By means of the evaluation of the models in different sets, i.e., validation and test sets, their capacity to reproduce the results and the ability to properly forecast on future occasions is also evaluated. The results show that the model with less dispersion, both in the validation set and test set, is LSTM. It presents errors of −0.02% of nMBE and 2.76% of nRMSE in the validation set and −0.54% of nMBE and 4.74% of nRMSE in the test set.
Source: crossref · Quality: baseline

Research context

OpenAlex topics: Energy Load and Power Forecasting · Building Energy and Comfort Optimization · Infrastructure Maintenance and Monitoring

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

CINTECX, Universidade de Vigo, Rúa Maxwell s/n, 36310 Vigo, Spain

Universidade de Vigo, Industrial Engineering School, Rúa Maxwell s/n, 36310 Vigo, Spain

GECAD–Knowledge Engineering and Decision Support Research Center, Polytechnic of Porto, School of Engineering, Rúa Dr. António Bernardino de Almeida, 431, 4200-072 Porto, Portugal

Funding

Ministry of Science, Innovation and Universities of the Spanish Government · Universidade de Vigo · European Group for territorial cooperation Galicia-North of Portugal (GNP, AECT) through the IACOBUS program of research stays

References (83)

Show source-provided references
1. Deb, S., Tammi, K., Kalita, K., and Mahanta, P. (2018). Impact of electric vehicle charging station on distribution network. Energies, 11.10.3390/en11010178 ↗
2. Effect of air flow rate and temperature on the atomization characteristics of biodiesel in internal and external flow fields of the pressure swirl nozzle10.1016/j.energy.2022.124112 ↗
3. Kakandwar, S., Bhushan, B., and Kumar, A. (2023). Blockchain Technology Solutions for the Security of IoT-Based Healthcare Systems, Academic Press.
4. Sheena, N., Joseph, S., Sivan, S., and Bhushan, B. (2022). Light-weight privacy enabled topology establishment and communication protocol for swarm IoT networks. Clust. Comput., in press.10.1007/s10586-022-03815-9 ↗
5. International Energy Agency (2020). Appliances and Equipment.
6. Building automation system for grid-connected home to optimize energy consumption and electricity bill10.1016/j.jobe.2018.10.032 ↗
7. A review of Deep Reinforcement Learning for smart building energy management10.1109/JIOT.2021.3078462 ↗
8. Optimal operation of an energy management system for a grid-connected smart building considering photovoltaics’ uncertainty and stochastic electric vehicles’ driving schedule10.1016/j.apenergy.2017.07.035 ↗
9. European Commission (2018). A European Long-Term Strategic Vision for a Prosperous, Modern, Competitive and Climate Neutral Economy.
10. International Energy Agency (2018). Energy Efficiency 2018. Analysis and Outlooks to 2040.
11. Villanueva, D., Cordeiro-Costas, M., Feijoó-Lorenzo, A.E., Fernández-Otero, A., and Míguez-García, E. (2021). Towards DC Energy Efficient Homes. Appl. Energy, 11.10.3390/app11136005 ↗
12. Reinforcement learning-based real-time power management for hybrid energy storage system in the plug-in hybrid electric vehicle10.1016/j.apenergy.2017.11.072 ↗
13. A novel methodology for optimal sizing photovoltaic-battery systems in smart homes considering grid outages and demand response10.1016/j.renene.2021.02.006 ↗
14. Towards nearly zero-energy residential neighbourhoods in the European Union: A case study10.1016/j.rser.2020.110198 ↗
15. Nearly zero energy building renovation: From energy efficiency to environmental efficiency, a pilot case study10.1016/j.enbuild.2018.02.002 ↗
16. Cordeiro-Costas, M., Villanueva, D., and Eguía-Oller, P. (2021). Optimization of the Electrical Demand of an Existing Building with Storage Management through Machine Learning Techniques. Appl. Sci., 11.10.3390/app11177991 ↗
17. A survey on deep learning for big data10.1016/j.inffus.2017.10.006 ↗
18. An optimal home energy management system for modulating heat pumps and photovoltaic systems10.1016/j.apenergy.2020.115661 ↗
19. Oh, S. (2020). Comparison of a Response Surface Method and Artificial Neural Network in Predicting the Aerodynamic Performance of a Wind Turbine Airfoil and Its Optimization. Appl. Sci., 10.10.3390/app10186277 ↗
20. A dynamic scenario-driven technique for stock price prediction and trading10.1002/for.2848 ↗
21. Runge, J., and Zmeureanu, R. (2019). Forecasting Energy Use in Buildings Using Artificial Neural Networks: A Review. Energies, 12.10.3390/en12173254 ↗
22. Habbak, H., Mahmoud, M., Metwally, K., Fouda, M.M., and Ibrahem, M.I. (2023). Load Forecasting Techniques and Their Applications in Smart Grids. Energies, 16.10.3390/en16031480 ↗
23. Deep Learning and transfer learning techniques applied to short-term load forecasting of data-poor buildings in local energy communities10.1016/j.enbuild.2023.113164 ↗
24. A multi-agent model of urban microgrids: Assessing the effects of energy-market shocks using real-world data10.1016/j.apenergy.2023.121180 ↗
25. Sethi, R., and Kleissl, J. (2020, January 23–25). Comparison of Short-Term Load Forecasting Techniques. Proceedings of the 2020 IEEE Conference on Technologies for Sustainability (SusTech), Santa Ana, CA, USA.10.1109/SusTech47890.2020.9150490 ↗
26. Forecasting energy consumption time series using machine learning techniques based on usage patterns of residential householders10.1016/j.energy.2018.09.144 ↗
27. A Short-Term Load Forecasting Method Using Integrated CNN and LSTM Network10.1109/ACCESS.2021.3060654 ↗
28. Predicting electricity consumption in a building using an optimized back-propagation and Levenberg-Marquardt back-propagation neural network: Case study of a shopping mall in China10.1016/j.scs.2018.05.050 ↗
29. Wang, C., Baratchi, M., Back, T., Hoos, H.H., Limmer, S., and Olhofer, M. (2022). Towards Time-Series Feature Engineering in Automated Machine Learning for Multi-Step-Ahead Forecasting. Eng. Proc., 18.10.3390/engproc2022018017 ↗
30. Deep learning-based feature engineering methods for improved building energy prediction10.1016/j.apenergy.2019.02.052 ↗
31. Data driven parallel prediction of building energy consumption using generative adversarial nets10.1016/j.enbuild.2019.01.034 ↗
32. A compositional kernel based gaussian process approach to day-ahead residential load forecasting10.1016/j.enbuild.2021.111459 ↗
33. Random Forest based hourly building energy prediction10.1016/j.enbuild.2018.04.008 ↗
34. Gradient boosting machine for modelling the energy consumption of commercial buildings10.1016/j.enbuild.2017.11.039 ↗
35. A Comparative Study of Predictive Approaches for Load Forecasting in Smart Buildings10.1016/j.procs.2019.09.458 ↗
36. Smart grid load forecasting using online support vector regression10.1016/j.compeleceng.2017.07.006 ↗
37. Electricity Load Forecasting for Each Day of Week Using Deep CNN10.1007/978-3-030-15035-8_107 ↗
38. Prediction of office building electricity demand using artificial neural network by splitting the time horizon for different occupancy rates10.1016/j.egyai.2021.100093 ↗
39. Intelligent techniques for forecasting electricity consumption of buildings10.1016/j.energy.2018.05.155 ↗
40. Vector field-based support vector regression for building energy consumption prediction10.1016/j.apenergy.2019.03.078 ↗
41. Martínez-Comesaña, M., Febrero-Garrido, M., Granada-Álvarez, E., Martínez-Torres, J., and Martínez-Mariño, S. (2020). Heat Loss Coefficient Estimation Applied to Existing Buildings through Machine Learning Models. Appl. Sci., 10.10.3390/app10248968 ↗
42. Imbalanced data preprocesing techniques for machine learning: A systematic mapping study10.1007/s10115-022-01772-8 ↗
43. Unsupervised outlier detection in multidimensional data10.1186/s40537-021-00469-z ↗
44. Bazlur Rashid, A.N.M., Ahmed, M., and Pathan, A.K. (2021). Infrequent pattern detection for reliable network traffic analysis using robust evolutionary computation. Sensors, 21.10.3390/s21093005 ↗
45. Cordeiro-Costas, M., Villanueva, D., Eguía-Oller, P., and Granada-Álvarez, E. (2022). Machine Learning and Deep Learning Models Applied to Photovoltaic Production Forecasting. Appl. Sci., 12.10.3390/app12178769 ↗
46. Evaluating explorative prediction power of machine learning algorithms for materials discovery using k-fold forward cross-validation10.1016/j.commatsci.2019.109203 ↗
47. Phases of learning dynamics in artificial neural networks in the absence or presence of mislabeled data10.1088/2632-2153/abf5b9 ↗
48. Decoding enhancer complexity with machine learning and high-throughput discovery10.1186/s13059-023-02955-4 ↗
49. Olu-Ajayi, R., Alaka, H., Owolabi, H., Akanbi, L., and Ganiyu, S. (2023). Data-Driven Tools for Building Energy Consumption Prediction: A Review. Energies, 16.10.3390/en16062574 ↗
50. Short-term Lake Erie algal bloom prediction by classification and regression models10.1016/j.watres.2023.119710 ↗
51. Stock market forecasting using a multi-task approach integrating long short-term memory and the random forest framework10.1016/j.asoc.2021.108106 ↗
52. Support vector machine in structural reliability analysis: A review10.1016/j.ress.2023.109126 ↗
53. Alrobaie, A., and Krati, M. (2022). A Review of Data-Driven Approaches for Measurement and Verification Analysis of Building Energy Retrofits. Energies, 15.10.3390/en15217824 ↗
54. Artificial intelligence systems for tool condition monitoring in machining: Analysis and critical review10.1007/s10845-022-01923-2 ↗
55. Huang, K., Guo, Y.F., Tseng, M.L., Wu, K.J., and Li, Z.G. (2018). A Novel Health Factor to Predict the Battery’s State-of-Health Using a Support Vector Machine Approach. Appl. Sci., 8.10.3390/app8101803 ↗
56. Machine learning-based new approach to films review10.1007/s13278-023-01042-7 ↗
57. IoT data analytics in dynamic environments: From an automated machine learning perspective10.1016/j.engappai.2022.105366 ↗
58. Priscilla, C.V., and Prabha, D.P. (2020, January 20–22). Influence of Optimizing XGBoost to Handle Class Imbalance in Credit Card Fraud Detection. Proceedings of the 2020 Third International Conference on Smart Systems and Inventive Technology (ICSSIT), Tirunelveli, India.10.1109/ICSSIT48917.2020.9214206 ↗
59. A novel systematic and evolved approach based on XGBoost-firefly algorithm to predict Young’s modulus and unconfined compressive strength of rock10.1007/s00366-020-01241-2 ↗
60. Analysing energy poverty in warm climate zones in Spain through artificial intelligence10.1016/j.jobe.2023.106116 ↗
61. Spatio-temporal hierarchical MLP network for traffic forecasting10.1016/j.ins.2023.03.063 ↗
62. Multiobjective bilevel programming model for multilayer perceptron neural networks10.1016/j.ins.2023.119031 ↗
63. Deep residual neural network for predicting aerodynamic coefficient changes with ablation10.1016/j.ast.2023.108207 ↗
64. Experimental methods in chemical engineering: Artificial neural networks-ANNs10.1002/cjce.23507 ↗
65. Marfo, K.F., and Przybyla-Kasperek, M. (2023). Study on the Use of Artificially Generated Objects in the Process of Training MLP Neural Networks Based on Dispersed Data. Entropy, 25.10.3390/e25050703 ↗
66. Dai, C., Wei, Y., Xu, Z., Chen, M., Liu, Y., and Fan, J. (2023). ConMLP: MLP-Based Self-Supervised Contrastive Learning for Skeleton Data Analysis and Action Recognition. Sensors, 23.10.3390/s23052452 ↗
67. Deep learning and its applications to machine health monitoring10.1016/j.ymssp.2018.05.050 ↗
68. Temporal feature aggregation with attention for insider threat detection from activity logs10.1016/j.eswa.2023.119925 ↗
69. An imputation and decomposition algorithms based integrated approach with bidirectional LSTM neural network for wind speed prediction10.1016/j.energy.2023.127799 ↗
70. Toward efficient energy systems based on natural gas consumption prediction with LSTM Recurrent Neural Networks10.1016/j.energy.2019.04.075 ↗
71. Sequential Fault Diagnosis Based on LSTM Neural Network10.1109/ACCESS.2018.2794765 ↗
72. Zaman, S.K.U., Jehangiri, A.I., Maqsood, T., Umar, A.I., Khan, M.A., Jhanjhi, N.Z., Shorfuzzaman, M., and Masud, M. (2022). COME-UP: Computation Offloading in Mobile Edge Computing with LSTM Based User Direction Prediction. Appl. Sci., 12.10.3390/app12073312 ↗
73. Spatio-temporal graph mixformer for traffic forecasting10.1016/j.eswa.2023.120281 ↗
74. A model combining convolutional neural network and lightgbm algorithm for ultra-short term wind power forecasting10.1109/ACCESS.2019.2901920 ↗
75. Zhang, Q., Jin, Q., Chang, J., Xiang, S., and Pan, C. (2018, January 20–24). Kernel-Weighted Graph Convolutional Network: A Deep Learning Approach for Traffic Forecasting. Proceedings of the 24th International Conference on Pattern Recognition (ICPR 2018), Beijing, China.10.1109/ICPR.2018.8545106 ↗
76. Deep Learning with Radiogenomics towards Personalized Management of Gliomas10.1109/RBME.2021.3075500 ↗
77. Using Temporal Convolutional Networks to estimate ball possession in soccer games10.1016/j.eswa.2023.119780 ↗
78. A focus module-based lightweight end-to-end CNN framework for voiceprint recognition10.1007/s11760-023-02500-7 ↗
79. Temporal convolutional networks for transient simulation of high-speed channels10.1016/j.aej.2023.05.059 ↗
80. Taqi, A.M., Awad, A., Al-Azzo, F., and Milanova, M. (2018, January 10–12). The Impact of Multi-Optimizers and Data Augmentation on TensorFlow Convolutional Neural Network Performance. Proceedings of the 1st IEEE Conference on Multimedia Information Processing and Retrieval (MIPR 2018), Miami, FL, USA.10.1109/MIPR.2018.00032 ↗
81. A Full Convolutional Network Based on DenseNet for remote sensing scene classification10.3934/mbe.2019167 ↗
82. William, H., Fanney, A.H., Dougherty, B., Payne, W.V., Ullah, T., Ng, L., and Omar, F. (2023, July 03). Net Zero Energy Residential Test Facility Instrumented Data; Year 2, Available online: https://pages.nist.gov/netzero/data.html.
83. William, H., Chen, T.H., Dougherty, B., Fanney, A.H., Ullah, T., Payne, W.V., Ng, L., and Omar, F. (2023, July 03). Net Zero Energy Residential Test Facility Instrumented Data; Year 1, Available online: https://pages.nist.gov/netzero/.