Assessment of the Reliability of AI Models in Predicting Urban Energy Consumption Under Conditions of Small or Incomplete Data
Source abstract
Abstract
The use of artificial intelligence (AI) and machine learning (ML) models to forecast urban energy consumption is becoming more widespread, but these models often rely on large, clean and well-distributed datasets. In reality, particularly at a local level, the available data are often limited, inconsistent or incomplete. This study systematically examines the robustness and reliability of AI predictive models in urban small data conditions using a real energy dataset from a neighborhood monitored over 24 months. The analysis compares several ML models trained on progressively shorter historical windows (6, 12, 18 and 24 months) and assesses performance degradation through controlled data quality stress tests, including missing values and noise. Results show that ensemble-based models achieve high accuracy when at least 18–24 months of data are available (normalized R2 up to 0.87), while performance declines markedly below 12 months. Gradient boosting demonstrates the highest robustness under severe data constraints, maintaining normalized R2 values above 0.70 with 12 months of data. Regularized linear models perform competitively in longer, well-structured time series but degrade under extreme data scarcity. An ultra-conservative data augmentation strategy yields limited but consistent improvements (≈1–2%) in short-horizon scenarios.
Source: crossref · Quality: baseline
Research context
OpenAlex topics: Energy Load and Power Forecasting · Air Quality Monitoring and Forecasting · Building Energy and Comfort Optimization
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
Affiliations
Department of Electrical and Energy Engineering (DIEE), Sapienza University of Rome, 00184 Roma, Italy
References (19)
Show source-provided references
1. Rojek, I., Mikołajewski, D., Andryszczyk, M., Bednarek, T., and Tyburek, K. (2025). Leveraging Machine Learning in Next-Generation Climate Change Adaptation Efforts by Increasing Renewable Energy Integration and Efficiency. Energies, 18.10.3390/en18133315 ↗
2. Azzi, A., Tabaa, M., Chegari, B., and Hachimi, H. (2024). Balancing Sustainability and Comfort: A Holistic Study of Building Control Strategies That Meet the Global Standards for Efficiency and Thermal Comfort. Sustainability, 16.10.3390/su16052154 ↗
3. An Energy Management System for Industrial Manufacturing: A Hybrid Approach with Demand Response10.1016/j.renene.2025.123814 ↗
4. Teslyuk, V., Kazarian, A., Kryvinska, N., and Tsmots, I. (2021). Optimal Artificial Neural Network Type Selection Method for Usage in Smart House Systems. Sensors, 21.10.3390/s21010047 ↗
5. Adaptive Co-Optimization of Artificial Neural Networks Using Evolutionary Algorithm for Global Radiation Forecasting10.1016/j.renene.2021.02.074 ↗
6. Piras, G., Muzi, F., and Ziran, Z. (2024). Open Tool for Automated Development of Renewable Energy Communities: Artificial Intelligence and Machine Learning Techniques for Methodological Approach. Energies, 17.10.3390/en17225726 ↗
7. Piras, G., Muzi, F., and Ziran, Z. (2025). A Data-Driven Model for the Energy and Economic Assessment of Building Renovations. Appl. Sci., 15.10.3390/app15148117 ↗
8. Integrated Generative Networks Embedded with Ensemble Classifiers for Fault Detection and Diagnosis under Small and Imbalanced Data of Building Air Condition System10.1016/j.enbuild.2022.112207 ↗
9. Franke, M., Gopinath, V., Ristić-Durrant, D., and Michels, K. (2022). Object-Level Data Augmentation for Deep Learning-Based Obstacle Detection in Railways. Appl. Sci., 12.10.3390/app122010625 ↗
10. Lee, J., Kim, J., and Ko, W. (2019). Day-Ahead Electric Load Forecasting for the Residential Building with a Small-Size Dataset Based on a Self-Organizing Map and a Stacking Ensemble Learning Method. Appl. Sci., 9.10.3390/app9061231 ↗
11. Predicting Energy Consumption of Build-ing Clusters at the Design Stage Using Machine Learning Models10.1016/j.asej.2025.103481 ↗
12. Machine Learning for Predicting Energy Efficiency of Buildings: A Small Data Approach10.1016/j.procs.2023.12.173 ↗
13. Deep Learning Techniques for Forecasting Energy Consumption in Smart Buildings: A Comprehensive Review10.1007/s10462-023-10660-8 ↗
14. NSGA-II Based Short-Term Building Energy Management Using Optimal LSTM-MLP Forecasts10.1016/j.ijepes.2024.110070 ↗
15. A Hybrid Model for Deep Learning Short term Power Load Forecasting Based on Feature Extraction Statistics Techniques10.1016/j.eswa.2023.122012 ↗
16. Gorzałczany, M.B., and Rudziński, F. (2024). Energy Consumption Prediction in Residential Buildings—An Accurate and Interpretable Machine Learning Approach Combining Fuzzy Systems with Evolutionary Optimization. Energies, 17.10.3390/en17133242 ↗
17. Innovative housing policy tools: Impact indicators in the NRRP Urban Regeneration Programmes
18. Random forests10.1023/A:1010933404324 ↗
19. Prediction and analysis of net ecosystem carbon exchange based on gradient boosting re-gression and random forest10.1016/j.apenergy.2020.114566 ↗