journal article·2025-08-30Open access

Evaluating Sampling Strategies for Characterizing Energy Demand in Regions of Colombia Without AMI Infrastructure

Oscar Alberto Bustos, Julián David Osorio, Javier Rosero-García, Cristian Camilo Marín-Cano, Luis Alirio Bolaños

Applied Sciences· Volume 15· Issue 17

Abstract

This study presents and evaluates three sampling strategies to characterize electricity demand in regions of Colombia with limited metering infrastructure. These areas lack Advanced Metering Infrastructure (AMI), relying instead on traditional monthly consumption records. The objective of the research is to obtain user samples that are representative of the original population and logistically efficient, in order to support energy planning and decision-making. The analysis draws on five years of historical data from 2020 to 2024. It includes monthly energy consumption, geographic coordinates, customer classification, and population type, covering over 500,000 users across four subregions of operation determined by the region grid operator: North, South, Center, and East. The proposed methodologies are based on Shannon entropy, consumption-based probabilistic sampling, and Kullback–Leibler divergence minimization. Each method is assessed for its ability to capture demand variability, ensure representativeness, and optimize field deployment. Representativeness is evaluated by comparing the differences in class proportions between the sample and the original population, complemented by the Pearson correlation coefficient between their distributions. Results indicate that entropy-based sampling excels in logistical simplicity and preserves categorical diversity, while KL divergence offers the best statistical fit to population characteristics. The findings demonstrate how combining information theory and statistical optimization enables flexible, scalable sampling solutions for demand characterization in under-instrumented electricity grids.
Source: crossref · Quality: baseline

Research context

OpenAlex topics: Water Systems and Optimization · Smart Grid Energy Management · Energy Load and Power Forecasting

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

EM&D Research Group, Electrical and Electronics Engineering Department, Faculty of Engineering, Universidad Nacional de Colombia, Bogotá 111321, Colombia

CHEC-Grupo EPM, Medellín 050015, Colombia

References (58)

Show source-provided references
1. Inter-American Development Bank (2022). Medición Inteligente en América Latina y el Caribe: Recomendaciones Regulatorias para Avanzar su Implementación, IDB. Technical Report.
2. A survey-based electricity demand profiling method for developing countries: The case of urban households in Bangladesh10.1016/j.jobe.2021.102507 ↗
3. World Bank (2016). Smartening the Grid in Developing Countries: Emerging Lessons from World Bank Lending, World Bank. Live Wire 2016/67.
4. Lessons from last mile electrification in Colombia: Examining the policy framework and outcomes for sustainability
5. Sistemas de medición avanzada en Colombia: Beneficios, retos y oportunidades
6. Viscidi, L. (2025, July 07). Peace in Colombia’s Countryside? First, Turn on the Lights. Americas Quarterly. November 2017. Available online: https://www.americasquarterly.org/fulltextarticle/peace-in-colombias-countryside-first-turn-on-the-lights.
7. Carrillo Romero, J.L., and Perdomo Arias, A.F. (2017). Caracterización y Análisis del Consumo Energético en Zonas Rurales Para Los Municipios de Arauca, Universidad de los Llanos.
8. Modeling of end-use energy consumption in the residential sector: A review of modeling techniques10.1016/j.rser.2008.09.033 ↗
9. Auder, B., Cugliari, J., Goude, Y., and Poggi, J.M. (2018). Scalable Clustering of Individual Electrical Curves for Profiling and Bottom-Up Forecasting. Energies, 11.10.20944/preprints201807.0019.v1 ↗
10. Huang, Y., Zhan, J., Wang, N., Luo, C., Wang, L., and Ren, R. (2018). Clustering Residential Electricity Load Curves via Community Detection in Network. arXiv.
11. Alonso, A.M., Nogales, F.J., and Ruiz, C. (2019). Hierarchical Clustering for Smart Meter Electricity Loads Based on Quantile Autocovariances. arXiv.10.1109/TSG.2020.2991316 ↗
12. Cordeiro-Costas, M., Villanueva, D., Martínez-Comesaña, M., and Ramos, S. (2023). Load Forecasting with Machine Learning and Deep Learning Methods. Appl. Sci., 13.10.3390/app13137933 ↗
13. Douaidi, L., Senouci, S.M., El Korbi, I., and Harrou, F. (2023, January 20–23). Predicting Electric Vehicle Charging Stations Occupancy: A Federated Deep Learning Framework. Proceedings of the 2023 IEEE 97th Vehicular Technology Conference (VTC2023-Spring), Florence, Italy.10.1109/VTC2023-Spring57618.2023.10199832 ↗
14. Genes, C., Esnaola, I., Perlaza, S.M., Ochoa, L.F., and Coca, D. (2017). Robust Recovery of Missing Data in Electricity Distribution Systems. arXiv.
15. Multivariate empirical mode decomposition based hybrid model for day-ahead peak load forecasting10.1016/j.energy.2021.122245 ↗
16. Short term electricity load forecasting using a hybrid model10.1016/j.energy.2018.06.012 ↗
17. An Accurate Hybrid Approach for Electric Short-Term Load Forecasting10.1080/03772063.2021.1905085 ↗
18. A hybrid machine learning model for forecasting a billing period’s peak electric load days10.1016/j.ijforecast.2019.03.025 ↗
19. Intelligent system for non-technical losses management in residential users of the electricity sector10.15446/ing.investig.v38n2.67331 ↗
20. Non-Intrusive Energy Disaggregation Using Non-Negative Matrix Factorization With Sum-to-k Constraint10.1109/TPWRS.2017.2660246 ↗
21. Norte, S., José, S., and Tortós, J.Q. (2019). Metodología para la Determinación de Curvas de Carga y Consumo Eléctrico Residencial por Uso—Informe Final, Escuela de Ingeniería Eléctrica, Universidad de Costa Rica, Informe Final para el Instituto Costarricense de Electricidad.
22. The determinants of household electricity demand in Turkey: An implementation of the Heckman Sample Selection model10.1016/j.energy.2023.128431 ↗
23. Pavón, C., and Barzola-Monteses, J. (2025, July 07). Estimación de la Demanda Energética Mensual Mediante Encuesta Aplicada en la Provincia de Santa Elena. Available online: https://www.researchgate.net/publication/309286132.
24. Active Sampling: A Machine-Learning-Assisted Framework for Finite Population Inference with Optimal Subsamples10.1080/00401706.2024.2374554 ↗
25. Reina García, J., and Peña Varón, M.R. (2019). Diseño Metodológico Para la Selección de Sitios de Muestreo en Una Red de Monitoreo de Micro–Contaminantes en Ríos de Valle: Caso de Estudio río Cauca, Food and Agriculture Organization of the United Nations.
26. Rafiee, H., Abin, A.A., and Majd, S.S. (2024, January 19). Cluster Sampling: A Cluster-Driven Sampling Strategy for Deep Metric Learning. Proceedings of the 2024 14th International Conference on Computer and Knowledge Engineering (ICCKE), Mashhad, Iran.10.1109/ICCKE65377.2024.10874603 ↗
27. Chen, S., Zheng, J., and Li, J. (2024, January 26–28). The Impact of Sample Size after Sampling on the Accuracy of Machine Learning Models. Proceedings of the 2024 International Conference on Computers, Information Processing and Advanced Education (CIPAE), Ottawa, ON, Canada.10.1109/CIPAE64326.2024.00017 ↗
28. Zhu, Q.-X., Zhao, Q.-Q., Xu, Y., and He, Y.-L. (2023, January 12–14). Novel virtual sample generation using Gibbs Sampling integrated with GRNN for handling small data in soft sensing. Proceedings of the 2023 IEEE 12th Data Driven Control and Learning Systems Conference (DDCLS), Xiangtan, China.10.1109/DDCLS58216.2023.10166679 ↗
29. Deep learning10.1038/nature14539 ↗
30. Smart Sampling for Reduced and Representative Power System Scenario Selection10.1109/OAJPE.2021.3093278 ↗
31. Selecting and prioritizing the electricity customers for participating in demand response programs10.1049/gtd2.12417 ↗
32. Ingredients for growth: Examining electricity consumption and complementary infrastructure for Small and Medium Enterprises in Kenya10.1016/j.deveng.2021.100072 ↗
33. Zhu, X., and Mather, B. (2019, January 4–9). Data-Driven Load Diversity and Variability Modeling for Quasi-Static Time-Series Simulation on Distribution Feeders. Proceedings of the 2019 IEEE Power & Energy Society General Meeting (PESGM), Atlanta, GA, USA.10.1109/PESGM40551.2019.8973929 ↗
34. Bañales, S., Dormido, R., and Duro, N. (2021). Smart Meters Time Series Clustering for Demand Response Applications in the Context of High Penetration of Renewable Energy Resources. Energies, 12.10.3390/en14123458 ↗
35. Stochastic load profile construction for the multi-tier framework for household electricity access using off-grid DC appliances10.1007/s12053-018-9725-6 ↗
36. An information theoretic metric for measurement vulnerability to data integrity attacks on smart grids10.1049/stg2.12163 ↗
37. Shen, C., Liu, H., Wang, J., Yang, Z., and Hai, C. (2025). Kullback–Leibler Divergence-Based Distributionally Robust Chance-Constrained Programming for PV Hosting Capacity Assessment in Distribution Networks. Sustainability, 17.10.3390/su17052022 ↗
38. A Mathematical Theory of Communication10.1002/j.1538-7305.1948.tb01338.x ↗
39. How to choose a sampling technique and determine sample size for research: A simplified guide for researchers10.1016/j.oor.2024.100662 ↗
40. Discretization: An Enabling Technique10.1023/A:1016304305535 ↗
41. Manning, C.D., and Schütze, H. (2008). Introduction to Information Retrieval, Cambridge University Press.10.1017/CBO9780511809071 ↗
42. Cover, T.M. (2006). Elements of Information Theory, Wiley. [2nd ed.].10.1002/047174882X ↗
43. On Information and Sufficiency10.1214/aoms/1177729694 ↗
44. Uncovering urban water consumption patterns through time series clustering and entropy analysis10.1016/j.watres.2024.122085 ↗
45. Using Maximum Entropy Modeling for Optimal Selection of Sampling Sites for Monitoring Networks10.3390/d3020252 ↗
46. Optimization of an urban monitoring network for emergency response applications: An approach for characterizing the source of hazardous releases10.1002/qj.3471 ↗
47. Optimal and objective placement of sensors in water distribution systems using information theory10.1016/j.watres.2018.06.050 ↗
48. Tian, H., Lang, Z., Cao, C., and Wang, B. (2025). Optimizing Sensor Placement for Enhanced Source Term Estimation in Chemical Plants. Processes, 13.10.3390/pr13030825 ↗
49. Hock, D., Kappes, M., and Ghita, B. (2020). Entropy-Based Metrics for Occupancy Detection Using Energy Demand. Entropy, 22.10.3390/e22070731 ↗
50. Gunkel, P.A., Bergaentzlé, C.M., Keles, D., Scheller, F., and Jacobsen, H.K. (2022). Grid tariff designs coping with the challenges of electrification and their socio-economic impacts. arXiv.
51. Smith, L.D., and Kirschen, D.S. (2021). Impacts of Time-of-Use Rate Changes on the Electricity Bills of Commercial Consumers. arXiv.10.1109/PESGM46819.2021.9638125 ↗
52. Ezhilarasi, P., Ramesh, L., Sanjeevikumar, P., and Khan, B. (2023). A cost-effective smart metering approach towards affordable deployment strategy. Sci. Rep., 13.10.1038/s41598-023-44149-9 ↗
53. Optimal water tariffs for domestic, agricultural and industrial use10.1007/s10479-024-05822-y ↗
54. Narzetti, D.A., and Marques, R.C. (2020). Models of subsidies for water and sanitation services for vulnerable people in South American countries: Lessons for Brazil. Water, 12.10.3390/w12071976 ↗
55. Subsidies and affordability: A social approach to water supply tariffs10.2166/washdev.2024.253 ↗
56. A new look at the distributive incidence of Chile’s means-tested water subsidy scheme
57. Customer-country diversification and inventory efficiency: Comparative evidence from the manufacturing sector during the pre-pandemic and the COVID-19 pandemic periods10.1016/j.jbusres.2022.04.066 ↗
58. Sevriugov, E., and Oseledets, I. (2024). KL-geodesics flow matching with a novel sampling scheme. arXiv.