The Design, Creation, Implementation, and Study of a New Dataset Suitable for Non-Intrusive Load Monitoring
Source abstract
Abstract
The increasing need for efficient energy consumption monitoring, driven by economic and environmental concerns, has made Non-Intrusive Load Monitoring (NILM) a cost-effective alternative to traditional measurement methods. Despite its progress since the 1980s, NILM still lacks standardized benchmarks, limiting objective performance comparisons. This study introduces several key contributions: (1) the development of five new converters with 13-digit timestamp support and harmonic inclusion, improving the data collection accuracy by up to 25%; (2) the implementation of an advanced disaggregation software, achieving a 10–15% increase in the F1-score for certain appliances; (3) a detailed analysis of harmonics’ impact on NILM, reducing the Mean Normalized Error in Assigned Power by up to 40%; and (4) the design of open-source measurement hardware to enhance reproducibility. This study also evaluates open hardware platforms and compares five common household appliances using NILM Toolkit metrics. Results demonstrate that open hardware and software foster reproducibility and accelerate innovation in NILM. The proposed approach contributes to a standardized and scalable NILM framework, facilitating real-world applications in energy management and smart grid optimization.
Source: crossref · Quality: baseline
Research context
OpenAlex topics: Smart Grid Energy Management · Water Systems and Optimization · Anomaly Detection Techniques and Applications
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
Affiliations
Department of Engineering, University of Almeria, ceiA3, 04120 Almeria, Spain
References (37)
Show source-provided references
1. Expanding Variety of Non-Intrusive Load Monitoring Training Data: Introducing and Benchmarking a Novel Data Augmentation Technique10.1016/j.segan.2023.101142 ↗
2. Information Provision and Energy Consumption: Evidence from a Field Experiment10.1016/j.eneco.2018.03.008 ↗
3. Nonintrusive Appliance Load Monitoring10.1109/5.192069 ↗
4. Kelly, J., and Knottenbelt, W. (2015, January 4). Neural NILM: Deep Neural Networks Applied to Energy Disaggregation. Proceedings of the BuildSys 2015—Proceedings of the 2nd ACM International Conference on Embedded Systems for Energy-Efficient Built, Seoul, Republic of Korea.10.1145/2821650.2821672 ↗
5. Unsupervised Algorithm for Disaggregating Low-Sampling-Rate Electricity Consumption of Households10.1016/j.segan.2019.100244 ↗
6. Shin, C., Rho, S., Lee, H., and Rhee, W. (2019). Data Requirements for Applying Machine Learning to Energy Disaggregation. Energies, 12.10.3390/en12091696 ↗
7. Çavdar, I.H., and Faryad, V. (2019). New Design of a Supervised Energy Disaggregation Model Based on the Deep Neural Network for a Smart Grid. Energes, 12.10.3390/en12071217 ↗
8. Shabbir, N., Vassiljeva, K., Nourollahi Hokmabad, H., Husev, O., Petlenkov, E., and Belikov, J. (2024). Comparative Analysis of Machine Learning Techniques for Non-Intrusive Load Monitoring. Electronics, 13.10.3390/electronics13081420 ↗
9. Irani Azad, M., Rajabi, R., and Estebsari, A. (2024). Nonintrusive Load Monitoring (NILM) Using a Deep Learning Model with a Transformer-Based Attention Mechanism and Temporal Pooling. Electronics, 13.10.3390/electronics13020407 ↗
10. Non-Intrusive Load Monitoring through Coupling Sequence Matrix Reconstruction and Cross Stage Partial Network10.1016/j.measurement.2023.113358 ↗
11. Athanasiadis, C., Doukas, D., Papadopoulos, T., and Chrysopoulos, A. (2021). A Scalable Real-Time Non-Intrusive Load Monitoring System for the Estimation of Household Appliance Power Consumption. Energies, 14.10.3390/en14030767 ↗
12. A Non-Intrusive Appliance Load Monitoring for Efficient Energy Consumption Based on Naive Bayes Classifier
13. Robust Event Detection for Residential Load Disaggregation10.1016/j.apenergy.2022.120339 ↗
14. A Review of Current Methods and Challenges of Advanced Deep Learning-Based Non-Intrusive Load Monitoring (NILM) in Residential Context10.1016/j.enbuild.2024.113890 ↗
15. Souza, J. (2025, March 11). Non-Intrusive Load Monitoring (NILM): An Introduction and Practical Example. Available online: https://www.linkedin.com/pulse/non-intrusive-load-monitoring-nilm-introduction-practical-souza-rpy4f/.
16. Parson, O., Fisher, G., Hersey, A., Batra, N., Kelly, J., Singh, A., Knottenbelt, W., and Rogers, A. (2015, January 14–16). Dataport and NILMTK: A Building Data Set Designed for Non-Intrusive Load Monitoring. Proceedings of the 2015 IEEE Global Conference on Signal and Information Processing (GlobalSIP), Orlando, FL, USA.10.1109/GlobalSIP.2015.7418187 ↗
17. Non-Intrusive Load Monitoring and Its Challenges in a NILM System Framework10.1504/IJHPCN.2019.099748 ↗
18. Vavouris, A., Garside, B., Stankovic, L., and Stankovic, V. (2022). Low-Frequency Non-Intrusive Load Monitoring of Electric Vehicles in Houses with Solar Generation: Generalisability and Transferability. Energies, 15.10.3390/en15062200 ↗
19. Sykiotis, S., Kaselimi, M., Doulamis, A., and Doulamis, N. (2022). Electricity: An Efficient Transformer for Non-Intrusive Load Monitoring. Sensors, 22.10.3390/s22082926 ↗
20. Non-Intrusive Load Monitoring (NILM): A Comprehensive Review
21. Nipun, B., Jack, K., Oliver, P., Haimonti, D., and William, K. (2014, January 11–13). NILMTK: An Open Source Toolkit for Non-Intrusive Load Monitoring. Proceedings of the 5th International Conference on Future Energy Systems, Cambridge, UK.
22. Nonintrusive Load Monitoring (NILM) Performance Evaluation10.1007/s12053-014-9306-2 ↗
23. Kukunuri, R., Batra, N., Pandey, A., Malakar, R., Kumar, R., Krystalakos, O., Zhong, M., Meira, P., and Parson, O. (2019, January 13–14). NILMTK-Contrib: Towards Reproducible State-of-the-Art Energy Disaggregation. Proceedings of the 6th ACM International Conference on Systems for Energy-Efficient Buildings, Cities, and Transportation, New York, NY, USA.
24. Kolter, J.Z., and Johnson, M.J. (2011, January 21). REDD: A Public Data Set for Energy Disaggregation Research. Proceedings of the 1st KDD Workshop on Data Mining Applications in Sustainability, San Diego, CA, USA.
25. The UK-DALE Dataset, Domestic Appliance-Level Electricity Demand and Whole-House Demand from Five UK Homes10.1038/sdata.2015.7 ↗
26. Beckel, C., Kleiminger, W., Cicchetti, R., Staake, T., and Santini, S. (2014, January 3). The ECO Data Set and the Performance of Non-Intrusive Load Monitoring Algorithms. Proceedings of the BuildSys 2014—Proceedings of the 1st ACM Conference on Embedded Systems for Energy-Efficient Buildings, Memphis, TN, USA.10.1145/2674061.2674064 ↗
27. Certification, L. (2025, June 17). Pecan Street Dataport. Available online: https://www.pecanstreet.org/dataport/.
28. Berrettoni, G., and Ferrigno Fabrizio Marignetti, L. (2024). Resilience of the Italian Electricity Grid: Objectives and Future Challenges, University of Cassino.
29. Non-Intrusive Load Monitoring by Using Active and Reactive Power in Additive Factorial Hidden Markov Models10.1016/j.apenergy.2017.08.203 ↗
30. Gawin, B., Małkowski, R., and Rink, R. (2023). Will NILM Technology Replace Multi-Meter Telemetry Systems for Monitoring Electricity Consumption?. Energies, 16.10.3390/en16052275 ↗
31. Rodríguez-Navarro, C., Portillo, F., Martínez, F., Manzano-Agugliaro, F., and Alcayde, A. (2023). Development and Application of an Open Power Meter Suitable for NILM. Inventions, 9.10.3390/inventions9010002 ↗
32. Rodriguez-Navarro, C. (2025, February 27). Datasets of Almeria University. Available online: https://zenodo.org/records/13739113.
33. Rodriguez-Navarro, C. (2025, June 17). DSUALMH. Available online: https://zenodo.org/records/13739563.
34. Viciana, E., Alcayde, A., Montoya, F., Baños, R., Arrabal-Campos, F., Zapata-Sierra, A., and Manzano-Agugliaro, F. (2018). OpenZmeter: An Efficient Low-Cost Energy Smart Meter and Power Quality Analyzer. Sustainability, 10.10.3390/su10114038 ↗
35. Rodriguez_Navarro, C. (2025, June 17). OMPM. Available online: https://zenodo.org/records/13740059.
36. Rodriguez-Navarro, C. (2025, June 17). DSUALM10H. Available online: https://zenodo.org/records/13740027.
37. Rodriguez-Navarro, C. (2025, June 17). Performance Analysis of Nine Disaggregation Algorithms on the DSUALM10 Dataset: A Notebook Study. Available online: https://zenodo.org/records/15575404.10.3390/inventions10030043 ↗