Using Different ML Algorithms and Hyperparameter Optimization to Predict Heat Meters’ Failures
Source abstract
Abstract
The need to increase the energy efficiency of buildings, as well as the use of local renewable heat sources has caused heat meters to be used not only to calculate the consumed energy, but also for the active management of central heating systems. Increasing the reading frequency and the use of measurement data to control the heating system expands the requirements for the reliability of heat meters. The aim of the research is to analyze a large set of meters in the real network and predict their faults to avoid inaccurate readings, incorrect billing, heating system disruption, and unnecessary maintenance. The reliability analysis of heat meters, based on historical data collected over several years, shows some regularities, which cannot be easily described by physics-based models. The failure rate is almost constant and does depend on the past, but is a non-linear combination of state variables. To predict meters’ failures in the next billing period, three independent machine learning models are implemented and compared with selected metrics, because even the high performance of a single model (87% true positive for neural network) may be insufficient to make a maintenance decision. Additionally, performing hyperparameter optimization boosts the models’ performance by a few percent. Finally, three improved models are used to build an ensemble classifier, which outperforms the individual models. The proposed procedure ensures the high efficiency of fault detection (>95%), while maintaining overfitting at the minimum level. The methodology is universal and can be utilized to study the reliability and predict faults of other types of meters and different objects with the constant failure rate.
Source: crossref · Quality: baseline
Research context
OpenAlex topics: Building Energy and Comfort Optimization · Energy Load and Power Forecasting · Energy Efficiency and Management
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
Affiliations
Rapp Enserv, Hochstrasse 100, 4018 Basel, Switzerland
Instytut Techniczny Wojsk Lotniczych, ul. Księcia Bolesława 6, 01-494 Warszawa, Poland
References (44)
Show source-provided references
1. European Commission (2019, May 02). Energy Efficiency, Available online: https://ec.europa.eu/energy/en/topics/energy-efficiency/energy-performance-of-buildings.
2. Opportunities and challenges of wireless sensor networks in smart grid10.1109/TIE.2009.2039455 ↗
3. A survey on smart metering and smart grid communication10.1016/j.rser.2015.12.114 ↗
4. Khairalla, M., Abdrabou, A., Dahir, A., and Gaouda, A. (2015, January 22–23). Fault location based on smart meters time synchronized measurements. Proceedings of the 2015 First Workshop on Smart Grid and Renewable Energy (SGRE), Doha, Qatar.10.1109/SGRE.2015.7208720 ↗
5. Smart energy solutions in the EU: State of play and measuring progress10.1016/j.esr.2018.02.005 ↗
6. The OMS-Group e.V. (2019, May 02). Open Metering System. Available online: https://oms-group.org/en/.
7. European Commission (2019, April 05). Directive 2012/27/EU of the European Parliament and of the Council, Available online: https://eur-lex.europa.eu/legal-content/EN/TXT/PDF/?uri=CELEX:32012L0027.
8. European Commission (2019, June 02). Directive (EU) 2018/2002 of the European Parliament and of the Council, Available online: https://eur-lex.europa.eu/legal-content/EN/TXT/PDF/?uri=CELEX:32018L2002.
9. Data mining of smart meters for load category based disaggregation of residential power consumption10.1016/j.segan.2017.03.006 ↗
10. Makonin, S., Wang, Z.J., and Tumpach, C. (2018). RAE: The rainforest automation energy dataset for smart grid meter data analysis. Data, 3.10.3390/data3010008 ↗
11. Smart electricity meter reliability prediction based on accelerated degradation testing and modeling10.1016/j.ijepes.2013.11.023 ↗
12. Alahakoon, D., and Yu, X. (2013, January 14). Advanced analytics for harnessing the power of smart meter big data. Proceedings of the 2013 IEEE International Workshop on Inteligent Energy Systems (IWIES), Vienna, Austria.10.1109/IWIES.2013.6698559 ↗
13. Smart electricity meter data intelligence for future energy systems: A survey10.1109/TII.2015.2414355 ↗
14. Predictive control of the radiant floor heating system in apartment buildings10.3130/jaabe.1.105 ↗
15. Javed, A., Larijani, H., Ahmadinia, A., and Emmanuel, R. (2014, January 3–5). Comparison of the robustness of RNN, MPC and ANN controller for residential heating system. Proceedings of the 2014 IEEE Fourth International Conference on Big Data and Cloud Computing, Sydney, NSW, Australia.10.1109/BDCloud.2014.20 ↗
16. Application of artificial neural network to predict the optimal start time for heating system in building10.1016/S0196-8904(03)00044-X ↗
17. Energetic and economic evaluations of geothermal district heating systems by using ANN10.1016/j.enpol.2013.01.039 ↗
18. Extreme learning machine for prediction of heat load in district heating systems10.1016/j.enbuild.2016.04.021 ↗
19. Bergstra, J., Yamins, D., and Cox, D.D. (2013, January 16–21). Making a science of model search: Hyperparameter optimization in hundreds of dimensions for vision architectures. Proceedings of the 30th International Conference on Machine Learning, Atlanta, GA, USA.
20. Bergstra, J.S., Bardenet, R., Bengio, Y., and Kégl, B. (2011, January 12–17). Algorithms for hyper-parameter optimization. Proceedings of the NIPS 2011, Granada, Spain.
21. Polikar, R. (2012). Ensemble learning. Ensemble Machine Learning, Springer.10.1007/978-1-4419-9326-7_1 ↗
22. Markov reliability model for heat meters10.2478/jok-2018-0005 ↗
23. Witten, I.H., Frank, E., Hall, M.A., and Pal, C.J. (2016). Data Mining: Practical Machine Learning Tools and Techniques, Morgan Kaufmann. Chapter 4.
24. Data quality considerations for big data and machine learning: Going beyond data cleaning and transformations
25. Hall, M.A. (July, January 29). Correlation-based feature selection of discrete and numeric class machine learning. Proceedings of the Seventeenth International Conference on Machine Learning, Stanford, CA, USA.
26. Goodfellow, I., Bengio, Y., Courville, A., and Bengio, Y. (2016). Deep Learning, MIT Press.
27. Pérez, R., and Vásquez, C. (2016, January 12–14). Fault location in distribution systems with distributed generation using support vector machines and smart meters. Proceedings of the 2016 IEEE Ecuador Technical Chapters Meeting (ETCM), Guayaquil, Ecuador.10.1109/ETCM.2016.7750857 ↗
28. Bagging, boosting, and C4.5
29. Backpropagation learning algorithm based on Levenberg Marquardt Algorithm
30. Vertical bagging decision trees model for credit scoring10.1016/j.eswa.2010.04.054 ↗
31. Johnson, R.A., and Wichern, D.W. (2007). Applied Multivariate Statistical Analysis, Prentice Hall. [6th ed.].
32. Statistical Analysis of the Volume of Passenger Air Traffic in Europe in years 2004–201510.1016/j.trpro.2018.12.014 ↗
33. Martinez, W.L., Martinez, A.R., and Solka, J. (2017). Exploratory Data Analysis with MATLAB, CRC Press.
34. Bradley, E. (2017). Reliability Engineering A Life Cycle Approach, CRC Press.10.1201/9781315367422 ↗
35. He Ren, X.C., and Chen, Y. (2017). Reliability Based Aircraft Maintenance Optimization and Application, Elsevier. Aerospace Engineering.
36. Rykov, V. (2016). Reliability of Engineering Systems and Technological Risks, John Wiley & Sons, Inc.10.1002/9781119347194 ↗
37. Murphy, K.P. (2013). Machine Learning: A Probabilistic Perspective, MIT Press.
38. Domingos, P. (2015). The Master Algorithm: How the Quest for the Ultimate Learning Machine Will Remake Our World, Basic Books.
39. Davis, J., and Goadrich, M. (2006, January 25–29). The relationship between Precision-Recall and ROC curves. Proceedings of the 23rd International Conference on Machine Learning, Pittsburgh, PA, USA.10.1145/1143844.1143874 ↗
40. Random search for hyper-parameter optimization
41. Snoek, J., Larochelle, H., and Adams, R.P. (2012, January 3–8). Practical bayesian optimization of machine learning algorithms. Proceedings of the NIPS 2012, Stateline, NV, USA.
42. Zhang, C., and Ma, Y. (2012). Ensemble Machine Learning: Methods and Applications, Springer.10.1007/978-1-4419-9326-7 ↗
43. Ferrero Bermejo, J., Gómez Fernández, J.F., Olivencia Polo, F., and Crespo Márquez, A. (2019). A Review of the Use of Artificial Neural Network Models for Energy and Reliability Prediction. A Study of the Solar PV, Hydraulic and Wind Energy Sources. Appl. Sci., 9.10.3390/app9091844 ↗
44. Heat load prediction in district heating systems with adaptive neuro-fuzzy method10.1016/j.rser.2015.04.020 ↗