journal article·2022-08-24Open access

A Machine-Learning Pipeline for Large-Scale Power-Quality Forecasting in the Mexican Distribution Grid

Juan J. Flores, Jose L. Garcia-Nava, Jose R. Cedeno Gonzalez, Victor M. Tellez, Felix Calderon, Arturo Medrano

Applied Sciences· Volume 12· Issue 17

Abstract

Electric power distribution networks face increasing factors for power-quality (PQ) deterioration, such as distributed, renewable-energy generation units and countless high-end electronic devices loaded as controllers or in standalone mode. Consequently, government regulations are issued worldwide to set up strict PQ distribution standards; the distribution grids must comply with those regulations. This situation drives research towards PQ forecasting as a crucial part of early-warning systems. However, most of the approaches in the literature disregard the big-data nature of the problem by working on small datasets. These datasets come from short-scale off-grid configurations or selected portions of a larger power grid. This article addresses a study case from a region-sized state-owned Mexican distribution grid, where the company must preserve essential PQ standards in approximately 700 distribution circuits and 150 quality-control nodes. We implemented a machine-learning pipeline with nearly 4000 univariate forecasting models to address this challenge. The system executes a weekly forecasting pipeline and daily data ingestion and preprocessing pipeline, processing massive amounts of data ingested. The implemented system, MIRD (an acronym for Monitoreo Inteligente de Redes de Distribution—Intelligent Monitoring of Distribution Networks), is an unprecedented effort in the production, deployment, and continuous use of forecasting models for PQ indices monitoring. To the extent of the authors’ best knowledge, there is no similar work of this type in any other Latin-American distribution grid.
Source: crossref · Quality: baseline

Research context

OpenAlex topics: Energy Load and Power Forecasting · Power System Reliability and Maintenance · Electricity Theft Detection Techniques

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

Computer Science Department, University of Oregon, Eugene, OR 97403, USA

Facultad de Ingeniería Eléctrica, Universidad Michocana de San Nicolás de Hidalgo, Morelia 58030, Mexico

Comision Federal de Electricidad, Av. Paseo de la Reforma 164, Juárez, Cuauhtémoc, Ciudad de México 06600, Mexico

Funding

CONACYT National Scholarship

References (36)

Show source-provided references
1. Power quality early warning based on anomaly detection10.5370/JEET.2014.9.4.1171 ↗
2. Power quality prediction, early warning, and control for points of common coupling with wind farms10.3390/en8099365 ↗
3. Stuchly, J., Misak, S., Vantuch, T., and Burianek, T. (2015, January 10–13). A power quality forecasting model as an integrate part of active demand side management using Artificial Intelligence Technique-Multilayer Neural Network with Backpropagation Learning Algorithm. Proceedings of the 2015 IEEE 15th International Conference on Environment and Electrical Engineering (EEEIC), Rome, Italy.10.1109/EEEIC.2015.7165233 ↗
4. Vantuch, T., Misák, S., and Stuchlỳ, J. (2016, January 7–10). Power quality prediction designed as binary classification in AC coupling Off-Grid system. Proceedings of the 2016 IEEE 16th International Conference on Environment and Electrical Engineering (EEEIC), Florence, Italy.10.1109/EEEIC.2016.7555551 ↗
5. Jahan, I.S., Blazek, V., Misak, S., Snasel, V., and Prokop, L. (2022). Forecasting of Power Quality Parameters Based on Meteorological Data in Small-Scale Household Off-Grid Systems. Energies, 15.10.3390/en15145251 ↗
6. Weng, G., Zhu, S., Gong, Y., Ma, T., Xie, F., and Fang, M. (2017, January 26–28). Research on power quality prediction for DG integrated smart grid based on neural network. Proceedings of the 2017 IEEE Conference on Energy Internet and Energy System Integration (EI2), Beijing, China.10.1109/EI2.2017.8245370 ↗
7. Hua, L. (2021, January 23–24). Power Quality Prediction of Active Distribution Network Based on CNN-LSTM Deep Learning Model. Proceedings of the International Conference on Artificial Intelligence for Communications and Networks, Xining, China.10.1007/978-3-030-90196-7_11 ↗
8. Power Quality Indices Online Prediction Based on VMD-LSTM Residual Analysis10.1088/1742-6596/2290/1/012009 ↗
9. Power quality indexes prediction based on cluster analysis and support vector machine10.1049/oap-cired.2017.0120 ↗
10. Predicting of Power Quality Steady State Index Based on Chaotic Theory Using Least Squares Support Vector Machine10.4236/epe.2017.94B077 ↗
11. Yong, Z., Chen, F., Zhifang, W., and Xiu, Y. (2018, January 25–27). Voltage deviation forecasting with improved BP neural network. Proceedings of the 2018 International Conference on Mechatronic Systems and Robots, Singapore.10.1145/3230876.3230889 ↗
12. Research on power quality prediction of fluctuating load10.1088/1757-899X/768/6/062013 ↗
13. Michałowska, K., Hoffmann, V., and Andresen, C. (2020, January 7–9). Impact of seasonal weather on forecasting of power quality disturbances in distribution grids. Proceedings of the 2020 International Conference on Smart Energy Systems and Technologies (SEST), Istanbul, Turkey.10.1109/SEST48500.2020.9203492 ↗
14. Research on Power Quality Prediction Based on BiLSTM Optimized by Bayesian Algorithm10.1088/1742-6596/2221/1/012033 ↗
15. A taxonomy of electricity demand forecasting techniques and a selection strategy
16. Big data analytics on Apache Spark10.1007/s41060-016-0027-9 ↗
17. Scikit-learn: Machine learning in Python
18. Sakr, S., and Zomaya, A. (2018). Columnar Storage Formats. Encyclopedia of Big Data Technologies, Springer International Publishing.10.1007/978-3-319-77525-8 ↗
19. Douglas, C., Montgomery, C.L.J., and Kulahci, M. (2015). Introduction to Time Series Analysis and Forecasting, John Wiley & Sons. [2nd ed.].
20. Box, G.E.P., Jenkins, G.M., Reinsel, G.C., and Ljung, G.M. (2015). Time Series Analysis: Forecasting and Control, John Wiley & Sons. [5th ed.].
21. Han, J., Kamber, M., and Pei, J. (2012). 12—Outlier Detection. Data Mining, Morgan Kaufmann. [3rd ed.].10.1016/B978-0-12-381479-1.00012-5 ↗
22. LOF: Identifying Density-based Local Outliers10.1145/335191.335388 ↗
23. Kantz, H., and Schreiber, T. (2004). Nonlinear Time Series Analysis, Cambridge University Press.10.1017/CBO9780511755798 ↗
24. van Gerven, M., and Bohte, S. (2017). Artificial Neural Networks as Models of Neural Information Processing, Frontiers Media SA.10.3389/978-2-88945-401-3 ↗
25. Hagan, M.T., Demuth, H.B., and Beale, M.H. (1996). Neural Network Design, Martin Hagan.
26. Haykin, S. (1994). Neural Networks: A Comprehensive Foundation, Prentice Hall PTR.
27. Short-term demand forecast using a bank of neural network models trained using genetic algorithms for the optimal management of drinking water networks10.2166/hydro.2016.199 ↗
28. Xu, L.M.X. (2007). RBF network-based chaotic time series prediction and its application in foreign exchange market. Proceedings of the International Conference on Intelligent Systems and Knowledge Engineering (ISKE 2007), Atlantis Press.
29. Kumar, H., and Patil, S.B. (2015, January 12–13). Estimation & forecasting of volatility using ARIMA, ARFIMA and Neural Network based techniques. Proceedings of the 2015 IEEE International Advance Computing Conference (IACC), Bangalore, India.
30. Li, Y., and Manoharan, S. (2013, January 27–29). A performance comparison of SQL and NoSQL databases. Proceedings of the 2013 IEEE Pacific Rim Conference on Communications, Computers and Signal Processing (PACRIM), Victoria, BC, Canada.10.1109/PACRIM.2013.6625441 ↗
31. Time series forecasting of petroleum production using deep LSTM recurrent networks10.1016/j.neucom.2018.09.082 ↗
32. Multivariate time series forecasting via attention-based encoder—Decoder framework10.1016/j.neucom.2019.12.118 ↗
33. Informer: Beyond efficient transformer for long sequence time-series forecasting
34. Baylor, D., Breck, E., Cheng, H.T., Fiedel, N., Foo, C.Y., Haque, Z., Haykal, S., Ispir, M., Jain, V., and Koc, L. (2017, January 13–17). Tfx: A tensorflow-based production-scale machine learning platform. Proceedings of the 23rd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, Halifax, NS, Canada.10.1145/3097983.3098021 ↗
35. Accelerating the machine learning lifecycle with MLflow
36. Bisong, E. (2019). Kubeflow and kubeflow pipelines. Building Machine Learning and Deep Learning Models on Google Cloud Platform, Springer.10.1007/978-1-4842-4470-8 ↗