PE-DOCC: A Novel Periodicity-Enhanced Deep One-Class Classification Framework for Electricity Theft Detection
Source abstract
Abstract
Electricity theft, emerging as one of the severe cyberattacks in smart grids, causes significant economic losses. Due to the powerful expressive ability of deep neural networks (DNN), supervised and unsupervised DNN-based electricity theft detection (ETD) schemes have experienced widespread deployment. However, existing works have the following weak points: Supervised DNN-based schemes require abundant labeled anomalous samples for training, and even worse, cannot detect unseen theft patterns. To avoid the extensively labor-consuming activity of labeling anomalous samples, unsupervised DNNs-based schemes aim to learn the normality of time-series and infer an anomaly score for each data instance, but they fail to capture periodic features effectively. To address these challenges, this paper proposes a novel periodicity-enhanced deep one-class classification framework (PE-DOCC) based on a periodicity-enhanced transformer encoder, named Periodicformer encoder. Specifically, within the encoder, a novel criss-cross periodic attention is proposed to capture both horizontal and vertical periodic features. The Periodicformer encoder is pre-trained by reconstructing partially masked input sequences, and the learned latent representations are then fed into a one-class classification for anomaly detection. Extensive experiments on real-world datasets demonstrate that our proposed PE-DOCC framework outperforms state-of-the-art unsupervised ETD methods.
Source: crossref · Quality: baseline
Research context
OpenAlex topics: Electricity Theft Detection Techniques · Anomaly Detection Techniques and Applications · Power System Reliability and Maintenance
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
Affiliations
School of Communications and Information Engineering, Nanjing University of Posts and Telecommunications, Nanjing 210003, China
References (40)
Show source-provided references
1. Detection Methods in Smart Meters for Electricity Thefts: A Survey10.1109/JPROC.2021.3139754 ↗
2. Performance Analysis of Electricity Theft Detection for the Smart Grid: An Overview10.1109/TIM.2021.3127649 ↗
3. Systematic review of energy theft practices and autonomous detection through artificial intelligence methods10.1016/j.rser.2023.113544 ↗
4. A hybrid approach based on deep learning and support vector machine for the detection of electricity theft in power grids10.1016/j.egyr.2021.08.038 ↗
5. Electricity theft detection in low-voltage stations based on similarity measure and DT-KSVM10.1016/j.ijepes.2020.106544 ↗
6. Nguyen, T.H.T., and Phan, Q.B. (2021, January 15–16). Electricity theft Detection in Power Grid with a Hybrid Convolutional Neural Network—Support Vector Machine Model. Proceedings of the 5th International Conference on Future Networks and Distributed Systems (ICFNDS ’21), Dubai, United Arab Emirates.10.1145/3508072.3508078 ↗
7. Electricity Theft Detection Base on Extreme Gradient Boosting in AMI10.1109/TIM.2020.3048784 ↗
8. A novel feature engineered-CatBoost-based supervised machine learning framework for electricity theft detection10.1016/j.egyr.2021.07.008 ↗
9. A Hybrid ConvLSTM-Based Anomaly Detection Approach for Combating Energy Theft10.1109/TIM.2022.3201569 ↗
10. Hybrid-Order Representation Learning for Electricity Theft Detection10.1109/TII.2022.3179243 ↗
11. Ensemble LOF-based detection of false data injection in smart grid demand response system10.1016/j.compeleceng.2024.109188 ↗
12. Electricity Theft Detection in AMI Based on Clustering and Local Outlier Factor10.1109/ACCESS.2021.3100980 ↗
13. A Novel Unsupervised Data-Driven Method for Electricity Theft Detection in AMI Using Observer Meters10.1109/TIM.2022.3189748 ↗
14. Development of electricity consumption profiles of residential buildings based on smart meter data clustering10.1016/j.enbuild.2021.111376 ↗
15. Takiddin, A., Ismail, M., Zafar, U., and Serpedin, E. (2021, January 18–21). Variational Auto-encoder-based Detection of Electricity Stealth Cyber-attacks in AMI Networks. Proceedings of the 2020 28th European Signal Processing Conference (EUSIPCO), Amsterdam, The Netherlands.10.23919/Eusipco47968.2020.9287764 ↗
16. Deep Autoencoder-Based Anomaly Detection of Electricity Theft Cyberattacks in Smart Grids10.1109/JSYST.2021.3136683 ↗
17. Unsupervised BLSTM-Based Electricity Theft Detection with Training Data Contaminated10.1145/3604432 ↗
18. Electricity theft detection based on stacked sparse denoising autoencoder10.1016/j.ijepes.2020.106448 ↗
19. ETD-ConvLSTM: A Deep Learning Approach for Electricity Theft Detection in Smart Grids10.1109/TIFS.2023.3265884 ↗
20. Electricity Theft Detection Using Euclidean and Graph Convolutional Neural Networks
21. Electricity theft detection based on hybrid random forest and weighted support vector data description10.1016/j.ijepes.2023.109283 ↗
22. Senol, N.S., Baza, M., Rasheed, A., and Alsabaan, M. (2024). Privacy-Preserving Detection of Tampered Radio-Frequency Transmissions Utilizing Federated Learning in LoRa Networks. Sensors, 24.10.3390/s24227336 ↗
23. Gas-Theft Suspect Detection Among Boiler Room Users: A Data-Driven Approach10.1109/TKDE.2021.3062707 ↗
24. TiWS-iForest: Isolation forest in weakly supervised and tiny ML scenarios10.1016/j.ins.2022.07.129 ↗
25. Liang, D., Wang, J., Gao, X., Wang, J., Zhao, X., and Wang, L. (2022, January 20–22). Self-supervised Pretraining Isolated Forest for Outlier Detection. Proceedings of the 2022 International Conference on Big Data, Information and Computer Network (BDICN), Sanya, China.10.1109/BDICN55575.2022.00065 ↗
26. Automated, Reliable Zero-Day Malware Detection Based on Autoencoding Architecture10.1109/TNSM.2023.3251282 ↗
27. Two-Step Electricity Theft Detection Strategy Considering Economic Return Based on Convolutional Autoencoder and Improved Regression Algorithm10.1109/TPWRS.2021.3114307 ↗
28. Zeng, A., Chen, M., Zhang, L., and Xu, Q. (2023, January 7–14). Are transformers effective for time series forecasting?. Proceedings of the AAAI Conference on Artificial Intelligence, Washington, DC, USA.
29. Autoformer: Decomposition Transformers with Auto-Correlation for Long-Term Series Forecasting
30. TranAD: Deep transformer networks for anomaly detection in multivariate time series data10.14778/3514061.3514067 ↗
31. Commission for Energy Regulation (CER) (2023, July 21). CER Smart Metering Project-Electricity Customer Behaviour Trial, 2009–2010. Available online: https://www.ucd.ie/issda/data/commissionforenergyregulationcer/.
32. Utilizing Unlabeled Data to Detect Electricity Fraud in AMI: A Semisupervised Deep Learning Approach10.1109/TNNLS.2018.2890663 ↗
33. A novel approach to detect electricity theft based on conv-attentional Transformer Neural Network10.1016/j.ijepes.2022.108642 ↗
34. Zerveas, G., Jayaraman, S., Patel, D., Bhamidipaty, A., and Eickhoff, C. (2021, January 14–18). A Transformer-based Framework for Multivariate Time Series Representation Learning. Proceedings of the 27th ACM SIGKDD Conference on Knowledge Discovery & Data Mining (KDD ’21), Singapore.10.1145/3447548.3467401 ↗
35. Estimating the support of a high-dimensional distribution10.1162/089976601750264965 ↗
36. Liu, F.T., Ting, K.M., and Zhou, Z.H. (2008, January 15–19). Isolation Forest. Proceedings of the 2008 Eighth IEEE International Conference on Data Mining, Pisa, Italy.10.1109/ICDM.2008.17 ↗
37. LOF: Identifying density-based local outliers10.1145/335191.335388 ↗
38. Cheng, Z., Zou, C., and Dong, J. (2019, January 24–27). Outlier detection using isolation forest and local outlier factor. Proceedings of the Conference on Research in Adaptive and Convergent Systems (RACS ’19), Chongqing, China.10.1145/3338840.3355641 ↗
39. Lu, T., Wang, L., and Zhao, X. (2023). Review of Anomaly Detection Algorithms for Data Streams. Appl. Sci., 13.10.3390/app13106353 ↗
40. Guyon, I., Luxburg, U.V., Bengio, S., Wallach, H., Fergus, R., Vishwanathan, S., and Garnett, R. (2017, January 4–9). Attention is All you Need. Proceedings of the Advances in Neural Information Processing Systems, Long Beach, CA, USA.