journal article·2024-05-09Open access

Transmission Line Fault Classification Using Conformer Convolution-Augmented Transformer Model

Meng-Yun Lee, Yu-Shan Huang, Chia-Jui Chang, Jia-Yu Yang, Chih-Wen Liu, Tzu-Chiao Lin, Yen-Bor Lin

Applied Sciences· Volume 14· Issue 10

Abstract

Ensuring a consistently reliable power supply is paramount in power systems. Researchers are engaged in the pursuit of categorizing transmission line failures to design countermeasures for mitigating the associated financial losses. Our study employs a machine learning-based methodology, specifically the Conformer Convolution-Augmented Transformer model, to classify transmission line fault types. This model processes time series input data directly, eliminating the need for expert feature extraction. The training and validation datasets are generated through simulations conducted on a two-terminal transmission line, while testing is conducted on historical data consisting of 108 events that occurred in the Taiwan power system. Due to the limited availability of historical data, they are utilized solely for inference purposes. Our simulations are meticulously designed to encompass potential faults based on an analysis of historical data. A significant aspect of our investigation focuses on the impact of the sampling rate on input data, establishing that a rate of four samples per cycle is sufficient. This suggests that, for our specific classification tasks, relying on lower frequency data might be adequate, thereby challenging the conventional emphasis on high-frequency analysis. Eventually, our methodology achieves a validation accuracy of 100%, although the testing accuracy is lower at 88.88%. The discrepancy in testing accuracy can be attributed to the limited information and the small number of historical events, which pose challenges in bridging the gap between simulated data and real-world measurements. Furthermore, we benchmarked our method against the ELM model proposed in 2023, demonstrating significant improvements in testing accuracy.
Source: crossref · Quality: baseline

Research context

OpenAlex topics: Power Systems Fault Detection · Power Line Inspection Robots · Power Transformer Diagnostics and Insulation

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

Department of Electrical Engineering, National Taiwan University, Taipei 10617, Taiwan

Department of Electrical Engineering, National Taipei University of Technology, Taipei 10608, Taiwan

Nuclear Instrumentation Division, Institute of Nuclear Energy Research, Taoyuan 32546, Taiwan

Funding

National Atomic Research Institute

References (29)

Show source-provided references
1. A fault detection and classification technique based on sequential components10.1109/TIA.2014.2313652 ↗
2. Fault detection, classification and location for transmission lines and distribution systems: A review on the methods10.1049/hve.2016.0005 ↗
3. Goni, M.O.F., Nahiduzzaman, M., Anower, M.S., Rahman, M.M., Islam, M.R., Ahsan, M., Haider, J., and Shahjalal, M. (2023). Fast and accurate fault detection and classification in transmission lines using extreme learning machine. e-Prime-Adv. Electr. Eng. Electron. Energy, 3.10.1016/j.prime.2023.100107 ↗
4. Nandhini, K., and Prajith, C. (2023, January 19–21). Review on Fault Detection and Classification in Transmission Line using Machine Learning Methods. Proceedings of the 2023 International Conference on Control, Communication and Computing (ICCC), Thiruvananthapuram, India.10.1109/ICCC57789.2023.10164876 ↗
5. An Explainable and Robust Method for Fault Classification and Location on Transmission Lines10.1109/TII.2022.3229497 ↗
6. Advanced Fault Detection, Classification, and Localization in Transmission Lines: A Comparative Study of ANFIS, Neural Networks, and Hybrid Methods
7. Xi, Y., Li, M., Zhou, F., Tang, X., Li, Z., and Tian, J. (2023). SE-Inception-ResNet Model with Focal Loss for Transmission Line Fault Classification Under Class Imbalance. IEEE Trans. Instrum. Meas., 73.10.1109/TIM.2023.3342231 ↗
8. Deep-learning-based fault classification using Hilbert–Huang transform and convolutional neural network in power distribution systems10.1109/JSEN.2019.2913006 ↗
9. Mathematical morphology-based feature-extraction technique for detection and classification of faults on power transmission line10.1109/ACCESS.2020.2975431 ↗
10. Fahim, S.R., Sarker, Y., Sarker, S.K., Sheikh, M.R.I., and Das, S.K. (2020). Self attention convolutional neural network with time series imaging based feature extraction for transmission line fault detection and classification. Electr. Power Syst. Res., 187.10.1016/j.epsr.2020.106437 ↗
11. Belagoune, S., Bali, N., Bakdi, A., Baadji, B., and Atif, K. (2021). Deep learning through LSTM classification and regression for transmission line fault detection, diagnosis and location in large-scale multi-machine power systems. Measurement, 177.10.1016/j.measurement.2021.109330 ↗
12. Fault detection and classification in electrical power transmission system using artificial neural network10.1186/s40064-015-1080-x ↗
13. Multiwavelet packet entropy and its application in transmission line fault recognition and classification10.1109/TNNLS.2014.2303086 ↗
14. Moloi, K., Ntombela, M., Mosetlhe, T.C., Ayodele, T.R., and Yusuff, A.A. (2021, January 23–27). Feature extraction based technique for fault classification in power distribution system. Proceedings of the 2021 IEEE PES/IAS PowerAfrica, Virtual.10.1109/PowerAfrica52236.2021.9543314 ↗
15. Fault Identification, Classification, and Location on Transmission Lines Using Combined Machine Learning Methods10.46604/ijeti.2022.7571 ↗
16. Kumar, P., Bag, B., Londhe, N.D., and Tikariha, A. (2021, January 7–8). Classification and Analysis of Power System Faults in IEEE-14 Bus System using Machine learning Algorithm. Proceedings of the 2021 4th International Conference on Recent Developments in Control, Automation & Power Engineering (RDCAPE), Noida, India.10.1109/RDCAPE52977.2021.9633750 ↗
17. Short-Term Rainfall Prediction Using Supervised Machine Learning10.46604/aiti.2023.8364 ↗
18. The Performance of Machine Learning for Chronic Kidney Disease Diagnosis10.46604/emsi.2023.11285 ↗
19. A novel fault classification scheme for series capacitor compensated transmission line based on bagged tree ensemble classifier10.1109/ACCESS.2018.2836401 ↗
20. Shim, K., and Sung, W. (2022). A Comparison of Transformer, Convolutional, and Recurrent Neural Networks on Phoneme Recognition. arXiv.
21. Gulati, A., Qin, J., Chiu, C.-C., Parmar, N., Zhang, Y., Yu, J., Han, W., Wang, S., Zhang, Z., and Wu, Y. (2020). Conformer: Convolution-augmented transformer for speech recognition. arXiv.10.21437/Interspeech.2020-3015 ↗
22. A survey on intelligent system application to fault diagnosis in electric power system transmission lines10.1016/j.epsr.2016.02.002 ↗
23. SciPy 1.0: Fundamental algorithms for scientific computing in Python10.1038/s41592-019-0686-2 ↗
24. Vaswani, A., Shazeer, N., Parmar, N., Uszkoreit, J., Jones, L., Gomez, A.N., Kaiser, Ł., and Polosukhin, I. (2017). Attention is all you need. Adv. Neural Inf. Process. Syst. arXiv.
25. Bello, I., Zoph, B., Vaswani, A., Shlens, J., and Le, Q.V. (November, January 27). Attention augmented convolutional networks. Proceedings of the IEEE/CVF International Conference on Computer Vision, Seoul, Republic of Korea.
26. Ioffe, S., and Szegedy, C. (2015, January 7–9). Batch normalization: Accelerating deep network training by reducing internal covariate shift. Proceedings of the International Conference on Machine Learning, Lille, France.
27. Chowdhury, J. (2024, January 11). Sample-Rate Agnostic Recurrent Neural Network. Available online: https://jatinchowdhury18.medium.com/sample-rate-agnostic-recurrent-neural-networks-238731446b2.
28. Goyal, P., Dollár, P., Girshick, R., Noordhuis, P., Wesolowski, L., Kyrola, A., Tulloch, A., Jia, Y., and He, K. (2017). Accurate, large minibatch sgd: Training imagenet in 1 hour. arXiv.
29. Popel, M., and Bojar, O. (2018). Training tips for the transformer model. arXiv.10.2478/pralin-2018-0002 ↗