Abnormal Sound Detection of Wind Turbine Gearboxes Based on Improved MobileFaceNet and Feature Fusion
Source abstract
Abstract
To solve problems such as the unstable detection performance of the sound anomaly detection of wind turbine gearboxes when only normal data are used for training, and the poor detection performance caused by the poor classification of samples with high similarity, this paper proposes a self-supervised wind turbine gearbox sound anomaly detection algorithm that fuses time-domain features and Mel spectrograms, improves the MobileFaceNet (MFN) model, and combines the Gaussian Mixture Model (GMM). This method compensates for the abnormal information lost in Mel spectrogram features through feature fusion and introduces a style attention mechanism (SRM) in MFN to enhance the expression of features, improving the accuracy and stability of the abnormal sound detection model. For the wind turbine gearbox sound dataset of a certain wind farm in Guangyuan, the average AUC of the sound data at five measuring point positions of the wind turbine gearbox using the method proposed in this paper, STgram-MFN-SRM, reached 96.16%. Compared with the traditional anomaly detection methods LogMel-MFN, STgram-MFN, STgram-Resnet50, and STgram-MFN-SRM(CE), the average AUC of sound detection at the five measuring point positions increased by 5.19%, 4.73%, 11.06%, and 2.88%, respectively. Therefore, the method proposed in this paper effectively improves the performance of the sound anomaly detection model of wind turbine gearboxes and has important engineering value for the healthy operation and maintenance of wind turbines.
Source: crossref · Quality: baseline
Research context
OpenAlex topics: Music and Audio Processing · Speech and Audio Processing · Vehicle Noise and Vibration Control
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
Affiliations
School of Mechanical and Equipment Engineering, Hebei University of Engineering, Handan 056038, China
Key Laboratory of Intelligent Industrial Equipment Technology of Hebei Province, Hebei University of Engineering, Handan 056038, China
School of Computer Science and Information Technology, Dezhou University, Dezhou 253023, China
Funding
Science Research Project of Hebei Education Department
References (36)
Show source-provided references
1. Carbon emission efficiency of thermal power generation in China: Empirical evidence from the micro-perspective of power plants10.1016/j.enpol.2022.112955 ↗
2. The Multiplier Effect of Energy Capital and Technological Innovation
3. Environmental impacts and risk factors of renewable energy paradigm a review10.1007/s11356-020-09751-8 ↗
4. Sun, K., Xiao, H., Liu, S., You, S., Yang, F., Dong, Y., Wang, W., and Liu, Y. (2020). A review of clean electricity policies—From countries to utilities. Sustainability, 12.10.3390/su12197946 ↗
5. Wind energy state of the art: Present and future technology advancements10.1051/rees/2020003 ↗
6. Bearing monitoring in the wind turbine drivetrain: A comparative study of the FFT and wavelet transforms10.1002/we.2491 ↗
7. Wavelet Packet Decomposition-Based Multiscale CNN for Fault Diagnosis of Wind Turbine Gearbox10.1109/TCYB.2021.3123667 ↗
8. Wilkinghoff, K. (2021, January 18–22). Sub-cluster adacos: Learning representations for anomalous sound detection. Proceedings of the IEEE International Joint Conference on Neural Networks (IJCNN), New York, NY, USA.10.1109/IJCNN52387.2021.9534290 ↗
9. Mechanical fault detection based on machine learning for robotic RV reducer using electrical current signature analysis: A data-driven approach
10. Prognostic health management of the robotic strain wave gear reducer based on variable speed of operation: A data-driven via deep learning approach
11. Raouf, I., Kumar, P., Lee, H., and Kim, H.S. (2023). Transfer Learning-Based Intelligent Fault Detection Approach for the Industrial Robotic System. Mathematics, 11.10.3390/math11040945 ↗
12. Koizumi, Y., Kawaguchi, Y., Imoto, K., Nakamura, T., Nikaido, Y., and Tanabe, R. (2020). Description and Discussion on DCASE2020 Challenge Task2: Unsupervised Anomalous Sound Detection for Machine Condition Monitoring. arXiv.
13. Deep learning for anomaly detection: A review
14. Koizumi, Y., Saito, S., Uematsu, H., and Harada, N. (September, January 28). Optimizing acoustic feature extractor for anomalous sound detection based on neyman-pearson lemma. Proceedings of the European Signal Processing Conference (EUSIPCO), Kos, Greece.
15. Probabilistic novelty detection for acoustic surveillance under real-world conditions10.1109/TMM.2011.2122247 ↗
16. Multiclass fault diagnosis in gears using support vector machine algorithms based on frequency domain data10.1016/j.measurement.2013.05.015 ↗
17. Fault diagnosis of spur bevel gear box using artificial neural network (ANN), and proximal support vector machine (PSVM)10.1016/j.asoc.2009.08.006 ↗
18. Variational autoencoder-driven adversarial SVDD for power battery anomaly detection on real industrial data10.1016/j.est.2024.114267 ↗
19. Stacked sparse autoencoder-based deep network for fault diagnosis of rotating machinery10.1109/ACCESS.2017.2728010 ↗
20. Anomaly Detection Algorithm Based on Memory-Augmented Adversarial Autoencoder
21. Wilkinghoff, K. (2023). Self-Supervised Learning for Anomalous Sound Detection. arXiv.10.1109/ICASSP48485.2024.10447156 ↗
22. Dohi, K., Endo, T., Purohit, H., Tanabe, R., and Kawaguchi, Y. (2021, January 6–11). Flow-based self-supervised density estimation for anomalous sound detection. Proceedings of the International Conference on Acoustics, Speech and Signal Processing (ICASSP), Toronto, ON, Canada.10.1109/ICASSP39728.2021.9414662 ↗
23. Kingma, D.P., and Dhariwal, P. (2018). Glow: Generative flow with invertible 1 × 1 convolutions. arXiv.
24. A review of novelty detection10.1016/j.sigpro.2013.12.026 ↗
25. Piczak, K.J. (2015, January 17–20). Environmental sound classification with convolutional neural networks. Proceedings of the 2015 IEEE 25th International Workshop on Machine Learning for Signal Processing (MLSP), Boston, MA, USA.10.1109/MLSP.2015.7324337 ↗
26. Liu, Y., Guan, J., Zhu, Q., and Wang, W. (2022, January 7–13). Anomalous sound detection using spectral-temporal information fusion. Proceedings of the IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), Singapore.10.1109/ICASSP43922.2022.9747868 ↗
27. Unsupervised Detection of Anomalous Sound based on Deep Learning and the Neyman-Pearson Lemma10.1109/TASLP.2018.2877258 ↗
28. PANNs: Large-scale pretrained audio neural networks for audio pattern recognition10.1109/TASLP.2020.3030497 ↗
29. Howard, A.G., Zhu, M., Chen, B., Kalenichenko, D., Wang, W., Weyand, T., Andreetto, M., and Adam, H. (2017). MobileNets: Efficient Convolutional Neural Networks for Mobile Vision Applications. arXiv.
30. Sandler, M., Howard, A., Zhu, M., Zhmoginov, A., and Chen, L. (2018, January 18–22). MobileNetV2: Inverted Residuals and Linear Bottlenecks. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Salt Lake City, UT, USA.10.1109/CVPR.2018.00474 ↗
31. Chen, S., Liu, Y., Gao, X., and Zhen, H. (2018). MobileFaceNets: Efficient CNNs for Accurate Real Time Face Verification on Mobile Device. arXiv.10.1007/978-3-319-97909-0_46 ↗
32. Lee, H., Kim, H., and Nam, H. (November, January 27). SRM: A Style-Based Recalibration Module for Convolutional Neural Networks. Proceedings of the 2019 IEEE/CVF International Conference on Computer Vision (ICCV), Seoul, Republic of Korea.10.1109/ICCV.2019.00194 ↗
33. Chu, X., Zhang, B., and Xu, R. (2019). MoGA: Searching Beyond MobileNetV3. arXiv.10.1109/ICASSP40776.2020.9054428 ↗
34. Hu, J., Shen, L., Albanie, S., Sun, G., and Wu, E. (2017). Squeeze-and-excitation networks. arXiv.10.1109/CVPR.2018.00745 ↗
35. Liu, W., Wen, Y., Yu, Z., and Yang, M. (2016). Large-Margin Softmax Loss for Convolutional Neural Networks. arXiv.
36. Deng, J., Guo, J., Xue, N., Kotsia, L., and Zafeiriou, S. (2018). ArcFace: Additive Angular Margin Loss for Deep Face Recognition. arXiv.10.1109/CVPR.2019.00482 ↗