Feature Mining and Sensitivity Analysis with Adaptive Sparse Attention for Bearing Fault Diagnosis
Source abstract
Abstract
Bearing fault diagnosis for equipment-safe operation has a crucial role. In recent years, more achievements have been made in bearing fault diagnosis. However, for the fault diagnosis model, the representation and sensitivity of bearing fault features have a great influence on the diagnosis output results; thus, the attention mechanism is particularly important for the selection of features. However, global attention focuses on all sequences, which is computationally expensive and not ideal for fault diagnosis tasks. The local attention mechanism ignores the relationship between non-adjacent sequences. To address the respective shortcomings of global attention and local attention, an adaptive sparse attention network is proposed in this paper to filter fault-sensitive information by soft threshold filtering. In addition, the effects of different signal representation domains on fault diagnosis results are investigated to filter out signal representation forms with better performance. Finally, the proposed adaptive sparse attention network is applied to cross-working conditions diagnosis of bearings. The adaptive sparse attention mechanism focuses on the signal characteristics of different frequency bands for different fault types. The proposed network model achieves better overall performance when comparing the cross-conditions diagnosis accuracy and model convergence speed.
Source: crossref · Quality: baseline
Research context
OpenAlex topics: Machine Fault Diagnosis Techniques · Gear and Bearing Dynamics Analysis · Engineering Diagnostics and Reliability
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
Affiliations
China Nuclear Power Operation Technology Co., Ltd., Wuhan 430223, China
Key Lab of Engine Health Monitoring-Control and Networking of Ministry of Education, Beijing University of Chemical Technology, Beijing 100013, China
Funding
National Natural Science Foundation of China
References (40)
Show source-provided references
1. Extraction and enhancement of unknown bearing fault feature in the strong noise under variable speed condition10.1088/1361-6501/ac0d78 ↗
2. A wasserstein gradient-penalty generative adversarial network with deep auto-encoder for bearing intelligent fault diagnosis10.1088/1361-6501/ab47df ↗
3. Sparsity-based fractional spline wavelet denoising via overlapping group shrinkage with non-convex regularization and convex optimization for bearing fault diagnosis10.1088/1361-6501/ab62c8 ↗
4. Tacholess bearing fault detection based on adaptive impulse extraction in the time domain under fluctuant speed10.1088/1361-6501/ab7dec ↗
5. Sparse representations for fault signatures via hybrid regularization in adaptive undecimated fractional spline wavelet transform domain10.1088/1361-6501/abd11d ↗
6. A time–frequency-based maximum correlated kurtosis deconvolution approach for detecting bearing faults under variable speed conditions10.1088/1361-6501/ab3678 ↗
7. An integrated health condition detection method for rolling bearings using time-shift multi-scale amplitude-aware permutation entropy and uniform phase empirical mode decomposition10.1088/1361-6501/ac1edf ↗
8. Rolling bearing transfer fault diagnosis method based on adversarial variational autoencoder network10.1088/1361-6501/ac1461 ↗
9. Sun, W., Yao, B., Zeng, N., Chen, B., He, Y., Cao, X., and He, W. (2017). An intelligent gear fault diagnosis methodology using a complex wavelet enhanced convolutional neural network. Materials, 10.10.3390/ma10070790 ↗
10. A generic intelligent bearing fault diagnosis system using compact adaptive 1d cnn classifier10.1007/s11265-018-1378-3 ↗
11. Sohaib, M., Kim, C.-H., and Kim, J.-M. (2017). A hybrid feature model and deep-learning-based bearing fault diagnosis. Sensors, 17.10.3390/s17122876 ↗
12. Iannace, G., Ciaburro, G., and Trematerra, A. (2019). Fault diagnosis for uav blades using artificial neural network. Robotics, 8.10.3390/robotics8030059 ↗
13. A spiking neural network-based approach to bearing fault diagnosis10.1016/j.jmsy.2020.07.003 ↗
14. A new convolutional neural network-based data-driven fault diagnosis method10.1109/TIE.2017.2774777 ↗
15. The mythos of model interpretability: In machine learning, the concept of interpretability is both important and slippery10.1145/3236386.3241340 ↗
16. Language. Combining context-relevant features with multi-stage attention network for short text classification10.1016/j.csl.2021.101268 ↗
17. Chan, W., Jaitly, N., Le, Q., and Vinyals, O. (2016, January 20–25). In Listen, attend and spell: A neural network for large vocabulary conversational speech recognition. Proceedings of the IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), Shanghai, China.10.1109/ICASSP.2016.7472621 ↗
18. Yang, Z., Yang, D., Dyer, C., He, X., Smola, A., and Hovy, E. (2016, January 12–17). Hierarchical attention networks for document classification. Proceedings of the Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, San Diego, CA, USA.10.18653/v1/N16-1174 ↗
19. Lstm: A search space odyssey10.1109/TNNLS.2016.2582924 ↗
20. Interpreting network knowledge with attention mechanism for bearing fault diagnosis10.1016/j.asoc.2020.106829 ↗
21. Xu, K., Ba, J., Kiros, R., Cho, K., Courville, A., Salakhudinov, R., Zemel, R., and Bengio, Y. (2015, January 6–11). Show, attend and tell: Neural image caption generation with visual attention. Proceedings of the International Conference on Machine Learning, Lille, France.
22. Attention is all you need
23. Luong, M.-T., Pham, H., and Manning, C.D. (2015). Effective approaches to attention-based neural machine translation. arXiv.10.18653/v1/D15-1166 ↗
24. Xue, L., Li, X., and Zhang, N.L. (2020, January 7–12). Not all attention is needed: Gated attention network for sequence data. Proceedings of the AAAI Conference on Artificial Intelligence, New York, NY, USA.10.1609/aaai.v34i04.6129 ↗
25. Deep residual shrinkage networks for fault diagnosis10.1109/TII.2019.2943898 ↗
26. Hierarchical adaptive deep convolution neural network and its application to bearing fault diagnosis10.1016/j.measurement.2016.07.054 ↗
27. Convolutional discriminative feature learning for induction motor fault diagnosis10.1109/TII.2017.2672988 ↗
28. Deep learning-based remaining useful life estimation of bearings using multi-scale feature extraction10.1016/j.ress.2018.11.011 ↗
29. Ciaburro, G., and Iannace, G. (2020). Improving smart cities safety using sound events detection based on deep neural network algorithms. Informatics, 7.10.3390/informatics7030023 ↗
30. A method for improving cnn-based image recognition using dcgan
31. Ambrożkiewicz, B., Litak, G., Georgiadis, A., Meier, N., and Gassner, A. (2021). Analysis of dynamic response of a two degrees of freedom (2-dof) ball bearing nonlinear model. Appl. Sci., 11.10.3390/app11020787 ↗
32. Detection of cylinder misfire in an aircraft engine using linear and non-linear signal analysis10.1016/j.measurement.2021.108982 ↗
33. Zaremba, W., Sutskever, I., and Vinyals, O. (2014). Recurrent neural network regularization. arXiv.
34. Graves, A. (2013). Generating sequences with recurrent neural networks. arXiv.10.1007/978-3-642-24797-2_3 ↗
35. An intelligent fault diagnosis method using unsupervised feature learning towards mechanical big data10.1109/TIE.2016.2519325 ↗
36. A sparse auto-encoder-based deep neural network approach for induction motor faults classification10.1016/j.measurement.2016.04.007 ↗
37. Zhu, H., Rui, T., Wang, X., Zhou, Y., and Fang, H. (2015, January 16–18). Fault diagnosis of hydraulic pump based on stacked autoencoders. Proceedings of the 2015 12th IEEE International Conference on Electronic Measurement & Instruments (ICEMI), Qingdao, China.
38. Hinton, G., Vinyals, O., and Dean, J. (2015). Distilling the knowledge in a neural network. arXiv.
39. Rolling element bearing diagnostics using the case western reserve university data: A benchmark study10.1016/j.ymssp.2015.04.021 ↗
40. Understanding and improving deep learning-based rolling bearing fault diagnosis with attention mechanism10.1016/j.sigpro.2019.03.019 ↗