Spike-Driven Channel-Temporal Attention Network with Multi-Scale Convolution for Energy-Efficient Bearing Fault Detection
Source abstract
Abstract
Real-time bearing fault diagnosis necessitates highly accurate, computationally efficient, and energy-conserving models suitable for deployment on resource-constrained edge devices. To address these demanding requirements, we propose the Spike Convolutional Attention Network (SpikeCAN), a novel spike-driven neural architecture tailored explicitly for real-time industrial diagnostics. SpikeCAN utilizes the inherent sparsity and event-driven processing capabilities of spiking neural networks (SNNs), significantly minimizing both computational load and power consumption. The SpikeCAN integrates a multi-dilated receptive field (MDRF) block and a convolution-based spike attention module. The MDRF module effectively captures extensive temporal dependencies from signals across various scales. Simultaneously, the spike-based attention mechanism dynamically extracts spatial-temporal patterns, substantially improving diagnostic accuracy and reliability. We validate SpikeCAN on two public bearing fault datasets: the Case Western Reserve University (CWRU) and the Society for Machinery Failure Prevention Technology (MFPT). The proposed model achieves 99.86% accuracy on the four-class CWRU dataset through five-fold cross-validation and 99.88% accuracy with a conventional 70:30 train–test random split. For the more challenging ten-class classification task on the same dataset, it achieves 97.80% accuracy under five-fold cross-validation. Furthermore, SpikeCAN attains a state-of-the-art accuracy of 96.31% on the fifteen-class MFPT dataset, surpassing existing benchmarks. These findings underscore a significant advancement in fault diagnosis technology, demonstrating the considerable practical potential of spike-driven neural networks in real-time, energy-efficient industrial diagnostic applications.
Source: crossref · Quality: baseline
Research context
OpenAlex topics: Machine Fault Diagnosis Techniques · Fault Detection and Control Systems · Gear and Bearing Dynamics Analysis
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
Affiliations
Department of Applied Artificial Intelligence, Seoul National University of Science and Technology, 232 Gongneung-ro, Nowon-gu, Seoul 01811, Republic of Korea
Funding
Ministry of Science and ICT (MSIT) of the Korean government
References (47)
Show source-provided references
1. Operational reliability evaluation and prediction of rolling bearing based on isometric mapping and NoCuSa-LSSVM10.1016/j.ress.2020.106968 ↗
2. Zhou, Z., Ai, Q., Lou, P., Hu, J., and Yan, J. (2024). A Novel Method for Rolling Bearing Fault Diagnosis Based on Gramian Angular Field and CNN-ViT. Sensors, 24.10.3390/s24123967 ↗
3. Increased Efficiency Versus Increased Reliability10.1109/MIA.2007.909802 ↗
4. Condition Monitoring and Fault Diagnosis of Electrical Motors—A Review10.1109/TEC.2005.847955 ↗
5. Bearing Fault Diagnosis With Envelope Analysis and Machine Learning Approaches Using CWRU Dataset10.1109/ACCESS.2023.3283466 ↗
6. Huang, S., Tang, J., Dai, J., and Wang, Y. (2019). Signal Status Recognition Based on 1DCNN and Its Feature Extraction Mechanism Analysis. Sensors, 19.10.3390/s19092018 ↗
7. Neupane, D., Kim, Y., Seok, J., and Hong, J. (2021). CNN-Based Fault Detection for Smart Manufacturing. Appl. Sci., 11.10.3390/app112411732 ↗
8. Fault diagnosis of rotating machinery based on recurrent neural networks10.1016/j.measurement.2020.108774 ↗
9. Intelligent fault diagnosis of rolling bearings using an improved deep recurrent neural network10.1088/1361-6501/aab945 ↗
10. Vaswani, A., Shazeer, N., Parmar, N., Uszkoreit, J., Jones, L., Gomez, A.N., Kaiser, Ł., and Polosukhin, I. (2017, January 4–9). Attention is All You Need. Proceedings of the 31st Conference on Neural Information Processing Systems (NIPS 2017), Long Beach, CA, USA. Available online: https://proceedings.neurips.cc/paper_files/paper/2017/file/3f5ee243547dee91fbd053c1c4a845aa-Paper.pdf.
11. An interpretable hybrid framework combining convolution latent vectors with transformer based attention mechanism for rolling element fault detection and classification10.1016/j.heliyon.2024.e38993 ↗
12. Kitaev, N., Kaiser, L., and Levskaya, A. (2020, January 30). Reformer: The Efficient Transformer. Proceedings of the International Conference on Learning Representations (ICLR), Addis Ababa, Ethiopia. Available online: https://openreview.net/forum?id=rkgNKkHtvB.
13. Choromanski, K.M., Likhosherstov, V., Dohan, D., Song, X., Gane, A., Sarlos, T., Hawkins, P., Davis, J.Q., Mohiuddin, A., and Kaiser, L. (2021, January 4). Rethinking Attention with Performers. Proceedings of the International Conference on Learning Representations (ICLR), Vienna, Austria. Available online: https://openreview.net/forum?id=Ua6zuk0WRH.
14. Zaheer, M., Guruganesh, G., Dubey, K.A., Ainslie, J., Alberti, C., Ontanon, S., Pham, P., Ravula, A., Wang, Q., and Yang, L. (2020, January 6–12). Big Bird: Transformers for Longer Sequences. Proceedings of the 34th Conference on Neural Information Processing Systems (NeurIPS 2020), Vancouver, BC Canada. Available online: https://proceedings.neurips.cc/paper/2020/file/c8512d142a2d849725f31a9a7a361ab9-Paper.pdf.
15. Tay, Y., Bahri, D., Metzler, D., Juan, D.-C., Zhao, Z., and Zheng, C. (2020). Synthesizer: Rethinking Self-Attention in Transformer Models. arXiv.
16. EdgeCog: A Real-Time Bearing Fault Diagnosis System Based on Lightweight Edge Computing10.1109/TIM.2023.3298403 ↗
17. Networks of spiking neurons: The third generation of neural network models10.1016/S0893-6080(97)00011-7 ↗
18. Yao, M., Hu, J., Zhou, Z., Yuan, L., Tian, Y., XU, B., and Li, G. (2023, January 10–16). Spike-driven Transformer. Proceedings of the Thirty-seventh Conference on Neural Information Processing Systems (NeurIPS), New Orleans, LA, USA. Available online: https://openreview.net/forum?id=9FmolyOHi5.
19. Semenov, I., and Nikitin, D. (2023, January 27–28). Advantages and Disadvantages of Spiking Neural Networks Compared to Classical Artificial Neural Networks. Proceedings of the 2023 Seminar on Information Computing and Processing (ICP), Saint Petersburg, Russia.10.1109/ICP60417.2023.10397433 ↗
20. Zhang, H., Li, Y., He, B., Fan, X., Wang, Y., and Zhang, Y. (2023). Direct training high-performance spiking neural networks for object recognition and detection. Front. Neurosci., 17.10.3389/fnins.2023.1229951 ↗
21. Rate coding versus temporal order coding: A theoretical approach10.1016/S0303-2647(98)00050-1 ↗
22. Comsa, I.M., Potempa, K., Versari, L., Fischbacher, T., Gesmundo, A., and Alakuijala, J. (2020, January 4–8). Temporal Coding in Spiking Neural Networks with Alpha Synaptic Function. Proceedings of the ICASSP 2020—2020 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), Barcelona, Spain.10.1109/ICASSP40776.2020.9053856 ↗
23. Wu, Y., Deng, L., Li, G., Zhu, J., Xie, Y., and Shi, L. (February, January 27). Direct Training for Spiking Neural Networks: Faster, Larger, Better. Proceedings of the AAAI Conference on Artificial Intelligence, Honolulu, HI, USA.
24. Kim, Y., Park, H., Moitra, A., Bhattacharjee, A., Venkatesha, Y., and Panda, P. (2022, January 23–27). Rate Coding Or Direct Coding: Which One Is Better For Accurate, Robust, Furthermore, Energy-Efficient Spiking Neural Networks?. Proceedings of the ICASSP 2022—2022 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), Singapore.10.1109/ICASSP43922.2022.9747906 ↗
25. Surrogate Gradient Learning in Spiking Neural Networks: Bringing the Power of Gradient-based optimization to spiking neural networks10.1109/MSP.2019.2931595 ↗
26. Fang, W., Yu, Z., Chen, Y., Huang, T., Masquelier, T., and Tian, Y. (2021, January 6–14). Deep Residual Learning in Spiking Neural Networks. Proceedings of the NeurIPS 2021, Virtual. Available online: https://proceedings.neurips.cc/paper_files/paper/2021/file/afe434653a898da20044041262b3ac74-Paper.pdf.
27. Zhou, Z., Zhu, Y., He, C., Wang, Y., Yan, S., Tian, Y., and Yuan, L. (2023, January 1–5). Spikformer: When Spiking Neural Network Meets Transformer. Proceedings of the Eleventh International Conference on Learning Representations (ICLR), Kigali, Rwanda. Available online: https://openreview.net/forum?id=frE4fUwz_h.
28. Shi, X., Hao, Z., and Yu, Z. (2024, January 13–19). SpikingResformer: Bridging ResNet and Vision Transformer in Spiking Neural Networks. Proceedings of the 2024 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), Seattle, WA, USA.10.1109/CVPR52733.2024.00536 ↗
29. Rolling element bearing diagnostics using the Case Western Reserve University data: A benchmark study10.1016/j.ymssp.2015.04.021 ↗
30. (2025, February 01). Machinery Failure Prevention Technology (MFPT). Available online: https://mfpt.org/fault-data-sets.
31. Fang, W., Yu, Z., Chen, Y., Masquelier, T., Huang, T., and Tian, Y. (2021, January 11–17). Incorporating learnable membrane time constant to enhance learning of spiking neural networks. Proceedings of the 2021 IEEE/CVF International Conference on Computer Vision (ICCV), Montreal, BC, Canada. Available online: https://api.semanticscholar.org/CorpusID:226976144.10.1109/ICCV48922.2021.00266 ↗
32. Bu, T., Fang, W., Ding, J., Dai, P., Yu, Z., and Huang, T. (2022, January 25–29). Optimal ANN-SNN Conversion for High-accuracy and Ultra-low-latency Spiking Neural Networks. Proceedings of the International Conference on Learning Representations (ICLR), Virtual. Available online: https://openreview.net/forum?id=7B3IJMM1k_M.
33. A brain-inspired spiking neural network model with temporal encoding and learning10.1016/j.neucom.2013.06.052 ↗
34. A multi-layer spiking neural network-based approach to bearing fault diagnosis10.1016/j.ress.2022.108561 ↗
35. A spiking neural network-based approach to bearing fault diagnosis10.1016/j.jmsy.2020.07.003 ↗
36. Woo, S., Park, J., Lee, J.-Y., and Kweon, I.S. (2018, January 8–14). CBAM: Convolutional Block Attention Module. Proceedings of the European Conference on Computer Vision (ECCV), Munich, Germany.10.1007/978-3-030-01234-2_1 ↗
37. Two-stage edge-side fault diagnosis method based on double knowledge distillation
38. He, K., Zhang, X., Ren, S., and Sun, J. (2016, January 27–30). Deep Residual Learning for Image Recognition. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Las Vegas, NV, USA. Available online: https://openaccess.thecvf.com/content_cvpr_2016/html/He_Deep_Residual_Learning_CVPR_2016_paper.html.10.1109/CVPR.2016.90 ↗
39. Sengupta, A., Ye, Y., Wang, R., Liu, C., and Roy, K. (2019). Going Deeper in Spiking Neural Networks: VGG and Residual Architectures. Front. Neurosci., 13.10.3389/fnins.2019.00095 ↗
40. Modified multiscale weighted permutation entropy and optimized support vector machine method for rolling bearing fault diagnosis with complex signals10.1016/j.isatra.2020.12.054 ↗
41. Roller element bearing fault diagnosis using singular spectrum analysis10.1016/j.ymssp.2012.08.019 ↗
42. LiftingNet: A Novel Deep Learning Network With Layerwise Feature Learning From Noisy Mechanical Data for Fault Classification10.1109/TIE.2017.2767540 ↗
43. Convolutional neural network-based hidden Markov models for rolling element bearing fault identification10.1016/j.knosys.2017.12.027 ↗
44. Li, H., Huang, J., and Ji, S. (2019). Bearing Fault Diagnosis with a Feature Fusion Method Based on an Ensemble Convolutional Neural Network and Deep Neural Network. Sensors, 19.10.3390/s19092034 ↗
45. Han, K., Wang, W., and Guo, J. (2024). Research on a Bearing Fault Diagnosis Method Based on a CNN-LSTM-GRU Model. Machines, 12.10.3390/machines12120927 ↗
46. FaultNet: A Deep Convolutional Neural Network for Bearing Fault Classification10.1109/ACCESS.2021.3056944 ↗
47. van den Hoogen, J., Bloemheuvel, S., and Atzmueller, M. (2021). Classifying Multivariate Signals in Rolling Bearing Fault Detection Using Adaptive Wide-Kernel CNNs. Appl. Sci., 11.10.3390/app112311429 ↗