The Lightweight Edge-Side Fault Diagnosis Approach Based on Spiking Neural Network
Source abstract
Abstract
Network fault diagnosis methods play a vital role in maintaining network service quality and enhancing user experience as an integral component of intelligent network management. Considering the unique characteristics of edge networks, such as limited resources, complex network faults, and the need for high real-time performance, enhancing and optimizing existing network fault diagnosis methods is necessary. Therefore, this paper proposes the lightweight edge-side fault diagnosis approach based on a spiking neural network (LSNN). Firstly, we use the Izhikevich neurons model to replace the Leaky Integrate and Fire (LIF) neurons model in the LSNN model. Izhikevich neurons inherit the simplicity of LIF neurons but also possess richer behavioral characteristics and flexibility to handle diverse data inputs. Inspired by Fast Spiking Interneurons (FSIs) with a high-frequency firing pattern, we use the parameters of FSIs. Secondly, inspired by the connection mode based on spiking dynamics in the basal ganglia (BG) area of the brain, we propose the pruning approach based on the FSIs of the BG in LSNN to improve computational efficiency and reduce the demand for computing resources and energy consumption. Furthermore, we propose a multiple iterative Dynamic Spike Timing Dependent Plasticity (DSTDP) algorithm to enhance the accuracy of the LSNN model. Experiments on two server fault datasets demonstrate significant precision, recall, and F1 improvements across three diagnosis dimensions. Simultaneously, lightweight indicators such as Params and FLOPs significantly reduced, showcasing the LSNN’s advanced performance and model efficiency. To conclude, experiment results on a pair of datasets indicate that the LSNN model surpasses traditional models and achieves cutting-edge outcomes in network fault diagnosis tasks.
Source: openalex_inverted_index · Quality: baseline
Research context
OpenAlex topics: Fault Detection and Control Systems · Machine Fault Diagnosis Techniques · Engineering and Test Systems
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
References (44)
Show source-provided references
1. Application-driven network-aware digital twin management in industrial edge environments10.1109/TII.2021.3067447 ↗
2. A new convolutional neural network-based data-driven fault diagnosis method10.1109/TIE.2017.2774777 ↗
3. Industrial internet of things: Challenges, opportunities, and directions10.1109/TII.2018.2852491 ↗
4. Learning attention representation with a multi-scale CNN for gear fault diagnosis under different working conditions10.3390/s20041233 ↗
5. A spiking neural network-based approach to bearing fault diagnosis10.1016/j.jmsy.2020.07.003 ↗
6. Edgenilm: Towards nilm on edge devices
7. Applications of machine learning to machine fault diagnosis: A review and roadmap10.1016/j.ymssp.2019.106587 ↗
8. A rule-based intelligent method for fault diagnosis of rotating machinery10.1016/j.knosys.2012.05.013 ↗
9. Statistical spectral analysis for fault diagnosis of rotating machines10.1109/TIE.2017.2762623 ↗
10. Industrial big data for fault diagnosis: Taxonomy, review, and applications10.1109/ACCESS.2017.2731945 ↗
11. Online fault diagnosis for industrial processes with Bayesian network-based probabilistic ensemble learning strategy10.1109/TASE.2019.2915286 ↗
12. Fault diagnosis based on cluster analysis theory in wide area backup protection system
13. Data-driven and association rule mining-based fault diagnosis and action mechanism analysis for building chillers10.1016/j.enbuild.2020.109957 ↗
14. Recent advances on SVM based fault diagnosis and process monitoring in complicated industrial processes10.1016/j.neucom.2015.09.081 ↗
15. Deep learning10.1038/nature14539 ↗
16. Wind turbine fault diagnosis based on ReliefF-PCA and DNN10.1016/j.eswa.2021.115016 ↗
17. Fault diagnosis based on RseNet-LSTM for industrial process
18. Fault diagnosis of rolling bearings with recurrent neural network-based autoencoders10.1016/j.isatra.2018.04.005 ↗
19. A novel gas turbine fault diagnosis method based on transfer learning with CNN10.1016/j.measurement.2019.01.022 ↗
20. Triplet metric driven multi-head GNN augmented with decoupling adversarial learning for intelligent fault diagnosis of machines under varying working condition10.1016/j.jmsy.2021.10.014 ↗
21. An improved bearing fault diagnosis method using one-dimensional CNN and LSTM
22. Interaction-aware graph neural networks for fault diagnosis of complex industrial processes10.1109/TNNLS.2021.3132376 ↗
23. Leveraging pre-trained checkpoints for sequence generation tasks10.1162/tacl_a_00313 ↗
24. M. Reid, E. Marrese-Taylor, and Y. Matsuo, “Subformer: Exploring weight sharing for parameter efficiency in generative transformers,” arXiv preprint arXiv:2101.00234, 2021.10.18653/v1/2021.findings-emnlp.344 ↗
25. S. Takase and S. Kiyono, “Lessons on parameter sharing across layers in transformers,” arXiv preprint arXiv:2104.06022, 2021.
26. M. S. Zhang and B. C. Stadie, “One-shot pruning of recurrent neural networks by Jacobian spectrum evaluation,” arXiv preprint arXiv:1912.00120, 2020.
27. Y. Wang, L. Wang, V. O. K. Li, and Z. Tu, “On the sparsity of neural machine translation models,” arXiv preprint arXiv:2010.02646, 2010.
28. D. Guo, A. M. Rush, and Y. Kim, “Parameter-efficient transfer learning with diff pruning,” arXiv preprint arXiv:2012.07463, 2020.10.18653/v1/2021.acl-long.378 ↗
29. F. Lagunas, E. Charlaix, V. Sanh, and A. M. Rush, “Block pruning for faster transformers,” arXiv preprint arXiv:2109.04838, 2021.10.18653/v1/2021.emnlp-main.829 ↗
30. M. Xia, Z. Zhong, and D. Chen, “Structured pruning learns compact and accurate models,” arXiv preprint arXiv:2204.00408, 2022.10.18653/v1/2022.acl-long.107 ↗
31. Necessary conditions for STDP-based pattern recognition learning in a memristive spiking neural network10.1016/j.neunet.2020.11.005 ↗
32. A biologically plausible supervised learning method for spiking neural networks using the symmetric STDP rule10.1016/j.neunet.2019.09.007 ↗
33. Area-and energy-efficient STDP learning algorithm for spiking neural network SoC10.1109/ACCESS.2020.3041946 ↗
34. Computing with the leaky integrate-and-fire neuron: Logarithmic computation and multiplication10.1162/neco.1997.9.2.305 ↗
35. Simple model of spiking neurons10.1109/TNN.2003.820440 ↗
36. A quantitative description of membrane current and its application to conduction and excitation in nerve10.1113/jphysiol.1952.sp004764 ↗
37. Oscillation dynamics in an extended model of thalamic-basal ganglia10.1007/s11071-019-05249-2 ↗
38. The basal ganglia and the cerebellum: Nodes in an integrated network10.1038/s41583-018-0002-7 ↗
39. Competitive STDP-based spike pattern learning10.1162/neco.2008.06-08-804 ↗
40. Robust anomaly detection for multivariate time series through stochastic recurrent neural network
41. Multivariate time series anomaly detection and interpretation using hierarchical inter-metric and temporal embedding
42. Practical approach to asynchronous multivariate time series anomaly detection and localization
43. MAD-GAN: Multivariate anomaly detection for time series data with generative adversarial networks
44. Y. Ikeda, K. Tajiri, Y. Nakano, K. Watanabe, and K. Ishibashi, “Estimation of dimensions contributing to detected anomalies with variational autoencoders,” arXiv preprint arXiv:1811.04576, 2018.