journal article·2023-05-04Open access

An Interpretable Deep Learning Method for Identifying Extreme Events under Faulty Data Interference

Jiaxing Guo, Zhiyi Tang, Changxing Zhang, Wei Xu, Yonghong Wu

Applied Sciences· Volume 13· Issue 9

Abstract

Structural health monitoring systems continuously monitor the operational state of structures, generating a large amount of monitoring data during the process. The structural responses of extreme events, such as earthquakes, ship collisions, or typhoons, could be captured and further analyzed. However, it is challenging to identify these extreme events due to the interference of faulty data. Real-world monitoring systems suffer from frequent misidentification and false alarms. Unfortunately, it is difficult to improve the system’s built-in algorithms, especially the deep neural networks, partly because the current neural networks only output results and do not provide an interpretable decision-making basis. In this study, a deep learning-based method with visual interpretability is proposed to identify seismic data under sensor faults interference. The transfer learning technique is employed to learn the features of seismic data and faulty data with efficiency. A post hoc interpretation algorithm, termed Gradient-weighted Class Activation Mapping (Grad-CAM), is embedded into the neural networks to uncover the interest regions that support the output decision. The in situ seismic responses of a cable-stayed long-span bridge are used for method verification. The results show that the proposed method can effectively identify seismic data mixed with various types of faulty data while providing good interpretability.
Source: crossref · Quality: baseline

Research context

OpenAlex topics: Structural Health Monitoring Techniques · Infrastructure Maintenance and Monitoring · Anomaly Detection Techniques and Applications

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

Faculty of Civil Engineering and Mechanics, Kunming University of Science and Technology, Kunming 650500, China

Intelligent Infrastructure Operation and Maintenance Technology Innovation Team of Yunnan Provincial Department of Education, Kunming University of Science and Technology, Kunming 650500, China

Funding

Yunnan Fundamental Research Projects · Fund for Less Developed Regions of the National Natural Science Foundation of China

References (42)

Show source-provided references
1. A Literature Review of Next-generation Smart Sensing Technology in Structural Health Monitoring10.1002/stc.2321 ↗
2. Wireless Sensor Network for Structural Health Monitoring: A Contemporary Review of Technologies, Challenges, and Future Direction10.1177/1475921719854528 ↗
3. Mei, H., Haider, M., Joseph, R., Migot, A., and Giurgiutiu, V. (2019). Recent Advances in Piezoelectric Wafer Active Sensors for Structural Health Monitoring Applications. Sensors, 19.10.3390/s19020383 ↗
4. The State of the Art of Data Science and Engineering in Structural Health Monitoring10.1016/j.eng.2018.11.027 ↗
5. Modeling, Detection, and Disambiguation of Sensor Faults for Aerospace Applications10.1109/JSEN.2009.2030284 ↗
6. Computer Vision and Deep Learning–Based Data Anomaly Detection Method for Structural Health Monitoring10.1177/1475921718757405 ↗
7. Convolutional Neural Network-Based Data Anomaly Detection Method Using Multiple Information for Structural Health Monitoring10.1002/stc.2296 ↗
8. Fault Diagnosis Based on Extremely Randomized Trees in Wireless Sensor Networks10.1016/j.ress.2020.107284 ↗
9. Decentralized Fault Detection and Isolation in Wireless Structural Health Monitoring Systems Using Analytical Redundancy10.1016/j.advengsoft.2014.02.005 ↗
10. A Distributed Sensor-Fault Detection and Diagnosis Framework Using Machine Learning10.1016/j.ins.2020.08.068 ↗
11. Condition Assessment of Cables by Pattern Recognition of Vehicle-Induced Cable Tension Ratio10.1016/j.engstruct.2017.09.063 ↗
12. Toward Data Anomaly Detection for Automated Structural Health Monitoring: Exploiting Generative Adversarial Nets and Autoencoders10.1177/1475921720924601 ↗
13. Utilization of Structural Health Monitoring in Long-Span Bridges: Case Studies10.1002/stc.1979 ↗
14. A Data-Driven Approach for Ship-Bridge Collision Candidate Detection in Bridge Waterway10.1016/j.oceaneng.2022.113137 ↗
15. Long Short-Term Memory (LSTM)-Based Wind Speed Prediction during a Typhoon for Bridge Traffic Control10.1016/j.jweia.2021.104788 ↗
16. Automatic Picking of P and S Phases Using a Neural Tree10.1007/s10950-006-2296-6 ↗
17. Convolutional Neural Network for Earthquake Detection and Location10.1126/sciadv.1700578 ↗
18. Generalized Seismic Phase Detection with Deep Learning10.1785/0120180080 ↗
19. Anomaly Detection of Sensor Faults and Extreme Events Based on Support Vector Data Description10.1002/stc.3047 ↗
20. Structural Damage Identification Using Ensemble Deep Convolutional Neural Network Models
21. Barkhordari, M.S., Barkhordari, M.M., Armaghani, D.J., Rashid, A.S.A., and Ulrikh, D.V. (2022). Hybrid Wavelet Scattering Network-Based Model for Failure Identification of Reinforced Concrete Members. Sustainability, 14.10.3390/su141912041 ↗
22. Explainable Artificial Intelligence (XAI): Concepts, Taxonomies, Opportunities and Challenges toward Responsible AI10.1016/j.inffus.2019.12.012 ↗
23. Xu, K., Liu, S., Zhang, G., Sun, M., Zhao, P., Fan, Q., Gan, C., and Lin, X. (2019). Interpreting Adversarial Examples by Activation Promotion and Suppression. arXiv.
24. Grad-CAM: Visual Explanations from Deep Networks via Gradient-Based Localization10.1007/s11263-019-01228-7 ↗
25. Dosovitskiy, A., and Brox, T. (2016, January 27–30). Inverting Visual Representations with Convolutional Networks. Proceedings of the 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Las Vegas, NV, USA.10.1109/CVPR.2016.522 ↗
26. A Deep Learning and Grad-CAM Based Color Visualization Approach for Fast Detection of COVID-19 Cases Using Chest X-Ray and CT-Scan Images10.1016/j.chaos.2020.110190 ↗
27. FCSNet: A Quantitative Explanation Method for Surface Scratch Defects during Belt Grinding Based on Deep Learning10.1016/j.compind.2022.103793 ↗
28. Vibration-based Structural State Identification by a 1-dimensional Convolutional Neural Network10.1111/mice.12447 ↗
29. CNN-LSTM Deep Learning Architecture for Computer Vision-Based Modal Frequency Detection10.1016/j.ymssp.2020.106885 ↗
30. Multi-Head CNN–RNN for Multi-Time Series Anomaly Detection: An Industrial Case Study10.1016/j.neucom.2019.07.034 ↗
31. He, K., Zhang, X., Ren, S., and Sun, J. (2015, January 7–13). Delving Deep into Rectifiers: Surpassing Human-Level Performance on ImageNet Classification. Proceedings of the 2015 IEEE International Conference on Computer Vision (ICCV), Santiago, Chile.10.1109/ICCV.2015.123 ↗
32. Liu, L., Liu, X., Gao, J., Chen, W., and Han, J. (2020). Understanding the Difficulty of Training Transformers. arXiv.10.18653/v1/2020.emnlp-main.463 ↗
33. Gradient Amplification: An Efficient Way to Train Deep Neural Networks10.26599/BDMA.2020.9020004 ↗
34. He, K., Zhang, X., Ren, S., and Sun, J. (2016, January 27–30). Deep Residual Learning for Image Recognition. Proceedings of the 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Las Vegas, NV, USA.10.1109/CVPR.2016.90 ↗
35. Zhuang, F., Qi, Z., Duan, K., Xi, D., Zhu, Y., Zhu, H., Xiong, H., and He, Q. (2020). A Comprehensive Survey on Transfer Learning. arXiv.10.1109/JPROC.2020.3004555 ↗
36. A Survey on Transfer Learning10.1109/TKDE.2009.191 ↗
37. Attribute-Based Structural Damage Identification by Few-Shot Meta Learning with Inter-Class Knowledge Transfer10.1177/1475921720921135 ↗
38. Improving EEG-Based Emotion Classification Using Conditional Transfer Learning10.3389/fnhum.2017.00334 ↗
39. Convolutional Neural Network-Based Data Anomaly Detection Considering Class Imbalance with Limited Data
40. Convolutional Neural Networks for Medical Image Analysis: Full Training or Fine Tuning?10.1109/TMI.2016.2535302 ↗
41. Zhou, B., Khosla, A., Lapedriza, A., Oliva, A., and Torralba, A. (2016, January 27–30). Learning Deep Features for Discriminative Localization. Proceedings of the 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Las Vegas, NV, USA.10.1109/CVPR.2016.319 ↗
42. Seismic Response Analyses of the Yokohama Bay Cable-Stayed Bridge in the 2011 Great East Japan Earthquake10.1061/(ASCE)BE.1943-5592.0000508 ↗