journal article·2022-11-10Open access

Multi-View Information Fusion Fault Diagnosis Method Based on Attention Mechanism and Convolutional Neural Network

Hongmei Li, Jinying Huang, Minjuan Gao, Luxia Yang, Yichen Bao

Applied Sciences· Volume 12· Issue 22

Abstract

Multi-view information fusion can provide more accurate, complete and reliable data descriptions for monitoring objects, effectively improve the limitations and unreliability of single-view data. Existing multi-view information fusion based on deep learning mostly focuses on the feature level and decision level, with large information loss, and does not distinguish the view weight in the fusion process. To this end, a multi-view data level information fusion model CAM_MCFCNN with view weight was proposed based on a channel attention mechanism and convolutional neural network. The model used the channel characteristics to implement multi-view information fusion at the data level stage, which made the fusion position and mode more natural and reduced the loss of information. A multi-channel fusion convolutional neural network was used for feature learning. In addition, the channel attention mechanism was used to learn the view weight, so that the algorithm could pay more attention to the views that contribute more to the fault identification task during the training process, and more reasonably integrate the information of different views. The proposed method was verified by the data of the planetary gearbox experimental platform. The multi-view data and single-view data were used as the input of the CAM_MCFCNN model and single-channel CNN model respectively for comparison. The average accuracy of CAM_MCFCNN on three constant-speed datasets reached 99.95%, 99.87% and 99.92%, which was an improvement of 0.95%, 2.25%, and 0.04%, compared with the single view with the highest diagnostic accuracy, respectively. When facing limited samples, CAM_MCFCNN had similar performance. Finally, compared with different multi-view information fusion algorithms, CAM_MCFCNN showed better stability and higher accuracy. The experimental results showed that the proposed method had better performance, higher diagnostic accuracy and was more reliable, compared with other methods.
Source: crossref · Quality: baseline

Research context

OpenAlex topics: Fault Detection and Control Systems · Anomaly Detection Techniques and Applications · Machine Fault Diagnosis Techniques

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

College of Computer Science and Technology, Taiyuan Normal University, Jinzhong 030619, China

School of Mechanical Engineering, North University of China, Taiyuan 030051, China

School of Computer Science and Engineering, South China University of Technology, Guangzhou 510006, China

Funding

Scientific and Technological Innovation Programs of Higher Education Institutions in Shanxi · Key R and D program of Shanxi Province · Natural Science Foundation of Shanxi Province · Shanxi Scholarship Council of China · Fundamental Research Program of Shanxi Province

References (25)

Show source-provided references
1. Data fusion and machine learning for industrial prognosis: Trends and perspectives towards Industry 4.010.1016/j.inffus.2018.10.005 ↗
2. Deep Ensemble Capsule Network for Intelligent Compound Fault Diagnosis Using Multisensory Data10.1109/TIM.2019.2958010 ↗
3. Xu, C., Guan, Z., Zhao, W., Niu, Y., Wang, Q., and Wang, Z. (2018, January 9–19). Deep Multi-View Concept Learning. Proceedings of the Twenty-Seventh International Joint Conference on Artificial Intelligence IJCAI-18, Stockholm, Sweden.10.24963/ijcai.2018/402 ↗
4. Xu, C., Tao, D., and Xu, C. (2013). A Survey on Multi-view Learning. arxiv.
5. A novel approach of multisensory fusion to collaborative fault diagnosis in maintenance10.1016/j.inffus.2021.03.008 ↗
6. Multi-Attentive Hierarchical Dense Fusion Net for Fusion Classification of Hyperspectral and LiDAR Data10.1016/j.inffus.2021.12.008 ↗
7. A data-level fusion approach for degradation modeling and prognostic analysis under multiple failure modes10.1080/00224065.2018.1436829 ↗
8. Motor fault diagnosis using attention mechanism and improved adaboost driven by multi-sensor information10.1016/j.measurement.2020.108718 ↗
9. Mechanical fault diagnosis and prediction in IoT based on multi-source sensing data fusion10.1016/j.simpat.2019.101981 ↗
10. Jing, L., Wang, T., Zhao, M., and Wang, P. (2017). An Adaptive Multi-Sensor Data Fusion Method Based on Deep Convolutional Neural Networks for Fault Diagnosis of Planetary Gearbox. Sensors, 17.10.3390/s17020414 ↗
11. Fault Diagnosis for Rotating Machinery Using Multiple Sensors and Convolutional Neural Networks10.1109/TMECH.2017.2728371 ↗
12. Multisensor data fusion for gearbox fault diagnosis using 2-D convolutional neural network and motor current signature analysis10.1016/j.ymssp.2020.106861 ↗
13. Multisensor feature fusion for bearing fault diagnosis using sparse autoencoder and deep belief network10.1109/TIM.2017.2669947 ↗
14. DCNN-Based Multi-Signal Induction Motor Fault Diagnosis10.1109/TIM.2019.2925247 ↗
15. Fault Diagnosis for Rotating Machinery Based on Convolutional Neural Network and Empirical Mode Decomposition
16. Li, H., Huang, J., and Ji, S. (2019). Bearing Fault Diagnosis with a Feature Fusion Method Based on an Ensemble Convolutional Neural Network and Deep Neural Network. Sensors, 19.10.3390/s19092034 ↗
17. Li, H., Huang, J., Yang, X., Luo, J., Zhang, L., and Pang, Y. (2020). Fault Diagnosis for Rotating Machinery Using Multiscale Permutation Entropy and Convolutional Neural Networks. Entropy, 22.10.3390/e22080851 ↗
18. Li, S., Liu, G., Tang, X., Lu, J., and Hu, J. (2017). An Ensemble Deep Convolutional Neural Network Model with Improved D-S Evidence Fusion for Bearing Fault Diagnosis. Sensors, 17.10.3390/s17081729 ↗
19. Fu, Y., Chen, X., Liu, Y., Son, C., and Yang, Y. (2022). Gearbox Fault Diagnosis Based on Multi-Sensor and Multi-Channel Decision-Level Fusion Based on SDP. Appl. Sci., 12.10.3390/app12157535 ↗
20. Woo, S., Park, J., Lee, J.Y., and Kweon, I.S. (2018). CBAM: Convolutional Block Attention Module, Springer.10.1007/978-3-030-01234-2_1 ↗
21. He, K., Zhang, X., Ren, S., and Sun, J. (2015, January 7–12). Delving Deep into Rectifiers: Surpassing Human-Level Performance on ImageNet Classification. Proceedings of the Conference on Computer Vision and Pattern Recognition CVPR, Boston, MA, USA.10.1109/ICCV.2015.123 ↗
22. Intelligent Fault Diagnosis of Reciprocating Compressor Based on Attention Mechanism Assisted Convolutional Neural Network Via Vibration Signal Rearrangement10.1007/s13369-021-05515-9 ↗
23. Liu, S., Huang, J., Ma, J., and Luo, J. (2022). SRMANet: Toward an Interpretable Neural Network with Multi-Attention Mechanism for Gear box Fault Diagnosis. Sciences, 12.10.3390/app12168388 ↗
24. Vibration signal models for fault diagnosis of planetary gearboxes10.1016/j.jsv.2012.05.039 ↗
25. Visualizing Data using t-SNE