Time-frequency synchronisation contrastive learning-driven multi-sensor remaining useful life prediction
Source abstract
Abstract
Deep learning techniques play a crucial role in predicting the remaining useful life (RUL) of mechanical equipment. Nevertheless, obtaining a substantial number of labeled samples is a challenge, and the prediction accuracy tends to decline when the labeled samples are insufficient. Moreover, existing RUL prediction methods usually extract the degradation characteristics only from one single domain, which is insufficient for a high-accuracy prediction. To address these challenges, a time-frequency synchronization contrastive learning-driven (TFSCL) multi-sensor remaining useful life prediction model is proposed. The proposed TFSCL utilizes a large amount of unlabeled data for model pre-training and key feature extraction, and it introduces a novel time-frequency fusion contrastive loss function to optimize the pre-training process. It employs a dual-channel structure at the sensor and timestamp levels, incorporating an attention mechanism that adaptively adjusts sensor feature weights, enabling more accurate extraction of critical information while effectively mitigating interference from irrelevant data. To validate the effectiveness of the proposed TFSCL, two case studies are conducted, with different labeling ratios being used. The experimental results demonstrate that even with lower labeling ratios, the proposed TFSCL model still achieves a satisfactory prediction effect and outperforms other advanced methods.
Source: openalex_inverted_index · Quality: baseline
Research context
OpenAlex topics: Fault Detection and Control Systems · Machine Fault Diagnosis Techniques · Electrical and Bioimpedance Tomography
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
Affiliations
School of Mechanical and Electronic Engineering, Wuhan University of Technology, Wuhan, China
Department of mechanical and aerospace engineering, The Hong Kong University of Science and Technology, Hong Kong, China
Funding
Research and Development
References (47)
Show source-provided references
1. 10.1109/TMECH.2024.349073310.1109/TMECH.2024.3490733 ↗
2. 10.1016/j.aei.2024.10236510.1016/j.aei.2024.102365 ↗
3. 10.1016/j.jmsy.2023.11.00910.1016/j.jmsy.2023.11.009 ↗
4. 10.1016/j.ress.2023.10960210.1016/j.ress.2023.109602 ↗
5. Zhang X, Zhang X, Liu J, et al. Graph features dynamic fusion learning driven by multi-head attention for large rotating machinery fault diagnosis with multi-sensor data. Eng Appl Artif Intel. 2023;125:109602.10.1016/j.engappai.2023.106601 ↗
6. 10.1016/j.engappai.2023.10703110.1016/j.engappai.2023.107031 ↗
7. 10.1016/j.aei.2023.10196610.1016/j.aei.2023.101966 ↗
8. 10.1088/1361-6501/ad6f3710.1088/1361-6501/ad6f37 ↗
9. 10.1016/j.est.2023.10842710.1016/j.est.2023.108427 ↗
10. 10.1016/j.engappai.2023.10649110.1016/j.engappai.2023.106491 ↗
11. 10.1016/j.engappai.2023.10724110.1016/j.engappai.2023.107241 ↗
12. 10.1016/j.ymssp.2023.11093510.1016/j.ymssp.2023.110935 ↗
13. 10.1016/j.ymssp.2021.10865710.1016/j.ymssp.2021.108657 ↗
14. 10.1109/TASE.2023.326786010.1109/TASE.2023.3267860 ↗
15. 10.1016/j.ymssp.2024.11166310.1016/j.ymssp.2024.111663 ↗
16. 10.1016/j.aei.2024.10252410.1016/j.aei.2024.102524 ↗
17. 10.1016/j.engappai.2023.10583710.1016/j.engappai.2023.105837 ↗
18. 10.1016/j.ress.2024.11016710.1016/j.ress.2024.110167 ↗
19. 10.1016/j.ress.2023.10945510.1016/j.ress.2023.109455 ↗
20. 10.1016/j.ress.2023.10916310.1016/j.ress.2023.109163 ↗
21. 10.1016/j.ress.2024.11021010.1016/j.ress.2024.110210 ↗
22. 10.1016/j.explore.2022.11.00110.1016/j.explore.2022.11.001 ↗
23. He K, Fan H, Wu Y, et al. Momentum contrast for unsupervised visual representation learning. In: Proceedings of the IEEE/CVF conference on computer vision and pattern recognition; Seattle, WA, USA. 2020. p. 9729–9738.
24. Yao T, Yi X, Cheng DZ, et al. Self-supervised learning for large-scale item recommendations. In: Proceedings of the 30th ACM International Conference on Information & Knowledge Management; Queensland, Australia. 2021. p. 4321–4330.10.1145/3459637.3481952 ↗
25. 10.1109/TPAMI.2023.326260810.1109/TPAMI.2023.3262608 ↗
26. 10.1016/j.asoc.2021.10839710.1016/j.asoc.2021.108397 ↗
27. 10.36001/ijphm.2022.v13i1.309610.36001/ijphm.2022.v13i1.3096 ↗
28. Chen T, Kornblith S, Norouzi M, et al. A simple framework for contrastive learning of visual representations. In: Hal D III, and Aarti S, editors. Proceedings of the 37th International Conference on Machine Learning, PMLR, Proceedings of Machine Learning Research; 2020. p. 1597–1607.
29. Vaswani A Shazeer N Parmar N et al. Attention is all you need. 2017. arXiv:1706.03762.
30. 10.1109/TIM.2022.321857410.1109/TIM.2022.3218574 ↗
31. 10.1007/s10845-021-01750-x10.1007/s10845-021-01750-x ↗
32. 10.1109/TNNLS.2020.297713210.1109/TNNLS.2020.2977132 ↗
33. Liang J, Liang S, Liu A, et al. Exploring inconsistent knowledge distillation for object detection with data augmentation. In: Proceedings of the 31st ACM International Conference on Multimedia; Ottawa, ON, Canada. 2023. p. 768–778.10.1145/3581783.3612281 ↗
34. 10.1109/TIM.2022.316056110.1109/TIM.2022.3160561 ↗
35. 10.1109/JAS.2022.10593510.1109/JAS.2022.105935 ↗
36. Ding Y Jia M. A convolutional transformer architecture for remaining useful life estimation 2021 global reliability and prognostics and health management (PHM-Nanjing). 2021:1–7.10.1109/PHM-Nanjing52125.2021.9612814 ↗
37. 10.1016/j.cie.2021.10753110.1016/j.cie.2021.107531 ↗
38. 10.1016/j.ymssp.2019.10633010.1016/j.ymssp.2019.106330 ↗
39. 10.3390/s1702027310.3390/s17020273 ↗
40. 10.1016/j.ress.2018.11.01110.1016/j.ress.2018.11.011 ↗
41. 10.1016/j.measurement.2021.10964210.1016/j.measurement.2021.109642 ↗
42. 10.1002/eng2.1230510.1002/eng2.12305 ↗
43. Eldele E Ragab M Chen Z et al. Time-series representation learning via temporal and contextual contrasting. 2021 arXiv:2106.14112.10.24963/ijcai.2021/324 ↗
44. 10.1016/j.ress.2023.10909610.1016/j.ress.2023.109096 ↗
45. 10.1016/j.ress.2021.10829710.1016/j.ress.2021.108297 ↗
46. 10.1016/j.ress.2024.11039810.1016/j.ress.2024.110398 ↗
47. 10.1016/j.neucom.2022.02.03210.1016/j.neucom.2022.02.032 ↗