journal article·2025-10-13Open access

Unsupervised Convolutional Transformer Autoencoder for Robust Health Indicator Construction and RUL Prediction in Rotating Machinery

Amrit Dahal, Hong-Zhong Huang, Cheng-Geng Huang, Tudi Huang, Smaran Khanal, Sajawal Gul Niazi

Applied Sciences· Volume 15· Issue 20

Abstract

Prognostics for rotating machinery, particularly bearings, encounter significant challenges in constructing reliable health indicators (HIs) that accurately reflect degradation trajectories, thereby enabling precise remaining useful life (RUL) predictions. This article proposes a novel integrated approach for predicting the RUL of bearings without manual feature engineering. Specifically, a sequential autoencoder integrating a convolutional neural network (CNN) and vision Transformer (Vi-T) is employed to capture the local spatial patterns and global temporal correlations of time-domain vibration signals. The Wasserstein distance is introduced to quantify the divergence between healthy and degraded signal embeddings, resulting in a robust HI metric. Subsequently, the derived HI is fed into a CNN-bidirectional long short-term memory-regressor with Monte Carlo dropout to provide RUL predictions and Bayesian uncertainty estimates. Experimental results from the Xi’an Jiao-Tong University bearing dataset demonstrate that the proposed method surpasses conventional techniques in HI construction and RUL prediction accuracy, demonstrating its efficacy for complex industrial systems with minimal data preprocessing.
Source: crossref · Quality: baseline

Research context

OpenAlex topics: Machine Fault Diagnosis Techniques · Engineering Diagnostics and Reliability · Mechanical Failure Analysis and Simulation

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

School of Mechanical and Electrical Engineering, University of Electronic Science and Technology of China, Chengdu 611731, China

Center for System Reliability and Safety, University of Electronic Science and Technology of China, Chengdu 611731, China

Funding

National Natural Science Foundation of China · Natural Science Foundation of Sichuan Province

References (42)

Show source-provided references
1. Joint Optimization of Maintenance and Spares Inventory Policy for a Series-Parallel System Considering Dependent Failure Processes10.1016/j.ress.2024.110116 ↗
2. A Novel Machinery RUL Prediction Method Based on Exponential Model and Cross-Domain Health Indicator Considering First-to-End Prediction Time10.1016/j.ymssp.2024.111122 ↗
3. A Novel Deep Convolutional Neural Network-Bootstrap Integrated Method for RUL Prediction of Rolling Bearing10.1016/j.jmsy.2021.03.012 ↗
4. Domain-Specific Dual Network with Unsupervised Domain Adaptation for Transfer Fault Prognosis Across Machines Using Multiple Source Domains10.1109/TIM.2025.3556193 ↗
5. Bayesian Transfer Learning with Active Querying for Intelligent Cross-Machine Fault Prognosis under Limited Data10.1016/j.ymssp.2022.109628 ↗
6. Theory and Application of Possibility and Evidence in Reliability Analysis and Design Optimization10.1088/3050-2454/adbaf7 ↗
7. Merging Multi-Level Evidential Observations for Dynamic Reliability Assessment of Hierarchical Multi-State Systems: A Dynamic Bayesian Network Approach10.1016/j.ress.2024.110225 ↗
8. A Dynamic Reliability Assessment Method for Multi-State Manufacturing System by Merging Imprecise Observational Information10.1016/j.ress.2025.111722 ↗
9. Remaining Useful Life Estimation Based on a Nonlinear Diffusion Degradation Process10.1109/TR.2011.2182221 ↗
10. A Model-Based Method for Remaining Useful Life Prediction of Machinery10.1109/TR.2016.2570568 ↗
11. A Graph-Embedded Subdomain Adaptation Approach for Remaining Useful Life Prediction of Industrial IoT Systems10.1109/JIOT.2024.3361533 ↗
12. Bayesian Deep-Learning for RUL Prediction: An Active Learning Perspective10.1016/j.ress.2022.108758 ↗
13. Personalized Federated Transfer Learning for Cycle-Life Prediction of Lithium-Ion Batteries in Heterogeneous Clients With Data Privacy Protection10.1109/JIOT.2024.3433460 ↗
14. Machinery Health Prognostics: A Systematic Review from Data Acquisition to RUL Prediction10.1016/j.ymssp.2017.11.016 ↗
15. Bearing Remain Life Prediction Based on Weighted Complex SVM Models10.21595/jve.2016.16910 ↗
16. Remaining Useful Life Prediction for Rolling Bearings Using EMD-RISI-LSTM
17. Remaining Useful Life Prediction for Rolling Bearings with a Novel Entropy-Based Health Indicator and Improved Particle Filter Algorithm10.1109/ACCESS.2023.3234286 ↗
18. Feature Extraction for Data-Driven Remaining Useful Life Prediction of Rolling Bearings
19. Long, Y., Pang, Q., Zhu, G., Cheng, J., and Li, X. (2024). Remaining Useful Life Prediction of Rolling Bearings Based on Refined Composite Multi-Scale Attention Entropy and Dispersion Entropy. arXiv.10.3390/e25050798 ↗
20. A Recurrent Neural Network Based Health Indicator for Remaining Useful Life Prediction of Bearings10.1016/j.neucom.2017.02.045 ↗
21. A Deep Learning Based Health Indicator Construction and Fault Prognosis with Uncertainty Quantification for Rolling Bearings10.1088/1361-6501/ace072 ↗
22. Li, Z., Zhang, K., Lai, X., Zheng, Q., and Ding, G. (2023, January 12–14). A Remaining Useful Life Prediction Method for Rolling Bearing Based on Multi-Channel Fusion Hierarchical Vision Transformer. Proceedings of the 2023 IEEE 12th Data Driven Control and Learning Systems Conference (DDCLS), Xiangtan, China.10.1109/DDCLS58216.2023.10166306 ↗
23. A Hybrid Prognosis Scheme for Rolling Bearings Based on a Novel Health Indicator and Nonlinear Wiener Process10.1016/j.ress.2024.110014 ↗
24. Prediction of Remaining Useful Life of Rolling Bearings Based on Multiscale Efficient Channel Attention CNN and Bidirectional GRU
25. An Unsupervised Feature Learning Based Health Indicator Construction Method for Performance Assessment of Machines10.1016/j.ymssp.2021.108573 ↗
26. A Health Indicator Construction Method Based on Self-Attention Convolutional Autoencoder for Rotating Machine Performance Assessment10.1016/j.measurement.2022.112108 ↗
27. Constructing a Health Indicator for Bearing Degradation Assessment via an Unsupervised and Enhanced Stacked Autoencoder10.1016/j.aei.2022.101708 ↗
28. Developing Health Indicators and RUL Prognostics for Systems with Few Failure Instances and Varying Operating Conditions Using a LSTM Autoencoder10.1016/j.engappai.2022.105582 ↗
29. A Novel Health Indicator for Intelligent Prediction of Rolling Bearing Remaining Useful Life Based on Unsupervised Learning Model10.1016/j.cie.2023.108999 ↗
30. Health Indicator Construction and Remaining Useful Life Prediction Based on MSC-LSTM-AE Model for Working Bearings10.1109/JSEN.2025.3548675 ↗
31. Multi-Sensor Signal Fusion for Tool Wear Condition Monitoring Using Denoising Transformer Auto-Encoder Resnet10.1016/j.jmapro.2024.07.002 ↗
32. Data-Driven Prognostic Scheme for Bearings Based on a Novel Health Indicator and Gated Recurrent Unit Network10.1109/TII.2022.3169465 ↗
33. An Improved Exponential Model for Predicting Remaining Useful Life of Rolling Element Bearings10.1109/TIE.2015.2455055 ↗
34. Tutorial on Time Series Prediction Using 1D-CNN and BiLSTM: A Case Example of Peak Electricity Demand and System Marginal Price Prediction10.1016/j.engappai.2023.106817 ↗
35. XJTU-SY Rolling Element Bearing Accelerated Life Test Datasets: A Tutorial
36. Kaji, M., Parvizian, J., and van de Venn, H.W. (2020). Constructing a Reliable Health Indicator for Bearings Using Convolutional Autoencoder and Continuous Wavelet Transform. Appl. Sci., 10.10.20944/preprints202011.0591.v1 ↗
37. Lin, P., and Tao, J. (2019, January 17–20). A Novel Bearing Health Indicator Construction Method Based on Ensemble Stacked Autoencoder. Proceedings of the 2019 IEEE International Conference on Prognostics and Health Management (ICPHM), San Francisco, CA, USA.10.1109/ICPHM.2019.8819405 ↗
38. Constructing a Health Indicator for Roller Bearings by Using a Stacked Auto-Encoder with an Exponential Function to Eliminate Concussion10.1016/j.asoc.2020.106119 ↗
39. Deep Learning-Based Remaining Useful Life Estimation of Bearings Using Multi-Scale Feature Extraction10.1016/j.ress.2018.11.011 ↗
40. Remaining Useful Life Prediction Using Graph Convolutional Attention Networks with Temporal Convolution-Aware Nested Residual Connections10.1016/j.ress.2023.109776 ↗
41. Multi-Scale Time Series Analysis Using TT-ConvLSTM Technique for Bearing Remaining Useful Life Prediction10.1016/j.ymssp.2023.110888 ↗
42. A Remaining Useful Life Prediction Method for Rolling Bearing Based on TCN-Transformer