A Causal-Transformer Based Meta-Learning Method for Few-Shot Fault Diagnosis in CNC Machine Tool Bearings
Source abstract
Abstract
In intelligent manufacturing processes such as aerospace production, computer numerical control (CNC) machine tools require real-time optimization of process parameters to meet precision machining demands. These dynamic operating conditions increase the risk of fatigue damage in CNC machine tool bearings, highlighting the urgent demand for rapid and accurate fault diagnosis methods that can maintain production efficiency and extend equipment uptime. However, varying conditions induce feature distribution shifts, and scarce fault samples limit model generalization. Therefore, this paper proposes a causal-Transformer-based meta-learning (CTML) method for bearing fault diagnosis in CNC machine tools, comprising three core modules: (1) the original bearing signal is transformed into a multi-scale time-frequency feature space using continuous wavelet transform; (2) a causal-Transformer architecture is designed to achieve feature extraction and fault classification based on the physical causal law of fault propagation; (3) the above mechanisms are integrated into a model-agnostic meta-learning (MAML) framework to achieve rapid cross-condition adaptation through an adaptive gradient pruning strategy. Experimental results using the multiple bearing dataset show that under few-shot cross-condition scenarios (3-way 1-shot and 3-way 5-shot), the proposed CTML outperforms benchmark models (e.g., Transformer, domain adversarial neural networks (DANN), and MAML) in terms of classification accuracy and sensitivity to operating conditions, while maintaining a moderate level of model complexity.
Source: openalex_inverted_index · Quality: baseline
Research context
OpenAlex topics: Fault Detection and Control Systems
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
References (47)
Show source-provided references
1. Advances in computer numerical control geometric error compensation: integrating AI and on-machine technologies for ultra-precision manufacturing10.3390/machines13020140 ↗
2. Bearing fault diagnosis in CNC machine using hybrid signal decomposition and gentle AdaBoost learning10.1007/s42417-023-00930-8 ↗
3. Digital twin-driven fault diagnosis for CNC machine tool10.1007/s00170-022-09978-4 ↗
4. Research on fault diagnosis method of bearings in the spindle system for CNC machine tools based on DRSN-Transformer10.1109/ACCESS.2024.3404968 ↗
5. Synthetic vibration data generation and fault classification in CNC machines using transformer GANs and ConvLSTM Networks
6. Lightweight mechanical equipment fault diagnosis framework based on GCGAN-MDSCNN-ICA model10.1038/s41598-025-89576-y ↗
7. Deep learning for anomaly detection in CNC machine vibration data: a rough LSTM-based approach10.3390/app15063179 ↗
8. Simulation data driven time-frequency Fusion 1D convolutional neural network with multiscale attention for bearing fault diagnosis10.1088/1361-6501/adb329 ↗
9. Data privacy protection diagnostic algorithm for industrial robot joint harmonic reducers based on swarm learning
10. Knowledge and data dual-driven fault diagnosis in industrial scenarios: a survey10.1109/JIOT.2024.3387538 ↗
11. The intelligent operation and maintenance method and experimental research of CNC machine tool bearings10.1177/09544089241284483 ↗
12. An optimized CNN-BiLSTM network for bearing fault diagnosis under multiple working conditions with limited training samples10.1016/j.neucom.2024.127284 ↗
13. Adaptive fault diagnosis of machining processes enabled by hybrid deep learning and incremental transfer learning10.1016/j.compind.2025.104262 ↗
14. Adversarial domain adaptation based on contrastive learning for bearings fault diagnosis10.1016/j.simpat.2024.103058 ↗
15. Bi-generator cooperative domain adversarial neural network for bearing fault diagnosis10.1109/JSEN.2024.3361013 ↗
16. Model-agnostic meta-learning-based fault classification for industrial processes with small sample
17. Few-shot fault diagnosis of axial piston pump based on prior knowledge-embedded meta learning vision transformer under variable operating conditions10.1016/j.eswa.2025.126452 ↗
18. Dynamic reliability analysis of CNC lathe spindle-bearing system with thermal effect in radial runout10.1177/09544062241227308 ↗
19. Geometric error measuring, modeling, and compensation for CNC machine tools: a review10.1016/j.cja.2023.02.035 ↗
20. Self-powered sensor for online monitoring of eccentricity faults in rotating machinery and its application in spindle eccentricity monitoring of machine tools10.1016/j.nanoen.2024.110084 ↗
21. Machine learning based surface roughness assessment via CNC spindle bearing vibration10.1007/s12008-024-01963-3 ↗
22. MEMS approach for rolling bearing fault diagnosis using vibration signal analysis10.1007/s42417-024-01730-4 ↗
23. Fault classification in rotor-bearing system using advanced signal processing and machine learning techniques10.1016/j.rineng.2024.103892 ↗
24. Adaptive generalized empirical wavelet transform and its application to fault diagnosis of rolling bearing10.1016/j.measurement.2025.116958 ↗
25. Alam TE, Ahsan MM, Raman S. Multimodal bearing fault classification under variable conditions: a 1D CNN with transfer learning. arXiv:2502.17524. 2025. doi:10.48550/arxiv.2502.17524.10.1016/j.mlwa.2025.100682 ↗
26. A high-performance rolling bearing fault diagnosis method based on adaptive feature mode decomposition and Transformer10.1016/j.apacoust.2024.110156 ↗
27. MT-ConvFormer: a multi-task bearing fault diagnosis method using a combination of CNN and transformer
28. Noise reduction in CWRU data using DAE and classification with ViT10.3390/app142411771 ↗
29. Rolling bearing fault diagnosis method based on SWT and improved vision transformer10.3390/s25072090 ↗
30. Multi-aircraft attention-based model for perceptive arrival transit time prediction10.1016/j.aei.2024.103067 ↗
31. Data-driven reliability assessment of manufacturing systems using process mining
32. Advancements in bearing health monitoring and remaining useful life prediction: techniques, challenges, and future directions10.1088/1361-6501/adafc8 ↗
33. A review of physics-based, data-driven, and hybrid models for tool wear monitoring10.3390/machines12120833 ↗
34. Knowledge driven machine learning towards interpretable intelligent prognostics and health management: review and case study10.1186/s10033-024-01173-8 ↗
35. A domain adaptation meta learning method with multilayer convolutional attention for cross-domain bearing fault diagnosis10.1109/JSEN.2025.3546955 ↗
36. MetaTrans-FSTSF: a transformer-based meta-learning framework for few-shot time series forecasting in flood prediction10.3390/rs17010077 ↗
37. Model-agnostic meta-learning for fault diagnosis of induction motors in data-scarce environments with varying operating conditions and electric drive noise10.1109/TEC.2025.3556100 ↗
38. Ensemble-based model-agnostic meta-learning with operational grouping for intelligent sensory systems10.3390/s25061745 ↗
39. Fault diagnosis for wind turbine generators based on Model-Agnostic Meta-Learning: a few-shot learning method10.1016/j.eswa.2024.126171 ↗
40. A meta-learning method based on meta-feature enhancement for bearing fault identification under few-sample conditions10.1016/j.ymssp.2025.112370 ↗
41. Few-shot bearing fault diagnosis by semi-supervised meta-learning with graph convolutional neural network under variable working conditions10.1016/j.measurement.2024.115402 ↗
42. Improved metric-based meta learning with attention mechanism for few-shot cross-domain train bearing fault diagnosis10.1088/1361-6501/ad30b6 ↗
43. Fault diagnosis model for bearings under multiple operating conditions based on feature parameterization weighting10.3390/electronics13112153 ↗
44. Intelligent bearing condition monitoring for electrical machines through vibration signal based on autoencoder and almost-parameter-free classifiers
45. Condition monitoring of bearing damage in electromechanical drive systems by using motor current signals of electric motors: a benchmark data set for data-driven classification
46. Yuan L, Chen Y, Wang T, Yu W, Shi Y, Jiang Z, et al. Tokens-to-token VIT: training vision transformers from scratch on imagenet. arXiv:2101.11986. 2021. doi:10.48550/arxiv.2101.11986.10.1109/ICCV48922.2021.00060 ↗
47. Long M, Zhu H, Wang J, Jordan MI. Deep transfer learning with joint adaptation networks. arXiv:1605.06636. 2017. doi:10.48550/arxiv.1605.06636.