journal article·2021-07-28Open access

Stamping Tool Conditions Diagnosis: A Deep Metric Learning Approach

Zaky Dzulfikri, Pin-Wei Su, Chih-Yung Huang

Applied Sciences· Volume 11· Issue 15

Abstract

Stamping processes remain crucial in manufacturing processes; therefore, diagnosing the condition of stamping tools is critical. One of the challenges in diagnosing stamping tool conditions is that traditionally, the tools need to be visually checked, and the production processes thus need to be halted. With the development of Industry 4.0, intelligent monitoring systems have been developed by using accelerometers and algorithms to diagnose the wear classification of stamping tools. Although several deep learning models such as the convolutional neural network (CNN), auto encoder (AE), and recurrent neural network (RNN) models have demonstrated promising results for classifying complex signals including accelerometer signals, the practicality of those methods are restricted due to the flexibility of adding new classes and low accuracy when faced to low numbers of samples per class. In this study, we applied deep metric learning (DML) methods to overcome these problems. DML involves extracting meaningful features using feature extraction modules to map inputs into embedding features. We compared the probability method, the contrastive method, and a triplet network to determine which method was most suitable for our case. The experimental results revealed that, compared with other models, a triplet network can be more effectively trained with limited training data. The triplet network demonstrated the best test results of the compared methods in the noised test data. Finally, when tested using unseen class, the triplet network and the probability method demonstrated similar results.
Source: crossref · Quality: baseline

Research context

OpenAlex topics: Advanced machining processes and optimization · Machine Fault Diagnosis Techniques · Metal Alloys Wear and Properties

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

Department of Mechanical Engineering, National Chin-Yi University of Technology, Taichung 41170, Taiwan

References (40)

Show source-provided references
1. (2021, January 25). American Industrial Metal Stamping Continues to Grow in 2019–2020. Available online: http://www.americanindust.com/blog/metal-stamping-continues-to-grow-2019-2020/.
2. Tool Condition Monitoring System: A Review10.1016/j.matpr.2015.07.317 ↗
3. Ge, M., Du, R., and Xu, Y. (2004). Hidden Markov Model Based Fault Diagnosis for Stamping Processes. Mech. Syst. Signal Process.10.1016/S0888-3270(03)00076-1 ↗
4. Fault Diagnosis of Stamping Process Based on Empirical Mode Decomposition and Learning Vector Quantization10.1016/j.ijmachtools.2007.06.006 ↗
5. Audio Signal Analysis for Tool Wear Monitoring in Sheet Metal Stamping10.1016/j.ymssp.2016.09.014 ↗
6. Shanbhag, V.V., Rolfe, B.F., and Pereira, M.P. (2020). Investigation of Galling Wear Using Acoustic Emission Frequency Characteristics. Lubricants, 8.10.3390/lubricants8030025 ↗
7. Time Series Analysis of Tool Wear in Sheet Metal Stamping Using Acoustic Emission10.1088/1742-6596/896/1/012030 ↗
8. Study of Sound Signal for Online Monitoring in the Micro-Piercing Process10.1007/s00170-018-1970-5 ↗
9. Fault Diagnosis Using Support Vector Machine with an Application in Sheet Metal Stamping Operations10.1016/S0888-3270(03)00071-2 ↗
10. Punching Process Monitoring Using Wavelet Transform Based Feature Extraction and Semi-Supervised Clustering10.1016/j.promfg.2018.07.156 ↗
11. A New Process Monitoring Method Based on Waveform Signal by Using Recurrence Plot10.3390/e17096379 ↗
12. Process Monitoring in Stamping Operations through Tooling Integrated Sensing10.1016/j.jmsy.2008.11.001 ↗
13. Deep Learning and Its Applications to Machine Health Monitoring10.1016/j.ymssp.2018.05.050 ↗
14. A New Convolutional Neural Network-Based Data-Driven Fault Diagnosis Method10.1109/TIE.2017.2774777 ↗
15. A New Bearing Fault Diagnosis Method Based on Modified Convolutional Neural Networks10.1016/j.cja.2019.07.011 ↗
16. Wu, J. (2019). Sensor Data-Driven Bearing Fault Diagnosis Based on Deep Convolutional Neural Networks and s-Transform. Sensors, 19.10.3390/s19122750 ↗
17. A Generic Intelligent Bearing Fault Diagnosis System Using Compact Adaptive 1D CNN Classifier10.1007/s11265-018-1378-3 ↗
18. Bearing Fault Detection by One-Dimensional Convolutional Neural Networks10.1155/2017/8617315 ↗
19. Deep Learning for Fault-Relevant Feature Extraction and Fault Classification with Stacked Supervised Auto-Encoder10.1016/j.jprocont.2020.05.015 ↗
20. Ensemble Deep Contractive Auto-Encoders for Intelligent Fault Diagnosis of Machines under Noisy Environment10.1016/j.knosys.2020.105764 ↗
21. Semisupervised Deep Sparse Auto-Encoder With Local and Nonlocal Information for Intelligent Fault Diagnosis of Rotating Machinery
22. Mallak, A., and Fathi, M. (2021). Sensor and Component Fault Detection and Diagnosis for Hydraulic Machinery Integrating LSTM Autoencoder Detector and Diagnostic Classifiers. Sensors, 21.10.3390/s21020433 ↗
23. A Sparse Auto-Encoder-Based Deep Neural Network Approach for Induction Motor Faults Classification10.1016/j.measurement.2016.04.007 ↗
24. A Two-Stage Approach for Predicting the Remaining Useful Life of Tools Using Bidirectional Long Short-Term Memory10.1016/j.measurement.2020.108029 ↗
25. Elimination of End Effects in LMD by Bi-LSTM Regression Network and Applications for Rolling Element Bearings Characteristic Extraction under Different Loading Conditions10.1016/j.dsp.2020.102881 ↗
26. Fault Detection and Diagnosis for Rotating Machinery: A Model Based on Convolutional LSTM, Fast Fourier and Continuous Wavelet Transforms10.1016/j.compind.2020.103378 ↗
27. Deep-Convolution-Based LSTM Network for Remaining Useful Life Prediction10.1109/TII.2020.2991796 ↗
28. Zhao, R., Yan, R., Wang, J., and Mao, K. (2017). Learning to Monitor Machine Health with Convolutional Bi-Directional LSTM Networks. Sensors, 17.10.3390/s17020273 ↗
29. Huang, C.-Y., and Dzulfikri, Z. (2021). Stamping Monitoring by Using an Adaptive 1D Convolutional Neural Network. Sensors, 21.10.3390/s21010262 ↗
30. Bromley, J., Guyon, I., LeCun, Y., Säckinger, E., and Shah, R. (2020, January 6–12). Signature Verification Using a “Siamese” Time Delay Neural Network. Proceedings of the 6th International Conference on Neural Information Processing Systems, Virtual-Only, Available online: https://dl.acm.org/doi/10.5555/2987189.2987282.
31. Ahmed, S., Basher, A., Reza, A.N.R., and Jung, H.Y. (2018). A Brief Overview of Deep Metric Learning Methods, Korea Next Generation Computing Society.
32. Kaya, M., and Bilge, H.Ş. (2019). Deep Metric Learning: A Survey. Symmetry, 11.10.3390/sym11091066 ↗
33. Hadsell, R., Chopra, S., and LeCun, Y. (2006, January 17–22). Dimensionality Reduction by Learning an Invariant Mapping. Proceedings of the 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR’06), New York, NY, USA.
34. Schroff, F., Kalenichenko, D., and Philbin, J. (2015, January 7–12). FaceNet: A Unified Embedding for Face Recognition and Clustering. Proceedings of the 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Boston, MA, USA.10.1109/CVPR.2015.7298682 ↗
35. A Robust Intelligent Fault Diagnosis Method for Rolling Element Bearings Based on Deep Distance Metric Learning10.1016/j.neucom.2018.05.021 ↗
36. Wang, S., Wang, D., Kong, D., Wang, J., Li, W., and Zhou, S. (2020). Few-Shot Rolling Bearing Fault Diagnosis with Metric-Based Meta Learning. Sensors, 20.10.3390/s20226437 ↗
37. Limited Data Rolling Bearing Fault Diagnosis with Few-Shot Learning10.1109/ACCESS.2019.2934233 ↗
38. Dynamic Spectrum Matching with One-Shot Learning10.1016/j.chemolab.2018.12.005 ↗
39. Distance Metric Learning for Large Margin Nearest Neighbor Classification
40. Hermans, A., Beyer, L., and Leibe, B. (2017). In Defense of the Triplet Loss for Person Re-Identification. arXiv Preprint.