journal article·2020-10-31Open access

Exploiting Generative Adversarial Networks as an Oversampling Method for Fault Diagnosis of an Industrial Robotic Manipulator

Ziqiang Pu, Diego Cabrera, René-Vinicio Sánchez, Mariela Cerrada, Chuan Li, José Valente de Oliveira

Applied Sciences· Volume 10· Issue 21

Abstract

Data-driven machine learning techniques play an important role in fault diagnosis, safety, and maintenance of the industrial robotic manipulator. However, these methods require data that, more often that not, are hard to obtain, especially data collected from fault condition states and, without enough and appropriated (balanced) data, no acceptable performance should be expected. Generative adversarial networks (GAN) are receiving a significant interest, especially in the image analysis field due to their outstanding generative capabilities. This paper investigates whether or not GAN can be used as an oversampling tool to compensate for an unbalanced data set in an industrial manipulator fault diagnosis task. A comprehensive empirical analysis is performed taking into account six different scenarios for mitigating the unbalanced data, including classical under and oversampling (SMOTE) methods. In all of these, a wavelet packet transform is used for feature generation while a random forest is used for fault classification. Aspects such as loss functions, learning curves, random input distributions, data shuffling, and initial conditions were also considered. A non-parametric statistical test of hypotheses reveals that all GAN based fault-diagnosis outperforms both under and oversampling classical methods while, within GAN based methods, an average accuracy difference as high as 1.68% can be achieved.
Source: crossref · Quality: baseline

Research context

OpenAlex topics: Machine Fault Diagnosis Techniques · Fault Detection and Control Systems · Industrial Vision Systems and Defect Detection

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

National Research Base of Intelligent Manufacturing Service, Chongqing Technology and Business University, China and Universidade do Algarve, 8005-139 Faro, Portugal

GIDTEC Research Group, Universidad Politécnica Salesiana, Cuenca 010105, Ecuador

National Research Base of Intelligent Manufacturing Service, Chongqing Technology and Business University, Chongqing 400067, China

Universidade do Algarve and with the Center of Intelligent Systems, IDMEC, Instituto Superior Técnico, Universidade de Lisboa, 1049-001 Lisboa, Portugal

Funding

Fundação para a Ciência e a Tecnologia · Natural Science Foundation of Chongqing · National Natural Science Foundation of China · CTBU - Chongqing Technologic and Business University

References (47)

Show source-provided references
1. A data-driven approach for bearing fault prognostics10.1109/TIA.2019.2907666 ↗
2. A discrepancy analysis methodology for rolling element bearing diagnostics under variable speed conditions10.1016/j.ymssp.2018.06.026 ↗
3. Bayesian hierarchical models for aerospace gas turbine engine prognostics10.1016/j.eswa.2014.08.007 ↗
4. Deep learning based approach for bearing fault diagnosis10.1109/TIA.2017.2661250 ↗
5. Adaptive feature extraction using sparse coding for machinery fault diagnosis10.1016/j.ymssp.2010.07.019 ↗
6. Intelligent fault diagnosis of rotating machinery based on one-dimensional convolutional neural network10.1016/j.compind.2018.12.001 ↗
7. Intelligent fault diagnosis of rotating machinery using a new ensemble deep auto-encoder method10.1016/j.measurement.2019.107232 ↗
8. Shen, C., Xie, J., Wang, D., Jiang, X., Shi, J., and Zhu, Z. (2019). Improved hierarchical adaptive deep belief network for bearing fault diagnosis. Appl. Sci., 9.10.3390/app9163374 ↗
9. Deng, S., Cheng, Z., Li, C., Yao, X., Chen, Z., and Sanchez, R.V. (2016, January 19–21). Rolling bearing fault diagnosis based on Deep Boltzmann machines. Proceedings of the 2016 Prognostics and System Health Management Conference (PHM-Chengdu), Chengdu, China.10.1109/PHM.2016.7819840 ↗
10. Neural network based adaptive actuator fault detection algorithm for robot manipulators10.1007/s10846-018-0781-0 ↗
11. A novel convolutional neural network based fault recognition method via image fusion of multi-vibration-signals10.1016/j.compind.2018.12.013 ↗
12. Ma, Q., Chen, E., Lin, Z., Yan, J., Yu, Z., and Ng, W.W. (2019). Convolutional Multitimescale Echo State Network. IEEE Trans. Cybern.
13. Evolving deep echo state networks for intelligent fault diagnosis10.1109/TII.2019.2938884 ↗
14. A deep Boltzmann machine and multi-grained scanning forest ensemble collaborative method and its application to industrial fault diagnosis10.1016/j.compind.2018.04.002 ↗
15. Deep Boltzmann machine based condition prediction for smart manufacturing10.1007/s12652-018-0794-3 ↗
16. Deep-learning-based fault detection and diagnosis of air-handling units10.1016/j.buildenv.2019.04.029 ↗
17. Rolling bearing fault detection using continuous deep belief network with locally linear embedding10.1016/j.compind.2018.01.005 ↗
18. Convolutional autoencoder for feature extraction in tactile sensing10.1109/LRA.2019.2927950 ↗
19. On the identification of the angular position of gears for the diagnostics of planetary gearboxes10.1016/j.ymssp.2016.06.016 ↗
20. Gas turbine engine prognostics using Bayesian hierarchical models: A variational approach10.1016/j.ymssp.2015.09.014 ↗
21. Application of empirical mode decomposition and artificial neural network for automatic bearing fault diagnosis based on vibration signals10.1016/j.apacoust.2014.08.016 ↗
22. Fast and accurate classification of time series data using extended ELM: Application in fault diagnosis of air handling units10.1109/TSMC.2017.2691774 ↗
23. Automating industrial tasks through mechatronic systems—A review of robotics in industrial perspective
24. Actuators fault diagnosis for robot manipulators with uncertain model10.1016/j.conengprac.2008.05.012 ↗
25. SMOTE: Synthetic minority over-sampling technique10.1613/jair.953 ↗
26. Goodfellow, I., Pouget-Abadie, J., Mirza, M., Xu, B., Warde-Farley, D., Ozair, S., Courville, A., and Bengio, Y. (2014, January 8–13). Generative adversarial nets. Proceedings of the Advances in Neural Information Processing Systems 27, Montreal, QC, Canada.
27. Ledig, C., Theis, L., Huszár, F., Caballero, J., Cunningham, A., Acosta, A., Aitken, A., Tejani, A., Totz, J., and Wang, Z. (2017, January 21–26). Photo-realistic single image super-resolution using a generative adversarial network. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Honolulu, HI, USA.10.1109/CVPR.2017.19 ↗
28. Isola, P., Zhu, J.Y., Zhou, T., and Efros, A.A. (2017, January 21–26). Image-to-image translation with conditional adversarial networks. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Honolulu, HI, USA.10.1109/CVPR.2017.632 ↗
29. Zhu, J.Y., Park, T., Isola, P., and Efros, A.A. (2017, January 22–29). Unpaired image-to-image translation using cycle-consistent adversarial networks. Proceedings of the IEEE International Conference on Computer Vision, Venice, Italy.10.1109/ICCV.2017.244 ↗
30. Generative adversarial networks for data augmentation in machine fault diagnosis10.1016/j.compind.2019.01.001 ↗
31. Fusing convolutional generative adversarial encoders for 3D printer fault detection with only normal condition signals10.1016/j.ymssp.2020.107108 ↗
32. Imbalanced fault diagnosis of rolling bearing based on generative adversarial network: A comparative study10.1109/ACCESS.2018.2890693 ↗
33. A GAN-based anomaly detection approach for imbalanced industrial time series10.1109/ACCESS.2019.2944689 ↗
34. One-shot fault diagnosis of 3D printers through improved feature space learning
35. Imbalanced sample fault diagnosis of rotating machinery using conditional variational auto-encoder generative adversarial network10.1016/j.asoc.2020.106333 ↗
36. Time domain signal analysis using wavelet packet decomposition approach
37. Dimensionality reduction of hyperspectral data using discrete wavelet transform feature extraction10.1109/TGRS.2002.804721 ↗
38. Gearbox fault diagnosis based on deep random forest fusion of acoustic and vibratory signals10.1016/j.ymssp.2016.02.007 ↗
39. Arjovsky, M., Chintala, S., and Bottou, L. (2017). Wasserstein gan. arXiv.
40. Gulrajani, I., Ahmed, F., Arjovsky, M., Dumoulin, V., and Courville, A.C. (2017, January 4–9). Improved training of wasserstein gans. Proceedings of the Advances in Neural Information Processing Systems 30, Long Beach, CA, USA.
41. Generative adversarial networks selection approach for extremely imbalanced fault diagnosis of reciprocating machinery10.1109/ACCESS.2019.2917604 ↗
42. Rethinking statistical learning theory: Learning using statistical invariants10.1007/s10994-018-5742-0 ↗
43. A tutorial on support vector regression10.1023/B:STCO.0000035301.49549.88 ↗
44. Decision tree classification of land cover from remotely sensed data10.1016/S0034-4257(97)00049-7 ↗
45. Classification and regression by randomForest
46. Statistical Comparisons of Classifiers over Multiple Data Sets
47. A statistical comparison of neuroclassifiers and feature selection methods for gearbox fault diagnosis under realistic conditions10.1016/j.neucom.2016.02.028 ↗