SDD-CNN: Small Data-Driven Convolution Neural Networks for Subtle Roller Defect Inspection
Source abstract
Abstract
Roller bearings are some of the most critical and widely used components in rotating machinery. Appearance defect inspection plays a key role in bearing quality control. However, in real industries, bearing defects are usually extremely subtle and have a low probability of occurrence. This leads to distribution discrepancies between the number of positive and negative samples, which makes intelligent data-driven inspection methods difficult to develop and deploy. This paper presents a small data-driven convolution neural network (SDD-CNN) for roller subtle defect inspection via an ensemble method for small data preprocessing. First, label dilation (LD) is applied to solve the problem of an imbalance in class distribution. Second, a semi-supervised data augmentation (SSDA) method is proposed to extend the dataset in a more efficient and controlled way. In this method, a coarse CNN model is trained to generate ground truth class activation and guide the random cropping of images. Third, four variants of the CNN model, namely, SqueezeNet v1.1, Inception v3, VGG-16, and ResNet-18, are introduced and employed to inspect and classify the surface defects of rollers. Finally, a rich set of experiments and assessments is conducted, indicating that these SDD-CNN models, particularly the SDD-Inception v3 model, perform exceedingly well in the roller defect classification task with a top-1 accuracy reaching 99.56%. In addition, the convergence time and classification accuracy for an SDD-CNN model achieve significant improvement compared to that for the original CNN. Overall, using an SDD-CNN architecture, this paper provides a clear path toward a higher precision and efficiency for roller defect inspection in smart manufacturing.
Source: crossref · Quality: baseline
Research context
OpenAlex topics: Industrial Vision Systems and Defect Detection · Non-Destructive Testing Techniques · Welding Techniques and Residual Stresses
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
Affiliations
School of Electronic Information, Wuhan University, Wuhan 430072, China
Department of Public Courses, Wuhan Railway Vocational College of Technology, Wuhan 430205, China
Funding
National Natural Science Foundation of China
References (41)
Show source-provided references
1. Zhang, B. (2018). Research on Surface Defect Detection of Bearing Roller Based on Machine Vision. [Master’s Thesis, Nanchang Hangkong University].
2. Bearing defect inspection based on machine vision10.1016/j.measurement.2011.12.018 ↗
3. UGC: Real-time, ultra-robust feature correspondence via unilateral grid-based clustering10.1109/ACCESS.2018.2871729 ↗
4. Krizhevsky, A., Sutskever, I., and Hinton, G.E. (2012, January 3–6). ImageNet classification with deep convolutional neural networks. Proceedings of the 2012 International Conference on Neural Information Processing Systems, Lake Tahoe, ND, USA.
5. Deep neural networks-based rolling bearing fault diagnosis10.1016/j.microrel.2017.03.006 ↗
6. A deep convolutional neural network with new training methods for bearing fault diagnosis under noisy environment and different working load10.1016/j.ymssp.2017.06.022 ↗
7. A novel method for intelligent fault diagnosis of rolling bearings using ensemble deep auto-encoders10.1016/j.ymssp.2017.09.026 ↗
8. A robust intelligent fault diagnosis method for rolling element bearings based on deep distance metric learning10.1016/j.neucom.2018.05.021 ↗
9. Construction of hierarchical diagnosis network based on deep learning and its application in the fault pattern recognition of rolling element bearings10.1016/j.ymssp.2015.11.014 ↗
10. Intelligent manufacturing in the context of industry 4.0: A review10.1016/J.ENG.2017.05.015 ↗
11. Deep learning for smart manufacturing: Methods and applications10.1016/j.jmsy.2018.01.003 ↗
12. Design of deep convolution neural network architectures for automated feature extraction in industrial inspection10.1016/j.cirp.2016.04.072 ↗
13. A generic deep-learning-based approach for automated surface inspection
14. Autonomous structural visual inspection using region-based deep learning for detecting multiple damage types10.1111/mice.12334 ↗
15. Machine learning-based imaging system for surface defect inspection10.1007/s40684-016-0039-x ↗
16. Gearbox fault identification and classification with convolution neural networks
17. Virtualization and deep recognition for system fault classification10.1016/j.jmsy.2017.04.012 ↗
18. Small fault diagnosis of front-end speed controlled wind generator based on deep learning
19. Convolutional neural network based fault detection for rotating machinery10.1016/j.jsv.2016.05.027 ↗
20. Machine health monitoring using local feature-based gated recurrent unit network10.1109/TIE.2017.2733438 ↗
21. Remaining useful life estimation of engineered systems using vanilla LSTM neural networks
22. Zhao, R., Yan, R., Wang, J., and Mao, K. (2017). Learning to monitor machine health with convolution bi-directional LSTM networks. Sensors, 17.10.3390/s17020273 ↗
23. A deep learning-based approach to material removal rate prediction in polishing10.1016/j.cirp.2017.04.013 ↗
24. Deutsch, J., He, M., and He, D. (2017). Remaining useful life prediction of hybrid ceramic bearings using an integrated deep learning and particle filter approach. Appl. Sci., 7.10.3390/app7070649 ↗
25. Resource requests prediction in the cloud computing environment with a deep belief network10.1002/spe.2426 ↗
26. A sparse auto-encoder-based deep neural network approach for induction motor faults classification10.1016/j.measurement.2016.04.007 ↗
27. Yang, Z., Wang, X., and Zhong, J. (2016). Representational learning for fault diagnosis of wind turbine equipment: A multi-layered extreme learning machines approach. Energies, 9.10.3390/en9060379 ↗
28. Transformer fault diagnosis using continuous sparse auto encoder10.1186/s40064-016-2107-7 ↗
29. Deep learning-based crack damage detection using convolutional neural networks10.1111/mice.12263 ↗
30. Using deep learning for image-based plant disease detection10.3389/fpls.2016.01419 ↗
31. Iandola, F.N., Han, S., and Moskewicz, M.W. (arXiv, 2016). SqueezeNet: AlexNet-level accuracy with 50x fewer parameters and <0.5 MB model size, arXiv.
32. Szegedy, C., Vanhoucke, V., Ioffe, S., and Shlens, J. (July, January 26). Rethinking the Inception Architecture for Computer Vision. Proceedings of the 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Las Vegas, NV, USA.10.1109/CVPR.2016.308 ↗
33. Simonyan, K., and Zisserman, A. (arXiv, 2014). Very deep convolutional networks for large-scale image recognition, arXiv.
34. He, K., Zhang, X., Ren, S., and Sun, J. (July, January 26). Deep residual learning for image recognition. Proceedings of the 2016 IEEE conference on Computer Vision and Pattern Recognition (CVPR), Las Vegas, NV, USA.10.1109/CVPR.2016.90 ↗
35. Shen, L., Lin, Z., and Huang, Q. (2016, January 8–16). Relay backpropagation for effective learning of deep convolutional neural networks. Proceedings of the 2016 European Conference on Computer Vision (ECCV), Amsterdam, The Netherlands.10.1007/978-3-319-46478-7_29 ↗
36. Zhou, B., Khosla, A., Lapedriza, A., Oliva, A., and Torralba, A. (July, January 26). Learning Deep Features for Discriminative Localization. Proceedings of the 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Las Vegas, NV, USA.10.1109/CVPR.2016.319 ↗
37. Zeiler, M.D., and Fergus, R. (2014, January 6–12). Visualizing and understanding convolutional networks. Proceedings of the 2014 European Conference on Computer Vision (ECCV), Zurich, Switzerland.10.1007/978-3-319-10590-1_53 ↗
38. Szegedy, C. (2015, January 8–10). Going deeper with convolutions. Proceedings of the 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Boston, MA, USA.10.1109/CVPR.2015.7298594 ↗
39. Jia, Y., Shelhamer, E., Donahue, J., Karayev, S., Long, J., Girshick, R., Guadarrama, S., and Darrell, T. (2014, January 24–27). Caffe: Convolutional architecture for fast feature embedding. Proceedings of the 2014 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Columbus, OH, USA.10.1145/2647868.2654889 ↗
40. Visualizing data using t-sne
41. Accelerating t-sne using tree-based algorithms