Object Detection and Classification of Metal Polishing Shaft Surface Defects Based on Convolutional Neural Network Deep Learning
Source abstract
Abstract
Defective shafts need to be classified because some defective shafts can be reworked to avoid replacement costs. Therefore, the detection and classification of shaft surface defects has important engineering application value. However, in the factory, shaft surface defect inspection and classification are done manually, with low efficiency and reliability. In this paper, a deep learning method based on convolutional neural network feature extraction is used to realize the object detection and classification of metal shaft surface defects. Through image segmentation, the system methods setting of a Fast-R-CNN object detection framework and parameter optimization settings are implemented to realize the classification of 16,384 × 4096 large image little objects. The experiment proves that the method can be applied in practical production and can also be extended to other fields of large image micro-fine defects with a high light surface. In addition, this paper proposes a method to increase the proportion of positive samples by multiple settings of IOU values and discusses the limitations of the system for defect detection.
Source: crossref · Quality: baseline
Research context
OpenAlex topics: Industrial Vision Systems and Defect Detection · Infrastructure Maintenance and Monitoring · Image and Object Detection Techniques
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
Affiliations
College of Mechanical Engineering, Zhejiang University of Technology, Hangzhou 320023, China
References (46)
Show source-provided references
1. Jia, H.B., Murphey, Y.L., and Shi, J.J. (2004, January 23–26). An intelligent real-time vision system for surface defect detection. Proceedings of the 17th International Conference on Pattern Recognition, Cambridge, UK.
2. Multispectral inspection of citrus in real-time using machine vision and digital signal processors10.1016/S0168-1699(02)00002-9 ↗
3. A neural network approach for defect identification and classification on leather fabric
4. Real-time vision-based system for textile fabric inspection10.1006/rtim.2001.0231 ↗
5. Li, L., Qi, H., Yin, Z., Li, D., Zhu, Z., Tangwarodomnukun, V., and Tan, D. (2019). Investigation on the multiphase sink vortex Ekman pumping effects by CFD-DEM coupling method. Powder Technol.10.1016/j.powtec.2019.06.036 ↗
6. Fucheng, Y., Lifan, Z., and Yongbin, Z. (2009, January 9–12). The research of printing’s image defect inspection based on machine vision. Proceedings of the 2009 International Conference on Mechatronics and Automation, Changchun, China.
7. Ma, J. (2017, January 26–28). Defect detection and recognition of bare PCB based on computer vision. Proceedings of the 2017 36th Chinese Control Conference (CCC), Dalian, China.10.23919/ChiCC.2017.8029117 ↗
8. Pan, Y., Ji, S., Tan, D., and Cao, H. (2019). Cavitation based soft abrasive flow processing method. Int. J. Adv. Manuf. Technol.
9. A logical calculus of the ideas immanent in nervous activity10.1007/BF02478259 ↗
10. The perceptron: A probabilistic model for information storage and organization in the brain10.1037/h0042519 ↗
11. Learning representations by back-propagating errors10.1038/323533a0 ↗
12. Li, L., Tan, D., Yin, Z., Li, D., Zhu, Y., and Zheng, S. (2019). Ekman boundary layer mass transfer mechanism of free sink vortex. Int. J. Heat Mass Transfer.
13. SA-ANN-based slag carry-over detection method and the embedded WME platform10.1109/TIE.2012.2213559 ↗
14. An embedded cloud database service method for distributed industry monitoring10.1109/TII.2017.2773644 ↗
15. The dimensionality of data with neural networks10.1126/science.1127647 ↗
16. Krizhevsky, A., Sutskever, I.I., and Hinton, G. (2012). Imagenet classification with deep convolutional neural networks. Adv. Neural Inf. Proc. Syst., 97–110.
17. Yi, L., Li, G., and Jiang, M. (2017). An End-to-End Steel Strip Surface Defects Recognition System Based on Convolutional Neural Networks. Steel Res Int., 88.10.1002/srin.201600068 ↗
18. Ma, L., Xie, W., and Zhang, Y. (2019). Blister Defect Detection Based on Convolutional Neural Network for Polymer Lithium-Ion Battery. Appl. Sci., 9.10.3390/app9061085 ↗
19. Defect detection of hot rolled steels with a new object detection framework called classification priority network10.1016/j.cie.2018.12.043 ↗
20. Liu, Y., Xu, K., and Xu, J. (2019). Periodic Surface Defect Detection in Steel Plates Based on Deep Learning. Appl. Sci., 9.10.3390/app9153127 ↗
21. Song, L., Li, X., Yang, Y., Zhu, X., Guo, Q., and Yang, H. (2018). Detection of Micro-Defects on Metal Screw Surfaces Based on Deep Convolutional Neural Networks. Sensors, 18.10.3390/s18113709 ↗
22. Railway Subgrade Defect Automatic Recognition Method Based on Improved Faster R-CNN
23. Santur, Y., Karaköse, M., and Akin, E. (2017, January 16–17). A new rail inspection method based on deep learning using laser cameras. Proceedings of the 2017 International Artificial Intelligence and Data Processing Symposium (IDAP), Malatya, Turkey.10.1109/IDAP.2017.8090245 ↗
24. Sun, X., Gu, J., Huang, R., Zou, R., and Palomares, B.G. (2019). Surface Defects Recognition of Wheel Hub Based on Improved Faster R-CNN. Electronics, 8.10.3390/electronics8050481 ↗
25. Measure System of Surface Flaw and Morphology Analysis of Cylindrical High Precision Parts
26. Shi, Y., Li, Y., Wei, X., and Zhou, Y. (2017, January 22–24). A faster-rcnn based chemical fiber paper tube defect detection method. Proceedings of the 2017 5th International Conference on Enterprise Systems (ES), Beijing, China.10.1109/ES.2017.35 ↗
27. Surface Defect Detection of Cylindrical Metal Workpiece Based on Faster R-CNN
28. Tao, X., Zhang, D., Ma, W., Liu, X., and Xu, D. (2018). Automatic metallic surface defect detection and recognition with convolutional neural networks. Appl. Sci., 8.10.3390/app8091575 ↗
29. Lien, P.C., and Zhao, Q. (2018, January 12–15). Product Surface Defect Detection Based on Deep Learning. Proceedings of the 2018 IEEE 16th Intl Conf on Dependable, Autonomic and Secure Computing, 16th Intl Conf on Pervasive Intelligence and Computing, 4th Intl Conf on Big Data Intelligence and Computing and Cyber Science and Technology Congress (DASC/PiCom/DataCom/CyberSciTech), Athens, Greece.10.1109/DASC/PiCom/DataCom/CyberSciTec.2018.00051 ↗
30. Few-shot Learning Combine Attention Mechanism-Based Defect Detection in Bar Surface10.2355/isijinternational.ISIJINT-2018-722 ↗
31. Haselmann, M., and Gruber, D. (2017, January 18–21). Supervised machine learning based surface inspection by synthetizing artificial defects. Proceedings of the 2017 16th IEEE international conference on machine learning and applications (ICMLA), Cancun, Mexico.10.1109/ICMLA.2017.0-130 ↗
32. Convolutional Neural Network Based Surface Inspection System for Non-patterned Welding Defects10.1007/s12541-019-00074-4 ↗
33. Surface defect detection based on fast regions with convolutional neutral network
34. Convolutional Neural Network for Wafer Surface Defect Classification and the Detection of Unknown Defect Class10.1109/TSM.2019.2902657 ↗
35. Li, Y., Huang, H., Xie, Q., Yao, L., and Chen, Q. (2018). Research on a surface defect detection algorithm based on MobileNet-SSD. Appl. Sci., 8.10.3390/app8091678 ↗
36. Deep learning-based crack damage detection using convolutional neural networks10.1111/mice.12263 ↗
37. Tang, C., Ling, Y., Yang, X., Jin, W., and Zheng, C. (2018). Multi-view object detection based on deep learning. Appl. Sci., 8.10.3390/app8091423 ↗
38. Tayara, H., and Chong, K. (2018). Object detection in very high-resolution aerial images using one-stage densely connected feature pyramid network. Sensors, 18.10.3390/s18103341 ↗
39. He, K.M., Zhang, X.Y., and Ren, S.Q. (2016, January 27–30). Deep residual learning for image recognition. Proceedings of the Computer Vision and Pattern Recognition, Las Vegas, NV, USA.10.1109/CVPR.2016.90 ↗
40. Ren, S.Q., He, K.M., and Ross, G. (2016, January 27–30). Faster R-CNN: Towards real-time object detection with region proposal networks. Proceedings of the Computer Vision and Pattern Recognition, Las Vegas, NV, USA.
41. Zeiler, M.D., and Rob, F. (2014, January 6–12). Computer Vision-ECCV 2014, PTI. Lecture Notes in Computer Science. Proceedings of the 13th Europen Conference on Computer Vision (ECCV), Zurich, Switzerland.
42. Simonyan, K., and Zisserman, A. (2015). Very Deep Convolutional Networks for Large-Scale Image Recognition. arXiv.
43. Zinkevich, M., Weimer, M., Smola, A.J., and Li, L. (2010, January 6–9). Parallelized stochastic gradient descent. Proceedings of the Conference on Neural Information Processing Systems, Vancouver, BC, Canada.
44. Demisse, G.G., Aouada, D., and Ottersten, D. (2016, January 27–30). Similarity metric for curved shapes in euclidean space. Proceedings of the Computer Vision & Pattern Recognition, Las Vegas, NV, USA.10.1109/CVPR.2016.545 ↗
45. Dai, J., Li, Y., He, K., and Sun, J. (2016, January 5–10). R-FCN: Object detection via region-based fully convolutional networks. Proceedings of the Advances in Neural Information Processing Systems, Barcelona, Spain.
46. Joseph, R., and Ali, F. (2018, January 18–23). YOLOv3: An incremental improvement. Proceedings of the Computer Vision and Pattern Recognition, Salt Lake City， UT, USA.