journal article·2020-11-18Open access

Dual-Kernel-Based Aggregated Residual Network for Surface Defect Inspection in Injection Molding Processes

Hwaseop Lee, Kwangyeol Ryu

Applied Sciences· Volume 10· Issue 22

Abstract

Automated quality inspection has been receiving increasing attention in manufacturing processes. Since the introduction of convolutional neural networks (CNNs), many researchers have attempted to apply CNNs to classification and detection of defect images. However, injection molding processes have not received much attention in this field of research because of product diversity, difficulty in obtaining uniform-quality product images, and short cycle times. In this study, two types of dual-kernel-based aggregated residual networks are proposed by utilizing a fixed kernel and a deformable kernel to detect surface and shape defects of molded products. The aggregated residual network is selected as a backbone, and a fixed-size, deformable kernel is applied for extracting surface and geometric features simultaneously. Comparative studies are conducted by including the existing research using the Weakly Supervised Learning for Industrial Optical Inspection dataset, which is a DAGM dataset. A case study reveals that the proposed method is applicable for inspecting the quality of injection molding products with excellent performance.
Source: crossref · Quality: baseline

Research context

OpenAlex topics: Industrial Vision Systems and Defect Detection · Advanced machining processes and optimization · Manufacturing Process and Optimization

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

Manufacturing Data Analytics Laboratory, Department of Industrial Engineering, Pusan National University, Busan 46241, Korea

References (38)

Show source-provided references
1. A review of human error in aviation maintenance and inspection10.1016/S0169-8141(99)00063-3 ↗
2. An automated mask inspection system—AMIS10.1109/T-ED.1975.18167 ↗
3. Automated inspection of textile fabrics using textural models10.1109/34.85670 ↗
4. Malloy, R.A. (1994). Plastic Part Design for Injection Molding, Hanser Publishers. [2nd ed.].
5. Qiu, Z., Chen, J., Zhao, Y., Zhu, S., He, Y., and Zhang, C. (2018). Variety identification of single rice seed using hyperspectral imaging combined with convolutional neural network. Appl. Sci., 8.10.3390/app8020212 ↗
6. Polat, H., and Danaei, M.H. (2019). Classification of pulmonary CT images by using hybrid 3D-deep convolutional neural network architecture. Appl. Sci., 9.10.3390/app9050940 ↗
7. Oh, S.L., Vicnesh, J., Ciaccio, E.J., Yuvaraj, R., and Acharya, U.R. (2019). Deep convolutional neural network model for automated diagnosis of schizophrenia using EEG signals. Appl. Sci., 9.10.3390/app9142870 ↗
8. Xie, S., Girshick, R., Dollár, P., Tu, Z., and He, K. (2017, January 21–26). Aggregated residual transformations for deep neural networks. Proceedings of the IEEE Conference On Computer Vision and Pattern Recognition, Honolulu, HI, USA.10.1109/CVPR.2017.634 ↗
9. Dai, J., Qi, H., Xiong, Y., Li, Y., Zhang, G., Hu, H., and Wei, Y. (2017, January 22). Deformable convolutional networks. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition Workshops, Venice, Italy.10.1109/ICCV.2017.89 ↗
10. Zhu, X., Hu, H., Lin, S., and Dai, J. (2019, January 16–20). Deformable convnets v2: More deformable, better results. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Long Beach, CA, USA.10.1109/CVPR.2019.00953 ↗
11. Gradient-based learning applied to document recognition10.1109/5.726791 ↗
12. Krizhevsky, A., Sutskever, I., and Hinton, G. (2012, January 3–6). Imagenet classification with deep convolutional neural networks. Proceedings of the Advances in Neural Information Processing Systems, Lake Tahoe, NV, USA.
13. Ren, S., He, K., Girshick, R., and Sun, J. (2015, January 7–12). Faster r-cnn: Towards realtime object detection with region proposal networks. Proceedings of the Advances in Neural Information Processing Systems, Montreal, QC, Canada.
14. Human tracking using convolutional neural networks10.1109/TNN.2010.2066286 ↗
15. A novel convolutional neural network based fault recognition method via image fusion of multi-vibration-signals10.1016/j.compind.2018.12.013 ↗
16. Intelligent fault diagnosis of rotating machinery based on one-dimensional convolutional neural network10.1016/j.compind.2018.12.001 ↗
17. A review of recent advances in surface defect detection using texture analysis techniques10.5565/rev/elcvia.268 ↗
18. A survey of fault diagnosis and fault-tolerant techniques—Part I: Fault diagnosis with model-based and signal-based approaches10.1109/TIE.2015.2417501 ↗
19. Color grading of randomly textured ceramic tiles using color histograms10.1109/41.744415 ↗
20. Pietikainen, M., Maenpaa, T., and Viertola, J. (2002). Color texture classification with color histograms and local binary patterns. Workshop on Texture Analysis in Machine Visio, Machine Vision Group, University of Oulu.
21. Detection of local defects in textile webs using Gabor filters10.1117/1.601751 ↗
22. A generic deep-learning-based approach for automated surface inspection10.1109/TCYB.2017.2668395 ↗
23. Anomaly detection with convolutional neural networks for industrial surface inspection10.1016/j.procir.2019.02.123 ↗
24. A fast and robust convolutional neural network-based defect detection model in product quality control10.1007/s00170-017-0882-0 ↗
25. Tao, X., Zhang, D., Ma, W., Liu, X., and Xu, D. (2018). Automatic metallic surface defect detection and recognition with convolutional neural networks. Appl. Sci., 8.10.3390/app8091575 ↗
26. Automatic defect detection of fasteners on the catenary support device using deep convolutional neural network10.1109/TIM.2017.2775345 ↗
27. Classification of surface defects on steel sheet using convolutional neural networks
28. Concrete crack detection with handwriting script interferences using faster region-based convolutional neural network10.1111/mice.12497 ↗
29. Chun, P.J., Izumi, S., and Yamane, T. (2020). Automatic detection method of cracks from concrete surface imagery using two-step light gradient boosting machine. Comput. Aided Civ. Infrastruct. Eng.10.1111/mice.12564 ↗
30. Crack Detection from a Concrete Surface Image Based on Semantic Segmentation Using Deep Learning10.3151/jact.18.493 ↗
31. Autonomous concrete crack detection using deep fully convolutional neural network10.1016/j.autcon.2018.11.028 ↗
32. He, K., Zhang, X., Ren, S., and Sun, J. (2016, January 27–30). Deep residual learning for image recognition. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Las Vegas, NV, USA.10.1109/CVPR.2016.90 ↗
33. Timm, F., and Barth, E. (2011, January 7). Non-parametric texture defect detection using Weibull features. Proceedings of the Image Processing: Machine Vision Applications IV, San Francisco, CA, USA.10.1117/12.872463 ↗
34. Siebel, N.T., and Sommer, G. (2008, January 1–6). Learning defect classifiers for visual inspection images by neuro-evolution using weakly labelled training data. Proceedings of the IEEE Congress on Evolutionary Computation, Hong Kong, China.10.1109/CEC.2008.4631331 ↗
35. Wavelets and their applications for surface metrology10.1016/j.cirp.2008.03.110 ↗
36. Design of deep convolutional neural network architectures for automated feature extraction in industrial inspection10.1016/j.cirp.2016.04.072 ↗
37. Chen, K., Wang, J., Pang, J., Cao, Y., Xiong, Y., Li, X., and Zhang, Z. (2019). Mmdetection: Open mmlab detection toolbox and benchmark. arXiv preprint.
38. (2019, April 19). PyTorch Implementation of Deformable ConvNets v2 (Modulated Deformable Convolution). Available online: https://Github.com/4uiiurz1/pytorch-deform-conv-v2.