journal article·2020-03

Aluminum Casting Inspection Using Deep Learning: A Method Based on Convolutional Neural Networks

Domingo Mery

Publisher page

Abstract

Castings produced for the automotive industry are considered important components for overall roadworthiness. To ensure the safety of construction, it is necessary to check every part thoroughly using non-destructive testing. X-ray testing rapidly became the accepted way of controlling the quality of die-cast pieces. In this paper, we present a Convolutional Neural Network (CNN) for defect detection in castings. In order to train the CNN model, a large dataset is necessary. We build the dataset by using synthetic defects. They are simulated using 3D ellipsoidal models and Generative Adversarial Networks (GAN). We compare different portions of ellipsoidal/GAN defects in the training subset. In our experiments, the use of GAN defects does not play a relevant role in this solution. However, ellipsoidal defects helped to achieve better performance. Ellipsoidal defects from any size and orientation could be superimposed onto real X-ray images in any location. In addition, we tested several CNN configurations, the best one, that we call Xnet-II, has 30 layers and more than 1,350,000 parameters. It has been trained using a dataset with around 640,000 patches containing 50% of ellipsoidal defects and 50% of real background captured from different casting types. The model was tested using sliding-windows methodology on whole X-ray images achieving promising results (mPA = 0.7102): the model was able to detect real defects from different casting types. We believe that the methodology presented could be used in similar projects that have to deal with automated detection of defects.
Source: openaire · Quality: candidate unverified · Source record ↗

Research context

OpenAlex topics: Industrial Vision Systems and Defect Detection · Welding Techniques and Residual Stresses · Non-Destructive Testing Techniques

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

References (47)

Show source-provided references
1. Mery, D.: Computer Vision for X-Ray Testing. Springer, New York (2015)10.1007/978-3-319-20747-6 ↗
2. Hanke, R., Fuchs, T., Uhlmann, N.: X-ray based methods for non-destructive testing and material characterization. Nucl. Instrum. Methods Phys. Res. Sect. A 591(1), 14–18 (2008)10.1016/j.nima.2008.03.016 ↗
3. Mery, D., Jaeger, T., Filbert, D.: A review of methods for automated recognition of casting defects. Insight 44(7), 428–436 (2002)
4. Mery, D.: Automated radioscopic testing of aluminum die castings. Mater. Eval. 64(2), 135–143 (2006)
5. Carrasco, M., Mery, D.: Automatic multiple view inspection using geometrical tracking and feature analysis in aluminum wheels. Mach. Vis. Appl. 22(1), 157–170 (2011)10.1007/s00138-010-0255-2 ↗
6. Cogranne, R., Retraint, F.: Statistical detection of defects in radiographic images using an adaptive parametric model. Signal Process. 96, 173–189 (2014)10.1016/j.sigpro.2013.09.016 ↗
7. Ferguson, M., Ak, R., Lee, Y.T.T., Law, K.H.: Automatic localization of casting defects with convolutional neural networks. In: 2017 IEEE International Conference on Big Data (Big Data), pp. 1726–1735. IEEE (2017)10.1109/BigData.2017.8258115 ↗
8. Kamalakannan, A., Rajamanickam, G.: Spatial smoothing based segmentation method for internal defect detection in x-ray images of casting components. In: Trends in Industrial Measurement and Automation (TIMA), vol. 2017, pp. 1–6. IEEE (2017)10.1109/TIMA.2017.8064796 ↗
9. Li, X., Tso, S.K., Guan, X.P., Huang, Q.: Improving automatic detection of defects in castings by applying wavelet technique. IEEE Trans. Ind. Electron. 53(6), 1927–1934 (2006)10.1109/TIE.2006.885448 ↗
10. Li, W., Li, K., Huang, Y., Deng, X.: A new trend peak algorithm with X-ray image for wheel hubs detection and recognition. In: Computational Intelligence and Intelligent Systems, pp. 23–31. Springer (2015)10.1007/978-981-10-0356-1_3 ↗
11. Lin, J., Yao, Y., Ma, L., Wang, Y.: Detection of a casting defect tracked by deep convolution neural network. Int. J. Adv. Manuf. Technol. 97(1–4), 573–581 (2018)10.1007/s00170-018-1894-0 ↗
12. Mery, D., Filbert, D.: Automated flaw detection in aluminum castings based on the tracking of potential defects in a radioscopic image sequence. IEEE Trans. Robot. Autom. 18(6), 890–901 (2002)10.1109/TRA.2002.805646 ↗
13. Mery, D.: Inspection of complex objects using multiple-X-ray views. IEEE/ASME Trans. Mechatron. 20(1), 338–347 (2015)10.1109/TMECH.2014.2311032 ↗
14. Mery, D., Arteta, C.: Automatic defect recognition in x-ray testing using computer vision. In: 2017 IEEE Winter Conference on Applications of Computer Vision (WACV), IEEE, pp. 1026–1035 (2017)10.1109/WACV.2017.119 ↗
15. Pieringer, C., Mery, D.: Flaw detection in aluminium die castings using simultaneous combination of multiple views. Insight 52(10), 548–552 (2010)10.1784/insi.2010.52.10.548 ↗
16. Pizarro, L., Mery, D., Delpiano, R., Carrasco, M.: Robust automated multiple view inspection. Pattern Anal. Appl. 11(1), 21–32 (2008)10.1007/s10044-007-0075-9 ↗
17. Ramírez, F., Allende, H.: Detection of flaws in aluminium castings: a comparative study between generative and discriminant approaches. Insight-Non-Destr. Test. Cond. Monit. 55(7), 366–371 (2013)10.1784/insi.2012.55.7.366 ↗
18. Tang, Y., Zhang, X., Li, X., Guan, X.: Application of a new image segmentation method to detection of defects in castings. Int. J. Adv. Manuf. Technol. 43(5–6), 431–439 (2009)10.1007/s00170-008-1720-1 ↗
19. Zhang, J., Guo, Z., Jiao, T., Wang, M.: Defect detection of aluminum alloy wheels in radiography images using adaptive threshold and morphological reconstruction. Appl. Sci. 8(12), 2365 (2018)10.3390/app8122365 ↗
20. Zhao, X., He, Z., Zhang, S.: Defect detection of castings in radiography images using a robust statistical feature. JOSA A 31(1), 196–205 (2014)10.1364/JOSAA.31.000196 ↗
21. Zhao, X., He, Z., Zhang, S., Liang, D.: A sparse-representation-based robust inspection system for hidden defects classification in casting components. Neurocomputing 153, 1–10 (2015)10.1016/j.neucom.2014.11.057 ↗
22. LeCun, Y., Bengio, Y., Hinton, G.: Deep learning. Nature 521(7553), 436–444 (2015)10.1038/nature14539 ↗
23. Bengio, Y., Courville, A., Vincent, P.: Representation learning: A review and new perspectives. IEEE Trans. Pattern Anal. Mach. Intell. 35(8), 1798–1828 (2013)10.1109/TPAMI.2013.50 ↗
24. Simonyan, K., Zisserman, A.: Very deep convolutional networks for large-scale image recognition. CoRR arXiv:1409.1556 (2014)
25. LeCun, Y., Bottou, L., Bengio, Y., Haffner, P., et al.: Gradient-based learning applied to document recognition. Proc. IEEE 86(11), 2278–2324 (1998)10.1109/5.726791 ↗
26. Krizhevsky, A., Sutskever, I., Hinton, G.E.: ImageNet classification with deep convolutional neural networks. In: NIPS, pp. 1106–1114 (2012)
27. Russakovsky, O., Deng, J., Su, H., Krause, J., Satheesh, S., Ma, S., Huang, Z., Karpathy, A., Khosla, A., Bernstein, M., Berg, A., Fei-Fei, L.: ImageNet large scale visual recognition challenge. Int. J. Comput. Vis. 115(3), 211–252 (2015)10.1007/s11263-015-0816-y ↗
28. Goodfellow, I., Bengio, Y., Courville, A.: Deep Learning. The MIT Press, Cambridge (2016)
29. Nair, V., Hinton, G.E.: Rectified linear units improve restricted boltzmann machines. In: Proceedings of the 27th International Conference on Machine Learning (ICML-10), pp. 807–814 (2010)
30. Rumelhart, D.E., Hinton, G.E., Williams, R.J.: Learning representations by back-propagating errors. Cogn. Model. 5(3), 1 (1998)
31. Srivastava, N., Hinton, G., Krizhevsky, A., Sutskever, I., Salakhutdinov, R.: Dropout: a simple way to prevent neural networks from overfitting. J. Mach. Learn. Res. 15, 1929–1958 (2014)
32. Ioffe, S., Szegedy, C.: Batch normalization: accelerating deep network training by reducing internal covariate shift. CoRR arXiv:1502.03167 (2015)
33. Carvajal, K., Chacon, M., Mery, D., Acuna, G.: Neural network method for failure detection with skewed class distribution. Insight-Non-Destr. Test. Cond. Monit. 46(7), 399–402 (2004)10.1784/insi.46.7.399.55578 ↗
34. Mery, D.: A new algorithm for flaw simulation in castings by superimposing projections of 3d models onto x-ray images. In: 21st International Conference of the Chilean Computer Science Society (SCCC 2001), 6–8 Nov 2001, Punta Arenas, Chile, pp. 193–202 (2001)
35. Radford, A., Metz, L., Chintala, S.: Unsupervised representation learning with deep convolutional generative adversarial networks. CoRR arXiv:1511.06434 (2015)
36. Martz, H., Logan, C., Schneberk, D., Shull, P.: X-ray Imaging: Fundamentals, Industrial Techniques and Applications. CRC Press, Boca Raton (2017)
37. Mery, D., Hahn, D., Hitschfeld, N.: Simulation of defects in aluminium castings using cad models of flaws and real x-ray images. Insight-Non-Destr. Test. Cond. Monit. 47(10), 618–624 (2005). (Ron Halmshaw Award 2005)10.1784/insi.2005.47.10.618 ↗
38. Creswell, A., White, T., Dumoulin, V., Arulkumaran, K., Sengupta, B., Bharath, A.A.: Generative adversarial networks: an overview. IEEE Signal Process. Mag. 35(1), 53–65 (2018)10.1109/MSP.2017.2765202 ↗
39. Goodfellow, I., Pouget-Abadie, J., Mirza, M., Xu, B., Warde-Farley, D., Ozair, S., Courville, A., Bengio, Y.: Generative adversarial nets. In: Advances in Neural Information Processing Systems, pp. 2672–2680 (2014)
40. Mery, D., Riffo, V., Zscherpel, U., Mondragón, G., Lillo, I., Zuccar, I., Lobel, H., Carrasco, M.: GDXray: the database of X-ray images for nondestructive testing. J. Nondestruct. Eval. 34(4), 1–12 (2015)10.1007/s10921-015-0315-7 ↗
41. Everingham, M., Van Gool, L., Williams, C.K., Winn, J., Zisserman, A.: The pascal visual object classes (voc) challenge. Int. J. Comput. Vis. 88(2), 303–338 (2010)10.1007/s11263-009-0275-4 ↗
42. Redmon, J., Farhadi, A.: Yolov3: an incremental improvement. arXiv:1804.02767 (2018)
43. He, K., Zhang, X., Ren, S., Sun, J.: Deep residual learning for image recognition. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 770–778 (2016)10.1109/CVPR.2016.90 ↗
44. Mery, D.: Automated detection of welding defects without segmentation. Mater. Eval. 69(6), 657–663 (2011)
45. Gucunski, N., et al.: Nondestructive Testing to Identify Concrete Bridge Deck Deterioration. Transportation Research Board, Washington, DC (2013)
46. Carrasco, M., Pizarro, L., Mery, D.: Visual inspection of glass bottlenecks by multiple-view analysis. Int. J. Comput. Integr. Manuf. 23(10), 925–941 (2010)10.1080/0951192X.2010.500676 ↗
47. Liu, H.W., Lan, Y.Y., Lee, H.W., Liu, D.K.: Steel surface in-line inspection using machine vision. In: First International Workshop on Pattern Recognition, vol. 10011; 100110X. International Society for Optics and Photonics (2016)10.1117/12.2242965 ↗