Using Deep Learning for Defect Classification on a Small Weld X-ray Image Dataset
Source abstract
Abstract
This document provides a comparative evaluation of the performance of a deep learning network for different combinations of parameters and hyper-parameters. Although there are numerous studies that report on performance in deep learning networks for ordinary data sets, their performance on small data sets is much less evaluated. The objective of this work is to demonstrate that such a challenging small data set, such as a welding X-ray image data set, can be trained and evaluated obtaining high precision and that it is possible thanks to data augmentation. In fact, this article shows that data augmentation, also a typical technique in any learning process on a large data set, plus that two image channels, such as channels B (blue) and G (green), both are replaced by the Canny edge map and a binary image provided by an adaptive Gaussian threshold, respectively, gives to the network a 3% increase in accuracy, approximately. In summary, the objective of this work is to present the methodology used and the results obtained to estimate the classification accuracy of three main classes of welding defects obtained on a small set of welding X-ray image data.
Source: openaire · Quality: candidate unverified · Source record ↗
Research context
OpenAlex topics: Welding Techniques and Residual Stresses · Non-Destructive Testing Techniques · Industrial Vision Systems and Defect Detection
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
References (35)
Show source-provided references
1. Bay, H., Tuytelaars, T., Gool, L.V.: Surf: Speeded up robust features. In: In ECCV, pp. 404–417 (2006). http://citeseerx.ist.psu.edu/viewdoc/summary?doi=10.1.1.85.251210.1007/11744023_32 ↗
2. Calonder, M., Lepetit, V., Strecha, C., Fua, P.: Brief: binary robust independent elementary features. In: Proceedings of the 11th European Conference on Computer vision: Part IV, ECCV’10, pp. 778–792. Springer-Verlag, Berlin, Heidelberg (2010). http://dl.acm.org/citation.cfm?id=1888089.188814810.1007/978-3-642-15561-1_56 ↗
3. Carvalho, A., Rebello, J., Sagrilo, L., Camerini, C., Miranda, I.: Mfl signals and artificial neural networks applied to detection and classification of pipe weld defects. Ndt & E Int. 39(8), 661–667 (2006)10.1016/j.ndteint.2006.04.003 ↗
4. Dalal, N., Triggs, B.: Histograms of oriented gradients for human detection. In: Computer Vision and Pattern Recognition, 2005. CVPR 2005. IEEE Computer Society Conference on, vol. 1, pp. 886–893 (2005). http://ieeexplore.ieee.org/xpl/login.jsp?tp=&arnumber=1467360&url=http%3A%2F%2Fieeexplore.ieee.org%2Fxpls%2Fabs_all.jsp%3Farnumber%3D1467360
5. Di, L., Yonglun, S., Feng, Y.: Online monitoring of weld defects for short-circuit gas metal arc welding based on the self-organizing feature map neural networks. In: Proceedings of the IEEE-INNS-ENNS International Joint Conference on Neural Networks. IJCNN 2000. Neural Computing: New Challenges and Perspectives for the New Millennium, vol. 5, pp. 239–244 (2000)
6. Ewert, U., Zscherpel, U., Horkey, M., Kennedy, J., Hutchinson, M.: A new computer based concept for digital radiographic reference images. J. Nondestr. Test. 7(12), 1–13 (2002)
7. Goodfellow, I., Bengio, Y., Courville, A.: Deep Learning. MIT Press, Cambridge (2016)
8. Haralick, R.M., Shanmugam, K.S., Dinstein, I.: Textural features for image classification. IEEE Trans. Syst. Man Cybern. 3(6), 610–621 (1973)10.1109/TSMC.1973.4309314 ↗
9. Harris, C., Stephens, M.: A combined corner and edge detector. In: In Proc. of Fourth Alvey Vision Conference, pp. 147–151 (1988). http://citeseerx.ist.psu.edu/viewdoc/summary?doi=10.1.1.231.1604
10. Hou, W., Wei, Y., Guo, J., Jin, Y., Zhu, C.: Automatic detection of welding defects using deep neural network. J. Phys. 933, 012006 (2018). https://doi.org/10.1088/1742-6596/933/1/01200610.1088/1742-6596/933/1/012006 ↗
11. Hu, M.K.: Visual pattern recognition by moment invariants. Inf. Theory IRE Trans. 8(2), 179–187 (1962). https://doi.org/10.1109/TIT.1962.105769210.1109/TIT.1962.1057692 ↗
12. Huang, J., Kumar, R., Mitra, M., Zhu, W.J., Zabih, R.: Image indexing using color correlograms. In: CVPR, pp. 762–768. IEEE Computer Society (1997). http://dblp.uni-trier.de/db/conf/cvpr/cvpr1997.html#HuangKMZZ97
13. Ioffe, S., Szegedy, C.: Batch normalization: Accelerating deep network training by reducing internal covariate shift. CoRR arXiv:abs/1502.03167 (2015). http://dblp.uni-trier.de/db/journals/corr/corr1502.html#IoffeS15
14. Khotanzad, A., Hong, Y.: Invariant image recognition by zernike moments. IEEE Trans. Pattern Anal. Mach. Intell. 12(5), 489–497 (1990). https://doi.org/10.1109/34.5510910.1109/34.55109 ↗
15. Krizhevsky, A., Sutskever, I., Hinton, G.E.: Imagenet classification with deep convolutional neural networks. In: Pereira, F., Burges, C.J.C., Bottou, L., Weinberger, K.Q. (eds.) Advances in Neural Information Processing Systems, pp. 1097–1105. Curran Associates Inc., New York (2012)
16. Laboratories, S.U.S.E., Widrow, B., of Naval Research, U.S.O., Corps, U.S.A.S., Force, U.S.A., Navy, U.S.: Adaptive “adaline” neuron using chemical “memistors.”. (1960). https://books.google.es/books?id=Yc4EAAAAIAAJ
17. LeCun, Y., Bengio, Y., Hinton, G.: Deep learning. Nature 521(7553), 436–444 (2015). https://doi.org/10.1038/nature1453910.1038/nature14539 ↗
18. Liao, T.W., Tang, K.: Automated extraction of welds from digitized radiographic images based on mlp neural networks. Appl. Artif. Intell. 11(3), 197–218 (1997)10.1080/088395197118226 ↗
19. Lowe, D.G.: Object recognition from local scale-invariant features. In: Proceedings of the Seventh IEEE International Conference on Computer Vision, vol. 2, pp. 1150–1157 (1999)10.1109/ICCV.1999.790410 ↗
20. Mery, D., Riffo, V., Zscherpel, U., Mondragón, G., Lillo, I., Zuccar, I., Lobel, H., Carrasco, M.: Gdxray: the database of x-ray images for nondestructive testing. J. Nondestr. Eval. 34(4), 42 (2015)10.1007/s10921-015-0315-7 ↗
21. Nacereddine, N., Goumeidane, A.B., Ziou, D.: Unsupervised weld defect classification in radiographic images using multivariate generalized gaussian mixture model with exact computation of mean and shape parameters. Comput. Ind. 108, 132–149 (2019). https://doi.org/10.1016/j.compind.2019.02.01010.1016/j.compind.2019.02.010 ↗
22. Nesterov, Y.E.: A method for solving the convex programming problem with convergence rate $$o(1/k^2)$$. Dokl. Akad. Nauk SSSR 269, 543–547 (1983)
23. Ojala, T., Pietikäinen, M., Mäenpää, T.: Multiresolution gray-scale and rotation invariant texture classification with local binary patterns. IEEE Trans. Pattern Anal. Mach. Intell. 24(7), 971–987 (2002)10.1109/TPAMI.2002.1017623 ↗
24. Peng, J.J.: A method for recognition of defects in welding lines. In: 2009 International Conference on Artificial Intelligence and Computational Intelligence, vol. 2, pp. 366–369. IEEE (2009)10.1109/AICI.2009.82 ↗
25. Qian, N.: On the momentum term in gradient descent learning algorithms. Neural Netw. 12(1), 145–151 (1999). https://doi.org/10.1016/S0893-6080(98)00116-610.1016/S0893-6080(98)00116-6 ↗
26. Rosenblatt, F.: The perceptron: a probabilistic model for information storage and organization in the brain. Psych. Rev. 65, 386–407 (1958)10.1037/h0042519 ↗
27. Rosten, E., Drummond, T.: Fusing points and lines for high performance tracking. IEEE Int. Conf. Comput. Vis. 2, 1508–1511 (2005). https://doi.org/10.1109/ICCV.2005.10410.1109/ICCV.2005.104 ↗
28. Russell, S., Norvig, P.: Artificial Intelligence: A Modern Approach, 3rd edn. Prentice Hall Press, Upper Saddle River (2009)
29. Shen, Q., Gao, J., Li, C.: Automatic classification of weld defects in radiographic images. Insight-Non-Destr. Test. Cond. Monit. 52(3), 134–139 (2010)10.1784/insi.2010.52.3.134 ↗
30. Shitole, C.N., Zahran, O., Al-Nuaimy, W.: Combining fuzzy logic and neural networks in classification of weld defects using ultrasonic time-of-flight diffraction. Insight-Non-Destr. Test. Cond. Monit. 49(2), 79–82 (2007)10.1784/insi.2007.49.2.79 ↗
31. Simonyan, K., Zisserman, A.: Very deep convolutional networks for large-scale image recognition. CoRR abs/1409.1556 (2014). arXiv:1409.1556
32. Sutcliffe, M., Lewis, J.: Automatic defect recognition of single-v welds using full matrix capture data, computer vision and multi-layer perceptron artificial neural networks. Insight-Non-Destr. Test. Cond. Monit. 58(9), 487–493 (2016). https://doi.org/10.1784/insi.2016.58.9.48710.1784/insi.2016.58.9.487 ↗
33. Zapata, J., Vilar, R., Ruiz, R.: Performance evaluation of an automatic inspection system of weld defects in radiographic images based on neuro-classifiers. Expert Syst. Appl. 38(7), 8812–8824 (2011)10.1016/j.eswa.2011.01.092 ↗
34. Zeiler, M.D., Fergus, R.: Visualizing and understanding convolutional networks. CoRR abs/1311.2901 (2013). http://dblp.uni-trier.de/db/journals/corr/corr1311.html#ZeilerF13
35. Zscherpel, U., Berlin, B.: Film digitisation systems for dir: standards, requirements, archiving and printing. J. NDT Ultrason. 5, 5 (2000)