Soldering Data Classification with a Deep Clustering Approach: Case Study of an Academic-Industrial Cooperation
Source abstract
Abstract
Modern industries still commonly use traditional methods to visually inspect products, even though automation has many advantages over the skills of human labour. The automation of redundant tasks is one of the greatest successes of Artificial Intelligence (AI). It employs human annotation and finds possible relationships between features within a particular dataset. However, until recently, this has always been the responsibility of AI specialists with a specific type of knowledge that is not available to the industrial domain experts. We documented the joint research of AI and domain experts as a case study on processing a soldering-related industrial dataset. Our image classification approach relies on the latent space representations of neural networks already trained on other databases. We perform dimensionality reduction of the representations of the new data and cluster the outputs in the lower dimension. This method requires little to no knowledge of the underlying architecture of neural networks by the domain experts, meaning it is easily manageable by them, supporting generalization to other use cases that can be investigated in future work. We also suggest a misclassification detecting method. We were able to achieve near-perfect test accuracy with minimal annotation work.
Source: crossref · Quality: baseline
Research context
OpenAlex topics: Industrial Vision Systems and Defect Detection · Anomaly Detection Techniques and Applications · Machine Learning in Materials Science
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
Affiliations
Department of Artificial Intelligence, Faculty of Informatics, ELTE Eötvös Loránd University, Pázmány Péter Sétány 1/A, 1117 Budapest, Hungary
Robert Bosch Ltd., Gyömrői út 104, 1103 Budapest, Hungary
Funding
National Research, Development and Innovation Fund of Hungary · Ministry of Innovation and Technology NRDI Office · Robert Bosch, Ltd. Budapest, Hungary
References (37)
Show source-provided references
1. Xin, D., Wu, E.Y., Lee, D.J.L., Salehi, N., and Parameswaran, A. (2021, January 8–13). Whither AutoML? understanding the role of automation in machine learning workflows. Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems, Yokohama, Japan.10.1145/3411764.3445306 ↗
2. Weidele, D.K.I., Weisz, J.D., Oduor, E., Muller, M., Andres, J., Gray, A., and Wang, D. (2020, January 17–20). AutoAIViz: Opening the blackbox of automated artificial intelligence with conditional parallel coordinates. Proceedings of the 25th International Conference on Intelligent User Interfaces, Cagliari, Italy.10.1145/3377325.3377538 ↗
3. Drozdal, J., Weisz, J., Wang, D., Dass, G., Yao, B., Zhao, C., Muller, M., Ju, L., and Su, H. (2020, January 17–20). Trust in AutoML: Exploring information needs for establishing trust in automated machine learning systems. Proceedings of the 25th International Conference on Intelligent User Interfaces, Cagliari, Italy.10.1145/3377325.3377501 ↗
4. A review and analysis of automatic optical inspection and quality monitoring methods in electronics industry10.1109/ACCESS.2020.3029127 ↗
5. Metzner, M., Fiebag, D., Mayr, A., and Franke, J. (2019, January 3–4). Automated optical inspection of soldering connections in power electronics production using convolutional neural networks. Proceedings of the 2019 9th International Electric Drives Production Conference (EDPC), Esslingen, Germany.10.1109/EDPC48408.2019.9011820 ↗
6. Design of deep convolutional neural network architectures for automated feature extraction in industrial inspection10.1016/j.cirp.2016.04.072 ↗
7. Silva, W.R.L.D., and Lucena, D.S.D. (2018). Concrete cracks detection based on deep learning image classification. Proceedings, 2.10.3390/ICEM18-05387 ↗
8. Soldering defect detection in automatic optical inspection10.1016/j.aei.2019.101004 ↗
9. A fast and robust convolutional neural network-based defect detection model in product quality control10.1007/s00170-017-0882-0 ↗
10. Abadi, M., Agarwal, A., Barham, P., Brevdo, E., Chen, Z., Citro, C., Corrado, G.S., Davis, A., Dean, J., and Devin, M. (2016). Tensorflow: Large-scale machine learning on heterogeneous distributed systems. arXiv.
11. Deng, J., Dong, W., Socher, R., Li, L.J., Li, K., and Fei-Fei, L. (2009, January 20–25). Imagenet: A large-scale hierarchical image database. Proceedings of the 2009 IEEE Conference on Computer Vision and Pattern Recognition, Miami, FL, USA.10.1109/CVPR.2009.5206848 ↗
12. Zhan, X., Xie, J., Liu, Z., Ong, Y.S., and Loy, C.C. (2020, January 13–19). Online deep clustering for unsupervised representation learning. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, Seattle, WA, USA.10.1109/CVPR42600.2020.00672 ↗
13. Algorithm AS 136: A k-means clustering algorithm
14. Data clustering: A review10.1145/331499.331504 ↗
15. Caruana, R., and Niculescu-Mizil, A. (2006, January 25–29). An empirical comparison of supervised learning algorithms. Proceedings of the 23rd International Conference on Machine Learning, Pittsburgh, PA, USA.10.1145/1143844.1143865 ↗
16. Simonyan, K., and Zisserman, A. (2014). Very deep convolutional networks for large-scale image recognition. arXiv.
17. Huang, G., Liu, Z., Van Der Maaten, L., and Weinberger, K.Q. (2017, January 21–26). Densely connected convolutional networks. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Honolulu, HI, USA.10.1109/CVPR.2017.243 ↗
18. Zoph, B., Vasudevan, V., Shlens, J., and Le, Q.V. (2018, January 18–23). Learning transferable architectures for scalable image recognition. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Salt Lake City, UT, USA.10.1109/CVPR.2018.00907 ↗
19. Szegedy, C., Ioffe, S., Vanhoucke, V., and Alemi, A.A. (2017, January 4–9). Inception-v4, inception-resnet and the impact of residual connections on learning. Proceedings of the Thirty-First AAAI Conference on Artificial Intelligence, San Francisco, CA, USA.10.1609/aaai.v31i1.11231 ↗
20. Chollet, F. (2017, January 21–26). Xception: Deep learning with depthwise separable convolutions. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Honolulu, HI, USA.10.1109/CVPR.2017.195 ↗
21. Tan, M., and Le, Q. (2019, January 10–15). Efficientnet: Rethinking model scaling for convolutional neural networks. Proceedings of the International Conference on Machine Learning, Long Beach, CA, USA.
22. Zhu, X.J. (2005). Semi-Supervised Learning Literature Survey, University of Wisconsin.
23. Bo, D., Wang, X., Shi, C., Zhu, M., Lu, E., and Cui, P. (2020, January 20–24). Structural deep clustering network. Proceedings of the Web Conference 2020, Taipei, Taiwan.10.1145/3366423.3380214 ↗
24. McInnes, L., Healy, J., and Melville, J. (2018). Umap: Uniform manifold approximation and projection for dimension reduction. arXiv.10.21105/joss.00861 ↗
25. Yang, B., Fu, X., Sidiropoulos, N.D., and Hong, M. (2017, January 6–11). Towards k-means-friendly spaces: Simultaneous deep learning and clustering. Proceedings of the International Conference on Machine Learning, Sydney, NSW, Australia.
26. A survey of clustering with deep learning: From the perspective of network architecture10.1109/ACCESS.2018.2855437 ↗
27. Gradient-based learning applied to document recognition10.1109/5.726791 ↗
28. Krizhevsky, A. (2022, July 07). Learning Multiple Layers of Features from Tiny Images, Citeseer. Available online: https://www.cs.toronto.edu/~kriz/cifar.html.
29. He, K., Zhang, X., Ren, S., and Sun, J. (2016, January 27–30). Deep residual learning for image recognition. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Las Vegas, NV, USA.10.1109/CVPR.2016.90 ↗
30. Visualizing data using t-SNE
31. Silhouettes: A graphical aid to the interpretation and validation of cluster analysis10.1016/0377-0427(87)90125-7 ↗
32. Community structure in social and biological networks10.1073/pnas.122653799 ↗
33. Fast unfolding of communities in large networks10.1088/1742-5468/2008/10/P10008 ↗
34. Ha, Q., Liu, B., and Liu, F. (2020). Identifying melanoma images using efficientnet ensemble: Winning solution to the siim-isic melanoma classification challenge. arXiv.
35. Ensemble learning: A survey10.1002/widm.1249 ↗
36. Goodfellow, I.J., Pouget-Abadie, J., Mirza, M., Xu, B., Warde-Farley, D., Ozair, S., Courville, A., and Bengio, Y. (2014, January 8–13). Generative Adversarial Nets. Proceedings of the Advances in Neural Information Processing Systems, Montréal, QC, Canada.
37. Kingma, D.P., and Welling, M. (2013). Auto-encoding variational Bayes. arXiv.