journal article·2022-02-22Open access

Data Extraction Method for Industrial Data Matrix Codes Based on Local Adjacent Modules Structure

Licheng Liao, Jianmei Li, Changhou Lu

Applied Sciences· Volume 12· Issue 5

Abstract

A 2D barcode is a reliable way to provide lifetime traceability of parts that are exposed to harsh environments. However, there are considerable challenges in adopting mobile cameras to read symbols directly marked on metal surfaces. Images captured by mobile cameras are usually of low quality with poor contrast due to the reflective surface of 2D barcode symbols. To deal with this problem, a novel laser-marked Data Matrix symbols reading method based on deep learning is proposed for mobile phone captured images. Utilizing the barcode module features, we train different convolutional neural network (CNN) models to learn the colors of two adjacent modules of a Data Matrix symbol. Depending on whether the colors of the two adjacent modules are the same or not, an edge image is transformed from a square grid, which is the same size as the barcode. A correction method based on the KM algorithm is used to get a corrected edge image, which helps to reconstruct the final barcode image. Experiments are carried out on our database, and the results show that the proposed algorithm outperforms in high accuracy of barcode recognition.
Source: crossref · Quality: baseline

Research context

OpenAlex topics: QR Code Applications and Technologies · Industrial Vision Systems and Defect Detection · Image and Object Detection Techniques

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

School of Mechanical Engineering, Shandong University, Jinan 250061, China

Key Laboratory of High-Efficiency and Clean Mechanical Manufacture, Shandong University, Ministry of Education, Jinan 250061, China

References (27)

Show source-provided references
1. Xiao, Y., and Ming, Z. (2019). 1D barcode detection via integrated deep-learning and geometric approach. Appl. Sci., 9.10.3390/app9163268 ↗
2. Karrach, L., Pivarčiová, E., and Bozek, P. (2020). Recognition of perspective distorted QR codes with a partially damaged finder pattern in real scene images. Appl. Sci., 10.10.3390/app10217814 ↗
3. Kim, J.S., Yi, C.Y., and Park, Y.J. (2021). Image Processing and QR Code Application Method for Construction Safety Management. Appl. Sci., 11.10.3390/app11104400 ↗
4. Nadabar, S.G., and Desai, R. (2005). Method and Apparatus Using Intensity Gradients for Visual Identification of 2D Matrix Symbols. (6,941,026), U.S. Patent.
5. Che, Z., Zhai, G., Liu, J., Gu, K., Le Callet, P., Zhou, J., and Liu, X. (2018, January 7–10). A blind quality measure for industrial 2d matrix symbols using shallow convolutional neural network. Proceedings of the 2018 25th IEEE International Conference on Image Processing (ICIP), Athens, Greece.10.1109/ICIP.2018.8451591 ↗
6. VCode-Pervasive data transfer using video barcode10.1109/TMM.2008.917353 ↗
7. (2011). Information Technology-Automatic Identification and Data Capture Techniques-Bar Code Symbol Print Quality Test Specification-Two-Dimensional Symbols (Standard No. ISO/IEC-15415).
8. (2006). Information Technology-Automatic Identification and Data Capture Techniques-Data Matrix Bar Code Symbology Specification (Standard No. ISO/IEC-16022).
9. A two-stage quality measure for mobile phone captured 2D barcode images10.1016/j.patcog.2013.01.031 ↗
10. Kang, L., Ye, P., Li, Y., and Doermann, D. (2014, January 23–28). Convolutional neural networks for no-reference image quality assessment. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Columbus, OH, USA.10.1109/CVPR.2014.224 ↗
11. Natsukari, C., and Nakata, H. (2006). Two-Dimensional Code Reader Setting Method, Two-Dimensional Code Reader, Two Dimensional Code Reader Setting Program and Computer Readable Recording Medium. (6,983,886), U.S. Patent.
12. A common image processing framework for 2-D barcode reading
13. Thielemann, J.T., Schumann-Olsen, H., Schulerud, H., and Kirkhus, T. (July, January 27). Handheld PC with camera used for reading information dense barcodes. Proceedings of the IEEE Int. Conference on Computer Vision and Pattern Recognition, Demonstration Program, Washington, DC, USA.
14. Parikh, D., and Jancke, G. (2008, January 7–9). Localization and segmentation of a 2D high capacity color barcode. Proceedings of the 2008 IEEE Workshop on Applications of Computer Vision, Copper Mountain, CO, USA.10.1109/WACV.2008.4544033 ↗
15. Binarization of Low-Quality Barcode Images Captured by Mobile Phones Using Local Window of Adaptive Location and Size10.1109/TIP.2011.2155074 ↗
16. Binarization for low-quality ESPI fringe patterns based on preprocessing and clustering10.1364/AO.440615 ↗
17. Binarization of Stone Inscription Images by Modified Bi-level Entropy Thresholding10.1142/S0219477521500541 ↗
18. Unsupervised neural domain adaptation for document image binarization10.1016/j.patcog.2021.108099 ↗
19. A survey of Hough Transform10.1016/j.patcog.2014.08.027 ↗
20. Invisible data matrix detection with smart phone using geometric correction and Hough transform10.1117/12.2223724 ↗
21. Chelghoum, R., Ikhlef, A., Hameurlaine, A., and Jacquir, S. (2020). Transfer learning using convolutional neural network architectures for brain tumor classification from MRI images. IFIP International Conference on Artificial Intelligence Applications and Innovations, Springer.10.1007/978-3-030-49161-1_17 ↗
22. Imagenet classification with deep convolutional neural networks
23. Szegedy, C., Liu, W., Jia, Y., Sermanet, P., Reed, S., Anguelov, D., Erhan, D., Vanhoucke, V., and Rabinovich, A. (2015, January 7–12). Going deeper with convolutions. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Boston, MA, USA.10.1109/CVPR.2015.7298594 ↗
24. Simonyan, K., and Zisserman, A. (2014). Very deep convolutional networks for large-scale image recognition. arXiv.
25. He, K., Zhang, X., Ren, S., and Sun, J. (2016, January 27–30). Deep residual learning for image recognition. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Las Vegas, NV, USA.10.1109/CVPR.2016.90 ↗
26. The Hungarian method for the assignment problem10.1002/nav.3800020109 ↗
27. Algorithms for the assignment and transportation problems10.1137/0105003 ↗