A Robust Texture-Less Gray-Scale Surface Matching Method Applied to a Liquid Crystal Display TV Diffuser Plate Assembly System
Source abstract
Abstract
In most liquid crystal display (LCD) backlight modules (BLMs), diffuser plates (DPs) play the essential role in blurring the backlight. A common BLM consists of multiple superimposed optical films. In a vision-based automated assembly system, to ensure sufficient accuracy, each of the multiple cameras usually shoots a local corner of the DP and jointly estimates the target pose, guiding the robot to assemble the DP on the BLM. In general, DPs are typical of texture-less objects with simple shapes. Due to the image background of superimposed multilayer optical films, the robustness of the most common detection methods must be improved to meet industrial needs. To solve the above problem, a texture-less surface matching method based on gray-scale images was proposed. An augmented and normalized gray-scale vector represents the texture-less gray-scale surface in a low-dimensional space. The cosine distance is then used to calculate the similarity between the template and matching vectors, combined with shape-based matching (SBM); the proposed method can obtain high robustness when detecting DPs. An image database from actual production lines was used in the experiment. In comparative tests with the NCC, SBM, YOLOv5s, and YOLOv5x methods, our proposed method had the best precision at all confidence thresholds. Although recall was slightly inferior to SBM, the comprehensive evaluation F1-Score reached 0.826, significantly outperforming the other methods. Regarding localizing accuracy, our algorithm also performed best, reaching 5.7 pixels. Although the time consumption of a single prediction is about 0.6 s, it can still meet industrial needs. These experimental results show that the proposed method has high robustness in detecting DPs and is especially suitable for vision-based automatic assembly tasks in BLM.
Source: crossref · Quality: baseline
Research context
OpenAlex topics: Advanced Vision and Imaging · Industrial Vision Systems and Defect Detection · Robotics and Sensor-Based Localization
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
Affiliations
Key Laboratory of Opto-Electronic Information Processing, Chinese Academy of Sciences, Shenyang 110016, China
Shenyang Institute of Automation, Chinese Academy of Sciences, Shenyang 110016, China
Institutes of Robotics and Intelligent Manufacturing, Chinese Academy of Sciences, Shenyang 110016, China
University of Chinese Academy of Sciences, Beijing 100049, China
Funding
National Natural Science Foundation of China
References (23)
Show source-provided references
1. Gall, J., and Lempitsky, V. (2009, January 20–25). Class-specific Hough forests for object detection. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Miami, FL, USA.10.1109/CVPR.2009.5206740 ↗
2. Hough Forests for Object Detection, Tracking, and Action Recognition10.1109/TPAMI.2011.70 ↗
3. Random Forests Machine Learning
4. Dalal, N., and Triggs, B. (2005, January 20–26). Histograms of oriented gradients for human detection. Proceedings of the Computer Vision and Pattern Recognition, San Diego, CA, USA.
5. Sadeghi, M.A., and Forsyth, D. (2014, January 6–12). 30hz object detection with dpm v5. Proceedings of the European Conference on Computer Vision, Zurich, Switzerland.10.1007/978-3-319-10590-1_5 ↗
6. Support Vector Machines for Multiple-Instance Learning
7. Lin, T.-Y., Goyal, P., Girshick, R., He, K., and Doll, P. (2017, January 22–29). Focal loss for dense object detection. Proceedings of the International Conference on Computer Vision, Venice, Italy.10.1109/ICCV.2017.324 ↗
8. Redmon, J., Divvala, S., Girshick, R., and Farhadi, A. (2016, January 27–30). You only look once: Unified, real-time object detection. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Las Vegas, NV, USA.10.1109/CVPR.2016.91 ↗
9. Zhu, X., Lyu, S., Wang, X., and Zhao, Q. (2021, January 11–17). TPH-YOLOv5: Improved YOLOv5 based on transformer prediction head for object detection on drone-captured scenarios. Proceedings of the International Conference on Computer Vision, Montreal, BC, Canada.10.1109/ICCVW54120.2021.00312 ↗
10. Ge, Z., Liu, S., Wang, F., Li, Z., and Sun, J. (2021, January 20–25). Yolox: Exceeding yolo series in 2021. Proceedings of the Computer Vision and Pattern Recognition, Nashville, TN, USA.
11. He, K., Zhang, X., Ren, S., and Sun, J. (2016, January 27–30). Deep residual learning for image recognition. Proceedings of the Computer Vision and Pattern Recognition, Las Vegas, NV, USA.10.1109/CVPR.2016.90 ↗
12. Lin, T.Y., Dollár, P., Girshick, R., He, K., Hariharan, B., and Belongie, S. (2017, January 21–26). Feature pyramid networks for object detection. Proceedings of the Computer Vision and Pattern Recognition, Honolulu, HI, USA.10.1109/CVPR.2017.106 ↗
13. Dosovitskiy, A., Beyer, L., Kolesnikov, A., Weissenborn, D., Zhai, X., Unterthiner, T., Dehghani, M., Minderer, M., Heigold, G., and Gelly, S. (2020, January 13–19). An image is worth 16 × 16 words: Transformers for image recognition at scale. Proceedings of the Computer Vision and Pattern Recognition, Seattle, WA, USA.
14. Liu, Z., Lin, Y., Cao, Y., Hu, H., Wei, Y., Zhang, Z., Lin, S., and Guo, B. (2021, January 11–17). Swin transformer: Hierarchical vision transformer using shifted windows. Proceedings of the International Conference on Computer Vision, Montreal, BC, Canada.10.1109/ICCV48922.2021.00986 ↗
15. Carion, N., Massa, F., Synnaeve, G., Usunier, N., Kirillov, A., and Zagoruyko, S. (2020, January 23–28). End-to-end object detection with transformers. Proceedings of the European Conference on Computer Vision, Glasgow, UK.10.1007/978-3-030-58452-8_13 ↗
16. Lv, W., Xu, S., Zhao, Y., Wang, G., Wei, J., Cui, C., Du, Y., Dang, Q., and Liu, Y. (2023, January 17–24). Detrs beat yolos on real-time object detection. Proceedings of the Computer Vision and Pattern Recognition, Vancouver, BC, Canada.
17. Fast recurrence algorithm for computing sub-Image energy using normalized cross correlation10.3788/OPE.20182610.2565 ↗
18. Illumination invariant object recognition
19. Gradient response maps for real-time detection of textureless objects10.1109/TPAMI.2011.206 ↗
20. Hinterstoisser, S., Lepetit, V., Ilic, S., Holzer, S., Bradski, G., Konolige, K., and Navab, N. (2013, January 5–9). Model based training, detection and pose estimation of texture-less 3d objects in heavily cluttered scenes. Proceedings of the Asian Conference on Computer Vision, Daejeon, Republic of Korea.10.1007/978-3-642-37331-2_42 ↗
21. MVTec (2023, January 10). HALCON. Available online: https://www.mvtec.com/halcon/.
22. (2023, January 10). Ultralytics.YOLOv5-v7.0. Available online: https://github.com/ultralytics/yolov5.
23. Drost, B., Ulrich, M., Bergmann, P., Hartinger, P., and Steger, C. (2017, January 22–29). Introducing mvtec itodd-a dataset for 3d object recognition in industry. Proceedings of the International Conference on Computer Vision Workshops, Venice, Italy.10.1109/ICCVW.2017.257 ↗