An Integrated Rule-Based and Deep Learning Method for Automobile License Plate Image Generation with Enhanced Geometric and Radiometric Details
Source abstract
Abstract
Automobile license plate image generation represents a pivotal technology for the development of intelligent transportation systems. However, existing methods are constrained by their inability to simultaneously preserve geometric structure and radiometric properties of both license plates and characters. To overcome this limitation, we propose a novel framework for generating geometrically and radiometrically consistent license plate images. The proposed radiometric enhancement framework integrates two specialized modules, which are precise geometric rectification and radiometric property learning. The precise geometric rectification module exploits the perspective transformation consistency between character regions and license plate boundaries. By employing a feature matching algorithm based on character endpoint correspondence, this module achieves precise plate rectification, thereby establishing a geometric foundation for maintaining character structural integrity in generated images. The radiometric property learning module implements a precise character inpainting strategy with fluctuation compensation inpainting to reconstruct background regions, followed by a character-wise style transfer approach to ensure both geometric and radiometric consistency with realistic automobile license plates. Furthermore, we introduce a physical validation and evaluation method to quantitatively assess image quality. Comprehensive evaluation on real-world datasets demonstrate that our method achieves superior performance, with a peak signal-to-noise ratio (PSNR) of 13.83 dB and a structural similarity index measure (SSIM) of 0.57, representing significant improvements over comparative methods in preserving both structural integrity and radiometric properties. This framework effectively enhances the visual fidelity and reliability of generated automobile license plate images, thereby providing high-quality data for intelligent transportation recognition systems while advancing license plate image generation technology.
Source: crossref · Quality: baseline
Research context
OpenAlex topics: Vehicle License Plate Recognition · Advanced Neural Network Applications · Autonomous Vehicle Technology and Safety
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
Affiliations
National Institute of Metrology, Beijing 100029, China
Funding
National Key Research and Development Program
References (44)
Show source-provided references
1. Wu, C., Xu, S., Song, G., and Zhang, S. (2018, January 23–26). How many labeled license plates are needed?. Proceedings of the Chinese Conference on Pattern Recognition and Computer Vision (PRCV), Guangzhou, China.10.1007/978-3-030-03341-5_28 ↗
2. Improving license plate recognition via diverse stylistic plate generation10.1016/j.patrec.2024.05.005 ↗
3. Data collection and quality challenges in deep learning: A data-centric ai perspective10.1007/s00778-022-00775-9 ↗
4. Data-centric artificial intelligence: A survey10.1145/3711118 ↗
5. Advancements and Challenges: A Comprehensive Review of GAN-based Models for the Mitigation of Small Dataset and Texture Sticking Issues in Fake License Plate Recognition10.48084/etasr.8870 ↗
6. An embedded automatic license plate recognition system using deep learning10.1007/s10617-019-09230-5 ↗
7. Robust license plate recognition using neural networks trained on synthetic images10.1016/j.patcog.2019.04.007 ↗
8. Silva, S.M., and Jung, C.R. (2020, January 23–28). License plate detection and recognition in unconstrained scenarios. Proceedings of the European Conference on Computer Vision (ECCV), Glasgow, UK.
9. Wang, X., Man, Z., You, M., and Shen, C. (2017). Adversarial generation of training examples: Applications to moving vehicle license plate recognition. arXiv.
10. PixTextGAN: Structure aware text image synthesis for license plate recognition10.1049/iet-ipr.2018.6588 ↗
11. A robust attentional framework for license plate recognition in the wild10.1109/TITS.2020.3000072 ↗
12. Multiple auxiliary classifiers GAN for controllable image generation: Application to license plate recognition10.1049/itr2.12251 ↗
13. Shpir, M., Shvai, N., and Nakib, A. (2024, January 19–24). License Plate Images Generation with Diffusion Models. Proceedings of the European Conference on Artificial Intelligence ECAI, Santiago de Compostela, Spain.10.3233/FAIA241053 ↗
14. Yang, S., Liu, J., Wang, W., and Guo, Z. (February, January 27). TET-GAN: Text effects transfer via stylization and destylization. Proceedings of the AAAI Conference on Artificial Intelligence, Honolulu, HI, USA.
15. Peng, Y., Xu, M., Jin, J.S., Luo, S., and Zhao, G. (2011, January 12–15). Cascade-based license plate localization with line segment features and haar-like features. Proceedings of the 2011 Sixth International Conference on Image and Graphics, Hefei, China.10.1109/ICIG.2011.154 ↗
16. Synthetic image generation for training deep learning-based automated license plate recognition systems on the Brazilian Mercosur standard10.1007/s10617-020-09241-7 ↗
17. Kim, T.G., Yun, B.J., Kim, T.H., Lee, J.Y., Park, K.H., Jeong, Y., and Kim, H.D. (2021). Recognition of vehicle license plates based on image processing. Appl. Sci., 11.10.3390/app11146292 ↗
18. Multinational vehicle license plate detection in complex backgrounds10.1016/j.jvcir.2017.03.020 ↗
19. A Robust and Efficient Approach to License Plate Detection10.1109/TIP.2016.2631901 ↗
20. Zhao, Y., Gu, J., Liu, C., Han, S., Gao, Y., and Hu, Q. (2010, January 16–17). License Plate Location Based on Haar-Like Cascade Classifiers and Edges. Proceedings of the 2010 Second WRI Global Congress on Intelligent Systems, Wuhan, China.10.1109/GCIS.2010.55 ↗
21. Dlagnekov, L. (2004). License Plate Detection Using Adaboost, Computer Science and Engineering Department, UC San Diego.
22. Selmi, Z., Ben Halima, M., and Alimi, A.M. (2017, January 9–15). Deep Learning System for Automatic License Plate Detection and Recognition. Proceedings of the 2017 14th IAPR International Conference on Document Analysis and Recognition (ICDAR), Kyoto, Japan.10.1109/ICDAR.2017.187 ↗
23. Laroca, R., Severo, E., Zanlorensi, L.A., Oliveira, L.S., Goncalves, G.R., Schwartz, W.R., and Menotti, D. (2018, January 8–13). A Robust Real-Time Automatic License Plate Recognition Based on the YOLO Detector. Proceedings of the 2018 International Joint Conference on Neural Networks (IJCNN), Rio de Janeiro, Brazil.10.1109/IJCNN.2018.8489629 ↗
24. License plate detection and recognition based on YOLOv3 and ILPRNET10.1007/s11760-021-01981-8 ↗
25. Rethinking and designing a high-performing automatic license plate recognition approach10.1109/TITS.2021.3087158 ↗
26. Bala, R., Zhao, Y., Burry, A., Kozitsky, V., Fillion, C., Saunders, C., and Rodríguez-Serrano, J. (2012, January 24–26). Image simulation for automatic license plate recognition. Proceedings of the Visual Information Processing and Communication III, Burlingame, CA, USA.10.1117/12.912453 ↗
27. Segmentation-and annotation-free license plate recognition with deep localization and failure identification10.1109/TITS.2016.2639020 ↗
28. Generative adversarial nets
29. Han, B.G., Lee, J.T., Lim, K.T., and Choi, D.H. (2020). License plate image generation using generative adversarial networks for end-to-end license plate character recognition from a small set of real images. Appl. Sci., 10.10.3390/app10082780 ↗
30. On realistic generation of new format license plate on vehicle images10.1016/j.procs.2021.10.019 ↗
31. Disentangled generation network for enlarged license plate recognition and a unified dataset10.1016/j.cviu.2023.103880 ↗
32. Ministry of Public Security of the People’s Republic of China (2018). License Plates of Motor Vehicles of the People’s Republic of China.
33. Redmon, J., Divvala, S., Girshick, R., and Farhadi, A. (2016, January 27–30). You Only Look Once: Unified, Real-Time Object Detection. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Las Vegas, NV, USA.10.1109/CVPR.2016.91 ↗
34. Jocher, G., Stoken, A., Borovec, J., Changyu, L., Hogan, A., Diaconu, L., Poznanski, J., Yu, L., Rai, P., and Ferriday, R. (2020). YOLOv5, Zenodo.
35. Shi, J. (1994, January 21–23). Good features to track. Proceedings of the 1994 IEEE Conference on Computer Vision and Pattern Recognition, Seattle, WA, USA.
36. Poisson image editing10.1145/882262.882269 ↗
37. Poisson image editing
38. Xu, Z., Yang, W., Meng, A., Lu, N., Huang, H., Ying, C., and Huang, L. (2018, January 8–14). Towards end-to-end license plate detection and recognition: A large dataset and baseline. Proceedings of the European Conference on Computer Vision (ECCV), Munich, Germany.10.1007/978-3-030-01261-8_16 ↗
39. Image quality assessment: From error visibility to structural similarity10.1109/TIP.2003.819861 ↗
40. Ronneberger, O., Fischer, P., and Brox, T. (2015, January 5–9). U-net: Convolutional networks for biomedical image segmentation. Proceedings of the Medical Image Computing and Computer-Assisted Intervention–MICCAI 2015: 18th International Conference, Munich, Germany. proceedings, part III 18.
41. Zheng, Y. (2019, April 18). License Plate Generator. Available online: https://github.com/zheng-yuwei/license-plate-generator.
42. Choi, Y., Choi, M., Kim, M., Ha, J.W., Kim, S., and Choo, J. (2018, January 18–23). Stargan: Unified generative adversarial networks for multi-domain image-to-image translation. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Salt Lake City, UT, USA.10.1109/CVPR.2018.00916 ↗
43. Chen, R., Huang, W., Huang, B., Sun, F., and Fang, B. (2020, January 14–19). Reusing discriminators for encoding: Towards unsupervised image-to-image translation. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, Seattle, WA, USA.10.1109/CVPR42600.2020.00819 ↗
44. Lee, H.Y., Tseng, H.Y., Huang, J.B., Singh, M., and Yang, M.H. (2018, January 8–14). Diverse image-to-image translation via disentangled representations. Proceedings of the European Conference on Computer Vision (ECCV), Munich, Germany.10.1007/978-3-030-01246-5_3 ↗