Corner Enhancement Module Based on Deformable Convolutional Networks and Parallel Ensemble Processing Methods for Distorted License Plate Recognition in Real Environments
Source abstract
Abstract
License plate recognition is a computer vision technology that plays a crucial role in intelligent transportation systems and vehicle management. However, in real-world road environments, recognition accuracy significantly decreases due to distortions caused by various viewing angles. In particular, existing systems exhibit severe performance degradation when processing license plate images captured at steep angles. This paper proposes a new approach to solve the license plate recognition problem in such unconstrained environments. To accurately recognize text on distorted license plates, it is crucial to precisely locate the four corners of the plate and correct the distortion. For this purpose, the proposed system incorporates vehicle and license plate detection based on YOLOv8 and integrates a Corner Enhancement Module (CEM) utilizing a Deformable Convolutional Network (DCN) into the model’s neck to ensure robust feature extraction against geometric transformations. Additionally, the system significantly improves corner detection accuracy through parallel ensemble processing of three license plate images: the original and two aspect ratio-adjusted versions (2:1 and 1.5:1). Furthermore, we verified the system’s versatility in real road environments by implementing a real-time license plate recognition system using Raspberry Pi 4 and a camera module.
Source: crossref · Quality: baseline
Research context
OpenAlex topics: Vehicle License Plate Recognition · Smart Parking Systems Research · Advanced Steganography and Watermarking Techniques
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
Affiliations
Defense Acquisition Program, Kwangwoon University, 20, Gwangun-ro, Nowon-gu, Seoul 01897, Republic of Korea
Department of Convergence Science, Kongju National University, Gongju 32588, Republic of Korea
Department of Smart Electrical and Electronic Engineering, Kwangwoon University, 20, Gwangun-ro, Nowon-gu, Seoul 01897, Republic of Korea
Funding
Kwangwoon University
References (33)
Show source-provided references
1. Automatic license plate recognition (ALPR): A state-of-the-art review10.1109/TCSVT.2012.2203741 ↗
2. Mufti, N., and Shah, S.A.A. (2021). Automatic number plate Recognition: A detailed survey of relevant algorithms. Sensors, 21.10.3390/s21093028 ↗
3. EILPR: Toward end-to-end irregular license plate recognition based on automatic perspective alignment
4. Khan, I.R., Ali, S.T.A., Siddiq, A., Khan, M.M., Ilyas, M.U., Rehman, H.Z.U., Chaudary, M.H., and Nawaz, S.J. (2022). Automatic license plate recognition in real-world traffic videos captured in unconstrained environment by a mobile camera. Electronics, 11.10.3390/electronics11091408 ↗
5. Robust automatic recognition of Chinese license plates in natural scenes
6. Kim, T.G., Yun, B.J., Kim, T.H., Lee, J.Y., Park, K.H., Jeong, Y., Lee, J.H., Kim, J.S., Yoon, S.H., and Lim, J.S. (2021). Recognition of vehicle license plates based on image processing. Appl. Sci., 11.10.3390/app11146292 ↗
7. Vehicle license plate detection and perspective rectification10.5755/j01.eie.25.5.24356 ↗
8. System implementation of multiple license plate detection and correction on wide-angle images using an instance segmentation network model
9. Yang, S.J., Ho, C.C., Chen, J.Y., and Tsai, C.Y. (2012, January 26–28). Practical homography-based perspective correction method for license plate recognition. Proceedings of the International Conference on Information Science and Digital Content Technology, Jeju, Republic of Korea.10.1109/ISIC.2012.6449740 ↗
10. Yoo, H., and Jun, K. (2020). Deep homography for license plate detection. Information, 11.10.3390/info11040221 ↗
11. Deep corner prediction to rectify tilted license plate images10.1007/s00530-020-00655-8 ↗
12. Sihombing, D.P., Nugroho, H.A., and Ardiyanto, I. (2015, January 11–13). Perspective rectification in vehicle number plate recognition using 2D-2D transformation of planar homography. Proceedings of the International Conference on Science and Technology, Yogyakarta, Indonesia.10.1109/ICSITech.2015.7407810 ↗
13. Plavac, N. (2024). Assessment of Deep Learning Algorithms for Automatic License Plate Recognition on Distorted Images. [Master’s Thesis, Norwegian University of Science and Technology].10.2352/J.ImagingSci.Technol.2024.68.6.060401 ↗
14. Effective deep neural networks for license plate detection and recognition10.1007/s00371-021-02375-0 ↗
15. A Structured Review of Vehicle Registration Number Plate Detection for Improvisation in Intelligent Transportation System: Special Study on Adverse Conditions
16. Liu, Y.Y., Liu, Q., Chen, S.L., Chen, F., and Yin, X.C. (February, January 29). Irregular License Plate Recognition via Global Information Integration. Proceedings of the Conference on Multimedia Modeling, Amsterdam, The Netherlands.
17. An efficient and unified recognition method for multiple license plates in unconstrained scenarios10.1109/TITS.2023.3237743 ↗
18. Dai, J., Qi, Z., Xiong, Y., Li, Y., Zhang, G., and Hu, H. (2017, January 22–29). Deformable convolutional networks. Proceedings of the IEEE International Conference on Computer Vision, Venice, Italy.10.1109/ICCV.2017.89 ↗
19. Zhao, K., Peng, L., Ding, N., Yao, G., and Tang, P. (2025). Deep representation learning for license plate recognition in low quality video images. Advances in Visual Computing, Springer.10.1007/s00138-025-01678-9 ↗
20. Vehicle detection algorithm based on improved RT-DETR10.1007/s11227-024-06766-7 ↗
21. Zhao, Y., Lv, W., Xu, S., Wei, J., Wang, G., Dang, Q., Liu, Y., and Chen, J. (2024, January 16–22). Detrs beat yolos on real-time object detection. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, Seattle, WA, USA.10.1109/CVPR52733.2024.01605 ↗
22. Hussein, A.M.A. (2025). Automatic Number Plate Recognition for Seamless Toll Charging Without Stopping. Ibn AL-Haitham J. Pure Appl. Sci., 38.
23. Arjun, R.P., Akshitha, R., and Ranjan, N. (2025). Innovation in Vehicle Tracking: Harnessing YOLOv8 and Deep Learning Tools for Automatic Number Plate Detection. Computing Technologies for Sustainable Development, Springer.10.1007/978-3-031-82383-1_6 ↗
24. Pandey, R., Maurya, P., and Saxena, P. (2025, January 7–9). Advancing Automatic Number Plate Recognition: Insights, Innovations, and Future Directions. Proceedings of the 2025 IEEE 14th International Conference, Bhopal, India.10.1109/CSNT64827.2025.10967880 ↗
25. Ashkanani, M., AlAjmi, A., Alhayyan, A., and Esmael, Z. (2025). A Self-Adaptive Traffic Signal System Integrating Real-Time Vehicle Detection and License Plate Recognition for Enhanced Traffic Management. Inventions, 10.10.3390/inventions10010014 ↗
26. Efficient improvement of classification accuracy via selective test-time augmentation10.1016/j.ins.2023.119148 ↗
27. Sherkatghanad, Z., Abdar, M., Bakhtyari, M., Plawiak, P., and Makarenkov, V. (2024). BayTTA: Uncertainty-aware medical image classification with optimized test-time augmentation using Bayesian model averaging. arXiv.
28. Ma, X., Tao, Y., Zhang, Y., Ji, Z., Zhang, Y., and Chen, Q. (2024). Test-Time Generative Augmentation for Medical Image Segmentation. arXiv.
29. Lin, T.-Y., Dollar, P., Girshick, R., He, K., Hariharan, B., and Belongie, S. (2017, January 21–26). Feature Pyramid Networks for Object Detection. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Honolulu, HI, USA.10.1109/CVPR.2017.106 ↗
30. CSPNeXt: A new efficient token hybrid backbone10.1016/j.engappai.2024.107886 ↗
31. Jiang, T., Lu, P., Zhang, L., Ma, N., Han, R., Lyu, C., Li, Y., and Chen, K. (2023). Rtmpose: Real-time multi-person pose estimation based on mmpose. arXiv.
32. Uniformer: Unifying convolution and self-attention for visual recognition10.1109/TPAMI.2023.3282631 ↗
33. Wang, C.-Y., Bochkovskiy, A., and Liao, H.-Y.M. (2023, January 17–24). YOLOv7: Trainable bag-of-freebies sets new state-of-the-art for real-time object detectors. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, Vancouver, BC, Canada.10.1109/CVPR52729.2023.00721 ↗