journal article·2023-04-13Open access

Two-Step Algorithm for License Plate Identification Using Deep Neural Networks

Mantas Kundrotas, Jūratė Janutėnaitė-Bogdanienė, Dmitrij Šešok

Applied Sciences· Volume 13· Issue 8

Abstract

License plate identification remains a crucial problem in computer vision, particularly in complex environments where license plates may be confused with road signs, billboards, and other objects. This paper proposes a solution by modifying the standard car–license plate–letter detection approach into a preliminary license plate detection–precise license plate detection of the four corners where the numbers are located–license plate correction–letter identification. This way, the first algorithm identifies all potential license plates and passes them as input parameters to the next algorithm for more precise detection. The main difference between this approach and other algorithms is that it uses a relatively small image compared to the whole vehicle. Thus, a small but robust network is used to find the four corners and perform a perspective transformation. This simplifies the letter recognition task for the next algorithm, as no additional transformations are required. This solution could be useful for research focusing on this specific task. It allows to apply another compact but robust neural network, increasing the overall speed of the system. Publicly available datasets were used for training and validation. The CenterNet object detection algorithm was used as a basis with a modified Hourglass-type network. The size of the network was decreased by 40% and the average accuracy was 96.19%. Speed significantly increased, reaching 2.71 ms and 405 FPS on average.
Source: crossref · Quality: baseline

Research context

OpenAlex topics: Vehicle License Plate Recognition · Handwritten Text Recognition Techniques · Advanced Neural Network Applications

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

Department of Information Technology, Vilnius Gediminas Technical University, LT-10223 Vilnius, Lithuania

References (33)

Show source-provided references
1. Automatic number plate recognition (ANPR) in smart cities: A systematic review on technological advancements and application cases10.1016/j.cities.2022.103833 ↗
2. Effect of taxis on emissions and fuel consumption in a city based on license plate recognition data: A case study in Nanning, China10.1016/j.jclepro.2019.01.123 ↗
3. A new DCT-PCM method for license plate number detection in drone images10.1016/j.patrec.2021.05.002 ↗
4. A New Image Enhancement and Super Resolution technique for license plate recognition10.1016/j.heliyon.2021.e08341 ↗
5. Leibe, B., Matas, J., Sebe, N., and Welling, M. (2016). Computer Vision—ECCV 2016. ECCV 2016, Springer. Lecture Notes in Computer Science.10.1007/978-3-319-46454-1 ↗
6. Cascaded hourglass feature fusing network for saliency detection10.1016/j.neucom.2020.11.058 ↗
7. Stacked attention hourglass network based robust facial landmark detection10.1016/j.neunet.2022.10.021 ↗
8. Detection of COVID-19 from Chest X-Ray Images using CNN and ANN Approach
9. Robust license plate signatures matching based on multi-task learning approach10.1016/j.neucom.2020.12.102 ↗
10. Perspective Vehicle License Plate Transformation using Deep Neural Network on Genesis of CPNet10.1016/j.procs.2020.04.199 ↗
11. A two-stage deep neural network for multi-norm license plate detection and recognition10.1016/j.eswa.2019.06.036 ↗
12. Lee., Y., Jun., J., Hong, Y., and Jeon, M. (2019, January 25–27). Practical License Plate Recognition in Unconstrained Surveillance Systems with Adversarial Super-Resolution. Proceedings of the 14th International Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications, Prague, Czech Republic.10.5220/0007378300680076 ↗
13. Redmon, J., and Farhadi, A. (2018). YOLOv3: An Incremental Improvement. arXiv.
14. He, K., Gkioxari, G., Dollar, P., and Girshick, R. (2017, January 22–29). Mask R-CNN. Proceedings of the 2017 IEEE International Conference on Computer Vision (ICCV), Venice, Italy.10.1109/ICCV.2017.322 ↗
15. DELP-DAR System for License Plate Detection and Recognition10.1016/j.patrec.2019.11.007 ↗
16. Batra, P., Hussain, I., Ahad, M.A., Casalino, G., Alam, M.A., Khalique, A., and Hassan, S.I. (2022). A Novel Memory and Time-Efficient ALPR System Based on YOLOv5. Sensors, 22.10.3390/s22145283 ↗
17. Khan, I.R., Ali, S.T.A., Siddiq, A., Khan, M.M., Ilyas, M.U., Alshomrani, S., and Rahardja, S. (2022). Automatic License Plate Recognition in Real-World Traffic Videos Captured in Unconstrained Environment by a Mobile Camera. Electronics, 11.10.3390/electronics11091408 ↗
18. Selmi, Z., Halima, M.B., and Alimi, A.M. (2017, January 9–15). Deep Learning System for Automatic License Plate Detection and Recognition. Proceedings of the 2017 14th IAPR International Conference on Document Analysis and Recognition (ICDAR), Kyoto, Japan.10.1109/ICDAR.2017.187 ↗
19. Deep-learning-based license plate detection method using vehicle region extraction10.1049/el.2017.1373 ↗
20. V-LPDR: Towards a unified framework for license plate detection, tracking, and recognition in real-world traffic videos10.1016/j.neucom.2021.03.103 ↗
21. A Deep Learning Model of Dual-Stage License Plate Recognition Applicable to the Data Processing Industry10.1155/2021/3723715 ↗
22. Real-time license plate detection and recognition using deep convolutional neural network10.1016/j.jvcir.2020.102773 ↗
23. Detection of the vehicle license plate using a kernel density with default search radius algorithm filter10.1016/j.ijleo.2020.164689 ↗
24. Unified Chinese License Plate detection and recognition with high efficiency10.1016/j.jvcir.2022.103541 ↗
25. Non-Anchor-Based Vehicle Detection for Traffic Surveillance Using Bounding Ellipses10.1109/ACCESS.2021.3109258 ↗
26. Comparison of Vehicle Detection Techniques applied to IP Camera Video Feeds for use in Intelligent Transport Systems10.1016/j.trpro.2020.02.069 ↗
27. Application-oriented-license-plate-recognition10.1109/TVT.2012.2226218 ↗
28. Weber, M., and Peona, P. (2023, March 31). Caltech Cars 1999 (1.0) [Data set]. Available online: https://data.caltech.edu/records/fmbpr-ezq86.
29. Srebrić, V. (2003). Information Technology Application Project—Ministry of Science and Technology, University of Zagreb.
30. OpenALPR Inc (2023, February 16). OpenALPR-EU Dataset. Available online: https://github.com/openalpr/benchmarks/tree/master/endtoend/eu.
31. Laroca, R., Severo, E., Zanlorensi, L.A., Oliveira, L.S., Gonc¸alves, G.R., Schwartz, W.R., and Menotti, D. (2018). A robust real-time automatic license plate recognition based on the YOLO detector. arXiv.10.1109/IJCNN.2018.8489629 ↗
32. An efficient and layout-independent automatic license plate recognition system based on the YOLO detector10.1049/itr2.12030 ↗
33. Zhou, X., Wang, D., and Krahenbuhl, P. (2019). Objects as Points. arXiv.