A Statistically Validated and Decoding-Aware CNN–Transformer–CTC Framework for Multi-Font Printed Arabic Word Recognition
Source abstract
Abstract
Printed Arabic Optical Character Recognition (OCR) remains challenging due to complex glyph morphology, typographic variability, and sensitivity to Unicode-preserved evaluation protocols. This work introduces a methodology that explicitly treats decoding strategy and orthographic normalization as primary experimental variables in multi-font Arabic OCR evaluation. A CNN–Transformer encoder trained with Connectionist Temporal Classification (CTC) is employed as a controlled backbone to isolate the effects of inference configuration and text normalization. Through systematic analysis on the APTI benchmark, we demonstrate that decoding policy and diacritic handling significantly influence reported recognition performance. In particular, language-model-guided decoding yields substantial improvements over greedy decoding, while Unicode-preserved evaluation introduces systematic orthographic inflation driven by deterministic diacritic mismatch. These effects are further amplified by strong cross-font variability. The proposed normalization-aware evaluation framework disentangles structural recognition errors from protocol-induced artifacts, providing a more controlled and reproducible basis for Arabic OCR benchmarking.
Source: crossref · Quality: baseline
Research context
OpenAlex topics: Handwritten Text Recognition Techniques · Speech Recognition and Synthesis · Natural Language Processing Techniques
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
Affiliations
Faculty of Sciences Dhar El Mahraz Fez, Sidi Mohamed Ben Abdellah University, Fès 30000, Morocco
References (38)
Show source-provided references
1. Online and Off-Line Handwriting Recognition: A Comprehensive Survey10.1109/34.824821 ↗
2. Text Detection and Recognition in Images and Video Frames10.1016/j.patcog.2003.06.001 ↗
3. A Novel Approach to Printed Arabic Optical Character Recognition10.1007/s13369-021-06163-9 ↗
4. A Hybrid Deep Learning Model for Arabic Text Recognition
5. Segmentation-Based, Omnifont Printed Arabic Character Recognition without Font Identification10.1016/j.jksuci.2020.10.001 ↗
6. Persian/Arabic Scene Text Recognition with Convolutional Recurrent Neural Network10.1049/smc2.70001 ↗
7. Campiotti, I., and Lotufo, R. (2022). Optical Character Recognition with Transformers and CTC. Proceedings of the 22nd ACM Symposium on Document Engineering, Association for Computing Machinery.10.1145/3558100.3563845 ↗
8. Efficient CRNN: Towards End-to-End Low Resource Urdu Text Recognition Using Depthwise Separable Convolutions and Gated Recurrent Units10.1016/j.ipm.2023.103544 ↗
9. Ying, X., Murugesan, R.K., Sindiramutty, S.R., Wei, G.W., Balakrishnan, S., Kumar, D., and Verma, S. (2024). Scene Text Recognition Using Deep Learning Techniques. Proceedings of the 2024 International Conference on Emerging Trends in Networks and Computer Communications (ETNCC), IEEE.10.1109/ETNCC63262.2024.10767484 ↗
10. Zaghdoud, R., Boukthir, K., Hamdani, T.M., and Alimi, A.M. (2024). Bilingual Road Text Recognition Based on a Hybrid Model of CTC and Attention. Proceedings of the 2024 IEEE/ACS 21st International Conference on Computer Systems and Applications (AICCSA), IEEE.10.1109/AICCSA63423.2024.10912568 ↗
11. Optimizing Dotted Arabic Expiration Date Recognition with ARABEX: A Convolutional Autoencoder with Bidirectional LSTM and CRNN Approach10.1007/s10032-024-00510-w ↗
12. Alae, A., Ghizlane, K., and Mostafa, M. (2025). Boosting Arabic OCR Performance with Multi-Head Selfattention in an End-to-End CNN-BiLSTM Deep Learning Pipeline. Proceedings of the 2025 International Conference on Circuit, Systems and Communication (ICCSC), IEEE.
13. MSdocTr-Lite: A Lite Transformer for Full Page Multi-Script Handwriting Recognition10.1016/j.patrec.2023.03.020 ↗
14. ResneSt-Transformer: Joint Attention Segmentation-Free for End-to-End Handwriting Paragraph Recognition Model10.1016/j.array.2023.100300 ↗
15. Chan, A., Mijar, A., Saeed, M., Wong, C.-W., and Khater, A. (2024). Hatformer: Historic Handwritten Arabic Text Recognition with Transformers. arXiv.
16. Elbereky, A., Elshenhab, H., Maklad, N., and Fares, A. (2025). Hybrid ResNet–Transformer Framework for Arabic Handwritten OCR in Exam Grading and Manuscript Digitization. Proceedings of the 2025 7th Novel Intelligent and Leading Emerging Sciences Conference (NILES), IEEE.10.1109/NILES68063.2025.11232091 ↗
17. Bhatia, G., Alwajih, F., and Abdul-Mageed, M. (2024). Qalam: A Multimodal Llm for Arabic Optical Character and Handwriting Recognition. Proceedings of the Second Arabic Natural Language Processing Conference, Association for Computational Linguistics.10.18653/v1/2024.arabicnlp-1.19 ↗
18. TDA-ViT: A Transformer-Based Framework for Unified Urdu Text Recognition via Topological and Visual Feature Fusion10.1109/ACCESS.2025.3620875 ↗
19. Nacar, O., Al-Habashi, Y., Sibaee, S., Ammar, A., and Boulila, W. (2025). Sard: A Large-Scale Synthetic Arabic Ocr Dataset for Book-Style Text Recognition. arXiv.
20. Mostafa, A., Mohamed, O., Ashraf, A., Elbehery, A., Jamal, S., Salah, A., and Ghoneim, A.S. (2022). An End-to-End Ocr Framework for Robust Arabic-Handwriting Recognition Using a Novel Transformers-Based Model and an Innovative 270 Million-Words Multi-Font Corpus of Classical Arabic with Diacritics. arXiv.
21. Mathew, M., Mondal, A., and Jawahar, C.V. (2024). Towards Deployable OCR Models for Indic Languages. Proceedings of the International Conference on Pattern Recognition, Springer.10.1007/978-3-031-78495-8_11 ↗
22. Antoun, W., Baly, F., and Hajj, H. (2020). AraBERT: Transformer-Based Model for Arabic Language Understanding. Proceedings of the 4th Workshop on Open-Source Arabic Corpora and Processing Tools, with a Shared Task on Offensive Language Detection, European Language Resources Association.
23. Elmadany, A., and Abdul-Mageed, M. (2022). AraT5: Text-to-Text Transformers for Arabic Language Generation. Proceedings of the 60th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), Association for Computational Linguistics.
24. Al-Qurishi, M.S., and Souissi, R. (2021, January 12–13). Arabic Named Entity Recognition Using Transformer-Based-Crf Model. Proceedings of the 4th International Conference on Natural Language and Speech Processing (ICNLSP 2021), Trento, Italy.
25. Toyin, H., Djanibekov, A., Kulkarni, A., and Aldarmaki, H. (2023). ArTST: Arabic Text and Speech Transformer. Proceedings of the ArabicNLP 2023, Association for Computational Linguistics.10.18653/v1/2023.arabicnlp-1.5 ↗
26. Alaqel, H., and El Hindi, K. (2025). Lightweight End-to-End Diacritical Arabic Speech Recognition Using CTC-Transformer with Relative Positional Encoding. Mathematics, 13.10.3390/math13203352 ↗
27. Alaqel, H., and El Hindi, K. (2025). Improving Diacritical Arabic Speech Recognition: Transformer-Based Models with Transfer Learning and Hybrid Data Augmentation. Information, 16.10.3390/info16030161 ↗
28. An Arabic Optical Character Recognition System Using Recognition-Based Segmentation10.1016/S0031-3203(99)00227-7 ↗
29. A Printed Arabic Optical Character Recognition System Using Deep Learning10.3844/jcssp.2022.1038.1050 ↗
30. Text Information Extraction in Images and Video: A Survey10.1016/j.patcog.2003.10.012 ↗
31. Mars, A., Dabbabi, K., Zrigui, S., and Zrigui, M. (2023). Combination of DE-GAN with CNN-LSTM for Arabic OCR on Images with Colorful Backgrounds. Proceedings of the International Conference on Computational Collective Intelligence, Springer.10.1007/978-3-031-41774-0_46 ↗
32. Printed Persian OCR System Using Deep Learning10.1049/iet-ipr.2019.0728 ↗
33. ADOCRNet: A Deep Learning OCR for Arabic Documents Recognition10.1109/ACCESS.2024.3379530 ↗
34. Mostafa, A., Mohamed, O., Ashraf, A., Elbehery, A., Jamal, S., Khoriba, G., and Ghoneim, A.S. (2021). Ocformer: A Transformer-Based Model for Arabic Handwritten Text Recognition. Proceedings of the 2021 International Mobile, Intelligent, and Ubiquitous Computing Conference (MIUCC), IEEE.10.1109/MIUCC52538.2021.9447608 ↗
35. Mortadi, A., Mohamed, A., Talima, A., Alkhattip, A., Ibrahim, A., Osman, A., and Hifny, Y. (2023). ALNASIKH: An Arabic OCR System Based on Transformers. Proceedings of the 2023 International Mobile, Intelligent, and Ubiquitous Computing Conference (MIUCC), IEEE.10.1109/MIUCC58832.2023.10278370 ↗
36. Comparative Evaluation of Deep Learning Architectures for Printed and Handwritten Farsi OCR
37. Ashish, V. (2017, January 4–9). Attention Is All You Need. Proceedings of the 31st Conference on Neural Information Processing Systems (NIPS 2017), Long Beach, CA, USA.
38. An enhanced word level Arabic OCR based on dual encoder transformer architecture