A Method for Detecting and Recognizing Yi Character Based on Deep Learning
Source abstract
Abstract
Aiming at the challenges associated with the absence of a labeled dataset for Yi characters and the complexity of Yi character detection and recognition, we present a deep learning-based approach for Yi character detection and recognition. In the detection stage, an improved Differentiable Binarization Network (DBNet) framework is introduced to detect Yi characters, in which the Omni-dimensional Dynamic Convolution (ODConv) is combined with the ResNet-18 feature extraction module to obtain multi-dimensional complementary features, thereby improving the accuracy of Yi character detection. Then, the feature pyramid network fusion module is used to further extract Yi character image features, improving target recognition at different scales. Further, the previously generated feature map is passed through a head network to produce two maps: a probability map and an adaptive threshold map of the same size as the original map. These maps are then subjected to a differentiable binarization process, resulting in an approximate binarization map. This map helps to identify the boundaries of the text boxes. Finally, the text detection box is generated after the post-processing stage. In the recognition stage, an improved lightweight MobileNetV3 framework is used to recognize the detect character regions, where the original Squeeze-and-Excitation (SE) block is replaced by the efficient Shuffle Attention (SA) that integrates spatial and channel attention, improving the accuracy of Yi characters recognition. Meanwhile, the use of depth separable convolution and reversible residual structure can reduce the number of parameters and computation of the model, so that the model can better understand the contextual information and improve the accuracy of text recognition. The experimental results illustrate that the proposed method achieves good results in detecting and recognizing Yi characters, with detection and recognition accuracy rates of 97.5% and 96.8%, respectively. And also, we have compared the detection and recognition algorithms proposed in this paper with other typical algorithms. In these comparisons, the proposed model achieves better detection and recognition results with a certain reliability.
Source: openalex_inverted_index · Quality: baseline
Research context
OpenAlex topics: Handwritten Text Recognition Techniques · Image Processing and 3D Reconstruction · Vehicle License Plate Recognition
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
References (37)
Show source-provided references
1. Linguistic landscape in Liangshan Yi autonomous prefecture: The case of an ethnic minority region in China10.1080/14790718.2020.1800018 ↗
2. Handwritten Yi character recognition with density-based clustering algorithm and convolutional neural network
3. Online recognition of Chinese characters: The state-of-the-art10.1109/TPAMI.2004.1262182 ↗
4. Handwritten optical character recognition (OCR): A comprehensive systematic literature review (SLR)10.1109/ACCESS.2020.3012542 ↗
5. Intelligent character recognition using fully convolutional neural networks10.1016/j.patcog.2018.12.017 ↗
6. Textnet: Irregular text reading from images with an end-to-end trainable network
7. Textocr: Towards large-scale end-to-end reasoning for arbitrary-shaped scene text
8. Real-time scene text detection with differentiable binarization
9. Deep residual learning for image recognition
10. C. Li, A. Zhou, and A. Yao, “Omni-dimensional dynamic convolution,” arXiv:2209.07947v1, 2022.
11. Searching for MobileNetV3
12. SA-Net: Shuffle attention for deep convolutional neural networks
13. Shape robust text detection with progressive scale expansion network
14. Fourier contour embedding for arbitrary-shaped text detection
15. An end-to-end trainable neural network for image-based sequence recognition and its application to scene text recognition10.1109/TPAMI.2016.2646371 ↗
16. Scene text recognition from two-dimensional perspective
17. FACLSTM: ConvLSTM with focused attention for scene text recognition10.1007/s11431-019-9532-5 ↗
18. Character detection and segmentation of historical Uchen Tibetan documents in complex situations10.1109/ACCESS.2022.3151886 ↗
19. Segmentation and recognition for historical Tibetan document images10.1109/ACCESS.2020.2975023 ↗
20. AMRE: An attention-based CRNN for Manchu word recognition on a woodblock-printed dataset
21. Segmentation-free multi-font printed Manchu word recognition using deep convolutional features and data augmentation
22. OCR with the deep CNN model for ligature script-based languages like Manchu
23. A knowledge-based recognition system for historical Mongolian documents10.1007/s10032-016-0267-1 ↗
24. A deep-learning approach to optical character recognition for Uighur language
25. A Segmentation-driven handwritten uighur word recognition algorithm based on feedback structure
26. Detecting Uyghur text in complex background images with convolutional neural network10.1007/s11042-017-4538-8 ↗
27. The algorithm and implementation of Yi character recognition based on convolutional neural network
28. A recognition method of ancient Yi script based on deep learning
29. Yi characters online handwriting recognition models based on recurrent neural network: RnnNet-Yi and ParallelRnnNet-Yi
30. CondConv: Conditionally prameterized convolutions for efficient inference
31. Dynamic convolution: Attention over convolution kernels
32. ImageNet classification with deep convolutional neural networks
33. Faster R-CNN: Towards real-time object detection with region proposal networks
34. NRTR: A no-recurrence sequence-to-sequence model for scene text recognition
35. A. Howard et al., “MobileNets: Efficient convolutional neural networks for mobile vision applications,” arXiv:1704.04861, 2017.
36. MobileNetV2: Inverted residuals and linear bottlenecks
37. Transformer in transformer