Real-Time Braille Image Detection Algorithm Based on Improved YOLOv11 in Natural Scenes
Source abstract
Abstract
The development of Braille recognition technology is intrinsically linked to the educational rights of individuals with visual impairments. The key challenges in natural scene Braille detection include three core trade-offs: difficulty extracting small-target features under complex background interference, a balance between model accuracy and real-time performance, and generalization across diverse scenes. To address these issues, this paper proposes an improved YOLOv11 algorithm that integrates a lightweight gating mechanism and subspace attention. By reconstructing the C3k2 module into a hybrid structure containing Gated Bottleneck Convolutions (GBC), the algorithm effectively captures weak Braille dot matrix features. A super-lightweight subspace attention module (ULSAM) enhances the attention to Braille regions, while the SDIoU loss function optimizes bounding box regression accuracy. Experimental results on a natural scene Braille dataset show that the algorithm achieves a Precision of 0.9420 and a Recall of 0.9514 with only 2.374 M parameters. Compared to the base YOLOv11, this algorithm improves the combined detection performance (Precision: 0.9420, Recall: 0.9514) by 3.2% and reduces computational complexity by 6.3% (with only 2.374 M parameters). Ablation experiments validate the synergistic effect of each module: the GBC structure reduces the model parameter count by 8.1% to maintain lightweight properties, and the ULSAM effectively lowers the missed detection rate of ultra-small Braille targets. This study provides core algorithmic support for portable Braille assistive devices, advancing the technical realization of equal information access for individuals with visual impairments.
Source: crossref · Quality: baseline
Research context
OpenAlex topics: Vehicle License Plate Recognition · Advanced Neural Network Applications · Advanced Technology in Applications
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
Affiliations
School of Special Education, Changchun University, Changchun 130022, China
School of Computer Science and Technology, Changchun University, Changchun 130022, China
Funding
general project of National Natural Science Foundation · general project of humanities and social sciences research of the Ministry ministry of Education education of the PRC
References (22)
Show source-provided references
1. Vision Loss Expert Group of the Global Burden of Disease Study. Global Causes of Blindness and Distance Vision Impairment 1990–2020: A Systematic Review and Meta-Analysis10.1016/S2214-109X(17)30393-5 ↗
2. Isayed, S., and Tahboub, R. (2015, January 21–23). A Review of Optical Braille Recognition. Proceedings of the 2015 2nd World Symposium on Web Applications and Networking (WSWAN), Sousse, Tunisia.10.1109/WSWAN.2015.7210343 ↗
3. Study on Image Processing Based Braille Automatic Identification System
4. Deep Learning Strategy for Braille Character Recognition10.1109/ACCESS.2021.3138240 ↗
5. Yamashita, A., Shirakawa, T., and Matsubayashi, K. (2024, January 25–26). Braille Character Recognition Independent of Lighting Direction Using Object Detection Models. Proceedings of the International Conference on Soft Computing and Intelligent Systems, Vancouver, BC, Canada.10.1109/SCISISIS61014.2024.10759883 ↗
6. Braille Letter Recognition in Deep Convolutional Neural Network with Horizontal and Vertical Projection10.11591/eei.v13i5.7222 ↗
7. Wang, A., Chen, H., Liu, L.H., Chen, K., Lin, Z.J., Han, J.G., and Ding, G.G. (2024, January 16). YOLOv10: Real-Time End-to-End Object Detection. Proceedings of the Neural Information Processing Systems (NeurIPS), Vancouver, BC, Canada.
8. Natural Scene Braille Image Dataset and Braille Segment Detection Method
9. Automate Extraction of Braille Text to Speech from an Image10.1016/j.advengsoft.2022.103180 ↗
10. Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks
11. Lu, H., Chen, J., Fan, S., Xu, C., and Cheng, S.Y. (2025, January 10–17). SCSegamba: Lightweight Structure-Aware Vision Mamba for Crack Segmentation in Structures. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Nashville, TN, USA.
12. Khanam, R., and Hussain, M. (2024). YOLOv11: An Overview of the Key Architectural Enhancements. Comput. Res. Repos.
13. Zhao, Z.H., Wang, P., Li, W., Liu, J.Z., Ye, R.G., and Ren, D.W. (2020, January 7–12). Distance-IoU Loss: Faster and Better Learning for Bounding Box Regression. Proceedings of the AAAI Conference on Artificial Intelligence, New York, NY, USA.
14. Object Detection with Deep Learning: A Review10.1109/TNNLS.2018.2876865 ↗
15. Wu, D., Lu, L.Q., and Xiong, J.F. (2024). Research on Natural Scene Braille Recognition Method based on SSD Framework. J. Comput. Aided Des. Comput. Graph.
16. Nair, B.J.B., Saketh, P. (2024, January 16–18). Empowering the Blind School Communities by Recognition of Handwritten Braille Text Documents Using YOLOv5 Technique. In Proceedings of the 2024 9th International Conference on Communication and Electronics Systems (ICCES). Coimbatore, India.
17. Wang, G.W., Guo, Y., Wang, W., Yang, Z., and Sun, S.Y. (2023, January 14–16). Braille Detection Model Based on Foreground Attention and Semantic Learning. Proceedings of the 2023 IEEE 5th International Conference on Power, Intelligent Computing and Systems (ICPICS), Shenyang, China.10.1109/ICPICS58376.2023.10235710 ↗
18. Anchor-Free Braille Character Detection Based on Edge Feature in Natural Scene Images
19. Saini, R., Jha, N.K., Das, B., Mittal, S., and Mohan, C.K. (2020, January 1–5). ULSAM: Ultra-Lightweight Subspace Attention Module for Compact Convolutional Neural Networks. Proceedings of the Winter Conference on Applications of Computer Vision, Snowmass Village, CO, USA.10.1109/WACV45572.2020.9093341 ↗
20. Focal Loss for Dense Object Detection10.1109/TPAMI.2018.2858826 ↗
21. Sun, Y., Qin, Y., Chen, W., Li, X., and Li, C. (2025). Context-Aware Multimodal Fusion with Sensor-Augmented Cross-Modal Learning: The BLAF Architecture for Robust Chinese Homophone Disambiguation in Dynamic Environments. Appl. Sci., 15.10.3390/app15137068 ↗
22. Near-Edge Computing Aware Object Detection: A Review10.1109/ACCESS.2023.3347548 ↗