journal article·2024-12-30Open access

Improved Localization and Recognition of Handwritten Digits on MNIST Dataset with ConvGRU

Yalin Wen, Wei Ke, Hao Sheng

Applied Sciences· Volume 15· Issue 1

Abstract

Video location prediction for handwritten digits presents unique challenges in computer vision due to the complex spatiotemporal dependencies and the need to maintain digit legibility across predicted frames, while existing deep learning-based video prediction models have shown promise, they often struggle with preserving local details and typically achieve clear predictions for only a limited number of frames. In this paper, we present a novel video location prediction model based on Convolutional Gated Recurrent Units (ConvGRU) that specifically addresses these challenges in the context of handwritten digit sequences. Our approach introduces three key innovations. Firstly, we introduce a specialized decoupling model using modified Generative Adversarial Networks (GANs) that effectively separates background and foreground information, significantly improving prediction accuracy. Secondly, we introduce an enhanced ConvGRU architecture that replaces traditional linear operations with convolutional operations in the gating mechanism, substantially reducing spatiotemporal information loss. Finally, we introduce an optimized parameter-tuning strategy that ensures continuous feature transmission while maintaining computational efficiency. Extensive experiments on both the MNIST dataset and custom mobile datasets demonstrate the effectiveness of our approach. Our model achieves a structural similarity index of 0.913 between predicted and actual sequences, surpassing current state-of-the-art methods by 1.2%. Furthermore, we demonstrate superior performance in long-term prediction stability, with consistent accuracy maintained across extended sequences. Notably, our model reduces training time by 9.5% compared to existing approaches while maintaining higher prediction accuracy. These results establish new benchmarks for handwritten digit video prediction and provide practical solutions for real-world applications in digital education, document processing, and real-time handwriting recognition systems.
Source: crossref · Quality: baseline

Research context

OpenAlex topics: Handwritten Text Recognition Techniques · Vehicle License Plate Recognition · Hand Gesture Recognition Systems

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

Faculty of Applied Sciences, Macao Polytechnic University, Macao, China

Engineering Research Centre of Applied Technology on Machine Translation and Artificial Intelligence of Ministry of Education, Macao Polytechnic University, Macao, China

State Key Laboratory of Virtual Reality Technology and Systems, School of Computer Science and Engineering, Beihang University, Beijing 100191, China

Department of Computer Science and Technology, Zhongfa Aviation Institute of Beihang University, 166 Shuanghongqiao Street, Pingyao Town, Yuhang District, Hangzhou 311115, China

Funding

National Key R&D Program of China · National Natural Science Foundation of China · Open Fund of the State Key Laboratory of Software Development Environment · Macao Polytechnic University

References (40)

Show source-provided references
1. Handwritten Digit Classification Using Deep Learning Convolutional Neural Network
2. Handwriting Enhancement: Recognition-Based and Recognition-Independent Approaches for On-device Online Handwritten Text Alignment10.1109/ACCESS.2024.3412433 ↗
3. Review of handwritten document recognition strategies: Patent perspective
4. Handwritten digit recognition using quantum convolution neural network
5. Absur, M.N., Nasif, K.F.A., Saha, S., and Nova, S.N. (2024, January 20–21). Revolutionizing Image Recognition: Next-Generation CNN Architectures for Handwritten Digits and Objects. Proceedings of the 2024 IEEE Symposium on Wireless Technology & Applications (ISWTA), Kuala Lumpur, Malaysia.10.1109/ISWTA62130.2024.10651815 ↗
6. Implementation of Handwritten Character Recognition and Writing in Pyramidal Manipulator Using CNN
7. A Comprehensive Literature Review on Air-written Online Handwritten Recognition10.12785/ijcds/150124 ↗
8. Historical digit recognition using CNN: A study with English handwritten digits10.1007/s12046-023-02322-w ↗
9. Suresh Kumar, K., and Divya Bharathi, K. Integrating Handwritten Digit Recognition with Learning Management Systems for Evaluated Answer Scripts. Proceedings of the International Conference on Emerging Trends in Expert Applications & Security.
10. Kumari, R., and Srivastava, N. (2022). Variations of Left and Right Hand Writers in Forging Signatures Written in Nastaleeq Script, Punjab Academy of Forensic Medicine & Toxicology.10.5958/0974-083X.2022.00007.3 ↗
11. Gao, Z., Tan, C., Wu, L., and Li, S.Z. (2022, January 18–24). Simvp: Simpler yet better video prediction. Proceedings of the IEEE/CVF conference on Computer Vision and Pattern Recognition, New Orleans, LA, USA.10.1109/CVPR52688.2022.00317 ↗
12. Hu, X., Huang, Z., Huang, A., Xu, J., and Zhou, S. (2023, January 17–24). A dynamic multi-scale voxel flow network for video prediction. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, Vancouver, BC, Canada.10.1109/CVPR52729.2023.00593 ↗
13. Handwriting for Text Input and the Impact of XR Displays, Surface Alignments, and Sentence Complexities10.1109/TVCG.2024.3372124 ↗
14. Blockchain-empowered distributed multicamera multitarget tracking in edge computing10.1109/TII.2023.3261890 ↗
15. Hybrid motion model for multiple object tracking in mobile devices10.1109/JIOT.2022.3219627 ↗
16. UrbanLF: A comprehensive light field dataset for semantic segmentation of urban scenes10.1109/TCSVT.2022.3187664 ↗
17. Light field depth estimation: A comprehensive survey from principles to future10.1016/j.hcc.2023.100187 ↗
18. Exploiting spatial and angular correlations with deep efficient transformers for light field image super-resolution10.1109/TMM.2023.3282465 ↗
19. Cross-view recurrence-based self-supervised super-resolution of light field10.1109/TCSVT.2023.3278462 ↗
20. Gupta, H., Kaur, A., Verma, S., and Rawat, P. (2023). Recognition of Handwritten Digits Using Convolutional Neural Network in Python and Comparison of Performance for Various Hidden Layers. Proceedings of the International Conference on Innovative Computing and Communication, Springer.10.1007/978-981-99-3010-4_58 ↗
21. Wu, B., Nair, S., Martin-Martin, R., Fei-Fei, L., and Finn, C. (2021, January 20–25). Greedy hierarchical variational autoencoders for large-scale video prediction. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, Nashville, TN, USA.10.1109/CVPR46437.2021.00235 ↗
22. Generative adversarial networks10.1145/3422622 ↗
23. Kumar, M., Babaeizadeh, M., Erhan, D., Finn, C., Levine, S., Dinh, L., and Kingma, D. (2019). Videoflow: A flow-based generative model for video. arXiv.
24. Advancing Multilingual Handwritten Numeral Recognition With Attention-Driven Transfer Learning10.1109/ACCESS.2024.3378598 ↗
25. Modeling daily load profiles of distribution network for scenario generation using flow-based generative network10.1109/ACCESS.2020.2989350 ↗
26. Human action recognition and prediction: A survey10.1007/s11263-022-01594-9 ↗
27. A novel evolving sentimental bag-of-words approach for feature extraction to detect misinformation
28. Fibonacci Numbers as Hyperparameters for Image Dimension of a Convolu-tional Neural Network Image Prognosis Classification Model of COVID X-ray Images10.11594/ijmaber.03.09.11 ↗
29. Robust and compact maximum margin clustering for high-dimensional data10.1007/s00521-023-09388-x ↗
30. Seismic inversion with deep learning: A proposal for litho-type classification10.1007/s10596-021-10118-2 ↗
31. Walker, W. (2024). Probabilistic Unsupervised Learning using Recognition Parameterized Models. [Ph.D. Thesis, UCL University College London].
32. A review on deep learning techniques for video prediction10.1109/TPAMI.2020.3045007 ↗
33. A modified uncertain maximum likelihood estimation with applications in uncertain statistics10.1080/03610926.2023.2248534 ↗
34. Ilmi, N., Budi, W.T.A., and Nur, R.K. (2016, January 25–27). Handwriting digit recognition using local binary pattern variance and K-Nearest Neighbor classification. Proceedings of the 2016 4th International Conference on Information and Communication Technology (ICoICT), Bandung, Indonesia.10.1109/ICoICT.2016.7571937 ↗
35. Video prediction model combining involution and convolution operators
36. Convolutional neural networks with gated recurrent connections
37. Application of an improved DCGAN for image generation
38. Generative adversarial networks (GANs) challenges, solutions, and future directions10.1145/3446374 ↗
39. Vibration characteristics and elastic wave propagation properties of mirror-symmetric structures of trichiral ligaments10.1016/j.photonics.2023.101120 ↗
40. Shao, H., Ma, E., Zhu, M., Deng, X., and Zhai, S. (2023). MNIST Handwritten Digit Classification Based on Convolutional Neural Network with Hyperparameter Optimization. Intell. Autom. Soft Comput., 36.10.32604/iasc.2023.036323 ↗