journal article·2023Open access

Text Extraction with Optimal Bi-LSTM

Bahera H. Nayef, Siti Norul Huda Sheikh Abdullah, Rossilawati Sulaiman, Ashwaq Mukred Saeed

Computers, Materials & Continua· Volume 76· Issue 3

Abstract

Text extraction from images using the traditional techniques of image collecting, and pattern recognition using machine learning consume time due to the amount of extracted features from the images. Deep Neural Networks introduce effective solutions to extract text features from images using a few techniques and the ability to train large datasets of images with significant results. This study proposes using Dual Maxpooling and concatenating convolution Neural Networks (CNN) layers with the activation functions Relu and the Optimized Leaky Relu (OLRelu). The proposed method works by dividing the word image into slices that contain characters. Then pass them to deep learning layers to extract feature maps and reform the predicted words. Bidirectional Short Memory (BiLSTM) layers extract more compelling features and link the time sequence from forward and backward directions during the training phase. The Connectionist Temporal Classification (CTC) function calcifies the training and validation loss rates. In addition to decoding the extracted feature to reform characters again and linking them according to their time sequence. The proposed model performance is evaluated using training and validation loss errors on the Mjsynth and Integrated Argument Mining Tasks (IAM) datasets. The result of IAM was 2.09% for the average loss errors with the proposed dual Maxpooling and OLRelu. In the Mjsynth dataset, the best validation loss rate shrunk to 2.2% by applying concatenating CNN layers, and Relu.
Source: openalex_inverted_index · Quality: baseline

Research context

OpenAlex topics: Edcuational Technology Systems · Handwritten Text Recognition Techniques · Text and Document Classification Technologies

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

References (32)

Show source-provided references
1. Natural scene text understanding10.5772/4966 ↗
2. Chaudhuri · Optical Character Recognition Systems for Different Languages with Soft Computing · 2017 · 352 · 910.1007/978-3-319-50252-6_2 ↗
3. H. S. Ackley, “Methods for optical character recognition (OCR),” Google Patents No. 10,621,470, 2020.
4. N. Islam, Z. Islam and N. Noor, “A survey on optical character recognition system,” Arxiv Preprint, arXiv:1710.05703, 2017.
5. Automatic number plate recognition system for vehicle identification using optical character recognition
6. A novel segmentation technique for online handwritten Bangla words10.1016/j.patrec.2018.02.008 ↗
7. Deep learning in neural networks: An overview10.1016/j.neunet.2014.09.003 ↗
8. A fast learning algorithm for deep belief nets
9. Deep neural networks for acoustic modeling in speech recognition10.1109/MSP.2012.2205597 ↗
10. Goyal · Deep Learning for Natural Language Processing · 2018 · 138
11. Z. Chen, “Deep-learning approaches to object recognition from 3D data,” M.S. Dissertation. Case Western Reserve University, Cleveland, Ohio, USA, 2017.
12. Dropout: A simple way to prevent neural networks from overfitting
13. P. Sermanet, D. Eigen, X. Zhang, M. Mathieu, R. Fergus et al., “Overfeat: Integrated recognition, localization and detection using convolutional networks,” Arxiv Preprint arXiv:1312.6229, 2013.
14. An efficient learning procedure for deep boltzmann machines
15. Cursive text recognition in natural scene images using deep convolutional recurrent neural network10.1109/ACCESS.2022.3144844 ↗
16. Multi-classifier Jawi handwritten sub-word recognition10.18517/ijaseit.8.4-2.6959 ↗
17. Multi-oriented and multi-lingual scene text detection with direct regression10.1109/TIP.2018.2855399 ↗
18. FTPN: Scene text detection with feature pyramid based text proposal network10.1109/ACCESS.2019.2908933 ↗
19. J. Memon, M. Sami and R. A. Khan, “Handwritten optical character recognition (OCR): A comprehensive systematic literature review (SLR),” Arxiv Preprint arXiv:2001.00139, 2020.10.1109/ACCESS.2020.3012542 ↗
20. Scene text detection with fully convolutional neural networks10.1007/s11042-019-7177-4 ↗
21. A unified deep learning framework of multi-scale detectors for Geo-spatial object detection in high-resolution satellite images10.1007/s13369-021-06288-x ↗
22. Application of long-short-term-memory recurrent neural networks to forecast wind speed10.3390/app11052387 ↗
23. Stacked bidirectional and unidirectional LSTM recurrent neural network for forecasting network-wide traffic state with missing values10.1016/j.trc.2020.102674 ↗
24. End-to-end sequence labeling via convolutional recurrent neural network with a connectionist temporal classification layer10.2991/ijcis.d.200316.001 ↗
25. An end-to-end trainable neural network for image-based sequence recognition and its application to scene text recognition
26. Optimized leaky ReLU for handwritten arabic character recognition using convolution neural networks10.1007/s11042-021-11593-6 ↗
27. L. G. Hafemann, R. Sabourin and L. Oliveira, “Learning features for offline handwritten signature verification using deep convolutional neural networks,” Arxiv Preprint arXiv:1705.05787, 2017.10.1016/j.patcog.2017.05.012 ↗
28. Handwritten digit string recognition using convolutional neural network10.1109/ICPR.2018.8546100 ↗
29. Deep recurrent neural networks for automatic detection of sleep apnea from single channel respiration signals
30. C. Wick, J. Zöllner and T. Grüning, “Rescoring sequence-to-sequence models for text line recognition with CTC-prefixes,” Arxiv Preprint arXiv:2110.05909, 2021.10.1007/978-3-031-06555-2_18 ↗
31. A blended attention-CTC network architecture for amharic text-image recognition10.5220/0010284204350441 ↗
32. Two streams deep neural network for handwriting word recognition10.1007/s11042-020-09923-1 ↗