journal article·2024Open access

A Harmonic Approach to Handwriting Style Synthesis Using Deep Learning

Mahatir Ahmed Tusher, Saket Choudary Kongara, Sagar Dhanraj Pande, SeongKi Kim, Salil Bharany

Computers, Materials & Continua· Volume 79· Issue 3

Abstract

The challenging task of handwriting style synthesis requires capturing the individuality and diversity of human handwriting. The majority of currently available methods use either a generative adversarial network (GAN) or a recurrent neural network (RNN) to generate new handwriting styles. This is why these techniques frequently fall short of producing diverse and realistic text pictures, particularly for terms that are not commonly used. To resolve that, this research proposes a novel deep learning model that consists of a style encoder and a text generator to synthesize different handwriting styles. This network excels in generating conditional text by extracting style vectors from a series of style images. The model performs admirably on a range of handwriting synthesis tasks, including the production of text that is out-of-vocabulary. It works more effectively than previous approaches by displaying lower values on key Generative Adversarial Network evaluation metrics, such Geometric Score (GS) (3.21 × 10) and Fréchet Inception Distance (FID) (8.75), as well as text recognition metrics, like Character Error Rate (CER) and Word Error Rate (WER). A thorough component analysis revealed the steady improvement in image production quality, highlighting the importance of specific handwriting styles. Applicable fields include digital forensics, creative writing, and document security.
Source: openalex_inverted_index · Quality: baseline

Research context

OpenAlex topics: Handwritten Text Recognition Techniques · Human Motion and Animation · Image Processing and 3D Reconstruction

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

References (30)

Show source-provided references
1. Separating style and content for generalized style transfer
2. BART: Denoising sequence-to-sequence pre-training for natural language generation, translation, and comprehension
3. Adversarial generation of handwritten text images conditioned on sequences
4. HiGAN: Handwriting imitation conditioned on arbitrary-length texts and disentangled styles
5. SLOGAN: Handwriting style synthesis for arbitrary-length and out-of-vocabulary text10.1109/TNNLS.2022.3151477 ↗
6. ScrabbleGAN: Semi-supervised varying length handwritten text generation
7. A. Graves, “Generating sequences with recurrent neural networks,” arXiv preprint arXiv:1308.0850, 2013.
8. Transfer learning for speech and language processing
9. Handwritten word recognition using deep learning approach: A novel way of generating handwritten words
10. Identifying and tackling key challenges in semantic word spotting
11. On the role of competing word units in visual word recognition: The neighborhood frequency effect10.3758/BF03210696 ↗
12. Bidirectional attention mechanism-based deep learning model for text classification under natural language processing
13. Handwritten text generation via disentangled representations10.1109/LSP.2021.3109541 ↗
14. GANwriting: Content-conditioned generation of styled handwritten word image
15. A literature review of online handwriting analysis to detect Parkinson’s disease at an early stage10.1007/s11042-022-13759-2 ↗
16. Evaluating synthetic pre-training for handwriting processing tasks10.1016/j.patrec.2023.06.003 ↗
17. Synthesis of human-inspired intelligent fonts using conditional-DCGAN
18. Global-local fusion based on adversarial sample generation for image-text matching10.1016/j.inffus.2023.102084 ↗
19. Multiscale feature extraction and fusion of image and text in VQA10.1007/s44196-023-00233-6 ↗
20. Long short-term memory10.1162/neco.1997.9.8.1735 ↗
21. Mixed attention dense network for sketch classification10.1007/s10489-021-02211-x ↗
22. Deep residual learning for image recognition
23. The IAM-database: An English sentence database for offline handwriting recognition10.1007/s100320200071 ↗
24. Results of the RIMES evaluation campaign for handwritten mail processing
25. Look closer to supervise better: One-shot font generation via component-based discriminator
26. MORAN: A multi-object rectified attention network for scene text recognition10.1016/j.patcog.2019.01.020 ↗
27. AEDmts: An attention-based encoder-decoder framework for multi-sensory time series analytic10.1109/ACCESS.2020.2971579 ↗
28. Generating structurally complete stylish chinese font based on semi-supervised model10.3390/app131910650 ↗
29. Secure sensitive data sharing using RSA and ElGamal cryptographic algorithms with hash functions10.3390/info13100442 ↗
30. A novel subset-based polynomial design for enhancing the security of short message-digest with inflated avalanche and random responses