journal article·2022-08-10Open access

CCFont: Component-Based Chinese Font Generation Model Using Generative Adversarial Networks (GANs)

Jangkyoung Park, Ammar Ul Hassan, Jaeyoung Choi

Applied Sciences· Volume 12· Issue 16

Abstract

Font generation using deep learning has made considerable progress using image style transfer, but the automatic conversion/generation of Chinese characters still remains a difficult task owing to the complex character shape and large number of Chinese characters. Most known Chinese character generation models use the image conversion method of the Chinese character shape itself; however, it is difficult to reproduce complex Chinese characters. Recent methods have utilized character compositionality by separating up to three or four components to improve the quality of generated characters, but it is still difficult to generate high-quality results for complex Chinese characters with many components. In this study, we proposed the CCFont model (component-based Chinese font generation model using generative adversarial networks (GANs)) that automatically generates all Chinese characters using Chinese character components (up to 17 components). The CCFont model generates all Chinese characters in various styles using the components of Chinese characters based on conditional GAN. By acquiring local style information from the components, the information is more accurate and there is less information loss than when global information is obtained from the image of the entire character, reducing the failure of style conversion and improving quality to produce high-quality results. Additionally, the CCFont model generates high-quality results without any additional training (zero-shot font generation without any additional training) for the first-seen characters and styles. For example, the CCFont model, which was trained with only traditional Chinese (TC) characters, generates high-quality results for languages that can be divided into components, such as Korean and Thai, as well as simplified Chinese (SC) characters that are only seen during inference. CCFont can be adopted as a multi-lingual font-generation model that can be applied to all languages, which can be divided into components. To the best of our knowledge, the proposed method is the first to generate a zero-shot multilingual generation model using components. Qualitative and quantitative experiments were conducted to demonstrate the effectiveness of the proposed method.
Source: crossref · Quality: baseline

Research context

OpenAlex topics: Generative Adversarial Networks and Image Synthesis · Human Motion and Animation · Handwritten Text Recognition Techniques

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

School of Computer Science and Engineering, Soongsil University, Seoul 06978, Korea

Funding

Institute of Information & communications Technology Planning & Evaluation (IITP)

References (30)

Show source-provided references
1. Cha, J. (2022, June 01). Few-Shot Handwriting Copycat AI, DEVIEW 2020 Session. Available online: https://deview.kr/data/deview/session/attach/1400_T4.
2. Evaluation of Criteria for Mapping Characters Using an Automated Hangul Font Generation System based on Deep Learning
3. Hangul Font Dataset for Korean Font Research Based on Deep Learning
4. Weidman, S. (2019). Deep Learning from Scratch, O’Reilly Media, Inc.
5. Foster, D. (2020). Generative Deep Learning, O’Reilly Media, Inc.
6. Goodfellow, I., Pouget-Abadie, J., Mirza, M., Xu, B., Warde-Farley, D., Ozair, S., Courville, A., and Bengio, Y. (2014, January 8–13). Generative Adversarial Nets. Proceedings of the Advances in neural information processing systems 27 (NIPS 2014), Montreal, QC, Canada.
7. Salimans, T., Goodfellow, I., Zaremba, W., Cheung, V., Radford, A., and Chen, X. (2016, January 5–10). Improved techniques for training GANs. Proceedings of the Advances in Neural Information Processing Systems 29 (NIPS 2016), Barcelona, Spain.
8. Tian, Y. (2022, June 01). zi2zi: Master Chinese Calligraphy with Conditional Adversarial Networks. Available online: https://github.com/kao-nashityc/zi2zi.
9. Jiang, Y., Lian, Z., Tang, Y., and Xiao, J. (2017, January 27–30). DCFont: An end-to-end deep Chinese font generation system. Proceedings of the SIGGRAPH Asia 2017, Bangkok, Thailand. Technical Briefs.10.1145/3145749.3149440 ↗
10. Jiang, Y., Lian, Z., Tang, Y., and Xiao, J. (February, January 27). SCFont: Structure guided Chinese font generation via deep stacked networks. Proceedings of the AAAI Conference on Artificial Intelligence and Innovative, Applications of Artificial Intelligence Conference and AAAI Symposium on Educational Advances in Artificial Intelligence (AAAI), Honolulu, HI, USA.
11. SKFont: Skeleton-driven Korean font generator with conditional deep adversarial networks10.1007/s10032-021-00374-4 ↗
12. Skelgan: A font image skeletonization method
13. Ma, L.L., and Liu, C.L. (2008, January 8–11). A new radical-based approach to online handwritten Chinese character recognition. Proceedings of the 2008 19th International Conference on Pattern Recognition, Tampa, FL, USA.10.1109/ICPR.2008.4761207 ↗
14. Wang, T.Q., Yin, F., and Liu, C.L. (2017, January 9–15). Radical-Based Chinese Character Recognition via Multi-Labeled Learning of Deep Residual Networks. Proceedings of the 2017 14th IAPR International Conference on Document Analysis and Recognition (ICDAR), Kyoto, Japan.10.1109/ICDAR.2017.100 ↗
15. Zhang, J., Zhu, Y., Du, J., and Dai, L. (2018, January 23–27). Radical analysis network for zero-shot learning in printed Chinese character recognition. Proceedings of the 2018 IEEE International Conference on Multimedia and Expo (ICME), San Diego, CA, USA.10.1109/ICME.2018.8486456 ↗
16. Wen, C., Chang, J., and Zhang, Y. (2019). Handwritten Chinese font generation with collaborative stroke refinement. arXiv.
17. Huang, Y., He, M., Jin, L., and Wang, Y. (2020). RD-GAN: Few/Zero-Shot Chinese Character Style Transfer via Radical Decomposition and Rendering. Computer Vision–ECCV 2020, Springer.10.1007/978-3-030-58539-6_10 ↗
18. Lladós, J., Lopresti, D., and Uchida, S. (2021). Radical Composition Network for Chinese Character Generation. Document Analysis and Recognition–ICDAR 2021, Springer.10.1007/978-3-030-86337-1 ↗
19. Tang, L., Cai, Y., Liu, J., Hong, Z., Gong, M., Fan, M., Han, J., Liu, J., Ding, E., and Wang, J. (2022). Few-Shot Font Generation by Learning Fine-Grained Local Styles. arXiv.10.1109/CVPR52688.2022.00774 ↗
20. Few-Shot Korean Font Generation based on Hangul Composability
21. Unpaired font family synthesis using conditional generative adversarial networks10.1016/j.knosys.2021.107304 ↗
22. Ko, D., Hassan, A., Majeed, S., and Choi, J. (2020, January 17–19). Font2Fonts: A modified Image-to-Image translation framework for font generation. Proceedings of the SMA 2020: The 9th International Conference on Smart Media and Applications, Jeju, Korea.10.1145/3426020.3426094 ↗
23. Korean Font Synthesis with GANs10.7763/IJCTE.2020.V12.1270 ↗
24. Cha, J., Chun, S., Lee, G., Lee, B., Kim, S., and Lee, H. (2020). Few-shot compositional font generation with dual memory. Computer Vision–ECCV 2020, Springer.10.1007/978-3-030-58529-7_43 ↗
25. Few-shot font generation with localized style representations and factorization
26. Park, S., Chun, S., Cha, J., Lee, B., and Shim, H. (2021). Multiple Heads are Better than One: Few-shot Font Generation with Multiple Localized Experts. arXiv.10.1109/ICCV48922.2021.01364 ↗
27. Isola, P., Zhu, J., Zhou, T., and Efros, A. (2017, January 21–26). Image-to-image translation with conditional adversarial networks. Proceedings of the Proceedings of the 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Honolulu, HI, USA.10.1109/CVPR.2017.632 ↗
28. Mirza, M., and Osindero, S. (2014). Conditional generative adversarial nets. arXiv.
29. (2022, June 01). Available online: https://github.com/kaonashi-tyc/Rewrite.
30. Parmar, G., Zhang, R., and Zhu, J. (2022, July 01). On Buggy Resizing Libraries and Surprising Subtleties in FID Calculation. Available online: https://github.com/bioinfjku/TTUR.10.1109/CVPR52688.2022.01112 ↗