EssayGAN: Essay Data Augmentation Based on Generative Adversarial Networks for Automated Essay Scoring
Source abstract
Abstract
In large-scale testing and e-learning environments, automated essay scoring (AES) can relieve the burden upon human raters by replacing human grading with machine grading. However, building AES systems based on deep learning requires a training dataset consisting of essays that are manually rated with scores. In this study, we introduce EssayGAN, an automatic essay generator based on generative adversarial networks (GANs). To generate essays rated with scores, EssayGAN has multiple generators for each score range and one discriminator. Each generator is dedicated to a specific score and can generate an essay rated with that score. Therefore, the generators can focus only on generating a realistic-looking essay that can fool the discriminator without considering the target score. Although ordinary-text GANs generate text on a word basis, EssayGAN generates essays on a sentence basis. Therefore, EssayGAN can compose not only a long essay by predicting a sentence instead of a word at each step, but can also compose a score-rated essay by adopting multiple generators dedicated to the target score. Since EssayGAN can generate score-rated essays, the generated essays can be used in the supervised learning process for AES systems. Experimental results show that data augmentation using augmented essays helps to improve the performance of AES systems. We conclude that EssayGAN can generate essays not only consisting of multiple sentences but also maintaining coherence between sentences in essays.
Source: crossref · Quality: baseline
Research context
OpenAlex topics: Topic Modeling · Multimodal Machine Learning Applications · Software Engineering Research
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
Affiliations
Department of Radio and Information Communications Engineering, Chungnam National University, 99 Daehak-ro, Yuseong-gu, Daejeon 34134, Korea
Interaction AI Core, KT Institute of Convergence Technology, Seoul 06763, Korea
Funding
Chungnam National University
References (23)
Show source-provided references
1. Automated language essay scoring systems: A literature review10.7717/peerj-cs.208 ↗
2. Ghahramani, Z., Welling, M., Cortes, C., Lawrence, N.D., and Weinberger, K.Q. (2014, January 8–13). Generative Adversarial Nets. Proceedings of the Advances in Neural Information Processing Systems 27, Montréal, QC, Canada.
3. Conditional Image Synthesis with Auxiliary Classifier GANs
4. Wang, K., and Wan, X. (2018, January 13–19). SentiGAN: Generating Sentimental Texts via Mixture Adversarial Networks. Proceedings of the Twenty-Seventh International Joint Conference on Artificial Intelligence, IJCAI 2018, Stockholm, Sweden.10.24963/ijcai.2018/618 ↗
5. A generative model for category text generation10.1016/j.ins.2018.03.050 ↗
6. Devlin, J., Chang, M.W., Lee, K., and Toutanova, K. (2019, January 2–7). BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding. Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Minneapolis, MI, USA. Volume 1 (Long and Short Papers).
7. Wallach, H., Larochelle, H., Beygelzimer, A., d’Alché-Buc, F., Fox, E., and Garnett, R. (2019, January 8–14). XLNet: Generalized Autoregressive Pretraining for Language Understanding. Proceedings of the Advances in Neural Information Processing Systems, Vancouver, BC, Canada.
8. Rodriguez, P.U., Jafari, A., and Ormerod, C.M. (2019). Language models and Automated Essay Scoring. arXiv.
9. Yang, R., Cao, J., Wen, Z., Wu, Y., and He, X. (2020, January 16–20). Enhancing Automated Essay Scoring Performance via Fine-tuning Pre-trained Language Models with Combination of Regression and Ranking. Proceedings of the Findings of the Association for Computational Linguistics: EMNLP 2020, Online.10.18653/v1/2020.findings-emnlp.141 ↗
10. Ormerod, C.M., Malhotra, A., and Jafari, A. (2021). Automated essay scoring using efficient transformer-based language models. arXiv.
11. Lan, Z., Chen, M., Goodman, S., Gimpel, K., Sharma, P., and Soricut, R. (2020, January 27–30). ALBERT: A Lite BERT for Self-supervised Learning of Language Representations. Proceedings of the 8th International Conference on Learning Representations (ICLR), Online.
12. Kitaev, N., Kaiser, L., and Levskaya, A. (2020). Reformer: The Efficient Transformer. arXiv.
13. Clark, K., Luong, M.T., Le, Q.V., and Manning, C.D. (2020). ELECTRA: Pre-training Text Encoders as Discriminators Rather Than Generators. arXiv.
14. Sun, Z., Yu, H., Song, X., Liu, R., Yang, Y., and Zhou, D. (2020, January 5–10). MobileBERT: A Compact Task-Agnostic BERT for Resource-Limited Devices. Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics, Association for Computational Linguistics, Online.10.18653/v1/2020.acl-main.195 ↗
15. Sethi, A., and Singh, K. (2022, January 29–31). Natural Language Processing based Automated Essay Scoring with Parameter-Efficient Transformer Approach. Proceedings of the 2022 6th International Conference on Computing Methodologies and Communication (ICCMC), Erode, India.10.1109/ICCMC53470.2022.9753760 ↗
16. Zügner, D., Kirschstein, T., Catasta, M., Leskovec, J., and Günnemann, S. (2021). Language-Agnostic Representation Learning of Source Code from Structure and Context. arXiv.
17. Chaslot, G., Bakkes, S., Szita, I., and Spronck, P. (2008, January 22–24). Monte-Carlo tree search: A new framework for game AI. Proceedings of the Fourth Artificial Intelligence and Interactive Digital Entertainment Conference (AIIDE), Stanford, CA, USA.
18. Simple Statistical Gradient-Following Algorithms for Connectionist Reinforcement Learning10.1007/BF00992696 ↗
19. Lapata, M., and Barzilay, R. (August, January 30). Automatic Evaluation of Text Coherence: Models and Representations. Proceedings of the IJCAI-05, Nineteenth International Joint Conference on Artificial Intelligence, Edinburgh, UK.
20. Chen, H., and He, B. (2013, January 18–21). Automated Essay Scoring by Maximizing Human-Machine Agreement. Proceedings of the 2013 Conference on Empirical Methods in Natural Language Processing, Seattle, WA, USA.
21. Dong, F., Zhang, Y., and Yang, J. (2017, January 3–4). Attention-based Recurrent Convolutional Neural Network for Automatic Essay Scoring. Proceedings of the SIGNLL Conference on Computational Natural Language Learning (CoNLL), Vancouver, BC, Canada.10.18653/v1/K17-1017 ↗
22. Tay, Y., Phan, M.C., Tuan, L.A., and Hui, S.C. SkipFlow: Incorporating Neural Coherence Features for End-to-End Automatic Text Scoring. Proceedings of the Proceedings of the Thirty-Second AAAI Conference on Artificial Intelligence, New Orleans, LA, USA, 2–7 February 2018.10.1609/aaai.v32i1.12045 ↗
23. Grzymala-Busse, J.W., Hippe, Z.S., and Mroczek, T. (2019). Reduced Data Sets and Entropy-Based Discretization. Entropy, 21.10.3390/e21111051 ↗