journal article·2021Open access

Tibetan Question Generation Based on Sequence to Sequence Model

Yuan Sun, Chaofan Chen, Andong Chen, Xiaobing Zhao

Computers, Materials & Continua· Volume 68· Issue 3

Abstract

As the dual task of question answering, question generation (QG) is a significant and challenging task that aims to generate valid and fluent questions from a given paragraph. The QG task is of great significance to question answering systems, conversational systems, and machine reading comprehension systems. Recent sequence to sequence neural models have achieved outstanding performance in English and Chinese QG tasks. However, the task of Tibetan QG is rarely mentioned. The key factor impeding its development is the lack of a public Tibetan QG dataset. Faced with this challenge, the present paper first collects 425 articles from the Tibetan Wikipedia website and constructs 7,234 question–answer pairs through crowdsourcing. Next, we propose a Tibetan QG model based on the sequence to sequence framework to generate Tibetan questions from given paragraphs. Secondly, in order to generate answer-aware questions, we introduce an attention mechanism that can capture the key semantic information related to the answer. Meanwhile, we adopt a copy mechanism to copy some words in the paragraph to avoid generating unknown or rare words in the question. Finally, experiments show that our model achieves higher performance than baseline models. We also further explore the attention and copy mechanisms, and prove their effectiveness through experiments.
Source: openalex_inverted_index · Quality: baseline

Research context

OpenAlex topics: Topic Modeling · Natural Language Processing Techniques · Advanced Text Analysis Techniques

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

References (32)

Show source-provided references
1. Pan · Recent Advances in Neural Question Generation · 2019 · 1
2. Towards topic to-question generation10.1162/COLI_a_00206 ↗
3. Generating natural language questions to support learning on-line
4. Let’s ask again: Refine network for automatic question generation
5. BERT for question generation
6. Capturing greater context for question generation
7. Good question! statistical ranking for question generation
8. Computer-aided generation of multiple-choice tests
9. Generating instruction automatically for the reading strategy of self-questioning
10. Deep questions without deep understanding
11. A joint model for question answering and question generation
12. Bilateral multi-perspective matching for natural language sentence
13. Incorporating copying mechanism in sequence-to-sequence learning
14. Linguistic structure prediction10.1007/978-3-031-02143-5 ↗
15. Generating factoid questions with recurrent neural networks: The 30 m factoid question-answer corpus
16. Identifying where to focus in reading comprehension for neural question generation
17. Harvesting paragraph-level question-answer pairs from wikipedia
18. Neural question generation from text: A preliminary study
19. Improving neural question generation using answer separation
20. SQuAD: 100,000+ question for machine reading comprehension of text
21. Leveraging context information for natural question generation
22. Paragraph-level neural question generation with max-out pointer and gated self-attention networks
23. Tibetan interrogative sentences parsing based on PCFG
24. L. P. Sun, “Classification of Tibetan problem for campus all-knowing,” M.S. theses, Northwest Minzu University, China, 2019.
25. Generating questions based on semi-automated and end-to-end neural network10.32604/cmc.2019.05860 ↗
26. QuGAN: Quasi generative adversarial network for Tibetan question answering corpus generation10.1109/ACCESS.2019.2934581 ↗
27. Generative adversarial nets
28. Tibetan pos tagging based on syllable tagging
29. Bidirectional recurrent neural networks10.1109/78.650093 ↗
30. Glove: Global vectors for word representation
31. A novel bidirectional LSTM and attention mechanism based neural network for answer selection in community question answering10.32604/cmc.2020.07269 ↗
32. An attentive survey of attention models