Information Extraction Based on Multi-turn Question Answering for燗nalyzing Korean Research Trends
Source abstract
Abstract
Analyzing Research and Development (R&D) trends is important because it can influence future decisions regarding R&D direction. In typical trend analysis, topic or technology taxonomies are employed to compute the popularities of the topics or codes over time. Although it is simple and effective, the taxonomies are difficult to manage because new technologies are introduced rapidly. Therefore, recent studies exploit deep learning to extract pre-defined targets such as problems and solutions. Based on the recent advances in question answering (QA) using deep learning, we adopt a multi-turn QA model to extract problems and solutions from Korean R&D reports. With the previous research, we use the reports directly and analyze the difficulties in handling them using QA style on Information Extraction (IE) for sentence-level benchmark dataset. After investigating the characteristics of Korean R&D, we propose a model to deal with multiple and repeated appearances of targets in the reports. Accordingly, we propose a model that includes an algorithm with two novel modules and a prompt. A newly proposed methodology focuses on reformulating a question without a static template or pre-defined knowledge. We show the effectiveness of the proposed model using a Korean R&D report dataset that we constructed and presented an in-depth analysis of the benefits of the multi-turn QA model.
Source: openalex_inverted_index · Quality: baseline
Research context
OpenAlex topics: Technology and Data Analysis · Expert finding and Q&A systems · Advanced Text Analysis Techniques
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
References (29)
Show source-provided references
1. Discovering trends in text databases
2. A text-mining-based patent network: Analytical tool for high-technology trend10.1016/j.hitech.2003.09.003 ↗
3. Visualization of patent analysis for emerging technology10.1016/j.eswa.2007.01.033 ↗
4. An approach to discovering new technology opportunities: Keyword-based patent map approach10.1016/j.technovation.2008.10.006 ↗
5. Discovering competitive intelligence by mining changes in patent trends10.1016/j.eswa.2009.09.001 ↗
6. Web mining based extraction of problem solution ideas10.1016/j.eswa.2013.01.013 ↗
7. How to combine term clumping and technology roadmapping for newly emerging science & technology competitive intelligence: ‘Problem & solution’ pattern based semantic TRIZ tool and case study10.1007/s11192-014-1262-2 ↗
8. Technology roadmapping for competitive technical intelligence10.1016/j.techfore.2015.11.029 ↗
9. Identifying R&D partners through subject-action-object semantic analysis in a problem & solution pattern10.1080/09537325.2016.1277202 ↗
10. Deriving technology intelligence from patents: Preposition-based semantic analysis10.1016/j.joi.2018.01.001 ↗
11. QA4IE: a question answering based framework for information extraction10.1007/978-3-030-00671-6_12 ↗
12. Zero-shot relation extraction via reading comprehension
13. B. McCann, N. S. Keskar, C. Xiong and R. Socher, “The natural language decathlon: Multitask learning as question answering,” arXiv preprint arXiv:1806.08730, pp. 1–23, 2018.
14. BERT: Pre-training of deep bidirectional transformers for language understanding
15. SpanBERT: Improving pre-training by representing and predicting spans10.1162/tacl_a_00300 ↗
16. Y. Liu, M. Ott, N. Goyal, J. Du, M. Joshi et al., “RoBERTa: A robustly optimized BERT pretraining approach,” arXiv preprint arXiv:1907.11692, pp. 1–13, 2019.
17. K. Clark, M. T. Luong, Q. V. Le and C. D. Manning, “ELECTRA: Pre-training text encoders as discriminators rather than generators,” arXiv preprint arXiv:2003.10555, pp. 1–18, 2020.
18. Entity-relation extraction as multi-turn question answering
19. Entity, relation, and event extraction with contextualized span representations
20. Asking effective and diverse questions: A machine reading comprehension based framework for joint entity-relation extraction
21. A pattern-first pipeline approach for entity and relation extraction10.1016/j.neucom.2022.04.059 ↗
22. S. Lim, M. Kim and J. Lee, “KorQuAD1.0: Korean QA dataset for machine reading comprehension,” arXiv preprint arXiv:1909.07005, pp. 1–5, 2019.
23. SQuAD: 100,000+ questions for machine comprehension of text
24. MS MARCO: A human generated machine reading comprehension dataset
25. NewsQA: A machine comprehension dataset
26. TriviaQA: A large scale distantly supervised challenge dataset for reading comprehension
27. MRQA 2019 shared task: Evaluating generalization in reading comprehension
28. Attention is all you need
29. Language models are few-shot learners