journal article·2023Open access

A Two-Phase Paradigm for Joint Entity-Relation Extraction

Bin Ji, Hao Xu, Jie Yu, Shasha Li, Jun Ma, Yuke Ji, Huijun Liu

Computers, Materials & Continua· Volume 74· Issue 1

Abstract

An exhaustive study has been conducted to investigate span-based models for the joint entity and relation extraction task. However, these models sample a large number of negative entities and negative relations during the model training, which are essential but result in grossly imbalanced data distributions and in turn cause suboptimal model performance. In order to address the above issues, we propose a two-phase paradigm for the span-based joint entity and relation extraction, which involves classifying the entities and relations in the first phase, and predicting the types of these entities and relations in the second phase. The two-phase paradigm enables our model to significantly reduce the data distribution gap, including the gap between negative entities and other entities, as well as the gap between negative relations and other relations. In addition, we make the first attempt at combining entity type and entity distance as global features, which has proven effective, especially for the relation extraction. Experimental results on several datasets demonstrate that the span-based joint extraction model augmented with the two-phase paradigm and the global features consistently outperforms previous state-of-the-art span-based models for the joint extraction task, establishing a new standard benchmark. Qualitative and quantitative analyses further validate the effectiveness the proposed paradigm and the global features.
Source: openalex_inverted_index · Quality: baseline

Research context

OpenAlex topics: Topic Modeling · Natural Language Processing Techniques · Text and Document Classification Technologies

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

References (38)

Show source-provided references
1. Span-based joint entity and relation extraction with transformer pre-training
2. Multi-task identification of entities, relations, and coreference for scientific knowledge graph construction
3. Span-level model for relation extraction
4. A general framework for information extraction using dynamic span graphs
5. Entity, relation, and event extraction with contextualized span representations
6. Span-based joint entity and relation extraction with attention-based span-specific and contextual semantic representations
7. A frustratingly easy approach for entity and relation extraction
8. End-to-end relation extraction using LSTMS on sequences and tree structures
9. Joint entity recognition and relation extraction as a multi-head selection problem10.1016/j.eswa.2018.07.032 ↗
10. Modeling dense cross-modal interactions for joint entity-relation extraction
11. Relation classification via convolutional deep neural network
12. Exploiting entity bio tag embeddings and multi-task learning for relation extraction with imbalanced data
13. End-to-end neural coreference resolution
14. Jointly predicting predicates and arguments in neural semantic role labeling
15. Modeling document-level context for event detection via important context selection
16. Evolutionary game theoretical on-line event detection over tweet streams
17. Deep contextualized word representations
18. BERT: Pre-training of deep bidirectional transformers for language understanding
19. ALBERT: A lite bert for self-supervised learning of language representations
20. Joint entity and relation extraction model based on rich semantics10.1016/j.neucom.2020.12.037 ↗
21. ENPAR: Enhancing entity and entity pair representations for joint entity relation extraction
22. Improving distantly-supervised relation extraction with joint label embedding
23. Going out on a limb: Joint extraction of entity mentions and relations without dependency trees
24. Extracting entities and relations with joint minimum risk training
25. Two are better than one: Joint entity and relation extraction with table-sequence encoders
26. Attention is all you need
27. A knowledge-enriched and span-based network for joint entity and relation extraction10.32604/cmc.2021.016301 ↗
28. Lexicalized dependency paths based supervised learning for relation extraction10.32604/csse.2022.030759 ↗
29. Research on Chinese medical named entity recognition based on collaborative cooperation of multiple neural network models10.1016/j.jbi.2020.103395 ↗
30. The automatic content extraction (ace) program-Tasks, data, and evaluation
31. A linear programming formulation for global inference in natural language tasks
32. Incremental joint extraction of entity mentions and relations
33. Entity-relation extraction as multi-turn question answering
34. UniRE: A unified label space for entity relation extraction
35. Joint entity and relation extraction from scientific documents: Role of linguistic information and entity types
36. Syntax-informed self-attention network for span-based joint entity and relation extraction
37. A span-based model for joint entity and relation extraction with relational graphs
38. Span representation generation method in entity-relation joint extraction