journal article·2024-02-06Open access

Joint Entity and Relation Extraction Model Based on Inner and Outer Tensor Dot Product and Single-Table Filling

Ping Feng, Lin Yang, Boning Zhang, Renjie Wang, Dantong Ouyang

Applied Sciences· Volume 14· Issue 4

Abstract

Joint relational triple extraction is a crucial step in constructing a knowledge graph from unstructured text. Recently, multiple methods have been proposed for extracting relationship triplets. Notably, end-to-end table-filling methods have garnered significant research interest due to their efficient extraction capabilities. However, existing approaches usually generate separate tables for each relationship, which neglects the global correlation between relationships and context, producing a large number of useless blank tables. This problem results in issues of redundant information and sample imbalance. To address these challenges, we propose a novel framework for joint entity and relation extraction based on a single-table filling method. This method incorporates all relationships as prompts within the text sequence and associates entity span information with relationship labels. This approach reduces the generation of redundant information and enhances the extraction capability for overlapping triplets. We utilize the internal and external multi-head tensor fusion approach to generate two sets of table feature vectors. These vectors are subsequently merged to capture a wider range of global information. Experimental results on the NYT and WebNLG datasets demonstrate the effectiveness of our proposed model, which maintains excellent performance, even in complex scenarios involving overlapping triplets.
Source: crossref · Quality: baseline

Research context

OpenAlex topics: Topic Modeling · Web Data Mining and Analysis · Text and Document Classification Technologies

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

College of Computer Science and Technology, Jilin University, Changchun 130012, China

College of Computer Science and Technology, Changchun University, Changchun 130022, China

Ministry of Education Key Laboratory of Intelligent Rehabilitation and Barrier-Free Access for the Disabled, Changchun 130022, China

Jilin Provincial Key Laboratory of Human Health State Identification and Function Enhancement, Changchun 130022, China

Jilin Rehabilitation Equipment and Technology Engineering Research Center for the Disabled, Changchun 130022, China

Funding

Science and Technology Development Plan Project of the Jilin Provincial Science and Technology Department

References (35)

Show source-provided references
1. A survey on knowledge graphs: Representation, acquisition, and applications10.1109/TNNLS.2021.3070843 ↗
2. Lin, Y., Liu, Z., Sun, M., Liu, Y., and Zhu, X. (2015, January 25–30). Learning entity and relation embeddings for knowledge graph completion. Proceedings of the AAAI Conference on Artificial Intelligence, Austin, TX, USA.10.1609/aaai.v29i1.9491 ↗
3. Chen, Z.Y., Chang, C.H., Chen, Y.P., Nayak, J., and Ku, L.W. (2019, January 3–5). UHop: An Unrestricted-Hop Relation Extraction Framework for Knowledge-Based Question Answering. Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long and Short Papers), Minneapolis, MN, USA.
4. Bian, N., Han, X., Chen, B., and Sun, L. (2021, January 2–9). Benchmarking knowledge-enhanced commonsense question answering via knowledge-to-text transformation. Proceedings of the AAAI Conference on Artificial Intelligence, Virtual.10.1609/aaai.v35i14.17490 ↗
5. Chan, Y.S., and Roth, D. (2011, January 19–24). Exploiting syntactico-semantic structures for relation extraction. Proceedings of the 49th Annual Meeting of the Association for Computationalinguistics: Humananguage Technologies, Portland, OR, USA.
6. Li, J., Fei, H., Liu, J., Wu, S., Zhang, M., Teng, C., Ji, D., and Li, F. (March, January 22). Unified named entity recognition as word-word relation classification. Proceedings of the AAAI Conference on Artificial Intelligence, Virtual.
7. Guo, Z., Zhang, Y., and Lu, W. (August, January 28). Attention Guided Graph Convolutional Networks for Relation Extraction. Proceedings of the 57th Annual Meeting of the Association for Computationalinguistics, Florence, Italy.
8. Wei, Z., Su, J., Wang, Y., Tian, Y., and Chang, Y. (2020, January 5–10). A Novel Cascade Binary Tagging Framework for Relational Triple Extraction. Proceedings of the 58th Annual Meeting of the Association for Computationalinguistics, Virtual.10.18653/v1/2020.acl-main.136 ↗
9. Gupta, P., Schütze, H., and Andrassy, B. (2016, January 11–16). Table filling multi-task recurrent neural network for joint entity and relation extraction. Proceedings of the COLING 2016, the 26th International Conference on Computational Linguistics: Technical Papers, Osaka, Japan.
10. Wang, Y., Yu, B., Zhang, Y., Liu, T., Zhu, H., and Sun, L. (2020, January 8–13). TPLinker: Single-stage Joint Extraction of Entities and Relations Through Token Pair Linking. Proceedings of the 28th International Conference on Computational Linguistics, Barcelona, Spain.10.18653/v1/2020.coling-main.138 ↗
11. Shang, Y.M., Huang, H., and Mao, X. (March, January 22). Onerel: Joint entity and relation extraction with one module in one step. Proceedings of the AAAI Conference on Artificial Intelligence, Virtual.
12. Ren, F., Zhang, L., Yin, S., Zhao, X., Liu, S., Li, B., and Liu, Y. (2021, January 7–11). A Novel Global Feature-Oriented Relational Triple Extraction Model based on Table Filling. Proceedings of the 2021 Conference on Empirical Methods in Natural Language Processing, Punta Cana, Dominican Republic.10.18653/v1/2021.emnlp-main.208 ↗
13. Wang, Z., Nie, H., Zheng, W., Wang, Y., and Li, X. (2023). A novel tensor learning model for joint relational triplet extraction. IEEE Trans. Cybern.10.1109/TCYB.2023.3265851 ↗
14. Zeng, X., Zeng, D., He, S., Liu, K., and Zhao, J. (2018, January 15–20). Extracting relational facts by an end-to-end neural model with copy mechanism. Proceedings of the 56th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), Melbourne, Australia.10.18653/v1/P18-1047 ↗
15. Tang, W., Xu, B., Zhao, Y., Mao, Z., Liu, Y., Liao, Y., and Xie, H. (2022, January 7–11). UniRel: Unified Representation and Interaction for Joint Relational Triple Extraction. Proceedings of the Conference on Empirical Methods in Natural Language Processing, Abu Dhabi, United Arab Emirates.10.18653/v1/2022.emnlp-main.477 ↗
16. Kenton, J.D.M.W.C., and Toutanova, L.K. (2019, January 3–5). BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding. Proceedings of the NAACL-HLT, Minneapolis, MN, USA.
17. Relation Extraction Based on Prompt Information and Feature Reuse10.1162/dint_a_00192 ↗
18. Attention is all you need
19. Lin, T.Y., Goyal, P., Girshick, R., He, K., and Dollár, P. (2017, January 22–29). Focal loss for dense object detection. Proceedings of the IEEE International Conference on Computer Vision, Venice, Italy.10.1109/ICCV.2017.324 ↗
20. Riedel, S., Yao, L., and McCallum, A. (2010, January 20–24). Modeling relations and their mentions without labeled text. Proceedings of the Machine Learning and Knowledge Discovery in Databases: European Conference—ECML PKDD 2010, Barcelona, Spain. Proceedings, Part III 21.10.1007/978-3-642-15939-8_10 ↗
21. Gardent, C., Shimorina, A., Narayan, S., and Perez-Beltrachini, L. (August, January 30). Creating training corpora for nlg micro-planning. Proceedings of the 55th Annual Meeting of the Association for Computational Linguistics (ACL), Vancouver, BC, Canada.
22. Zheng, S., Wang, F., Bao, H., Hao, Y., Zhou, P., and Xu, B. (August, January 30). Joint Extraction of Entities and Relations Based on a Novel Tagging Scheme. Proceedings of the 55th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers). Association for Computational Linguistics, Vancouver, BC, Canada.
23. Joint entity recognition and relation extraction as a multi-head selection problem10.1016/j.eswa.2018.07.032 ↗
24. Miwa, M., and Bansal, M. (2016, January 7–12). End-to-End Relation Extraction using LSTMs on Sequences and Tree Structures. Proceedings of the 54th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers). Association for Computational Linguistics, Berlin, Germany.10.18653/v1/P16-1105 ↗
25. Zheng, H., Wen, R., Chen, X., Yang, Y., Zhang, Y., Zhang, Z., Zhang, N., Qin, B., Ming, X., and Zheng, Y. (2021, January 1–6). PRGC: Potential Relation and Global Correspondence Based Joint Relational Triple Extraction. Proceedings of the 59th Annual Meeting of the Association for Computational Linguistics and the 11th International Joint Conference on Natural Language Processing, Vrtual.10.18653/v1/2021.acl-long.486 ↗
26. Sequence to sequence learning with neural networks
27. Cabot, P.L.H., and Navigli, R. (2021, January 7–11). REBEL: Relation extraction by end-to-end language generation. Proceedings of the Findings of the Association for Computational Linguistics: EMNLP 2021, Virtual.
28. Wang, Y., Sun, C., Wu, Y., Zhou, H., Li, L., and Yan, J. (2021, January 1–6). UniRE: A Unified Label Space for Entity Relation Extraction. Proceedings of the 59th Annual Meeting of the Association for Computational Linguistics and the 11th International Joint Conference on Natural Language Processing, Virtual.10.18653/v1/2021.acl-long.19 ↗
29. Named entity recognition and relation extraction using enhanced table filling by contextualized representations10.5715/jnlp.29.187 ↗
30. Xu, B., Wang, Q., Lyu, Y., Shi, Y., Zhu, Y., Gao, J., and Mao, Z. (2022, January 10–15). EmRel: Joint Representation of Entities and Embedded Relations for Multi-triple Extraction. Proceedings of the Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Seattle, WA, USA.10.18653/v1/2022.naacl-main.48 ↗
31. Representation iterative fusion based on heterogeneous graph neural network for joint entity and relation extraction10.1016/j.knosys.2021.106888 ↗
32. SSEL-ADE: A semi-supervised ensemble learning framework for extracting adverse drug events from social media10.1016/j.artmed.2017.10.003 ↗
33. A machine learning-based approach to ERα bioactivity and drug ADMET prediction10.3389/fgene.2022.1087273 ↗
34. Li, Z., Fu, L., Wang, X., Zhang, H., and Zhou, C. (2022, January 22–27). RFBFN: A relation-first blank filling network for joint relational triple extraction. Proceedings of the 60th Annual Meeting of the Association for Computational Linguistics: Student Research Workshop, Dublin, Ireland.10.18653/v1/2022.acl-srw.2 ↗
35. Impact of strategy conformity on vaccination behaviors10.3389/fphy.2022.972457 ↗