Joint Extraction of Entities and Relations Based on Multi-Scale Information Enhancement
Source abstract
Abstract
Extracting relational triples from unstructured text is essential for information extraction and knowledge graph construction, but it remains challenging in complex scenarios involving overlapping entities and diverse relational patterns. To address this issue, this paper proposes an Information-Enhanced Multi-Scale Fusion Convolutional Neural Network (EnInfo-Mulscal FCNN) for joint entity–relation extraction. The model uses BERT to obtain contextual representations, predicts candidate relations through multi-label classification, incorporates relation-aware features into entity recognition, and introduces a multi-scale fusion convolutional module and an attention-based entity filtering mechanism to enhance subject–object correspondence modeling. Experiments on the NYT-star and WebNLG datasets demonstrate the effectiveness of the proposed method. Experiments show that EnInfo-Mulscal FCNN achieves precision, recall, and F1-score values of 87.2%, 75.1%, and 80.7% on NYT-star and 86.3%, 88.3%, and 87.3% on WebNLG, respectively. Compared with ETL-span, our model improves the F1-score by 2.7% on NYT-star and 4.2% on WebNLG. Compared with PRE-span, our model improves the F1-score by 4.3%, demonstrating its effectiveness in relational triple extraction. These results indicate that the proposed method improves relational triple extraction by enhancing information in the relation identification, entity recognition, and entity filtering stages, thereby improving triple generation in complex text scenarios.
Source: crossref · Quality: baseline
Research context
OpenAlex topics: Advanced Graph Neural Networks · Topic Modeling · Text and Document Classification Technologies
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
Affiliations
National Center for Materials Service Safety, University of Science and Technology Beijing, Beijing 100083, China
Computer Network Information Center, Chinese Academy of Sciences, Beijing 100190, China
Funding
National Key R\&D Program of China
References (45)
Show source-provided references
1. A comprehensive survey on automatic knowledge graph construction
2. Golshan, P.N., Dashti, H.A.R., Azizi, S., and Safari, L. (2018). A study of recent contributions on information extraction. arXiv.
3. Bender, O., Och, F.J., and Ney, H. (June, January 31). Maximum entropy models for named entity recognition. Proceedings of the Seventh Conference on Natural Language Learning at HLT-NAACL 2003, Edmonton, AB, Canada. Available online: https://aclanthology.org/W03-0420/.
4. Kernel methods for relation extraction
5. Han, X., and Ruonan, R. (2011, January 24–26). The method of medical named entity recognition based on semantic model and improved SVM-KNN algorithm. Proceedings of the 2011 Seventh International Conference On Semantics, Knowledge and Grids, Beijing, China.10.1109/SKG.2011.24 ↗
6. Chunk Parsing and Entity Relation Extracting to Chinese Text by Using Conditional Random Fields Model
7. Structured minimally supervised learning for neural relation extraction
8. Joint entity and relation extraction based on a hybrid neural network10.1016/j.neucom.2016.12.075 ↗
9. Boundaries and edges rethinking: An end-to-end neural model for overlapping entity relation extraction10.1016/j.ipm.2020.102311 ↗
10. Semantic relation extraction using sequential and tree-structured LSTM with attention10.1016/j.ins.2019.09.006 ↗
11. Joint entity and relation extraction model based on rich semantics10.1016/j.neucom.2020.12.037 ↗
12. Representation iterative fusion based on heterogeneous graph neural network for joint entity and relation extraction10.1016/j.knosys.2021.106888 ↗
13. Chen, Z., Li, Z., Huang, Y., and Tang, Z. (2024, January 14–19). Adaptive prompt construction method for relation extraction. Proceedings of the 2024 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), Seoul, Republic of Korea.10.1109/ICASSP48485.2024.10448452 ↗
14. Zhang, M., and Qian, T. (2021). Multi-scale feature and metric learning for relation extraction. arXiv.
15. HeteroGraphRec: A heterogeneous graph-based neural networks for social recommendations10.1016/j.knosys.2021.106817 ↗
16. A review of relational machine learning for knowledge graphs10.1109/JPROC.2015.2483592 ↗
17. An asymmetric knowledge representation learning in manifold space10.1016/j.ins.2020.04.036 ↗
18. Knowledge graph based natural language generation with adapted pointer-generator networks10.1016/j.neucom.2019.11.079 ↗
19. Imagenet classification with deep convolutional neural networks
20. Graves, A. (2012). Long short-term memory. Supervised Seq. Label. Recurr. Neural Netw., 37–45.10.1007/978-3-642-24797-2_4 ↗
21. A neural network framework for relation extraction: Learning entity semantic and relation pattern10.1016/j.knosys.2016.09.019 ↗
22. Multichannel convolutional neural network for biological relation extraction10.1155/2016/1850404 ↗
23. Li, F., Zhang, M., Fu, G., and Ji, D. (2017). A neural joint model for entity and relation extraction from biomedical text. BMC Bioinform., 18.10.1186/s12859-017-1609-9 ↗
24. Knowledge-oriented convolutional neural network for causal relation extraction from natural language texts10.1016/j.eswa.2018.08.009 ↗
25. A novel document-level relation extraction method based on BERT and entity information10.1109/ACCESS.2020.2996642 ↗
26. Joint extraction of entities and relations based on a novel tagging scheme10.18653/v1/P17-1113 ↗
27. Extracting relational facts by an end-to-end neural model with copy mechanism10.18653/v1/P18-1047 ↗
28. Zeng, D., Zhang, H., and Liu, Q. (2020, January 7–12). Copymtl: Copy mechanism for joint extraction of entities and relations with multi-task learning. Proceedings of the AAAI Conference on Artificial Intelligence, New York, NY, USA.10.1609/aaai.v34i05.6495 ↗
29. Wei, Z., Su, J., Wang, Y., Tian, Y., and Chang, Y. (2020). A Novel Cascade Binary Tagging Framework for Relational Triple Extraction. Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics, Association for Computational Linguistics. Available online: https://aclanthology.org/2020.acl-main.136/.10.18653/v1/2020.acl-main.136 ↗
30. Fu, T.J., Li, P.H., and Ma, W.Y. (2019). Graphrel: Modeling text as relational graphs for joint entity and relation extraction. Proceedings of the 57th Annual Meeting of the Association for Computational Linguistics, Association for Computational Linguistics. Available online: https://aclanthology.org/P19-1136/.10.18653/v1/P19-1136 ↗
31. Improving graph convolutional networks based on relation-aware attention for end-to-end relation extraction10.1109/ACCESS.2020.2980859 ↗
32. Yu, B., Zhang, Z., Shu, X., Liu, T., Wang, Y., Wang, B., and Li, S. (2020). Joint extraction of entities and relations based on a novel decomposition strategy. Proceedings of the ECAI 2020: 24th European Conference on Artificial Intelligence, 29 August–8 September 2020, Santiago de Compostela, Spain–Including 10th Conference on Prestigious Applications of Artificial Intelligence (PAIS 2020), SAGE Publications.
33. OD-RTE: A one-stage object detection framework for relational triple extraction10.18653/v1/2023.acl-long.623 ↗
34. IPED: An implicit perspective for relational triple extraction based on diffusion model
35. Multiple features for clinical relation extraction: A machine learning approach10.1016/j.jbi.2020.103382 ↗
36. A joint entity and relation extraction model based on efficient sampling and explicit interaction10.1145/3604811 ↗
37. Kong, W., and Xia, Y. (2024). CARE: Co-attention network for joint entity and relation extraction. Proceedings of the 2024 Joint International Conference on Computational Linguistics, Language Resources and Evaluation (LREC-COLING 2024), Association for Computational Linguistics. Available online: https://aclanthology.org/2024.lrec-main.255/.10.63317/4ovpe98f2y6r ↗
38. PRGC: Potential relation and global correspondence based joint relational triple extraction
39. Bert: Pre-training of deep bidirectional transformers for language understanding
40. Attention is all you need
41. Riedel, S., Yao, L., and McCallum, A. (2010). Modeling relations and their mentions without labeled text. Proceedings of the Joint European Conference on Machine Learning and Knowledge Discovery in Databases, Springer.10.1007/978-3-642-15939-8_10 ↗
42. Gardent, C., Shimorina, A., Narayan, S., and Perez-Beltrachini, L. (August, January 30). Creating training corpora for NLG micro-planners. Proceedings of the 55th Annual Meeting of the Association for Com-Putational Linguistics, Vancouver, BC, Canada.
43. Kingma, D.P., and Ba, J. (2014). Adam: A method for stochastic optimization. arXiv.
44. Zeng, X., He, S., Zeng, D., Liu, K., Liu, S., and Zhao, J. (2019). Learning the extraction order of multiple relational facts in a sentence with reinforcement learning. Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing (EMNLP-IJCNLP), Association for Computational Linguistics. Available online: https://aclanthology.org/D19-1035/.10.18653/v1/D19-1035 ↗
45. A Parallel Model for Jointly Extracting Entities and Relations10.1007/s11063-024-11616-x ↗