journal article·2025-07-02Open access

CLEAR: Cross-Document Link-Enhanced Attention for Relation Extraction with Relation-Aware Context Filtering

Yihan She, Tian Tian, Junchi Zhang

Applied Sciences· Volume 15· Issue 13

Abstract

Cross-document relation extraction (CodRE) aims to predict the semantic relationships between target entities located in different documents, a critical capability for comprehensive knowledge graph construction and multi-source intelligence analysis. Existing approaches primarily rely on bridge entities to capture interdependencies between target entities across documents. However, these models face two potential limitations: they employ entity-centered context filters that overlook relation-specific information, and they fail to account for varying semantic distances between document paths. To address these challenges, we propose CLEAR (Cross-document Link-Enhanced Attention for Relations), a novel framework integrating three key components: (1) the Relation-aware Context Filter that incorporates relation type descriptions to preserve critical relation-specific evidence; (2) the Path Distance-Weighted Attention mechanism that dynamically adjusts attention weights based on semantic distances between document paths; and (3) a cross-path entity matrix that leverages inner- and inter-path relations to enrich target entity representations. Experimental results on the CodRED benchmark demonstrate that CLEAR outperforms all competitive baselines, achieving state-of-the-art performance, with 68.78% AUC and 68.42% F1 scores, confirming the effectiveness of our framework.
Source: crossref · Quality: baseline

Research context

OpenAlex topics: Topic Modeling · Advanced Graph Neural Networks · Advanced Text Analysis Techniques

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

School of Artificial Intelligence, Jianghan University, Wuhan 430056, China

Funding

National Natural Science Foundation of China

References (33)

Show source-provided references
1. A relationship extraction method for domain knowledge graph construction10.1007/s11280-019-00765-y ↗
2. Chen, Z.Y., Chang, C.H., Chen, Y.P., Nayak, J., and Ku, L.W. (2019, January 2–7). UHop: An Unrestricted-Hop Relation Extraction Framework for Knowledge-Based Question Answering. Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Minneapolis, MN, USA.
3. Kadry, A., and Dietz, L. (2017, January 7–11). Open relation extraction for support passage retrieval: Merit and open issues. Proceedings of the 40th International ACM SIGIR Conference on Research and Development in Information Retrieval, Tokyo, Japan.10.1145/3077136.3080744 ↗
4. Miwa, M., and Bansal, M. (2016, January 7–12). End-to-End Relation Extraction using LSTMs on Sequences and Tree Structures. Proceedings of the 54th Annual Meeting of the Association for Computational Linguistics, Berlin, Germany.10.18653/v1/P16-1105 ↗
5. Xu, W., Chen, K., Mou, L., and Zhao, T. (2022, January 10–15). Document-Level Relation Extraction with Sentences Importance Estimation and Focusing. Proceedings of the 2022 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Online.10.18653/v1/2022.naacl-main.212 ↗
6. Xie, Y., Shen, J., Li, S., Mao, Y., and Han, J. (2022, January 22–27). Eider: Empowering Document-level Relation Extraction with Efficient Evidence Extraction and Inference-stage Fusion. Proceedings of the Findings of the Association for Computational Linguistics: ACL, Dublin, Ireland.10.18653/v1/2022.findings-acl.23 ↗
7. Liu, W., Zeng, D., Zhou, L., Xiao, Y., Zhang, M., and Chen, W. (2025, January 6–11). Enhancing Document-Level Relation Extraction through Entity-Pair-Level Interaction Modeling. Proceedings of the ICASSP 2025-2025 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), Hyderabad, India.10.1109/ICASSP49660.2025.10887549 ↗
8. Wang, F., Li, F., Fei, H., Li, J., Wu, S., Su, F., Shi, W., Ji, D., and Cai, B. (2022, January 7–11). Entity-centered Cross-document Relation Extraction. Proceedings of the 2022 Conference on Empirical Methods in Natural Language Processing, Abu Dhabi, United Arab Emirates.10.18653/v1/2022.emnlp-main.671 ↗
9. Yao, Y., Du, J., Lin, Y., Li, P., Liu, Z., Zhou, J., and Sun, M. (2021, January 7–11). CodRED: A Cross-Document Relation Extraction Dataset for Acquiring Knowledge in the Wild. Proceedings of the 2021 Conference on Empirical Methods in Natural Language Processing, Punta Cana, Dominican Republic.10.18653/v1/2021.emnlp-main.366 ↗
10. Local-to-global causal reasoning for cross-document relation extraction10.1109/JAS.2023.123540 ↗
11. Na, B., Jo, S., Kim, Y., and Moon, I.C. (2024, January 11–16). Reward-based Input Construction for Cross-document Relation Extraction. Proceedings of the 62nd Annual Meeting of the Association for Computational Linguistics, Bangkok, Thailand.10.18653/v1/2024.acl-long.501 ↗
12. Son, J., Kim, J., Lim, J., Jang, Y., and Lim, H. (2023, January 6–10). Explore the Way: Exploring Reasoning Path by Bridging Entities for Effective Cross-Document Relation Extraction. Proceedings of the Findings of the Association for Computational Linguistics: EMNLP 2023, Singapore.10.18653/v1/2023.findings-emnlp.450 ↗
13. Yue, H., Lai, S., Yang, C., Zhang, L., Yao, J., and Su, J. (2024, January 11–16). Towards Better Graph-based Cross-document Relation Extraction via Non-bridge Entity Enhancement and Prediction Debiasing. Proceedings of the Findings of the Association for Computational Linguistics ACL 2024, Bangkok, Thailand.10.18653/v1/2024.findings-acl.38 ↗
14. Jain, M., Mutharaju, R., Singh, K., and Kavuluru, R. (2024, January 11–16). Knowledge-Driven Cross-Document Relation Extraction. Proceedings of the Findings of the Association for Computational Linguistics ACL 2024, Bangkok, Thailand.10.18653/v1/2024.findings-acl.227 ↗
15. Ma, Y., Wang, A., and Okazaki, N. (2023, January 2–4). DREEAM: Guiding Attention with Evidence for Improving Document-Level Relation Extraction. Proceedings of the 17th Conference of the European Chapter of the Association for Computational Linguistics, Dubrovnik, Croatia.10.18653/v1/2023.eacl-main.145 ↗
16. Jeong, M., Suh, H., Lee, H., and Lee, J.H. (2022). A named entity and relationship extraction method from trouble-shooting documents in korean. Appl. Sci., 12.10.3390/app122311971 ↗
17. Document-level relation extraction with context guided mention integration and inter-pair reasoning10.1109/TASLP.2023.3316454 ↗
18. Zeng, S., Xu, R., Chang, B., and Li, L. (2020, January 16–20). Double Graph Based Reasoning for Document-level Relation Extraction. Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing (EMNLP), Online.10.18653/v1/2020.emnlp-main.127 ↗
19. Xue, Z., Li, R., Dai, Q., and Jiang, Z. (2022). Corefdre: Document-level relation extraction with coreference resolution. arXiv.10.1007/978-3-031-10989-8_10 ↗
20. Tan, Q., He, R., Bing, L., and Ng, H.T. (2022, January 22–27). Document-Level Relation Extraction with Adaptive Focal Loss and Knowledge Distillation. Proceedings of the Findings of the Association for Computational Linguistics: ACL 2022, Dublin, Ireland.10.18653/v1/2022.findings-acl.132 ↗
21. Zhang, L., and Cheng, Y. (2022). A Densely Connected Criss-Cross Attention Network for Document-level Relation Extraction. arXiv.
22. Lu, K., Hsu, I.H., Zhou, W., Ma, M.D., and Chen, M. (2023, January 9–14). Multi-hop Evidence Retrieval for Cross-document Relation Extraction. Proceedings of the Findings of the Association for Computational Linguistics: ACL 2023, Toronto, ON, Canada.10.18653/v1/2023.findings-acl.657 ↗
23. Min, Q., Guo, Q., Hu, X., Huang, S., Zhang, Z., and Zhang, Y. (2024, January 11–16). Synergetic Event Understanding: A Collaborative Approach to Cross-Document Event Coreference Resolution with Large Language Models. Proceedings of the 62nd Annual Meeting of the Association for Computational Linguistics, Bangkok, Thailand.10.18653/v1/2024.acl-long.164 ↗
24. Cremisini, A., and Finlayson, M. (2020, January 9). New Insights into Cross-Document Event Coreference: Systematic Comparison and a Simplified Approach. Proceedings of the First Joint Workshop on Narrative Understanding, Storylines, and Events, Online.10.18653/v1/2020.nuse-1.1 ↗
25. Sbert-wk: A sentence embedding method by dissecting bert-based word models10.1109/TASLP.2020.3008390 ↗
26. Devlin, J., Chang, M.W., Lee, K., and Toutanova, K. (2019, January 2–7). BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding. Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Minneapolis, MN, USA.
27. Liu, Y., Ott, M., Goyal, N., Du, J., Joshi, M., Chen, D., Levy, O., Lewis, M., Zettlemoyer, L., and Stoyanov, V. (2019). Roberta: A robustly optimized bert pretraining approach. arXiv.
28. Yao, Y., Ye, D., Li, P., Han, X., Lin, Y., Liu, Z., Liu, Z., Huang, L., Zhou, J., and Sun, M. (August, January 28). DocRED: A Large-Scale Document-Level Relation Extraction Dataset. Proceedings of the 57th Annual Meeting of the Association for Computational Linguistics, Florence, Italy.
29. Sun, Y., Cheng, C., Zhang, Y., Zhang, C., Zheng, L., Wang, Z., and Wei, Y. (2020, January 14–19). Circle Loss: A Unified Perspective of Pair Similarity Optimization. Proceedings of the 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), Seattle, WA, USA.10.1109/CVPR42600.2020.00643 ↗
30. Rijsbergen, C.J.V. (1979). Information Retrieval, University of Glasgow. [2nd ed.].
31. The use of the area under the ROC curve in the evaluation of machine learning algorithms10.1016/S0031-3203(96)00142-2 ↗
32. Ahmed, S.R., Nath, A., Martin, J.H., and Krishnaswamy, N. (2023, January 9–14). 2* n is better than n2: Decomposing Event Coreference Resolution into Two Tractable Problems. Proceedings of the Findings of the Association for Computational Linguistics: ACL 2023, Toronto, ON, Canada.
33. Ling, C., Zhao, X., Zhang, X., Liu, Y., Cheng, W., Wang, H., Chen, Z., Oishi, M., Osaki, T., and Matsuda, K. (2024, January 10). Improving Open Information Extraction with Large Language Models: A Study on Demonstration Uncertainty. Proceedings of the ICLR 2024 Workshop on Reliable and Responsible Foundation Models, Vienna, Austria.