journal article·2025-08-16Open access

RASD: Relation Aware Spectral Decoupling Attention Network for Knowledge Graph Reasoning

Zheng Wang, Taiyu Li, Zengzhao Chen

Applied Sciences· Volume 15· Issue 16

Abstract

Knowledge Graph Reasoning (KGR) aims to deduce missing or novel knowledge by learning structured information and semantic relationships within Knowledge Graphs (KGs). Despite significant advances achieved by deep neural networks in recent years, existing models typically extract non-linear representations from explicit features in a relatively simplistic manner and fail to fully exploit semantic heterogeneity of relation types and entity co-occurrence frequencies. Consequently, these models struggle to capture critical predictive cues embedded in various entities and relations. To address these limitations, this paper proposes a relation aware spectral decoupling attention network for KGR (RASD). First, a spectral decoupling attention network module projects joint embeddings of entities and relations into the frequency domain, extracting features across different frequency bands and adaptively allocating attention at the global level to model frequency specific information. Next, a relation-aware learning module employs relation aware filters and an augmentation mechanism to preserve distinct relational properties and suppress redundant features, thereby enhancing representation of heterogeneous relations. Experimental results demonstrate that RASD achieves significant and consistent improvements over multiple leading baseline models on link prediction tasks across five public benchmark datasets.
Source: crossref · Quality: baseline

Research context

OpenAlex topics: Advanced Graph Neural Networks · Topic Modeling · Brain Tumor Detection and Classification

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

Faculty of Artificial Intelligence in Education, Central China Normal University, Wuhan 430079, China

National Engineering Research Center for E-Learning, Central China Normal University, Wuhan 430079, China

Funding

National Natural Science Foundation of China · Fundamental Research Funds for the Central Universities at Central China Normal University: Artificial Intelligence +

References (33)

Show source-provided references
1. Liu, R., He, L., and Zheng, J. (2025). GLARA: A Global–Local Attention Framework for Semantic Relation Abstraction and Dynamic Preference Modeling in Knowledge-Aware Recommendation. Appl. Sci., 15.10.3390/app15126386 ↗
2. Chen, Y., Sun, S., and Hu, X. (2025). DRKG: Faithful and Interpretable Multi-Hop Knowledge Graph Question Answering via LLM-Guided Reasoning Plans. Appl. Sci., 15.10.3390/app15126722 ↗
3. Wang, Y., Yu, Z., Wang, Z., Yu, Z., and Wang, J. (2025). Multi-Examiner: A Knowledge Graph-Driven System for Generating Comprehensive IT Questions with Higher-Order Thinking. Appl. Sci., 15.10.20944/preprints202503.1067.v1 ↗
4. Galárraga, L.A., Teflioudi, C., Hose, K., and Suchanek, F. (2013, January 13–17). AMIE: Association rule mining under incomplete evidence in ontological knowledge bases. Proceedings of the 22nd International Conference on World Wide Web, Rio de Janeiro, Brazil.10.1145/2488388.2488425 ↗
5. Schoenmackers, S., Davis, J., Etzioni, O., and Weld, D.S. (2010, January 9–11). Learning first-order horn clauses from web text. Proceedings of the 2010 Conference on Empirical Methods in Natural Language Processing, Stroudsburg, PA, USA.
6. Tang, X., Zhu, S.-C., Liang, Y., and Zhang, M. (2024, January 11–16). RulE: Knowledge Graph Reasoning with Rule Embedding. Proceedings of the Findings of the Association for Computational Linguistics ACL 2024, Bangkok, Thailand.10.18653/v1/2024.findings-acl.256 ↗
7. Bordes, A., Usunier, N., Garcia-Durán, A., Weston, J., and Yakhnenko, O. (2013, January 5–10). Translating embeddings for modeling multi-relational data. Proceedings of the 26th International Conference on Neural Information Processing Systems—Volume 2, Lake Tahoe, Nevada.
8. Yang, B., Yih, W.-t., He, X., Gao, J., and Deng, L. (2014). Embedding entities and relations for learning and inference in knowledge bases. arXiv.
9. Dettmers, T., Minervini, P., Stenetorp, P., and Riedel, S. (2018, January 2–7). Convolutional 2d knowledge graph embeddings. Proceedings of the AAAI Conference on Artificial Intelligence, New Orleans, LA, USA.10.1609/aaai.v32i1.11573 ↗
10. Schlichtkrull, M., Kipf, T.N., Bloem, P., van den Berg, R., Titov, I., and Welling, M. (2018, January 3–7). Modeling Relational Data with Graph Convolutional Networks. Proceedings of the European Semantic Web Conference, Crete, Greece.10.1007/978-3-319-93417-4_38 ↗
11. Meilicke, C., Fink, M., Wang, Y., Ruffinelli, D., Gemulla, R., and Stuckenschmidt, H. (2018, January 8–12). Fine-grained evaluation of rule-and embedding-based systems for knowledge graph completion. Proceedings of the Semantic Web–ISWC 2018: 17th International Semantic Web Conference, Monterey, CA, USA. Proceedings, Part I 17.10.1007/978-3-030-00671-6_1 ↗
12. Meilicke, C., Chekol, M.W., Fink, M., and Stuckenschmidt, H. (2020). Reinforced anytime bottom up rule learning for knowledge graph completion. arXiv.10.24963/ijcai.2019/435 ↗
13. Ferré, S. (2019, January 2–6). Link prediction in knowledge graphs with concepts of nearest neighbours. Proceedings of the Semantic Web: 16th International Conference, ESWC 2019, Portorož, Slovenia. Proceedings 16.
14. Wang, Z., Zhang, J., Feng, J., and Chen, Z. (2014, January 27–31). Knowledge graph embedding by translating on hyperplanes. Proceedings of the AAAI Conference on Artificial Intelligence, Québec City, QC, Canada.10.1609/aaai.v28i1.8870 ↗
15. Ji, G., He, S., Xu, L., Liu, K., and Zhao, J. (2015, January 26–31). Knowledge graph embedding via dynamic mapping matrix. Proceedings of the 53rd Annual Meeting of the Association for Computational Linguistics and the 7th International Joint Conference on Natural Language Processing (Volume 1: Long Papers), Beijing, China.10.3115/v1/P15-1067 ↗
16. Lin, Y., Liu, Z., Sun, M., Liu, Y., and Zhu, X. (2015, January 25–30). Learning entity and relation embeddings for knowledge graph completion. Proceedings of the AAAI Conference on Artificial Intelligence, Austin, TX, USA.10.1609/aaai.v29i1.9491 ↗
17. Nickel, M., Tresp, V., and Kriegel, H.-P. (July, January 28). A three-way model for collective learning on multi-relational data. Proceedings of the ICML, Bellevue, WA, USA.
18. Trouillon, T., Welbl, J., Riedel, S., Gaussier, É., and Bouchard, G. (2016, January 19–24). Complex embeddings for simple link prediction. Proceedings of the 33rd International Conference on International Conference on Machine Learning—Volume 48, New York, NY, USA.
19. CircularE: A Complex Space Circular Correlation Relational Model for Link Prediction in Knowledge Graph Embedding10.1109/TASLP.2023.3297959 ↗
20. Multisource hierarchical neural network for knowledge graph embedding10.1016/j.eswa.2023.121446 ↗
21. Wang, B., Shen, T., Long, G., Zhou, T., Wang, Y., and Chang, Y. (2021, January 19–23). Structure-augmented text representation learning for efficient knowledge graph completion. Proceedings of the Web Conference 2021, Ljubljana, Slovenia.10.1145/3442381.3450043 ↗
22. Xu, Z., Ye, P., Chen, H., Zhao, M., Chen, H., and Zhang, W. (2022, January 12–17). Ruleformer: Context-aware rule mining over knowledge graph. Proceedings of the 29th International Conference on Computational Linguistics, Gyeongju, Republic of Korea.
23. Liu, Y., Sun, Z., Li, G., and Hu, W. (2022, January 17–21). I know what you do not know: Knowledge graph embedding via co-distillation learning. Proceedings of the 31st ACM International Conference on Information & Knowledge Management, Atlanta, GA, USA.10.1145/3511808.3557355 ↗
24. Position-aware relational transformer for knowledge graph embedding10.1109/TNNLS.2023.3262937 ↗
25. Generalized Translation-Based Embedding of Knowledge Graph10.1109/TKDE.2019.2893920 ↗
26. Vashishth, S., Sanyal, S., Nitin, V., Agrawal, N., and Talukdar, P.P. (2020, January 7–12). InteractE: Improving Convolution-Based Knowledge Graph Embeddings by Increasing Feature Interactions. Proceedings of the AAAI Conference on Artificial Intelligence, New York, NY, USA.10.1609/aaai.v34i03.5694 ↗
27. Song, T., Luo, J., and Huang, L. (2021, January 6–14). Rot-Pro: Modeling Transitivity by Projection in Knowledge Graph Embedding. Proceedings of the Thirty-Fifth Annual Conference on Advances in Neural Information Processing Systems (NeurIPS), Online.
28. Complex graph convolutional network for link prediction in knowledge graphs10.1016/j.eswa.2022.116796 ↗
29. SDFormer: A shallow-to-deep feature interaction for knowledge graph embedding10.1016/j.knosys.2023.111253 ↗
30. Sun, Z., Deng, Z.-H., Nie, J.-Y., and Tang, J. (2019, January 6–9). RotatE: Knowledge Graph Embedding by Relational Rotation in Complex Space. Proceedings of the 7th International Conference on Learning Representations (ICLR), New Orleans, LA, USA.
31. Knowledge graph embedding by projection and rotation on hyperplanes for link prediction10.1007/s10489-022-03983-6 ↗
32. Knowledge graph embedding with the special orthogonal group in quaternion space for link prediction10.1016/j.knosys.2023.110400 ↗
33. Knowledge graph embedding with 3d compound geometric transformations10.1561/116.00000177 ↗