IndRT-GCNets: Knowledge Reasoning with Independent Recurrent Temporal Graph Convolutional Representations
Source abstract
Abstract
Due to the structural dependencies among concurrent events in the knowledge graph and the substantial amount of sequential correlation information carried by temporally adjacent events, we propose an Independent Recurrent Temporal Graph Convolution Networks (IndRT-GCNets) framework to efficiently and accurately capture event attribute information. The framework models the knowledge graph sequences to learn the evolutionary representations of entities and relations within each period. Firstly, by utilizing the temporal graph convolution module in the evolutionary representation unit, the framework captures the structural dependency relationships within the knowledge graph in each period. Meanwhile, to achieve better event representation and establish effective correlations, an independent recurrent neural network is employed to implement auto-regressive modeling. Furthermore, static attributes of entities in the entity-relation events are constrained and merged using a static graph constraint to obtain optimal entity representations. Finally, the evolution of entity and relation representations is utilized to predict events in the next subsequent step. On multiple real-world datasets such as Freebase13 (FB13), Freebase 15k (FB15K), WordNet11 (WN11), WordNet18 (WN18), FB15K-237, WN18RR, YAGO3-10, and Nell-995, the results of multiple evaluation indicators show that our proposed IndRT-GCNets framework outperforms most existing models on knowledge reasoning tasks, which validates the effectiveness and robustness.
Source: openalex_inverted_index · Quality: baseline
Research context
OpenAlex topics: Advanced Graph Neural Networks · Topic Modeling · Data Quality and Management
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
References (41)
Show source-provided references
1. Trend analysis of global disaster education research based on scientific knowledge graphs10.3390/su14031492 ↗
2. Financial fraud risk analysis based on audit information knowledge graph10.1016/j.procs.2022.01.097 ↗
3. A. García-Durán, S. Dumančić and M. Niepert, “Learning sequence encoders for temporal knowledge graph completion,” arXiv preprint arXiv:1809.03202, 2018.10.18653/v1/D18-1516 ↗
4. Dynamic knowledge graph based fake-review detection10.1007/s10489-020-01761-w ↗
5. Diachronic embedding for temporal knowledge graph completion
6. Trivedi · Proc. of PMLR · 2017 · 3462
7. DyRep: Learning representations over dynamic graphs
8. Convolutional 2D knowledge graph embeddings
9. End-to-end structure-aware convolutional networks for knowledge base completion
10. Rule-enhanced iterative complementation for knowledge graph reasoning10.1016/j.ins.2021.06.040 ↗
11. Target relational attention-oriented knowledge graph reasoning10.1016/j.neucom.2021.03.135 ↗
12. Multi-scale dynamic convolutional network for knowledge graph embedding10.1109/TKDE.2020.3005952 ↗
13. Modeling relational data with graph convolutional networks
14. S. Vashishth, S. Sanyal, V. Nitin and P. Talukdar, “Composition-based multi-relational graph convolutional networks,” arXiv preprint arXiv:1911.03082, 2019.
15. A vectorized relational graph convolutional network for multi-relational network alignment
16. Z. Han, Y. Ma, P. Chen and V. Tresp, “DyERNIE: Dynamic evolution of riemannian manifold embeddings for temporal knowledge graph completion,” arXiv preprint arXiv.2011.03984, 2020.10.18653/v1/2020.emnlp-main.593 ↗
17. J. Wu, M. Cao, J. C. K. Cheung and W. L. Hamilton, “Temp: Temporal message passing for temporal knowledge graph completion,” arXiv preprint arXiv:2010.03526, 2020.10.18653/v1/2020.emnlp-main.462 ↗
18. Xu · ISWC 2020: The Semantic Web–ISWC 2020 · 2020 · 654
19. Temporal knowledge graph reasoning based on evolutional representation learning
20. Z. Li, S. Guan, X. Jin, W. Peng, Y. Lyu et al., “Complex evolutional pattern learning for temporal knowledge graph reasoning,” arXiv preprint arXiv:2203.07782, 2022.10.18653/v1/2022.acl-short.32 ↗
21. Evokg: Jointly modeling event time and network structure for reasoning over temporal knowledge graphs
22. An improving reasoning network for complex question answering over temporal knowledge graphs10.1007/s10489-022-03913-6 ↗
23. Temporal-structural importance weighted graph convolutional network for temporal knowledge graph completion10.1016/j.future.2023.01.012 ↗
24. Temporal knowledge graph embedding via sparse transfer matrix10.1016/j.ins.2022.12.019 ↗
25. KST-GCN: A knowledge-driven spatial-temporal graph convolutional network for traffic forecasting10.1109/TITS.2021.3136287 ↗
26. S. Arora, “A survey on graph neural networks for knowledge graph completion,” arXiv preprint arXiv:2007.12374, 2020.
27. A novel encoder-decoder knowledge graph completion model for robot brain10.3389/fnbot.2021.674428 ↗
28. Forecasting oil consumption with attention-based IndRNN optimized by adaptive differential evolution
29. Independently recurrent neural network (IndRNN): Building a longer and deeper RNN
30. Delving deep into rectifiers: Surpassing human-level performance on imagenet classification
31. ImageNet classification with deep convolutional neural networks10.1145/3065386 ↗
32. B. Xu, N. Wang, T. Chen and M. Li, “Empirical evaluation of rectified activations in convolutional network,” arXiv preprint arXiv:1505.00853, 2015.
33. Rectifier nonlinearities improve neural network acoustic models
34. Y. Xu, J. Ou, H. Xu and L. Fu, “Temporal knowledge graph reasoning with historical contrastive learning,” arXiv preprint arXiv:2211.10904, 2022.
35. Complex embeddings for simple link prediction
36. Geometry interaction knowledge graph embeddings
37. M. Zhao, L. Zhang, Y. Kong and B. Yin, “Temporal knowledge graph reasoning triggered by memories,” arXiv preprint arXiv:2110.08765, 2021.
38. Z. Sun, Z. H. Deng, J. Y. Nie and J. Tang, “Rotate: Knowledge graph embedding by relational rotation in complex space,” arXiv preprint arXiv:1902.10197, 2019.
39. DHGE: Dual-view hyper-relational knowledge graph embedding for link prediction and entity typing
40. Logic and commonsense-guided temporal knowledge graph completion
41. V-Net: Fully convolutional neural networks for volumetric medical image segmentation