Efficient Parameterization for Knowledge Graph Embedding Using Hierarchical Attention Network
Source abstract
Abstract
In the domain of knowledge graph embedding, conventional approaches typically transform entities and relations into continuous vector spaces. However, parameter efficiency becomes increasingly crucial when dealing with large-... | Find, read and cite all the research you need on Tech Science Press
Source: openalex_inverted_index · Quality: baseline
Research context
OpenAlex topics: Advanced Graph Neural Networks · Graph Theory and Algorithms
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
References (45)
Show source-provided references
1. MulDE: multi-teacher knowledge distillation for low-dimensional knowledge graph embeddings
2. Freebase: a collaboratively created graph database for structuring human knowledge
3. Yago: a core of semantic knowledge
4. DBpedia—a crystallization point for the web of data10.1016/j.websem.2009.07.002 ↗
5. Hu Z, Xu Y, Yu W, Wang S, Yang Z, Zhu C, et al. Empowering language models with knowledge graph reasoning for question answering. arXiv:2211.08380. 2022.10.18653/v1/2022.emnlp-main.650 ↗
6. JAKET: joint pre-training of knowledge graph and language understanding
7. Deep learning and knowledge graph for image/video captioning: a review of datasets, evaluation metrics, and methods10.1002/eng2.12785 ↗
8. TIVA-KG: a multimodal knowledge graph with text, image, video and audio
9. AgriKG: an agricultural knowledge graph and its applications
10. Domain specific knowledge graphs as a service to the public: powering social-impact funding in the US
11. Tang Z, Pei S, Zhang Z, Zhu Y, Zhuang F, Hoehndorf R, et al. Positive-unlabeled learning with adversarial data augmentation for knowledge graph completion. arXiv:2205.00904. 2022.10.24963/ijcai.2022/312 ↗
12. STDE: a single-senior-teacher knowledge distillation model for high-dimensional knowledge graph embeddings
13. Quaternion knowledge graph embeddings
14. Li J, Wang Q, Liu Y, Zhang L, Mao Z. Random entity quantization for parameter-efficient compositional knowledge graph representation. arXiv:2310.15797. 2023.10.18653/v1/2023.emnlp-main.177 ↗
15. Entity-agnostic representation learning for parameter-efficient knowledge graph embedding
16. Hu Z, Gutiérrez-Basulto V, Xiang Z, Li X, Li R, Pan JZ. Type-aware embeddings for multi-hop reasoning over knowledge graphs. arXiv:2205.00782. 2022.10.24963/ijcai.2022/427 ↗
17. To see further: knowledge graph-aware deep graph convolutional network for recommender systems10.1016/j.ins.2023.119465 ↗
18. A survey on knowledge graphs: representation, acquisition, and applications10.1109/TNNLS.2021.3070843 ↗
19. Translating embeddings for modeling multi-relational data
20. Sun Z, Deng ZH, Nie JY, Tang J. RotatE: knowledge graph embedding by relational rotation in complex space. arXiv:1902.10197. 2019.
21. Learning hierarchy-aware knowledge graph embeddings for link prediction
22. Learning knowledge graph embedding with heterogeneous relation attention networks10.1109/TNNLS.2021.3055147 ↗
23. Complex embeddings for simple link prediction
24. Balažević I, Allen C, Hospedales TM. TuckER: tensor factorization for knowledge graph completion. arXiv:1901.09590. 2019.10.18653/v1/D19-1522 ↗
25. DynaSemble: dynamic ensembling of textual and structure-based models for knowledge graph completion
26. Simple but effective compound geometric operations for temporal knowledge graph completion
27. Generating and evaluating plausible explanations for knowledge graph completion
28. Exploring the knowledge transferred by response-based teacher-student distillation
29. Yang · Advancements in knowledge distillation: towards new horizons of intelligent systems · 2023 · 1
30. Knowledge distillation with feature self attention10.1109/ACCESS.2023.3265382 ↗
31. Hinton G. Distilling the Knowledge in a Neural Network. arXiv:1503.02531. 2015.
32. Zhou H, Song L, Chen J, Zhou Y, Wang G, Yuan J, et al. Rethinking soft labels for knowledge distillation: a bias-variance tradeoff perspective. arXiv:2102.00650. 2021.
33. Huang Z, Wang N. Like what you like: knowledge distill via neuron selectivity transfer. 2017. doi:10.48550/arXiv.1707.01219.
34. Cross-layer distillation with semantic calibration
35. Distilling knowledge via knowledge review
36. Cross-image relational knowledge distillation for semantic segmentation
37. DualDE: dually distilling knowledge graph embedding for faster and cheaper reasoning
38. Knowledge graph embedding compression
39. A lightweight knowledge graph embedding framework for efficient inference and storage
40. Galkin M, Denis E, Wu J, Hamilton WL. NodePiece: compositional and parameter-efficient representations of large knowledge graphs. arXiv:2106.12144. 2021.
41. Vaswani · 31st Annual Conference on Neural Information Processing Systems (NIPS 2017) · 2017
42. Vashishth S, Sanyal S, Nitin V, Talukdar P. Composition-based multi-relational graph convolutional networks. arXiv:1911.03082. 2019.
43. Distributed representations of words and phrases and their compositionality
44. Convolutional 2D knowledge graph embeddings
45. Safavi T, Koutra D. CoDEx: a comprehensive knowledge graph completion benchmark. arXiv:2009.07810. 2020.10.18653/v1/2020.emnlp-main.669 ↗