Knowledge Graph Construction: Extraction, Learning, and Evaluation
Source abstract
Abstract
A Knowledge Graph (KG), which structurally represents entities (nodes) and relationships (edges), offers a powerful and flexible approach to knowledge representation in the field of Artificial Intelligence (AI). KGs have been increasingly applied in various domains—such as natural language processing (NLP), recommendation systems, knowledge search, and medical diagnostics—spurring continuous research on effective methods for their construction and maintenance. Recently, efforts to combine large language models (LLMs), particularly those aimed at managing hallucination symptoms, with KGs have gained attention. Consequently, new approaches have emerged in each phase of KG development, including Extraction, Learning Paradigm, and Evaluation Methodology. In this paper, we focus on major publications released after 2022 to systematically examine the process of KG construction along three core dimensions: Extraction, Learning Paradigm, and Evaluation Methodology. Specifically, we investigate (1) large-scale data preprocessing and multimodal extraction techniques in the KG Extraction domain, (2) the refinement of traditional embedding methods and the application of cutting-edge techniques—such as Graph Neural Networks, Transformers, and LLMs—in the KG Learning domain, and (3) both intrinsic and extrinsic metrics in the KG Evaluation domain, as well as various approaches to ensure interpretability and reliability.
Source: crossref · Quality: baseline
Research context
OpenAlex topics: Advanced Graph Neural Networks · Topic Modeling · Data Quality and Management
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
Affiliations
Department of Computer Engineering, Kumoh National Institute of Technology, Gumi-si 39177, Republic of Korea
Department of AI Engineering, Kumoh National Institute of Technology, Gumi-si 39177, Republic of Korea
Funding
IITP(Institute of Information & Coummunications Technology Planning & Evaluation)-ICAN (ICT Challenge and Advanced Network of HRD) grant funded by the Korea government (Ministry of Science and ICT)
References (100+)
Show source-provided references
1. Knowledge graph embedding: A survey of approaches and applications10.1109/TKDE.2017.2754499 ↗
2. Huang, H., Chen, C., He, C., Li, Y., Jiang, J., and Zhang, W. (2024). Can LLMs be Good Graph Judger for Knowledge Graph Construction?. arXiv.
3. Du, X., and Li, N. (2022, January 21–23). Academic Paper Knowledge Graph, the Construction and Application. Proceedings of the ICBASE, Guangzhou, China.
4. Hofer, M., Obraczka, D., Saeedi, A., Köpcke, H., and Rahm, E. (2024). Construction of knowledge graphs: Current state and challenges. Information, 15.10.3390/info15080509 ↗
5. ASER: Towards large-scale commonsense knowledge acquisition via higher-order selectional preference over eventualities10.1016/j.artint.2022.103740 ↗
6. Relation extraction for manufacturing knowledge graphs based on feature fusion of attention mechanism and graph convolution network10.1016/j.knosys.2022.109703 ↗
7. Active knowledge graph completion10.1016/j.ins.2022.05.027 ↗
8. The role of software in science: A knowledge graph-based analysis of software mentions in PubMed Central10.7717/peerj-cs.835 ↗
9. Random walk on node cliques for high-quality samples to estimate large graphs with high accuracies and low costs10.1007/s10115-022-01691-8 ↗
10. MRGAT: Multi-relational graph attention network for knowledge graph completion10.1016/j.neunet.2022.07.014 ↗
11. Bidirectional relation-guided attention network with semantics and knowledge for relational triple extraction10.1016/j.eswa.2023.119905 ↗
12. Attack Behavior Extraction Based on Heterogeneous Cyberthreat Intelligence and Graph Convolutional Networks
13. Retrieval augmented generation using engineering design knowledge10.1016/j.knosys.2024.112410 ↗
14. Autoalign: Fully automatic and effective knowledge graph alignment enabled by large language models10.1109/TKDE.2023.3325484 ↗
15. Liu, T., Feenstra, K.A., Huang, Z., and Heringa, J. (2024). Mining literature and pathway data to explore the relations of ketamine with neurotransmitters and gut microbiota using a knowledge-graph. Bioinformatics, 40.10.1093/bioinformatics/btad771 ↗
16. Mconvkgc: A novel multi-channel convolutional model for knowledge graph completion10.1007/s00607-023-01247-w ↗
17. A method for constructing a machining knowledge graph using an improved transformer10.1016/j.eswa.2023.121448 ↗
18. An radicals construction technique based on dual quaternions and hierarchical transformers10.1016/j.neucom.2024.128315 ↗
19. Triplet extraction leveraging sentence transformers and dependency parsing10.1016/j.array.2023.100334 ↗
20. Multi-information preprocessing event extraction with BiLSTM-CRF attention for academic knowledge graph construction10.1109/TCSS.2022.3183685 ↗
21. Document-level relation extraction with two-stage dynamic graph attention networks10.1016/j.knosys.2023.110428 ↗
22. Seq2EG: A novel and effective event graph parsing approach for event extraction10.1007/s10115-023-01898-3 ↗
23. A novel, cognitively inspired, unified graph-based multi-task framework for information extraction10.1007/s12559-023-10163-2 ↗
24. Liu, X., Hong, H., Wang, X., Chen, Z., Kharlamov, E., Dong, Y., and Tang, J. (2022, January 25–29). Selfkg: Self-supervised entity alignment in knowledge graphs. Proceedings of the ACM Web Conference 2022, Virtual.10.1145/3485447.3511945 ↗
25. ERGM: A multi-stage joint entity and relation extraction with global entity match10.1016/j.knosys.2023.110550 ↗
26. Vassiliades, A., Symeonidis, S., Diplaris, S., Tzanetis, G., Vrochidis, S., Bassiliades, N., and Kompatsiaris, I. (2023, January 1–3). XR4DRAMA Knowledge Graph: A Knowledge Graph for Disaster Management. Proceedings of the 2023 IEEE 17th International Conference on Semantic Computing (ICSC), Laguna Hills, CA, USA.10.1109/ICSC56153.2023.00051 ↗
27. SCICERO: A deep learning and NLP approach for generating scientific knowledge graphs in the computer science domain10.1016/j.knosys.2022.109945 ↗
28. Asada, M., Miwa, M., and Sasaki, Y. (2023). Integrating heterogeneous knowledge graphs into drug–drug interaction extraction from the literature. Bioinformatics, 39.10.1093/bioinformatics/btac754 ↗
29. Merging Web Tables for Relation Extraction with Knowledge Graphs
30. Lin, Y., Lu, K., Yu, S., Cai, T., and Zitnik, M. (2023). Multimodal learning on graphs for disease relation extraction. J. Biomed. Inform., 143.10.1016/j.jbi.2023.104415 ↗
31. Scaling up knowledge graph creation to large and heterogeneous data sources10.1016/j.websem.2022.100755 ↗
32. Information extraction pipelines for knowledge graphs10.1007/s10115-022-01826-x ↗
33. Joint extraction of entities and overlapping relations by improved graph convolutional networks10.1007/s10489-021-02667-x ↗
34. Three birds, one stone: A novel translation based framework for joint entity and relation extraction10.1016/j.knosys.2021.107677 ↗
35. Li, N., Shen, Q., Song, R., Chi, Y., and Xu, H. (2022). MEduKG: A deep-learning-based approach for multi-modal educational knowledge graph construction. Information, 13.10.3390/info13020091 ↗
36. SoftNER: Mining knowledge graphs from cloud incidents10.1007/s10664-022-10159-w ↗
37. Constructing marine expert management knowledge graph based on Trellisnet-CRF10.7717/peerj-cs.1083 ↗
38. AFGSL: Automatic feature generation based on graph structure learning10.1016/j.knosys.2021.107835 ↗
39. Understanding geological reports based on knowledge graphs using a deep learning approach10.1016/j.cageo.2022.105229 ↗
40. GridOnto: Knowledge representation and extraction for fault events in power grid10.1109/ACCESS.2023.3284839 ↗
41. Llm-tikg: Threat intelligence knowledge graph construction utilizing large language model10.1016/j.cose.2024.103999 ↗
42. Causal knowledge extraction from long text maintenance documents10.1016/j.compind.2024.104110 ↗
43. Knowledge Guided Attention and Graph Convolutional Networks for Chemical-Disease Relation Extraction10.1109/TCBB.2021.3135844 ↗
44. Exploiting global context and external knowledge for distantly supervised relation extraction10.1016/j.knosys.2022.110195 ↗
45. Experiencer-driven and knowledge-aware graph model for emotion–cause pair extraction10.1016/j.knosys.2023.110703 ↗
46. A multimodal dual-fusion entity extraction model for large and complex devices10.1016/j.comcom.2023.07.026 ↗
47. Automated clinical knowledge graph generation framework for evidence based medicine10.1016/j.eswa.2023.120964 ↗
48. A performant and incremental algorithm for knowledge graph entity typing10.1007/s11280-023-01155-1 ↗
49. Prediction of tuberculosis from lung tissue images of diversity outbred mice using jump knowledge based cell graph neural network10.1109/ACCESS.2024.3359989 ↗
50. Qin, C., Wang, Z., Zhao, J., Liu, L., Xiao, F., and Han, Y. (2024). A Novel Rational Medicine Use System Based on Domain Knowledge Graph. Electronics, 13.10.3390/electronics13163156 ↗
51. He, L., Li, H., and Zhang, R. (2024). A Semantic-Spatial Aware Data Conflation Approach for Place Knowledge Graphs. ISPRS Int. J. Geo-Inf., 13.10.3390/ijgi13040106 ↗
52. Relation labeling in product knowledge graphs with large language models for e-commerce10.1007/s13042-024-02274-5 ↗
53. Knowledge Graph Generation and Application for Unstructured Data Using Data Processing Pipeline10.1109/ACCESS.2024.3462635 ↗
54. A task-centric knowledge graph construction method based on multi-modal representation learning for industrial maintenance automation10.1002/eng2.12952 ↗
55. A deep learning-based method for deep information extraction from multimodal data for geological reports to support geological knowledge graph construction10.1007/s12145-023-01207-0 ↗
56. Medical knowledge graph completion via fusion of entity description and type information10.1016/j.artmed.2024.102848 ↗
57. Joint extraction of entity relations from geological reports based on a novel relation graph convolutional network10.1016/j.cageo.2024.105571 ↗
58. Bdcore: Bidirectional decoding with co-graph representation for joint entity and relation extraction10.1016/j.knosys.2024.111781 ↗
59. Guo, B., Meng, J., Zhao, D., Jia, X., Chu, Y., and Lin, H. (2024). Integrating graph convolutional networks to enhance prompt learning for biomedical relation extraction. J. Biomed. Inform., 157.10.1016/j.jbi.2024.104717 ↗
60. Gao, F., Zhang, L., Wang, W., Zhang, B., Liu, W., Zhang, J., and Xie, L. (2024). Named Entity Recognition for Equipment Fault Diagnosis Based on RoBERTa-wwm-ext and Deep Learning Integration. Electronics, 13.10.3390/electronics13193935 ↗
61. Jofche, N., Mishev, K., Stojanov, R., Jovanovik, M., Zdravevski, E., and Trajanov, D. (2023). Pharmke: Knowledge extraction platform for pharmaceutical texts using transfer learning. Computers, 12.10.3390/computers12010017 ↗
62. Knez, T., and Žitnik, S. (2023). Event-centric temporal knowledge graph construction: A survey. Mathematics, 11.10.3390/math11234852 ↗
63. A Knowledge Graph Construction Method for Software Project Based on CAJP10.53106/160792642023112406006 ↗
64. Query path generation via bidirectional reasoning for multihop question answering from knowledge bases10.1109/TCDS.2022.3198272 ↗
65. Dang, X., Deng, H., Dong, X., Zhu, Z., Li, F., and Wang, L. (2023). MHlinker: Research on a Joint Extraction Method of Fault Entity Relationship for Mine Hoist. Electronics, 12.10.3390/electronics12163430 ↗
66. A Novel Joint Extraction Model for Entity Relations Using Interactive Encoding and Visual Attention10.1109/ACCESS.2023.3335623 ↗
67. Heterogenous affinity graph inference network for document-level relation extraction10.1016/j.knosys.2022.109146 ↗
68. Image2Triplets: A computer vision-based explicit relationship extraction framework for updating construction activity knowledge graphs10.1016/j.compind.2022.103610 ↗
69. El-Allaly, E.-D., Sarrouti, M., En-Nahnahi, N., and El Alaoui, S.O. (2022). An attentive joint model with transformer-based weighted graph convolutional network for extracting adverse drug event relation. J. Biomed. Inform., 125.10.1016/j.jbi.2021.103968 ↗
70. Qlogice: Quantum logic empowered embedding for knowledge graph completion10.1016/j.knosys.2021.107963 ↗
71. KGGen: A Generative Approach for Incipient Knowledge Graph Population10.1109/TKDE.2020.3014166 ↗
72. Improving attention network to realize joint extraction for the construction of equipment knowledge graph10.1016/j.engappai.2023.106723 ↗
73. AttenSy-SNER: Software knowledge entity extraction with syntactic features and semantic augmentation information10.1007/s40747-022-00742-5 ↗
74. The construction of knowledge graphs in the aviation assembly domain based on a joint knowledge extraction model10.1109/ACCESS.2023.3254132 ↗
75. Dual attention graph convolutional network for relation extraction10.1109/TKDE.2023.3289879 ↗
76. A contextual dependency-aware graph convolutional network for extracting entity relations10.1016/j.eswa.2023.122366 ↗
77. Extraction of object-action and object-state associations from Knowledge Graphs10.1016/j.websem.2024.100816 ↗
78. Interactive optimization of relation extraction via knowledge graph representation learning10.1007/s12650-024-00955-5 ↗
79. Bordes, A., Usunier, N., Garcia-Duran, A., Weston, J., and Yakhnenko, O. (2013). Translating embeddings for modeling multi-relational data. Adv. Neural Inf. Process. Syst., 26, Available online: https://papers.nips.cc/paper_files/paper/2013/file/1cecc7a77928ca8133fa24680a88d2f9-Paper.pdf.
80. A hierarchical interactive multi-channel graph neural network for technological knowledge flow forecasting10.1007/s10115-022-01697-2 ↗
81. Multi-filter soft shrinkage network for knowledge graph embedding10.1016/j.eswa.2024.123875 ↗
82. Iterative rule-guided reasoning over sparse knowledge graphs with deep reinforcement learning10.1016/j.ipm.2022.103040 ↗
83. SSKGE: A time-saving knowledge graph embedding framework based on structure enhancement and semantic guidance10.1007/s10489-023-04896-8 ↗
84. Knowledge graph embedding closed under composition10.1007/s10618-024-01050-x ↗
85. Step by step: A hierarchical framework for multi-hop knowledge graph reasoning with reinforcement learning10.1016/j.knosys.2022.108843 ↗
86. Open-world knowledge graph completion for unseen entities and relations via attentive feature aggregation10.1016/j.ins.2021.11.085 ↗
87. TSA-Net: A temporal knowledge graph completion method with temporal-structural adaptation10.1007/s10489-024-05734-1 ↗
88. Multi-grained semantics-aware graph neural networks
89. Graph Relearn Network: Reducing performance variance and improving prediction accuracy of graph neural networks10.1016/j.knosys.2024.112311 ↗
90. Spatiotemporal scene-graph embedding for autonomous vehicle collision prediction10.1109/JIOT.2022.3141044 ↗
91. Combining Graph Convolutional Neural Networks and Label Propagation10.1145/3507357 ↗
92. A graph neural network-based node classification model on class-imbalanced graph data10.1016/j.knosys.2022.108538 ↗
93. INS-GNN: Improving graph imbalance learning with self-supervision10.1016/j.ins.2023.118935 ↗
94. HIRE: Distilling high-order relational knowledge from heterogeneous graph neural networks10.1016/j.neucom.2022.08.022 ↗
95. Heterogeneous graph convolutional network with local influence10.1016/j.knosys.2021.107699 ↗
96. Fully-inductive link prediction with path-based graph neural network: A comparative analysis10.1016/j.neucom.2024.128484 ↗
97. Graph attention network with dynamic representation of relations for knowledge graph completion10.1016/j.eswa.2023.119616 ↗
98. Iterative graph self-distillation10.1109/TKDE.2023.3303885 ↗
99. Revisiting initializing then refining: An incomplete and missing graph imputation network10.1109/TNNLS.2024.3349850 ↗
100. Schema-aware hyper-relational knowledge graph embeddings for link prediction10.1109/TKDE.2023.3323499 ↗