Time-Aware PolarisX: Auto-Growing Knowledge Graph
Source abstract
Abstract
A knowledge graph is a structured graph in which data obtained from multiple sources are standardized to acquire and integrate human knowledge. Research is being actively conducted to cover a wide variety of knowledge, as it can be applied to applications that help humans. However, existing researches are constructing knowledge graphs without the time information that knowledge implies. Knowledge stored without time information becomes outdated over time, and in the future, the possibility of knowledge being false or meaningful changes is excluded. As a result, they can’t reflect information that changes dynamically, and they can’t accept information that has newly emerged. To solve this problem, this paper proposes Time-Aware PolarisX, an automatically extended knowledge graph including time information. Time-Aware PolarisX constructed a BERT model with a relation extractor and an ensemble NER model including a time tag with an entity extractor to extract knowledge consisting of subject, relation, and object from unstructured text. Through two application experiments, it shows that the proposed system overcomes the limitations of existing systems that do not consider time information when applied to an application such as a chatbot. Also, we verify that the accuracy of the extraction model is improved through a comparative experiment with the existing model.
Source: openalex_inverted_index · Quality: baseline
Research context
OpenAlex topics: Topic Modeling · Semantic Web and Ontologies · Advanced Graph Neural Networks
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
References (37)
Show source-provided references
1. S. Ji, S. Pan, E. Cambria, P. Marttsssinen and P. S. Yu, “A survey on knowledge graphs: Representation, acquisition and applications. arXiv preprint arXiv: 2002.00388, 2020.
2. R. Trivedi, H. Dai, Y. Wang and L. Song, “Know-evolve: Deep temporal reasoning for dynamic knowledge graphs. arXiv preprint arXiv: 1705.05742, 2017.
3. ConceptNet: A lexical resource for common sense knowledge
4. Yago: A core of semantic knowledge
5. Never-ending learning10.1145/3191513 ↗
6. Vrandečić · 2012 · 1063
7. Leblay · 2018 · 1771
8. Automating the expansion of a knowledge graph10.1016/j.eswa.2019.112965 ↗
9. Dbpedia: A Nucleus for a Web of Open Data10.1007/978-3-540-76298-0_52 ↗
10. Karpf · Second Life, and Beyond: From Production to Produsage · 2009
11. Towards time-aware knowledge graph completion
12. Acquiring temporal constraints between relations
13. Predicting the co-evolution of event and knowledge graphs
14. A. García-Durán, S. Dumančić and M. Niepert, “Learning sequence encoders for temporal knowledge graph completion,” arXiv preprint arXiv: 1809.03202, 2018.10.18653/v1/D18-1516 ↗
15. Social media contents based sentiment analysis and prediction system10.1016/j.eswa.2018.03.055 ↗
16. A survey of named entity recognition and classification10.1075/li.30.1.03nad ↗
17. E. Loper and S. Bird, “NLTK: The natural language toolkit. arXiv preprint cs/0205028, 2002.10.3115/1118108.1118117 ↗
18. The Stanford CoreNLP natural language processing toolkit
19. E. F. Sang and F. De Meulder, “Introduction to the CoNLL-2003 shared task: Language-independent named entity recognition,” arXiv preprint cs/0306050, 2003.
20. Results of the WNUT2017 shared task on novel and emerging entity recognition
21. I. Yamada, A. Asai, H. Shindo, H. Takeda, Y. Matsumoto et al., “Deep contextualized entity representations with entity-aware self-attention,” arXiv preprint arXiv: 2010.01057, 2020.10.18653/v1/2020.emnlp-main.523 ↗
22. X. Wang, Y. Jiang, N. Bach, T. Wang, Z. Huang et al., “Huang etal, Automated concatenation of embeddings for structured prediction. arXiv preprint arXiv: 2010.05006, 2020.
23. Dietterich · Ensemble methods in machine learning, in International workshop on multiple classifier systems · 2000 · 1
24. Bos · Handbook of linguistic annotation · 2017 · 46310.1007/978-94-024-0881-2_18 ↗
25. J. Yu, B. Bohnet and M. Poesio, “Named entity recognition as dependency parsing,” arXiv preprint arXiv: 2005.07150, 2020..10.18653/v1/2020.acl-main.577 ↗
26. A. D. Cohen, S. Rosenman and Y. Goldberg, “Relation extraction as two-way span-prediction,” arXiv preprint arXiv: 2010.04829, 2020.
27. W. Zhou, K. Huang, T. Ma and J. Huang, “Document-level relation extraction with adaptive thresholding and localized context pooling,” arXiv preprint arXiv: 2010.11304, 2020.
28. Position-aware attention and supervised data improve slot filling
29. J. Devlin, M. W. Chang, K. Lee and K. Toutanova, “Bert: Pre-training of deep bidirectional transformers for language understanding. arXiv preprint arXiv: 1810.04805, 2018.
30. Multilayer perceptron, fuzzy sets classifiaction10.1109/72.159058 ↗
31. An introduction to conditional random fields10.1561/2200000013 ↗
32. Z. Huang, W. Xu and K. Yu, “Bidirectional LSTM-CRF models for sequence tagging,” arXiv preprint arXiv: 1508.01991, 2015.
33. A. Baevski, S. Edunov, Y. Liu, L. Zettlemoyer and M. Auli, “Cloze-driven pretraining of self-attention networks. arXiv preprint arXiv: 1903. 07785, 2019.10.18653/v1/D19-1539 ↗
34. Distributed representation, LDA topic modelling and deep learning for emerging named entity recognition from social media
35. Multi-channel BiLSTM-CRF model for emerging named entity recognition in social media
36. Däniken · 3rd Workshop on Noisy User-generated Text (W-NUT), Association for Computational Linguistics · 2017 · 166
37. G. Aguilar, S. Maharjan, A. P. López-Monroy and T. Solorio, “A multi-task approach for named entity recognition in social media data. arXiv preprint arXiv: 1906.04135, 2019.