Multi-Granularity Temporal Knowledge Graph Question Answering Based on Data Augmentation and Convolutional Networks
Source abstract
Abstract
The multi-granularity temporal knowledge graph question-answering model consists of two core tasks: question information extraction and knowledge graph embedding representation. Existing studies typically compute the relevance score between the question and the associated temporal knowledge graph to identify the answer. However, current multi-granularity temporal knowledge graph datasets are relatively scarce, and most research has not fully exploited the potential of these limited datasets, resulting in limitations in the model’s ability to capture complex temporal relationships. Additionally, existing methods often overlook the model’s ability to capture the rich semantic relationships within questions, especially when dealing with diverse and dynamically changing temporal information. To make full use of the limited datasets and help the model better capture the complex relationships in the question, this paper proposes a multi-granularity temporal knowledge graph question-answering model based on data augmentation and convolutional networks. By using semantic paraphrasing to expand the questions and obtain more comprehensive question representations, and incorporating convolutional networks in the feature learning phase to capture more diverse and richer question representations, the proposed method outperforms baseline models on publicly available datasets, as demonstrated by experimental results.
Source: crossref · Quality: baseline
Research context
OpenAlex topics: Advanced Graph Neural Networks · Topic Modeling · Web Data Mining and Analysis
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
Affiliations
Faculty of Information Engineering and Automation, Kunming University of Science and Technology, Kunming 650500, China
Funding
National Natural Science Foundation of China
References (32)
Show source-provided references
1. Zhou, M., Peng, S., Yang, M., Li, N., Wang, H., Qiao, L., Mi, H., Wen, Z., Xu, T., and Liu, L. (2021, January 19–27). IIAS: An Intelligent Insurance Assessment System through Online Real-time Conversation Analysis. Proceedings of the IJCAI, Montreal, QC, Canada.10.24963/ijcai.2021/721 ↗
2. Tai, C.Y., Huang, L.Y., Huang, C.K., and Ku, L.W. (2021, January 11–15). User-centric path reasoning towards explainable recommendation. Proceedings of the 44th International ACM SIGIR Conference on Research and Development in Information Retrieval, Virtual Event.10.1145/3404835.3462847 ↗
3. Leblay, J., and Chekol, M.W. (2018, January 23–27). Deriving validity time in knowledge graph. Proceedings of the Companion Proceedings of the Web Conference, Lyon, France.
4. Jia, Z., Abujabal, A., Saha Roy, R., Strötgen, J., and Weikum, G. (2018, January 23–27). Tempquestions: A benchmark for temporal question answering. Proceedings of the Companion Proceedings of the Web Conference, Lyon, France.10.1145/3184558.3191536 ↗
5. Saxena, A., Chakrabarti, S., and Talukdar, P. (2021, January 1–6). Question Answering Over Temporal Knowledge Graphs. Proceedings of the 59th Annual Meeting of the Association for Computational Linguistics and the 11th International Joint Conference on Natural Language Processing (Volume 1: Long Papers), Virtual Event.10.18653/v1/2021.acl-long.520 ↗
6. Mavromatis, C., Subramanyam, P.L., Ioannidis, V.N., Adeshina, A., Howard, P.R., Grinberg, T., Hakim, N., and Karypis, G. (March, January 22). Tempoqr: Temporal question reasoning over knowledge graphs. Proceedings of the AAAI Conference on Artificial Intelligence, Virtual Event.
7. Chen, Z., Liao, J., and Zhao, X. (2023, January 9–14). Multi-granularity temporal question answering over knowledge graphs. Proceedings of the 61st Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), Toronto, QC, Canada.10.18653/v1/2023.acl-long.637 ↗
8. Jia, Z., Abujabal, A., Saha Roy, R., Strötgen, J., and Weikum, G. (2018, January 22–26). Tequila: Temporal question answering over knowledge bases. Proceedings of the 27th ACM International Conference on Information and Knowledge Management, Torino, Italy.10.1145/3269206.3269247 ↗
9. Ding, W., Chen, H., Li, H., and Qu, Y. (2022, January 7–11). Semantic Framework based Query Generation for Temporal Question Answering over Knowledge Graphs. Proceedings of the 2022 Conference on Empirical Methods in Natural Language Processing, Abu Dhabi, United Arab Emirates.10.18653/v1/2022.emnlp-main.122 ↗
10. Bordes, A., Usunier, N., Garcia-Duran, A., Weston, J., and Yakhnenko, O. (2013, January 5–10). Translating embeddings for modeling multi-relational data. Proceedings of the NIPS’13: 27th International Conference on Neural Information Processing Systems, Lake Tahoe, NV, USA.
11. Wang, Z., Zhang, J., Feng, J., and Chen, Z. (2014, January 27–31). Knowledge graph embedding by translating on hyperplanes. Proceedings of the AAAI Conference on Artificial Intelligence, Quebec City, QC, Canada.10.1609/aaai.v28i1.8870 ↗
12. Trouillon, T., Welbl, J., Riedel, S., Gaussier, É., and Bouchard, G. (2016, January 20–22). Complex embeddings for simple link prediction. Proceedings of the International Conference on Machine Learning, PMLR, New York, NY, USA.
13. Nickel, M., Tresp, V., and Kriegel, H.P. (July, January 28). A three-way model for collective learning on multi-relational data. Proceedings of the ICML, Bellevue, WA, USA.
14. Yang, B., Yih, S.W.t., He, X., Gao, J., and Deng, L. (2015, January 7–9). Embedding Entities and Relations for Learning and Inference in Knowledge Bases. Proceedings of the International Conference on Learning Representations (ICLR), San Diego, CA, USA.
15. Jain, P., Rathi, S., and Chakrabarti, S. (2020, January 16–20). Temporal Knowledge Base Completion: New Algorithms and Evaluation Protocols. Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing (EMNLP), Virtual.10.18653/v1/2020.emnlp-main.305 ↗
16. Lacroix, T., Obozinski, G., and Usunier, N. (2020). Tensor Decompositions for Temporal Knowledge Base Completion. arXiv.
17. Shang, C., Wang, G., Qi, P., and Huang, J. (2022, January 22–27). Improving Time Sensitivity for Question Answering over Temporal Knowledge Graphs. Proceedings of the 60th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), Dublin, Ireland.10.18653/v1/2022.acl-long.552 ↗
18. Jia, Z., Pramanik, S., Saha Roy, R., and Weikum, G. (2021, January 1–5). Complex temporal question answering on knowledge graphs. Proceedings of the 30th ACM International Conference on Information & Knowledge Management, New York, NY, USA.10.1145/3459637.3482416 ↗
19. An improving reasoning network for complex question answering over temporal knowledge graphs10.1007/s10489-022-03913-6 ↗
20. Graves, A., and Graves, A. (2012). Long short-term memory. Supervised Sequence Labelling with Recurrent Neural Networks, Springer.10.1007/978-3-642-24797-2 ↗
21. Chung, J., Gulcehre, C., Cho, K., and Bengio, Y. (2014, January 8–13). Empirical evaluation of gated recurrent neural networks on sequence modeling. Proceedings of the NIPS 2014 Workshop on Deep Learning, Montreal, QC, Canada.
22. Lai, G., Chang, W.C., Yang, Y., and Liu, H. (2018, January 8–12). Modeling long-and short-term temporal patterns with deep neural networks. Proceedings of the the 41st International ACM SIGIR Conference on Research & Development in Information Retrieval, Ann Arbor, MI, USA.10.1145/3209978.3210006 ↗
23. Temporal pattern attention for multivariate time series forecasting10.1007/s10994-019-05815-0 ↗
24. Kitaev, N., Kaiser, L., and Levskaya, A. (2019, January 6–9). Reformer: The Efficient Transformer. Proceedings of the International Conference on Learning Representations, New Orleans, LA, USA.
25. Zhang, L., Aggarwal, C., and Qi, G.J. (2017, January 13–17). Stock price prediction via discovering multi-frequency trading patterns. Proceedings of the 23rd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, Halifax, NS, Canada.10.1145/3097983.3098117 ↗
26. Vaswani, A. (2017, January 4–9). Attention is all you need. Proceedings of the NIPS’17: 31st International Conference on Neural Information Processing Systems, Long Beach, CA, USA.
27. Hou, M., Xu, C., Li, Z., Liu, Y., Liu, W., Chen, E., and Bian, J. (2022, January 25–29). Multi-granularity residual learning with confidence estimation for time series prediction. Proceedings of the ACM Web Conference, Lyon, France.10.1145/3485447.3512056 ↗
28. Févry, T., Soares, L.B., Fitzgerald, N., Choi, E., and Kwiatkowski, T. (2020, January 16–20). Entities as Experts: Sparse Memory Access with Entity Supervision. Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing (EMNLP), Virtual.10.18653/v1/2020.emnlp-main.400 ↗
29. Lan, Z. (2019). Albert: A lite bert for self-supervised learning of language representations. arXiv.
30. Saxena, A., Tripathi, A., and Talukdar, P. (2020, January 5–10). Improving multi-hop question answering over knowledge graphs using knowledge base embeddings. Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics, Virtual.10.18653/v1/2020.acl-main.412 ↗
31. Exploring the limits of transfer learning with a unified text-to-text transformer
32. Language models are few-shot learners