journal article·2024Open access

LKPNR: Large Language Models and Knowledge Graph for Personalized News Recommendation Framework

Hao Chen, Runfeng Xie, Xiangyang Cui, Zhou Yan, Xin Wang, Zhanwei Xuan, Kai Zhang

Computers, Materials & Continua· Volume 79· Issue 3

Abstract

Accurately recommending candidate news to users is a basic challenge of personalized news recommendation systems. Traditional methods are usually difficult to learn and acquire complex semantic information in news texts, resulting in unsatisfactory recommendation results. Besides, these traditional methods are more friendly to active users with rich historical behaviors. However, they can not effectively solve the long tail problem of inactive users. To address these issues, this research presents a novel general framework that combines Large Language Models (LLM) and Knowledge Graphs (KG) into traditional methods. To learn the contextual information of news text, we use LLMs’ powerful text understanding ability to generate news representations with rich semantic information, and then, the generated news representations are used to enhance the news encoding in traditional methods. In addition, multi-hops relationship of news entities is mined and the structural information of news is encoded using KG, thus alleviating the challenge of long-tail distribution. Experimental results demonstrate that compared with various traditional models, on evaluation indicators such as AUC, MRR, nDCG@5 and nDCG@10, the framework significantly improves the recommendation performance. The successful integration of LLM and KG in our framework has established a feasible way for achieving more accurate personalized news recommendation. Our code is available at .
Source: openalex_inverted_index · Quality: baseline

Research context

OpenAlex topics: Topic Modeling · Recommender Systems and Techniques · Advanced Graph Neural Networks

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

References (30)

Show source-provided references
1. Personalized news recommendation: Methods and challenges
2. Representation learning: A review and new perspectives10.1109/TPAMI.2013.50 ↗
3. MIND: A large-scale dataset for news recommendation
4. Neural news recommendation with attentive multi-view learning
5. Neural news recommendation with multi-head self-attention
6. ImageNet classification with deep convolutional networks
7. Long short-term memory10.1007/978-3-642-24797-2_4 ↗
8. GLM-130B: An open bilingual pre-trained model
9. H. Touvron et al., “LLaMA: Open and efficient foundation language models,” arXiv preprint arXiv:2302.13971, 2023.
10. B. Peng et al., “RWKV: Reinventing RNNs for the transformer era,” arXiv preprint arXiv:2305.13048, 2023.
11. Challenging the long tail recommendation10.14778/2311906.2311916 ↗
12. A survey on knowledge graph-based recommender systems10.1109/TKDE.2020.3028705 ↗
13. Knowledge graph convolutional networks for recommender systems
14. Learning graph meta embeddings for cold-start ads in click-through rate prediction
15. Embedding-based news recommendation for millions of users
16. Towards better representation learning for personalized news recommendation: A multi-channel deep fusion approach
17. Neural news recommendation with long-and short-term user representations
18. Attention is all you need
19. NPA: Neural news recommendation with personalized attention
20. Fine-grained interest matching for neural news recommendation
21. W. C. Kang et al., “Do LLMs understand user preferences? Evaluating LLMs on user rating prediction,” arXiv preprint arXiv:2305.06474, 2023.
22. Y. Hou et al., “Large language models are zero-shot rankers for recommender systems,” arXiv preprint arXiv:2305.08845, 2023.
23. Y. Gao, T. Sheng, Y. Xiang, Y. Xiong, H. Wang and J. Zhang, “Chat-REC: Towards interactive and explainable LLMs-augmented recommender system,” arXiv preprint arXiv:2303.14524, 2023.
24. Q. Liu, N. Chen, T. Sakai, and X. M. Wu, “A first look at LLM-powered generative news recommendation,” arXiv preprint arXiv:2305.06566, 2023.
25. R. Li, W. Deng, Y. Cheng, Z. Yuan, J. Zhang and F. Yuan, “Exploring the upper limits of text-based collaborative filtering using large language models: Discoveries and insights,” arXiv preprint arXiv:2305.11700, 2023.
26. DKN: Deep knowledge-aware network for news recommendation
27. Neural news recommendation with collaborative news encoding and structural user encoding
28. Going beyond local: Global graph-enhanced personalized news recommendations
29. JointLK: Joint reasoning with language models and knowledge graphs for commonsense question answering
30. Popularity prediction with semantic retrieval for news recommendation10.1016/j.eswa.2024.123308 ↗