MLAHRec: A Multi-Layer Attention Hybrid Recommendation Model Based on Heterogeneous Information Networks
Source abstract
Abstract
The rapid expansion of information on the Internet has rendered recommender systems vital for mitigating information overload. However, existing recommendation models based on heterogeneous information networks (HINs) often face challenges such as data sparsity and insufficient semantic utilization. Therefore, we propose a multi-layer attention hybrid recommendation model based on heterogeneous information networks (MLAHRec). Compared to traditional HIN-based recommendation models, we design a progressive three-layer attention architecture of “collaborative-node-path.” Specifically, collaborative attention first enhances the direct interaction representation between users and items. Subsequently, node attention filters important neighbor information on the same meta-path. Finally, path attention adaptively fuses the semantics of multiple meta-paths, thereby achieving hierarchical refinement from micro-level interactions to macro-level semantics. Experiments on four real datasets, including MovieLens, LastFM, Yelp, and Douban-Movie, demonstrate that MLAHRec significantly outperforms mainstream baseline algorithms, as determined by Precision@10, Recall@10, and NDCG@10 metrics, validating the effectiveness and interpretability of the model.
Source: crossref · Quality: baseline
Research context
OpenAlex topics: Recommender Systems and Techniques · Advanced Graph Neural Networks · Advanced Technologies in Various Fields
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
Affiliations
School of Data Science, City University of Macau, Macau 999078, China
Department of Digital Media Technology, Nanfang College Guangzhou, Guangzhou 510970, China
School of Information Engineering, Minzu University of China, Beijing 100081, China
References (42)
Show source-provided references
1. Recent Developments in Recommender Systems: A Survey [Review Article]10.1109/MCI.2024.3363984 ↗
2. Design of a dynamic and robust recommender system based on item context, trust, rating matrix and rating time using social networks analysis10.1016/j.jksuci.2024.101964 ↗
3. An attention mechanism and residual network based knowledge graph-enhanced recommender system10.1016/j.knosys.2024.112042 ↗
4. Ricci, F., Rokach, L., and Shapira, B. (2022). Advances in Collaborative Filtering. Recommender Systems Handbook, Springer.10.1007/978-1-0716-2197-4 ↗
5. Self-supervised learning for fair recommender systems10.1016/j.asoc.2022.109126 ↗
6. Lin, H., and Ji, H. (2024, January 12–14). Improved Wide&Deep Recommendation Algorithm for User Behavioural Characteristics. Proceedings of the 2024 13th International Conference of Information and Communication Technology (ICTech), Xiamen, China.10.1109/ICTech63197.2024.00052 ↗
7. Ma, M., Wang, G., and Fan, T. (2022). Improved DeepFM Recommendation Algorithm Incorporating Deep Feature Extraction. Appl. Sci., 12.10.3390/app122311992 ↗
8. AAHIN: Attribute-aware heterogeneous information network representation learning for data mining
9. EvoPath: Evolutionary meta-path discovery with large language models for complex heterogeneous information networks10.1016/j.ipm.2024.103920 ↗
10. Heterogeneous Meta-Path Graph Learning for Higher-Order Social Recommendation10.1145/3673658 ↗
11. Meta Path-Aware Recommendation Method Based on Non-Negative Matrix Factorization in LBSN10.1109/TNSM.2022.3219456 ↗
12. Movie recommendation based on ALS collaborative filtering recommendation algorithm with deep learning model10.1016/j.entcom.2024.100715 ↗
13. A neural collaborative filtering recommendation algorithm based on attention mechanism and contrastive learning10.1515/nleng-2025-0137 ↗
14. Deep Attentive Interest Collaborative Filtering for Recommender Systems10.1109/TETC.2023.3286404 ↗
15. DLSF: Deep learning and semantic fusion based recommendation system10.1016/j.eswa.2024.123900 ↗
16. Implicit Supervision-Assisted Graph Collaborative Filtering for Third-Party Library Recommendation10.1109/TSC.2025.3562349 ↗
17. TPGRec: Text-enhanced and popularity-smoothing graph collaborative filtering for long-tail item recommendation10.1016/j.neucom.2025.129539 ↗
18. Graph Collaborative Filtering Model Combining Time Factor and Attention Mechanism10.1613/jair.1.18696 ↗
19. Dual-View Fusion of Heterogeneous Information Network Embedding for Recommendation10.1109/TLA.2024.10562237 ↗
20. Heterogeneous Graph Neural Network with Personalized and Adaptive Diversity for News Recommendation10.1145/3649886 ↗
21. Higher-order knowledge-enhanced recommendation with heterogeneous hypergraph multi-attention10.1016/j.ins.2024.121165 ↗
22. Heterogeneous Propagation-Based Recommendation Systems with Knowledge Graph Attention Network10.1109/TCSS.2025.3558227 ↗
23. Meta-path automatically extracted from heterogeneous information network for recommendation10.1007/s11280-024-01265-4 ↗
24. MHANER: A Multi-source Heterogeneous Graph Attention Network for Explainable Recommendation in Online Games10.1145/3626243 ↗
25. Jiang, Y., Ma, H., Zhang, X., Li, Z., and Chang, L. (2023). Incorporating metapath interaction on heterogeneous information network for social recommendation. Front. Comput. Sci., 18.10.1007/s11704-022-2438-1 ↗
26. Metapath and attribute-based academic collaborator recommendation in heterogeneous academic networks10.1007/s11192-024-05043-x ↗
27. Meta-path fusion based neural recommendation in heterogeneous information networks10.1016/j.neucom.2023.01.070 ↗
28. Contrastive learning of similarity meta-path clustering for multi-behavior recommendation10.1007/s44443-025-00121-3 ↗
29. Attention mechanisms in computer vision: A survey10.1007/s41095-022-0271-y ↗
30. Neural attention model for recommendation based on factorization machines10.1007/s10489-020-01921-y ↗
31. On the diversity of multi-head attention10.1016/j.neucom.2021.04.038 ↗
32. Collaborative attention neural network for multi-domain sentiment classification10.1007/s10489-020-02021-7 ↗
33. Fu, T.-Y., Lee, W.-C., and Lei, Z. (2017, January 6–10). HIN2Vec: Explore Meta-paths in Heterogeneous Information Networks for Representation Learning. Proceedings of the 2017 ACM on Conference on Information and Knowledge Management, Singapore.10.1145/3132847.3132953 ↗
34. Rendle, S., Freudenthaler, C., and Gantner, Z. (2012). BPR: Bayesian personalized ranking from implicit feedback. arXiv.
35. Matrix Factorization Techniques for Recommender Systems10.1109/MC.2009.263 ↗
36. He, X., Liao, L., Zhang, H., Nie, L., Hu, X., and Chua, T.-S. (2017, January 3–7). Neural Collaborative Filtering. Proceedings of the 26th International Conference on World Wide Web, Perth, Australia.10.1145/3038912.3052569 ↗
37. Zhao, H., Yao, Q., Li, J., Song, Y., and Lee, D.L. (2017, January 13–17). Meta-Graph Based Recommendation Fusion over Heterogeneous Information Networks. Proceedings of the 23rd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, Halifax, NS, Canada.10.1145/3097983.3098063 ↗
38. HIN-based rating prediction in recommender systems via GCN and meta-learning10.1007/s10489-023-04769-0 ↗
39. Graph neural network recommendation algorithm based on improved dual tower model10.1038/s41598-024-54376-3 ↗
40. Nimmalapudi, P.K.C. (2025, January 7–8). MCRec: A Co-Attention Based Meta-Path Contextualized Recommender System for Heterogeneous Information Networks. Proceedings of the 2025 International Conference on Computer, Electrical & Communication Engineering (ICCECE), Kolkata, India.10.1109/ICCECE61355.2025.10941064 ↗
41. Li, L., Gui, X., and Lv, R. (2024). Recommendation Algorithm Based on Heterogeneous Information Network and Attention Mechanism. Appl. Sci., 14.10.3390/app14010353 ↗
42. Zheng, H., Xing, Y., and Zhu, L. (2025). Modeling Multi-Hop Semantic Paths for Recommendation in Heterogeneous Information Networks. arXiv.10.1109/CISCE65916.2025.11065749 ↗