Deep Learning and Embedding Based Latent Factor Model for Collaborative Recommender Systems
Source abstract
Abstract
A collaborative recommender system based on a latent factor model has achieved significant success in the field of personalized recommender systems. However, the latent factor model suffers from sparsity problems. It is also limited in its ability to extract non-linear data features, resulting in poor recommendation performance. Inspired by the success of deep learning in different application areas, we incorporate deep learning into our proposed method to overcome the above problems. In this paper, we propose a dual deep learning and embedding-based latent factor model that considers dense user and item feature vectors. The model combines the existing deep learning and latent factor models to extract deep abstractions and non-linear feature representations of the data for rating prediction. The core idea is to map the dense user and item vectors generated by embedding techniques into dual, fully connected deep neural network architectures. In these two separate architectures, it learns the non-linear representation of the input data. The method then predicts the rating score by integrating the factors obtained from the two independent structures using the inner product. From the experimental result, we observe that the proposed model outperformed state-of-the-art existing models in real-world datasets (MovieLens ML-100K and ML-1M).
Source: crossref · Quality: baseline
Research context
OpenAlex topics: Recommender Systems and Techniques · Image Retrieval and Classification Techniques · Advanced Graph Neural Networks
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
Affiliations
School of Computer Science and Engineering, University of Electronic Science and Technology of China, Chengdu 611731, China
CoE of Big Data Analytics and HPC, Addis Ababa Science and Technology University, Addis Ababa P.O. Box 16417, Ethiopia
School of Information and Software Engineering, University of Electronic Science and Technology of China, Chengdu 611731, China
Funding
National Natural Science Foundation of China
References (37)
Show source-provided references
1. Pawlicka, A., Pawlicki, M., Kozik, R., and Choraś, R.S. (2021). A systematic review of recommender systems and their applications in cybersecurity. Sensors, 21.10.3390/s21155248 ↗
2. Ricci, F., Rokach, L., and Shapira, B. (2015). Recommender systems: Introduction and challenges. Recommender Systems Handbook, Springer.10.1007/978-1-4899-7637-6 ↗
3. Research commentary on recommendations with side information: A survey and research directions10.1016/j.elerap.2019.100879 ↗
4. Catherine, R., Mazaitis, K., Eskenazi, M., and Cohen, W. (2017). Explainable entity-based recommendations with knowledge graphs. arXiv.10.1145/2959100.2959131 ↗
5. Wang, H., Zhang, F., Hou, M., Xie, X., Guo, M., and Liu, Q. (2018, January 5–9). Shine: Signed heterogeneous information network embedding for sentiment link prediction. Proceedings of the Eleventh ACM International Conference on Web Search and Data Mining, Marina Del Rey, CA, USA.10.1145/3159652.3159666 ↗
6. Collaborative intent prediction with real-time contextual data10.1145/3041659 ↗
7. A hybrid user similarity model for collaborative filtering10.1016/j.ins.2017.08.008 ↗
8. Xue, H.J., Dai, X., Zhang, J., Huang, S., and Chen, J. (2017, January 19–25). Deep matrix factorization models for recommender systems. Proceedings of the 26th International Joint Conference on Artificial Intelligence, Melbourne, Australia.10.24963/ijcai.2017/447 ↗
9. A Meta-Algorithm for Improving Top-N Prediction Efficiency of Matrix Factorization Models in Collaborative Filtering10.1142/S0218001420590077 ↗
10. He, X., Zhang, H., Kan, M.Y., and Chua, T.S. (2016, January 17–21). Fast matrix factorization for online recommendation with implicit feedback. Proceedings of the 39th International ACM SIGIR Conference on Research and Development in Information Retrieval, Pisa, Italy.10.1145/2911451.2911489 ↗
11. Matrix factorization techniques for recommender systems10.1109/MC.2009.263 ↗
12. Wang, H., Wang, N., and Yeung, D.Y. (2015, January 10–13). Collaborative deep learning for recommender systems. Proceedings of the 21th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, Sydney, Australia.10.1145/2783258.2783273 ↗
13. Learning to recommend with social contextual information from implicit feedback10.1007/s00500-014-1347-0 ↗
14. Robust weighted SVD-type latent factor models for rating prediction10.1016/j.eswa.2019.112885 ↗
15. Learning deep architectures for AI10.1561/2200000006 ↗
16. Deep belief networks10.4249/scholarpedia.5947 ↗
17. Deep neural network based m-learning model for predicting mobile learners’ performance10.3906/elk-1907-8 ↗
18. Deep knowledge-aware framework for web service recommendation10.1007/s11227-021-03832-2 ↗
19. Tegene, A.T., Liu, Q., Muhammed, S.B., and Leka, H.L. (2021, January 17–19). Deep Learning Based Matrix Factorization For Collaborative Filtering. Proceedings of the 2021 18th International Computer Conference on Wavelet Active Media Technology and Information Processing (ICCWAMTIP), Chengdu, China.10.1109/ICCWAMTIP53232.2021.9674157 ↗
20. Deep learning based recommender system: A survey and new perspectives10.1145/3158369 ↗
21. He, X., Liao, L., Zhang, H., Nie, L., Hu, X., and Chua, T.S. (2017, January 3–7). Neural collaborative filtering. Proceedings of the 26th International Conference on World Wide Web, Perth, Australia.10.1145/3038912.3052569 ↗
22. Salakhutdinov, R., Mnih, A., and Hinton, G. (2007, January 20–24). Restricted Boltzmann machines for collaborative filtering. Proceedings of the 24th International Conference on Machine Learning, Corvalis, OR, USA.10.1145/1273496.1273596 ↗
23. Wang, S., Sun, G., and Li, Y. (2020). SVD++ recommendation algorithm based on backtracking. Information, 11.10.3390/info11070369 ↗
24. Factorization machines with libfm10.1145/2168752.2168771 ↗
25. Guo, H., Tang, R., Ye, Y., Li, Z., and He, X. (2017). DeepFM: A factorization-machine based neural network for CTR prediction. arXiv.10.24963/ijcai.2017/239 ↗
26. Covington, P., Adams, J., and Sargin, E. (2016, January 15–19). Deep neural networks for youtube recommendations. Proceedings of the 10th ACM Conference on Recommender Systems, Boston, MA, USA.10.1145/2959100.2959190 ↗
27. The netflix recommender system: Algorithms, business value, and innovation
28. A deep latent factor model for high-dimensional and sparse matrices in recommender systems10.1109/TSMC.2019.2931393 ↗
29. Deep latent factor model for collaborative filtering10.1016/j.sigpro.2019.107366 ↗
30. A novel deep multi-criteria collaborative filtering model for recommendation system10.1016/j.knosys.2019.06.019 ↗
31. Cheng, W., Shen, Y., Zhu, Y., and Huang, L. (2018, January 13–19). DELF: A Dual-Embedding based Deep Latent Factor Model for Recommendation. Proceedings of the IJCAI, Stockholm, Sweden.10.24963/ijcai.2018/462 ↗
32. He, G., Zhao, D., and Ding, L. (2021). Dual-embedding based Neural Collaborative Filtering for Recommender Systems. arXiv.
33. Kingma, D.P., and Ba, J. (2014). Adam: A method for stochastic optimization. arXiv.
34. Heterogeneous information network embedding for recommendation10.1109/TKDE.2018.2833443 ↗
35. Li, S., Kawale, J., and Fu, Y. (2015, January 18–23). Deep collaborative filtering via marginalized denoising auto-encoder. Proceedings of the 24th ACM International on Conference on Information and Knowledge Management, Melbourne, Australia.10.1145/2806416.2806527 ↗
36. On the performance of manhattan nonnegative matrix factorization10.1109/TNNLS.2015.2458986 ↗
37. Exploring hierarchical structures for recommender systems10.1109/TKDE.2018.2789443 ↗