Deep Variational Embedding Representation on Neural Collaborative Filtering Recommender Systems
Source abstract
Abstract
Visual representation of user and item relations is an important issue in recommender systems. This is a big data task that helps to understand the underlying structure of the information, and it can be used by company managers and technical staff. Current collaborative filtering machine learning models are designed to improve prediction accuracy, not to provide suitable visual representations of data. This paper proposes a deep learning model specifically designed to display the existing relations among users, items, and both users and items. Making use of representative datasets, we show that by setting small embedding sizes of users and items, the recommender system accuracy remains nearly unchanged; it opens the door to the use of bidimensional and three-dimensional representations of users and items. The proposed neural model incorporates variational embedding stages to “unpack” (extend) embedding representations, which facilitates identifying individual samples. It also replaces the join layers in current models with a Lambda Euclidean layer that better catches the space representation of samples. The results show numerical and visual improvements when the proposed model is used compared to the baselines. The proposed model can be used to explain recommendations and to represent demographic features (gender, age, etc.) of samples.
Source: crossref · Quality: baseline
Research context
OpenAlex topics: Recommender Systems and Techniques · Image Retrieval and Classification Techniques · Advanced Graph Neural Networks
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
Affiliations
Departamento de Sistemas Informáticos, Escuela Técnica Superior de Ingeniería de Sistemas Informáticos, Universidad Politécnica de Madrid, 28031 Madrid, Spain
References (39)
Show source-provided references
1. A review on deep learning for recommender systems: Challenges and remedies10.1007/s10462-018-9654-y ↗
2. Deep learning feature selection to unhide demographic recommender systems factors10.1007/s00521-020-05494-2 ↗
3. Recommender Systems Leveraging Multimedia Content10.1145/3407190 ↗
4. Context Aware Recommendation Systems: A review of the state of the art techniques10.1016/j.cosrev.2020.100255 ↗
5. A study on features of social recommender systems10.1007/s10462-019-09684-w ↗
6. Bobadilla, J., Alonso, S., and Hernando, A. (2020). Deep Learning Architecture for Collaborative Filtering Recommender Systems. Appl. Sci., 10.10.3390/app10072441 ↗
7. Presentation of a recommender system with ensemble learning and graph embedding: A case on MovieLens10.1007/s11042-020-09949-5 ↗
8. An Efficient Recommender System Method Based on the Numerical Relevances and the Non-Numerical Structures of the Ratings10.1109/ACCESS.2018.2868464 ↗
9. Koller, D., Schuurmans, D., Bengio, Y., and Bottou, L. (2008). Probabilistic matrix factorization. Advances in Neural Information Processing Systems 21, MIT Press.
10. Leen, T.K., Dietterich, T.G., and Tresp, V. (2001). Algorithms for Non-negative Matrix Factorization. Advances in Neural Information Processing Systems 13, MIT Press.
11. A non negative matrix factorization for Collaborative Filtering Recommender Systems based on a Bayesian probabilistic model10.1016/j.knosys.2015.12.018 ↗
12. Hierarchical graph maps for visualization of collaborative recommender systems10.1177/0165551513507407 ↗
13. Method to interactively visualize and navigate related information10.1016/j.eswa.2018.01.034 ↗
14. Hong-Jian, X., Xinyu, D., Jianbing, Z., Shujian, H., and Jiajun, C. (2017, January 19–25). Deep Matrix Factorization Models for Recommender Systems. Proceedings of the Twenty-Sixth International Joint Conference on Artificial Intelligence, Melbourne, Australia.
15. Xiangnan, H., Lizi, L., and Hanwang, Z. (2017, January 3–7). Neural Collaborative Filtering. Proceedings of the International World Wide Web Conference, Perth, Australia.
16. A Survey on Network Embedding10.1109/TKDE.2018.2849727 ↗
17. Knowledge graph embedding with concepts10.1016/j.knosys.2018.10.008 ↗
18. Gene2vec: Gene Subsequence Embedding for Prediction of Mammalian N6-Methyladenosine Sites from mRNA10.1261/rna.069112.118 ↗
19. Graph embedding on biomedical networks: Methods, applications and evaluations10.1093/bioinformatics/btz718 ↗
20. Embedding-based Silhouette community detection10.1007/s10994-020-05882-8 ↗
21. Pose-Invariant Embedding for Deep Person Re-Identification10.1109/TIP.2019.2910414 ↗
22. Deep Collaborative Embedding for Social Image Understanding10.1109/TPAMI.2018.2852750 ↗
23. Supervised Deep Feature Embedding with Handcrafted Feature10.1109/TIP.2019.2901407 ↗
24. Convolution–deconvolution word embedding: An end-to-end multi-prototype fusion embedding method for natural language processing10.1016/j.inffus.2019.06.009 ↗
25. DeepFair: Deep Learning for Improving Fairness in Recommender Systems
26. Neural embedding collaborative filtering for recommender systems10.1007/s00521-020-04920-9 ↗
27. Fuzheng, Z., Nicholas, J.Y., Defu, L., Xing, X., and Wei-Ying, M. (2016, January 13–17). Collaborative Knowledge Base Embedding for Recommender Systems. Proceedings of the 22nd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining (KDD ’16), San Francisco, CA, USA.10.1145/2939672.2939673 ↗
28. Jeong, S.-Y., and Kim, Y.-K. (2022). Deep Learning-Based Context-Aware Recommender System Considering Contextual Features. Appl. Sci., 12.10.3390/app12010045 ↗
29. Chih-Ming, C., Chuan-Ju, W., Ming-Feng, T., and Yi-Hsuan, Y. (2019, January 13–17). Collaborative Similarity Embedding for Recommender Systems. Proceedings of the The World Wide Web Conference (WWW ’19), San Francisco, CA, USA.
30. Heng-Tze, C., Levent, K., Jeremiah, H., Tal, S., Chandra, T., Aradhye, H., Anderson, G., Corrado, G., Chai, W., and Ispir, M. (2016, January 15). Wide & Deep Learning for Recommender Systems. Proceedings of the 1st Workshop on Deep Learning for Recommender Systems (DLRS 2016), Boston, MA, USA.10.1145/2988450.2988454 ↗
31. Zhao, W.X., Huang, J., and Wen, J.R. (December, January 30). Learning Distributed Representations for Recommender Systems with a Network Embedding Approach. Proceedings of the Information Retrieval Technology (AIRS 2016), Beijing, China. Lecture Notes in Computer Science 9994.10.1007/978-3-319-48051-0_17 ↗
32. Zhang, C., Yu, L., Wang, Y., Shah, C., and Zhang, X. (2017, January 27–29). Collaborative User Network Embedding for Social Recommender Systems. Proceedings of the 2017 SIAM International Conference on Data Mining (SDM), Houston, TX, USA.10.1137/1.9781611974973.43 ↗
33. Liu, H., Zhao, X., Wang, C., Liu, X., and Tang, J. (2020, January 25–30). Automated Embedding Size Search in Deep Recommender Systems. Proceedings of the 43rd International ACM SIGIR Conference on Research and Development in Information Retrieval, Online.10.1145/3397271.3401436 ↗
34. Bobadilla, J., Gutierrez, A., Alonso, S., and González-Prieto, A. (2021). Neural Collaborative Filtering Classification Model to Obtain Prediction Reliabilities. Int. J. Interact. Multimed. Artif. Intell.10.9781/ijimai.2021.08.010 ↗
35. Multispectral Image Reconstruction from Color Images Using Enhanced Variational Autoencoder and Generative Adversarial Network10.1109/ACCESS.2020.3047074 ↗
36. Liu, Z.-S., Siu, W.-C., Wang, L.-W., Li, C.-T., Cani, M.-P., and Chan, Y. (2020, January 14–19). Unsupervised Real Image Super-Resolution via Generative Variational AutoEncoder. Proceedings of the EEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW), Seattle, WA, USA.10.1109/CVPRW50498.2020.00229 ↗
37. Photo-Realistic Image Super-Resolution via Variational Autoencoders10.1109/TCSVT.2020.3003832 ↗
38. The movielens datasets: History and context10.1145/2827872 ↗
39. CF4J: Collaborative filtering for Java10.1016/j.knosys.2018.04.008 ↗