journal article·2021-07-13Open access

New Vector-Space Embeddings for Recommender Systems

Sandra Rizkallah, Amir F. Atiya, Samir Shaheen

Applied Sciences· Volume 11· Issue 14

Abstract

In this work, we propose a novel recommender system model based on a technology commonly used in natural language processing called word vector embedding. In this technology, a word is represented by a vector that is embedded in an n-dimensional space. The distance between two vectors expresses the level of similarity/dissimilarity of their underlying words. Since item similarities and user similarities are the basis of designing a successful collaborative filtering, vector embedding seems to be a good candidate. As opposed to words, we propose a vector embedding approach for learning vectors for items and users. There have been very few recent applications of vector embeddings in recommender systems, but they have limitations in the type of formulations that are applicable. We propose a novel vector embedding that is versatile, in the sense that it is applicable for the prediction of ratings and for the recommendation of top items that are likely to appeal to users. It could also possibly take into account content-based features and demographic information. The approach is a simple relaxation algorithm that optimizes an objective function, defined based on target users’, items’ or joint user–item’s similarities in their respective vector spaces. The proposed approach is evaluated using real life datasets such as “MovieLens”, “ModCloth”, “Amazon: Magazine_Subscriptions” and “Online Retail”. The obtained results are compared with some of the leading benchmark methods, and they show a competitive performance.
Source: crossref · Quality: baseline

Research context

OpenAlex topics: Recommender Systems and Techniques · Text and Document Classification Technologies · Image Retrieval and Classification Techniques

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

Department of Computer Engineering, Faculty of Engineering, Cairo University, Giza 12613, Egypt

References (54)

Show source-provided references
1. Ortega, F., and González-Prieto, Á. (2020). Recommender Systems and Collaborative Filtering. Appl. Sci., 10.10.3390/app10207050 ↗
2. Fayyaz, Z., Ebrahimian, M., Nawara, D., Ibrahim, A., and Kashef, R. (2020). Recommendation Systems: Algorithms, Challenges, Metrics, and Business Opportunities. Appl. Sci., 10.10.3390/app10217748 ↗
3. Ricci, F., Rokach, L., and Shapira, B. (2015). Recommender systems: Introduction and challenges. Recommender Systems Handbook, Springer.10.1007/978-1-4899-7637-6 ↗
4. Sarwar, B., Karypis, G., Konstan, J., and Riedl, J. (2001, January 1–5). Item-based collaborative filtering recommendation algorithms. Proceedings of the 10th International Conference on World Wide Web, Hong Kong, China.10.1145/371920.372071 ↗
5. Classifications of Recommender Systems: A review10.25103/jestr.104.18 ↗
6. Recommendation systems: Principles, methods and evaluation10.1016/j.eij.2015.06.005 ↗
7. Gómez-Pulido, J.A., Durán-Domínguez, A., and Pajuelo-Holguera, F. (2020). Optimizing Latent Factors and Collaborative Filtering for Students’ Performance Prediction. Appl. Sci., 10.10.3390/app10165601 ↗
8. A survey of collaborative filtering-based recommender systems for mobile internet applications10.1109/ACCESS.2016.2573314 ↗
9. Deep learning based recommender system: A survey and new perspectives10.1145/3158369 ↗
10. Bobadilla, J., Alonso, S., and Hernando, A. (2020). Deep Learning Architecture for Collaborative Filtering Recommender Systems. Appl. Sci., 10.10.3390/app10072441 ↗
11. Shafqat, W., Byun, Y.C., and Park, N. (2020). Effectiveness of Machine Learning Approaches Towards Credibility Assessment of Crowdfunding Projects for Reliable Recommendations. Appl. Sci., 10.10.3390/app10249062 ↗
12. Shafqat, W., and Byun, Y.C. (2021). Incorporating Similarity Measures to Optimize Graph Convolutional Neural Networks for Product Recommendation. Appl. Sci., 11.10.3390/app11041366 ↗
13. Sulikowski, P., and Zdziebko, T. (2021). Horizontal vs. Vertical Recommendation Zones Evaluation Using Behavior Tracking. Appl. Sci., 11.10.3390/app11010056 ↗
14. Sulikowski, P., Zdziebko, T., Coussement, K., Dyczkowski, K., Kluza, K., and Sachpazidu-Wójcicka, K. (2021). Gaze and Event Tracking for Evaluation of Recommendation-Driven Purchase. Sensors, 21.10.3390/s21041381 ↗
15. Mikolov, T., Chen, K., Corrado, G., and Dean, J. (2013). Efficient estimation of word representations in vector space. arXiv.
16. Mikolov, T., Sutskever, I., Chen, K., Corrado, G.S., and Dean, J. (2013, January 5–8). Distributed representations of words and phrases and their compositionality. Proceedings of the 26th International Conference on Neural Information Processing Systems—Volume 2 (NIPS’13), Lake Tahoe, NV, USA.
17. Matrix factorization techniques for recommender systems10.1109/MC.2009.263 ↗
18. A survey of collaborative filtering based social recommender systems10.1016/j.comcom.2013.06.009 ↗
19. Girase, S., and Mukhopadhyay, D. (2015). Role of matrix factorization model in collaborative filtering algorithm: A survey. arXiv.
20. Ma, H., Zhou, D., Liu, C., Lyu, M.R., and King, I. (2011, January 9–12). Recommender systems with social regularization. Proceedings of the Fourth ACM International Conference on Web Search and Data Mining, Hong Kong, China.10.1145/1935826.1935877 ↗
21. Matrix factorization with rating completion: An enhanced SVD model for collaborative filtering recommender systems10.1109/ACCESS.2017.2772226 ↗
22. Mitroi, B., and Frasincar, F. (April, January 30). An elastic net regularized matrix factorization technique for recommender systems. Proceedings of the 35th Annual ACM Symposium on Applied Computing, Brno, Czech Republic.
23. Recommender systems
24. Desrosiers, C., and Karypis, G. (2011). A comprehensive survey of neighborhood-based recommendation methods. Recommender Systems Handbook, Springer.10.1007/978-0-387-85820-3_4 ↗
25. Recommender systems survey10.1016/j.knosys.2013.03.012 ↗
26. A semantic approach to improve neighborhood formation in collaborative recommender systems10.1016/j.eswa.2014.06.038 ↗
27. Adaptive KNN based recommender system through mining of user preferences10.1007/s11277-017-4605-5 ↗
28. Ayyaz, S., and Qamar, U. (2017, January 22–25). Improving collaborative filtering by selecting an effective user neighborhood for recommender systems. Proceedings of the 2017 IEEE International Conference on Industrial Technology (ICIT), Toronto, ON, Canada.10.1109/ICIT.2017.7915541 ↗
29. Neighbor Selection for User-Based Collaborative Filtering Using Covering-Based Rough Sets10.1007/978-3-030-29566-0_9 ↗
30. Gutiérrez, L., and Keith, B. (2018). A systematic literature review on word embeddings. International Conference on Software Process Improvement, Springer.10.1007/978-3-030-01171-0_12 ↗
31. Grbovic, M., Radosavljevic, V., Djuric, N., Bhamidipati, N., Savla, J., Bhagwan, V., and Sharp, D. (2015, January 10–13). E-commerce in your inbox: Product recommendations at scale. Proceedings of the 21th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, Sydney, NSW, Australia.10.1145/2783258.2788627 ↗
32. Vasile, F., Smirnova, E., and Conneau, A. (2016, January 15–19). Meta-prod2vec: Product embeddings using side-information for recommendation. Proceedings of the 10th ACM Conference on Recommender Systems, Boston, MA, USA.10.1145/2959100.2959160 ↗
33. Liang, D., Altosaar, J., Charlin, L., and Blei, D.M. (2016, January 15–19). Factorization meets the item embedding: Regularizing matrix factorization with item co-occurrence. Proceedings of the 10th ACM Conference on Recommender Systems, Boston, MA, USA.10.1145/2959100.2959182 ↗
34. Ozsoy, M.G. (2016). From word embeddings to item recommendation. arXiv.
35. Learning vector-space representations of items for recommendations using word embedding models10.1016/j.procs.2016.05.380 ↗
36. Pennington, J., Socher, R., and Manning, C. (2014, January 25–29). Glove: Global vectors for word representation. Proceedings of the 2014 Conference on Empirical Methods in Natural Language Processing (EMNLP), Doha, Qatar.10.3115/v1/D14-1162 ↗
37. Barkan, O., and Koenigstein, N. (2016, January 13–16). Item2vec: Neural item embedding for collaborative filtering. Proceedings of the 2016 IEEE 26th International Workshop on Machine Learning for Signal Processing (MLSP), Vietri sul Mare, Italy.10.1109/MLSP.2016.7738886 ↗
38. Yang, Z., He, J., and He, S. (2019, January 24–26). A collaborative filtering method based on forgetting theory and neural item embedding. Proceedings of the 2019 IEEE 8th Joint International Information Technology and Artificial Intelligence Conference (ITAIC), Chongqing, China.10.1109/ITAIC.2019.8785589 ↗
39. Lu, N., Ohsawa, Y., and Hayashi, T. (2019, January 4–7). Learning Sequential Behavior for Next-Item Prediction. Proceedings of the Annual Conference of JSAI 33rd Annual Conference, Niigata, Japan.
40. Barkan, O., Caciularu, A., Katz, O., and Koenigstein, N. (2020, January 4–8). Attentive Item2vec: Neural attentive user representations. Proceedings of the ICASSP 2020—2020 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), Barcelona, Spain.10.1109/ICASSP40776.2020.9053071 ↗
41. Rizkallah, S., Atiya, A.F., and Shaheen, S. (2020). A Polarity Capturing Sphere for Word to Vector Representation. Appl. Sci., 10.10.3390/app10124386 ↗
42. The movielens datasets: History and context10.1145/2827872 ↗
43. Wan, M., Ni, J., Misra, R., and McAuley, J. (2020, January 3–7). Addressing marketing bias in product recommendations. Proceedings of the 13th International Conference on Web Search and Data Mining, Houston, TX, USA.10.1145/3336191.3371855 ↗
44. Ni, J., Li, J., and McAuley, J. (2019, January 3–7). Justifying recommendations using distantly-labeled reviews and fine-grained aspects. Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing (EMNLP-IJCNLP), Hong Kong, China.10.18653/v1/D19-1018 ↗
45. Chen, M., and Liu, P. (2017). Performance Evaluation of Recommender Systems. Int. J. Perform. Eng., 13.10.23940/ijpe.17.08.p7.12461256 ↗
46. Surprise: A python library for recommender systems10.21105/joss.02174 ↗
47. (2021, January 29). Surprise. Available online: https://github.com/NicolasHug/Surprise.
48. Sarwar, B., Karypis, G., Konstan, J., and Riedl, J. (2000). Application of Dimensionality Reduction in Recommender System A Case study, Minnesota Univ Minneapolis Dept of Computer Science. Technical Report.10.21236/ADA439541 ↗
49. Social popularity based SVD++ recommender system
50. An efficient non-negative matrix-factorization-based approach to collaborative filtering for recommender systems10.1109/TII.2014.2308433 ↗
51. Lemire, D., and Maclachlan, A. (2005, January 21–23). Slope one predictors for online rating-based collaborative filtering. Proceedings of the 2005 SIAM International Conference on Data Mining, Newport Beach, CA, USA.10.1137/1.9781611972757.43 ↗
52. Factor in the neighbors: Scalable and accurate collaborative filtering10.1145/1644873.1644874 ↗
53. George, T., and Merugu, S. (2005, January 27–30). A scalable collaborative filtering framework based on co-clustering. Proceedings of the Fifth IEEE International Conference on Data Mining (ICDM’05), Washington, DC, USA.
54. Chen, D.D. (1970, January 01). Online Retail Dataset. Available online: https://archive.ics.uci.edu/ml/datasets/online+retail.