Self-Attentive Subset Learning over a Set-Based Preference in Recommendation
Source abstract
Abstract
Recommender systems that learn user preference from item-level feedback (provided to individual items) have been extensively studied. Considering the risk of privacy exposure, learning from set-level feedback (provided to sets of items) has been demonstrated to be a better way, since set-level feedback reveals user preferences while to some extent, hiding his/her privacy. Since only set-level feedback is provided as a supervision signal, different methods are being investigated to build connections between set-based preferences and item-based preferences. However, they overlook the complexity of user behavior in real-world applications. Instead, we observe that users’ set-level preference can be better modeled based on a subset of items in the original set. To this end, we propose to tackle the problem of identifying subsets from sets of items for set-based preference learning. We propose a policy network to explicitly learn a personalized subset selection strategy for users. Given the complex correlation between items in the set-rating process, we introduce a self-attention module to make sure all set members are considered in subset selecting process. Furthermore, we introduce gumble softmax to avoid gradient vanishing caused by binary selection in model learning. Finally the selected items are aggregated by user-specific personalized positional weights. Empirical evaluation with real-world datasets verifies the superiority of the proposed model over the state-of-the-art.
Source: crossref · Quality: baseline
Research context
OpenAlex topics: Recommender Systems and Techniques · Advanced Graph Neural Networks · Advanced Bandit Algorithms Research
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
Affiliations
Laboratory for Big Data and Decision, National University of Defense Technology, Changsha 410073, China
Funding
National Key Research and Development Program of China · National Natural Science Foundation of China · Postgraduate Scientific Research Innovation Project of Hunan Province
References (42)
Show source-provided references
1. Aggarwal, C.C. (2016). Recommender Systems, Springer International Publishing.10.1007/978-3-319-29659-3 ↗
2. Matrix Factorization Techniques for Recommender Systems10.1109/MC.2009.263 ↗
3. Hu, Y., Koren, Y., and Volinsky, C. (2008, January 15–19). Collaborative Filtering for Implicit Feedback Datasets. Proceedings of the 2008 Eighth IEEE International Conference on Data Mining, Pisa, Italy.10.1109/ICDM.2008.22 ↗
4. Latest trends of security and privacy in recommender systems: A comprehensive review and future perspectives10.1016/j.cose.2022.102746 ↗
5. Learning from Sets of Items in Recommender Systems
6. des Jardins, M., Eaton, E., and Wagstaff, K. (2006, January 25–29). Learning user preferences for sets of objects. Proceedings of the Machine Learning, Twenty-Third International Conference (ICML 2006), Pittsburgh, PA, USA.10.1145/1143844.1143879 ↗
7. Brafman, R.I., Domshlak, C., Shimony, S.E., and Silver, Y. (2006, January 16–20). Preferences over Sets. Proceedings of the Twenty-First National Conference on Artificial Intelligence and the Eighteenth Innovative Applications of Artificial Intelligence Conference, Boston, MA, USA.
8. Brewka, G., Truszczynski, M., and Woltran, S. (2010, January 11–15). Representing Preferences Among Sets. Proceedings of the Twenty-Fourth AAAI Conference on Artificial Intelligence, AAAI 2010, Atlanta, GA, USA.10.1609/aaai.v24i1.7584 ↗
9. Chang, S., Harper, F.M., and Terveen, L. (2015). Proceedings of the 18th ACM Conference on Computer Supported Cooperative Work & Social Computing, CSCW’15, Association for Computing Machinery.
10. Aizenberg, N., Koren, Y., and Somekh, O. (2012, January 16–20). Build your own music recommender by modeling internet radio streams. Proceedings of the 21st International Conference on World Wide Web 2012, Lyon, France.10.1145/2187836.2187838 ↗
11. Chen, S., Moore, J.L., Turnbull, D., and Joachims, T. (2012, January 12–16). Playlist prediction via metric embedding. Proceedings of the 18th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, Beijing, China.10.1145/2339530.2339643 ↗
12. A Cocktail Approach for Travel Package Recommendation10.1109/TKDE.2012.233 ↗
13. Liu, Q., Ge, Y., Li, Z., Chen, E., and Xiong, H. (2011, January 11–14). Personalized Travel Package Recommendation. Proceedings of the 2011 IEEE 11th International Conference on Data Mining, Vancouver, BC, Canada.10.1109/ICDM.2011.118 ↗
14. Hu, H., and He, X. (2019, January 4–8). Sets2Sets: Learning from Sequential Sets with Neural Networks. Proceedings of the KDD 2019, Anchorage, AK, USA.10.1145/3292500.3330979 ↗
15. Liu, Y., Xie, M., and Lakshmanan, L.V.S. (2014, January 6–10). Recommending user generated item lists. Proceedings of the 8th ACM Conference on Recommender Systems, Silicon Valley, CA, USA.10.1145/2645710.2645750 ↗
16. Eksombatchai, C., Jindal, P., Liu, J.Z., Liu, Y., Sharma, R., Sugnet, C., Ulrich, M., and Leskovec, J. (2018, January 23–27). Pixie: A System for Recommending 3+ Billion Items to 200+ Million Users in Real-Time. Proceedings of the 2018 World Wide Web Conference on World Wide Web, WWW 2018, Lyon, France.10.1145/3178876.3186183 ↗
17. Greene, D., Reid, F., Sheridan, G., and Cunningham, P. (2011). Supporting the Curation of Twitter User Lists. arXiv.
18. Kando, N., Sakai, T., Joho, H., Li, H., de Vries, A.P., and White, R.W. (2017, January 7–11). Generating and Personalizing Bundle Recommendations on Steam. Proceedings of the 40th International ACM SIGIR Conference on Research and Development in Information Retrieval, Shinjuku, Tokyo, Japan.
19. Cao, D., Nie, L., He, X., Wei, X., Zhu, S., and Chua, T. (2017, January 7–11). Embedding Factorization Models for Jointly Recommending Items and User Generated Lists. Proceedings of the 40th International ACM SIGIR Conference on Research and Development in Information Retrieval, Tokyo, Japan.10.1145/3077136.3080779 ↗
20. Chen, L., Liu, Y., He, X., Gao, L., and Zheng, Z. (2019, January 10–16). Matching User with Item Set: Collaborative Bundle Recommendation with Deep Attention Network. Proceedings of the Twenty-Eighth International Joint Conference on Artificial Intelligence, IJCAI 2019, Macao, China.10.24963/ijcai.2019/290 ↗
21. Chang, J., Gao, C., He, X., Li, Y., and Jin, D. (2020, January 25–30). Bundle Recommendation with Graph Convolutional Networks. Proceedings of the 43rd International ACM SIGIR Conference on Research and Development in Information Retrieval, Virtual Event.10.1145/3397271.3401198 ↗
22. Yu, L., Sun, L., Du, B., Liu, C., Xiong, H., and Lv, W. (2020, January 6–10). Predicting Temporal Sets with Deep Neural Networks. Proceedings of the 26th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining, Virtual Event.10.1145/3394486.3403152 ↗
23. Yu, F., Liu, Q., Wu, S., Wang, L., and Tan, T. (2016, January 17–21). A Dynamic Recurrent Model for Next Basket Recommendation. Proceedings of the 39th International ACM SIGIR Conference on Research and Development in Information Retrieval, SIGIR 2016, Pisa, Italy.10.1145/2911451.2914683 ↗
24. Wang, P., Guo, J., Lan, Y., Xu, J., Wan, S., and Cheng, X. (2015, January 9–13). Learning Hierarchical Representation Model for NextBasket Recommendation. Proceedings of the 38th International ACM SIGIR Conference on Research and Development in Information Retrieval, Santiago, Chile.10.1145/2766462.2767694 ↗
25. Rendle, S., Freudenthaler, C., and Schmidt-Thieme, L. (2010, January 26–30). Factorizing personalized Markov chains for next-basket recommendation. Proceedings of the 19th International Conference on World Wide Web, WWW 2010, Raleigh, NC, USA.10.1145/1772690.1772773 ↗
26. Bai, T., Zhang, S., Egleston, B.L., and Vucetic, S. (2018, January 19–23). Interpretable Representation Learning for Healthcare via Capturing Disease Progression through Time. Proceedings of the 24th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining, KDD 2018, London, UK.10.1145/3219819.3219904 ↗
27. Choi, E., Bahadori, M.T., Schuetz, A., Stewart, W.F., and Sun, J. (2016, January 19–20). Doctor AI: Predicting Clinical Events via Recurrent Neural Networks. Proceedings of the 1st Machine Learning in Health Care, MLHC 2016, Los Angeles, CA, USA.
28. Benson, A.R., Kumar, R., and Tomkins, A. (2018, January 19–23). Sequences of Sets. Proceedings of the 24th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining, KDD 2018, London, UK.10.1145/3219819.3220100 ↗
29. Sarwar, B.M., Karypis, G., Konstan, J.A., and Riedl, J. (2001, January 1–5). Item-based collaborative filtering recommendation algorithms. Proceedings of the Tenth International World Wide Web Conference, WWW 10, Hong Kong, China.10.1145/371920.372071 ↗
30. He, X., Liao, L., Zhang, H., Nie, L., Hu, X., and Chua, T. (2017, January 3–7). Neural Collaborative Filtering. Proceedings of the 26th International Conference on World Wide Web, WWW 2017, Perth, Australia.10.1145/3038912.3052569 ↗
31. Koren, Y. (2008, January 24–27). Factorization meets the neighborhood: A multifaceted collaborative filtering model. Proceedings of the 14th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, Las Vegas, NV, USA.10.1145/1401890.1401944 ↗
32. Sutton, R.S., and Barto, A.G. (2018). Reinforcement Learning: An Introduction, MIT Press.
33. Jang, E., Gu, S., and Poole, B. (2017, January 24–26). Categorical Reparameterization with Gumbel-Softmax. Proceedings of the 5th International Conference on Learning Representations, ICLR 2017, Toulon, France.
34. Vaswani, A., Shazeer, N., Parmar, N., Uszkoreit, J., Jones, L., Gomez, A.N., Kaiser, Ł., and Polosukhin, I. (2017, January 4–9). Attention is all you need. In Proceedings of the Advances in Neural Information Processing Systems Annual Conference on Neural Information Processing Systems 2017, Long Beach, CA, USA.
35. He, Y., Wang, J., Niu, W., and Caverlee, J. (2019, January 3–7). A Hierarchical Self-Attentive Model for Recommending User-Generated Item Lists. Proceedings of the 28th ACM International Conference on Information and Knowledge Management, CIKM 2019, Beijing, China.10.1145/3357384.3358030 ↗
36. He, K., Zhang, X., Ren, S., and Sun, J. (2016, January 27–30). Deep Residual Learning for Image Recognition. Proceedings of the 2016 IEEE Conference on Computer Vision and Pattern Recognition, CVPR ’16, Las Vegas, NV, USA.10.1109/CVPR.2016.90 ↗
37. Paisley, J.W., Blei, D.M., and Jordan, M.I. (July, January 26). Variational Bayesian Inference with Stochastic Search. Proceedings of the 29th International Conference on Machine Learning, ICML 2012, Edinburgh, Scotland, UK.
38. Simple Statistical Gradient-Following Algorithms for Connectionist Reinforcement Learning10.1007/BF00992696 ↗
39. Kingma, D.P., and Welling, M. (2014, January 14–16). Auto-Encoding Variational Bayes. Proceedings of the 2nd International Conference on Learning Representations, ICLR ’14, Banff, AB, Canada.
40. Rendle, S., Freudenthaler, C., Gantner, Z., and Schmidt-Thieme, L. (2009, January 18–21). BPR: Bayesian Personalized Ranking from Implicit Feedback. Proceedings of the UAI 2009, the Twenty-Fifth Conference on Uncertainty in Artificial Intelligence, Montreal, QC, Canada.
41. Yuan, F., Guo, G., Jose, J.M., Chen, L., Yu, H., and Zhang, W. (2017, January 13–16). BoostFM: Boosted Factorization Machines for Top-N Feature-based Recommendation. Proceedings of the 22nd International Conference on Intelligent User Interfaces, IUI 2017, Limassol, Cyprus.10.1145/3025171.3025211 ↗
42. Kipf, T.N., and Welling, M. (2017, January 24–26). Semi-Supervised Classification with Graph Convolutional Networks. Proceedings of the 5th International Conference on Learning Representations, ICLR 2017, Toulon, France.