Disentangled Self-Attention with Auto-Regressive Contrastive Learning for Neural Group Recommendation
Source abstract
Abstract
Group recommender systems aim to provide recommendations to a group of users as a whole rather than to individual users. Nonetheless, prevailing methodologies predominantly aggregate user preferences without adequately accounting for the unique individual intents influencing item selection. This oversight becomes particularly problematic in the context of ephemeral groups formed by users with limited shared historical interactions, which exacerbates the data sparsity challenge. In this paper, we introduce a novel Disentangled Self-Attention Group Recommendation framework with auto-regressive contrastive learning method, termed DAGA. This framework not only employs disentangled neural architectures to reconstruct the multi-head self-attention network but also incorporates modules for mutual information optimization via auto-regressive contrastive learning to better leverage the context information of user–item and group–item historical interactions, obtaining group representations and further executing recommendations. Specifically, we develop a disentangled model comprising multiple components to individually assess and interpret the diverse intents of users and their impacts on collective group preferences towards items. Building upon this model, we apply the principle of contrastive mutual information maximization to train our framework, aligning the group representations with the corresponding user representations derived from each factor of the disentangled model, thereby enriching the contextual understanding required to effectively address the challenges posed by ephemeral groups. Empirical evaluations conducted on three real-world benchmark datasets substantiate the superior performance of our proposed framework over existing state-of-the-art group recommendation approaches.
Source: crossref · Quality: baseline
Research context
OpenAlex topics: Recommender Systems and Techniques · Advanced Bandit Algorithms Research · Advanced Graph Neural Networks
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
Affiliations
Cooperative Medianet Innovation Center, Shanghai Jiao Tong University, Shanghai 200240, China
Wireless Network Research Department, Huawei Technologies Co., Ltd., Shanghai 201206, China
Department of Computer Science and Engineering, Shanghai Jiao Tong University, Shanghai 200240, China
Funding
National Natural Science Foundation of China · 111 project
References (57)
Show source-provided references
1. Secrecy Capacity Scaling of Large-Scale Networks With Social Relationships10.1109/TVT.2016.2582778 ↗
2. DDPG-Based Joint Time and Energy Management in Ambient Backscatter-Assisted Hybrid Underlay CRNs10.1109/TCOMM.2022.3221422 ↗
3. Kabbur, S., Ning, X., and Karypis, G. (2013, January 11–14). FISM: Factored item similarity models for top-N recommender systems. Proceedings of the KDD ’13: Proceedings of the 19th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, Chicago, IL, USA.10.1145/2487575.2487589 ↗
4. Wang, X., He, X., Wang, M., Feng, F., and Chua, T.-S. (2019, January 21–25). Neural Graph Collaborative Filtering. Proceedings of the SIGIR’19: Proceedings of the 42nd International ACM SIGIR Conference on Research and Development in Information Retrieval, Paris, France.10.1145/3331184.3331267 ↗
5. Rendle, S., Freudenthaler, C., Gantner, Z., and Schmidt-Thieme, L. (2009). BPR: Bayesian Personalized Ranking from Implicit Feedback. arXiv.
6. He, X., Deng, K., Wang, X., Li, Y., Zhang, Y., and Wang, M. (2020, January 25–30). LightGCN: Simplifying and Powering Graph Convolution Network for Recommendation. Proceedings of the SIGIR ’20: Proceedings of the 43rd International ACM SIGIR Conference on Research and Development in Information Retrieval, Virtual Event.10.1145/3397271.3401063 ↗
7. NAIS: Neural Attentive Item Similarity Model for Recommendation10.1109/TKDE.2018.2831682 ↗
8. Koren, Y. (2008, January 24–27). Factorization meets the neighborhood: A multifaceted collaborative fltering model. Proceedings of the KDD ’08: Proceedings of the 14th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, Las Vegas, NV, USA.10.1145/1401890.1401944 ↗
9. Liang, D., Krishnan, R.G., Hoffman, M.D., and Jebara, T. (2018, January 23–27). Variational Autoencoders for Collaborative Filtering. Proceedings of the WWW ’18: Proceedings of the 2018 World Wide Web Conference, Lyon, France.10.1145/3178876.3186150 ↗
10. Deep modeling of group preferences for group-based recommendation
11. Cao, D., He, X., Miao, L., An, Y., Yang, C., and Hong, R. (2018, January 8–12). Attentive group recommendation. Proceedings of the SIGIR ’18: The 41st International ACM SIGIR Conference on Research & Development in Information Retrieval, Ann Arbor, MI, USA.10.1145/3209978.3209998 ↗
12. Sankar, A., Wu, Y., Wu, Y., Zhang, W., Yang, H., and Sundaram, H. (2020, January 25–30). GroupIM: A mutual information maximization framework for neural group recommendation. Proceedings of the SIGIR ’20: Proceedings of the 43rd International ACM SIGIR Conference on Research and Development in Information Retrieval, Virtual Event.10.1145/3397271.3401116 ↗
13. Baltrunas, L., Makcinskas, T., and Ricci, F. (2010, January 26–30). Group recommendations with rank aggregation and collaborative fltering. Proceedings of the RecSys ’10: Proceedings of the Fourth ACM Conference on Recommender Systems, Barcelona, Spain.10.1145/1864708.1864733 ↗
14. Berkovsky, S., and Freyne, J. (2010, January 26–30). Group-based recipe recommendations: Analysis of data aggregation strategies. Proceedings of the RecSys ’10: Proceedings of the fourth ACM conference on Recommender systems, Barcelona, Spain.10.1145/1864708.1864732 ↗
15. State-of-the-Art in Group Recommendation and New Approaches for Automatic Identifcation of Groups
16. Group Recommendation: Semantics and Efciency10.14778/1687627.1687713 ↗
17. He, Z., Chow, C.-Y., and Zhang, J.-D. (2020, January 25–30). GAME: Learning Graphical and Attentive Multi-view Embeddings for Occasional Group Recommendation. Proceedings of the SIGIR ’20: Proceedings of the 43rd International ACM SIGIR Conference on Research and Development in Information Retrieval, Virtual Event.10.1145/3397271.3401064 ↗
18. Tran, L.V., Pham, T.-A.N., Tay, Y., Liu, Y., Cong, G., and Li, X. (2019, January 21–25). Interact and Decide: Medley of Sub-Attention Networks for Effective Group Recommendation. Proceedings of the SIGIR’19: Proceedings of the 42nd International ACM SIGIR Conference on Research and Development in Information Retrieval, Paris, France.
19. Yin, H., Wang, Q., Zheng, K., Li, Z., Yang, J., and Zhou, X. (2019, January 8–11). Social Influence-Based Group Representation Learning for Group Recommendation. Proceedings of the 2019 IEEE 35th International Conference on Data Engineering (ICDE), Macao, China.10.1109/ICDE.2019.00057 ↗
20. Zhang, J., Gao, M., Yu, J., Guo, L., Li, J., and Yin, H. (2021, January 1–5). Double-Scale Self-Supervised Hypergraph Learning for Group Recommendation. Proceedings of the CIKM ’21: Proceedings of the 30th ACM International Conference on Information & Knowledge Management, Virtual Event.10.1145/3459637.3482426 ↗
21. Chen, T., Yin, H., Long, J., Nguyen, Q.V.H., Wang, Y., and Wang, M. (2022, January 11–15). Thinking inside The Box: Learning Hypercube Representations for Group Recommendation. Proceedings of the SIGIR ’22: Proceedings of the 45th International ACM SIGIR Conference on Research and Development in Information Retrieval, Madrid, Spain.10.1145/3477495.3532066 ↗
22. Li, K., Wang, C.-D., Lai, J., and Yuan, H. (March, January 27). Self-Supervised Group Graph Collaborative Filtering for Group Recommendation. Proceedings of the WSDM ’23: Proceedings of the Sixteenth ACM International Conference on Web Search and Data Mining, Singapore.
23. Quintarelli, E., Rabosio, E., and Tanca, L. (2016, January 15–19). Recommending new items to ephemeral groups using contextual user influence. Proceedings of the RecSys ’16: Proceedings of the 10th ACM Conference on Recommender Systems, Boston, MA, USA.10.1145/2959100.2959137 ↗
24. Seko, S., Yagi, T., Motegi, M., and Muto, S. (2011, January 23–27). Group recommendation using feature space representing behavioral tendency and power balance among members. Proceedings of the RecSys ’11: Proceedings of the Fifth ACM Conference on Recommender Systems, Chicago, IL, USA.10.1145/2043932.2043953 ↗
25. Overcoming data sparsity in group recommendation
26. Guo, L., Yin, H., Wang, Q., Cui, B., Huang, Z., and Cui, L. (2020, January 20–24). Group recommendation with latent voting mechanism. Proceedings of the 2020 IEEE 36th International Conference on Data Engineering (ICDE), Dallas, TX, USA.10.1109/ICDE48307.2020.00018 ↗
27. Jia, R., Zhou, X., Dong, L., and Pan, S. (2021, January 7–10). Hypergraph Convolutional Network for Group Recommendation. Proceedings of the 2021 IEEE International Conference on Data Mining (ICDM), Auckland, New Zealand.10.1109/ICDM51629.2021.00036 ↗
28. Gorla, J., Lathia, N., Robertson, S., and Wang, J. (2013, January 13–17). Probabilistic group recommendation via information matching. Proceedings of the WWW ’13: Proceedings of the 22nd international conference on World Wide Web, Rio de Janeiro, Brazil.10.1145/2488388.2488432 ↗
29. Liu, X., Tian, Y., Ye, M., and Lee, W.-C. (November, January 29). Exploring personal impact for group recommendation. Proceedings of the CIKM ’12: Proceedings of the 21st ACM International Conference on Information and Knowledge Management, Maui, HI, USA.
30. Yuan, Q., Cong, G., and Lin, C.-Y. (2014, January 24–27). COM: A generative model for group recommendation. Proceedings of the KDD ’14: Proceedings of the 20th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, New York, NY, USA.10.1145/2623330.2623616 ↗
31. An efcient group recommendation model with multiattention-based neural networks10.1109/TNNLS.2019.2955567 ↗
32. Ghaemmaghami, S.S., and Salehi-Abari, A. (2021, January 1–5). DeepGroup: Group Recommendation with Implicit Feedback. Proceedings of the CIKM ’21: Proceedings of the 30th ACM International Conference on Information & Knowledge Management, Virtual Event.
33. Social-Enhanced Attentive Group Recommendation10.1109/TKDE.2019.2936475 ↗
34. Deng, Z., Li, C., Liu, S., Ali, W., and Shao, J. (2021, January 19–22). KnowledgeAware Group Representation Learning for Group Recommendation. Proceedings of the 2021 IEEE 37th International Conference on Data Engineering (ICDE), Chania, Greece.10.1109/ICDE51399.2021.00139 ↗
35. Yang, M., Liu, Z., Yang, L., Liu, X., Wang, C., Peng, H., and Yu, P.S. (March, January 27). Ranking-based Group Identification via Factorized Attention on Social Tripartite Graph. Proceedings of the WSDM ’23: Proceedings of the Sixteenth ACM International Conference on Web Search and Data Mining, Singapore.
36. Yang, M., Liu, Z., Yang, L., Liu, X., Wang, C., Peng, H., and Yu, P.S. (2023, January 21–25). Group Identification via Transitional Hypergraph Convolution with Cross-view Self-supervised Learning. Proceedings of the CIKM ’23: Proceedings of the 32nd ACM International Conference on Information and Knowledge Management, Birmingham, UK.10.1145/3583780.3614902 ↗
37. Attention is all you need
38. Wu, J., Wang, X., Feng, F., He, X., Chen, L., Lian, J., and Xie, X. (2021, January 11–15). Self-supervised graph learning for recommendation. Proceedings of the SIGIR ’21: Proceedings of the 44th International ACM SIGIR Conference on Research and Development in Information Retrieval, Virtual Event.10.1145/3404835.3462862 ↗
39. Yu, J., Yin, H., Xia, X., Chen, T., Li, J., and Huang, Z. (2022). Self-Supervised Learning for Recommender Systems: A Survey. arXiv.
40. Zhou, Y., Dou, Z., Zhu, Y., and Wen, J.-R. (2021, January 1–5). PSSL: Selfsupervised Learning for Personalized Search with Contrastive Sampling. Proceedings of the CIKM ’21: Proceedings of the 30th ACM International Conference on Information & Knowledge Management, Virtual Event.10.1145/3459637.3482379 ↗
41. Representation learning: A review and new perspectives10.1109/TPAMI.2013.50 ↗
42. Learning to decompose and disentangle representations for video prediction
43. Infogan: Interpretable representation learning by information maximizing generative adversarial nets
44. Ma, L., Sun, Q., Georgoulis, S., Gool, L.V., Schiele, B., and Fritz, M. (2018, January 18–23). Disentangled person image generation. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Salt Lake City, UT, USA.10.1109/CVPR.2018.00018 ↗
45. Ma, J., Cui, P., Kuang, K., Wang, X., and Zhu, W. (2019, January 9–15). Disentangled graph convolutional networks. Proceedings of the 36th International Conference on Machine Learning, Long Beach, CA, USA.
46. Disentangled Contrastive Learning on Graphs
47. Higgins, I., Matthey, L., Pal, A., Burgess, C., Glorot, X., Botvinick, M., Mohamed, S., and Lerchner, A. (2017, January 24–26). beta-vae: Learning basic visual concepts with a constrained variational framework. Proceedings of the 5th International Conference on Learning Representations, Toulon, France.
48. Burgess, C.P., Higgins, I., Pal, A., Matthey, L., Watters, N., Desjardins, G., and Lerchner, A. (2017, January 9). Understanding disentangling in β-vae. Proceedings of the NeurIPS Workshop on Learning Disentangled Representations, Long Beach, CA, USA.
49. Liu, X., Yang, L., Liu, Z., Li, X., Yang, M., Wang, C., and Yu, P.S. (2023, January 15–18). Group-Aware Interest Disentangled Dual-Training for Personalized Recommendation. Proceedings of the 2023 IEEE International Conference on Big Data (BigData), Sorrento, Italy.10.1109/BigData59044.2023.10386885 ↗
50. Oord, A.v., Li, Y., and Vinyals, O. (2018). Representation learning with contrastive predictive coding. arXiv.
51. Hjelm, R.D., Fedorov, A., Lavoie-Marchildon, S., Grewal, K., Bachman, P., Trischler, A., and Bengio, Y. (2018). Learning deep representations by mutual information estimation and maximization. arXiv.
52. Chen, T., Kornblith, S., Norouzi, M., and Hinton, G. (2020, January 13–18). A simple framework for contrastive learning of visual representations. Proceedings of the 37th International Conference on Machine Learning, Virtual Event.
53. Veličković, P., Fedus, W., Hamilton, W.L., Liò, P., Bengio, Y., and Hjelm, R.D. (2018). Deep graph infomax. arXiv.
54. Hassani, K., and Khasahmadi, A.H. (2020, January 13–18). Contrastive multi-view representation learning on graphs. Proceedings of the 37th International Conference on Machine Learning, Virtual Event.
55. Peng, Z., Huang, W., Luo, M., Zheng, Q., Rong, Y., Xu, T., and Huang, J. (2020, January 20–24). Graph representation learning via graphical mutual information maximization. Proceedings of the WWW ’20: Proceedings of The Web Conference 2020, Taipei, Taiwan.10.1145/3366423.3380112 ↗
56. Graph contrastive learning with augmentations
57. He, X., Liao, L., Zhang, H., Nie, L., Hu, X., and Chua, T.-S. (2017, January 3–7). Neural Collaborative Filtering. Proceedings of the WWW ’17: Proceedings of the 26th International Conference on World Wide Web, Perth, Australia.10.1145/3038912.3052569 ↗