journal article·2022-11-19Open access

DACSR: Decoupled-Aggregated End-to-End Calibrated Sequential Recommendation

Jiayi Chen, Wen Wu, Liye Shi, Yu Ji, Wenxin Hu, Xi Chen, Wei Zheng, Liang He

Applied Sciences· Volume 12· Issue 22

Abstract

Sequential recommendations have made great strides in accurately predicting the future behavior of users. However, seeking accuracy alone may bring side effects such as unfair and overspecialized recommendation results. In this work, we focus on the calibrated recommendations for sequential recommendation, which is connected to both fairness and diversity. On the one hand, it aims to provide fairer recommendations whose preference distributions are consistent with users’ historical behaviors. On the other hand, it can improve the diversity of recommendations to a certain degree. But existing methods for calibration have mainly relied on the post-processing on the candidate lists, which require more computation time in generating recommendations. In addition, they fail to establish the relationship between accuracy and calibration, leading to the limitation of accuracy. To handle these problems, we propose an end-to-end framework to provide both accurate and calibrated recommendations for sequential recommendation. We design an objective function to calibrate the interests between recommendation lists and historical behaviors. We also provide distribution modification approaches to improve the diversity and mitigate the effect of imbalanced interests. In addition, we design a decoupled-aggregated model to improve the recommendation. The framework assigns two objectives to two individual sequence encoders, and aggregates the outputs by extracting useful information. Experiments on benchmark datasets validate the effectiveness of our proposed model.
Source: crossref · Quality: baseline

Research context

OpenAlex topics: Recommender Systems and Techniques · Face recognition and analysis · Visual Attention and Saliency Detection

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

School of Computer Science and Technology, East China Normal University, Shanghai 200062, China

Shanghai Key Laboratory of Mental Health and Psychological Crisis Intervention, School of Psychology and Cognitive Science, East China Normal University, Shanghai 200062, China

School of Data Science and Engineering, East China Normal University, Shanghai 200062, China

Information Technology Services, East China Normal University, Shanghai 200062, China

Funding

National Natural Science Foundation of China · Science and Technology Commission of Shanghai Municipality, China · Natural Science Foundation of Shanghai · The Research Project of Shanghai Science and Technology Commission · Fundamental Research Funds for the Central Universities

References (42)

Show source-provided references
1. Hidasi, B., Karatzoglou, A., Baltrunas, L., and Tikk, D. (2016, January 2–4). Session-based Recommendations with Recurrent Neural Networks. Proceedings of the International Conference on Learning Representations, ICLR 2016, San Juan, Puerto Rico.
2. Chang, J., Gao, C., Zheng, Y., Hui, Y., Niu, Y., Song, Y., Jin, D., and Li, Y. (2021, January 11–15). Sequential Recommendation with Graph Neural Networks. Proceedings of the ACM SIGIR Conference on Research and Development in Information Retrieval, SIGIR 2021, Virtual Event.10.1145/3404835.3462968 ↗
3. Wu, S., Tang, Y., Zhu, Y., Wang, L., Xie, X., and Tan, T. (February, January 27). Session-Based Recommendation with Graph Neural Networks. Proceedings of the AAAI Conference on Artificial Intelligence, AAAI 2019, Honolulu, Hawaii.10.1609/aaai.v33i01.3301346 ↗
4. Huang, J., Zhao, W.X., Dou, H., Wen, J.R., and Chang, E.Y. (2018, January 8–12). Improving sequential recommendation with knowledge-enhanced memory networks. Proceedings of the International ACM SIGIR Conference on Research & Development in Information Retrieval, SIGIR 2018, Ann Arbor, MI, USA.10.1145/3209978.3210017 ↗
5. Lu, Y., Zhang, S., Huang, Y., Wang, L., Yu, X., Zhao, Z., and Wu, F. (2021, January 19–23). Future-Aware Diverse Trends Framework for Recommendation. Proceedings of the World Wide Web Conference, WWW 2021, Ljubljana, Slovenia.10.1145/3442381.3449791 ↗
6. Cen, Y., Zhang, J., Zou, X., Zhou, C., Yang, H., and Tang, J. (2020, January 23–27). Controllable Multi-Interest Framework for Recommendation. Proceedings of the ACM SIGKDD Conference on Knowledge Discovery and Data Mining, SIGKDD 2020, Virtual Event, CA, USA.10.1145/3394486.3403344 ↗
7. Zheng, Y., Gao, C., Chen, L., Jin, D., and Li, Y. (2021, January 19–23). DGCN: Diversified Recommendation with Graph Convolutional Networks. Proceedings of the World Wide Web Conference, WWW 2021, Ljubljana, Slovenia.10.1145/3442381.3449835 ↗
8. Parapar, J., and Radlinski, F. (October, January 27). Towards Unified Metrics for Accuracy and Diversity for Recommender Systems. Proceedings of the ACM Conference on Recommender Systems, RecSys 2021, Amsterdam, The Netherlands.10.1145/3460231.3474234 ↗
9. Liu, S., and Zheng, Y. (2020, January 22–26). Long-tail Session-based Recommendation. Proceedings of the ACM Conference on Recommender Systems, RecSys 2020, Virtual Event, Brazil.10.1145/3383313.3412222 ↗
10. Kim, Y., Kim, K., Park, C., and Yu, H. (2019, January 10–16). Sequential and Diverse Recommendation with Long Tail. Proceedings of the International Joint Conference on Artificial Intelligence, IJCAI 2019, Macao, China.10.24963/ijcai.2019/380 ↗
11. Mitigating long tail effect in recommendations using few shot learning technique10.1016/j.eswa.2019.112887 ↗
12. Chen, L., Yang, Y., Wang, N., Yang, K., and Yuan, Q. (2019, January 13–17). How Serendipity Improves User Satisfaction with Recommendations? A Large-Scale User Evaluation. Proceedings of the World Wide Web Conference, WWW 2019, San Francisco, CA, USA.10.1145/3308558.3313469 ↗
13. Neural Serendipity Recommendation: Exploring the Balance between Accuracy and Novelty with Sparse Explicit Feedback10.1145/3396607 ↗
14. Li, P., Que, M., Jiang, Z., Hu, Y., and Tuzhilin, A. (2020, January 22–26). PURS: Personalized Unexpected Recommender System for Improving User Satisfaction. Proceedings of the ACM Conference on Recommender Systems, RecSys 2020, Virtual Event, Brazil.10.1145/3383313.3412238 ↗
15. Dai, E., and Wang, S. (2021, January 8–12). Say No to the Discrimination: Learning Fair Graph Neural Networks with Limited Sensitive Attribute Information. Proceedings of the ACM International Conference on Web Search and Data Mining, WSDM 2021, Virtual Event, Israel.10.1145/3437963.3441752 ↗
16. Ge, Y., Liu, S., Gao, R., Xian, Y., Li, Y., Zhao, X., Pei, C., Sun, F., Ge, J., and Ou, W. (2021, January 8–12). Towards Long-term Fairness in Recommendation. Proceedings of the ACM International Conference on Web Search and Data Mining, WSDM 2021, Virtual Event, Israel.10.1145/3437963.3441824 ↗
17. Steck, H. (2018, January 2–7). Calibrated recommendations. Proceedings of the ACM Conference on Recommender Systems, RecSys 2018, Vancouver, BC, Canada.10.1145/3240323.3240372 ↗
18. Kaya, M., and Bridge, D.G. (2019, January 16–20). A comparison of calibrated and intent-aware recommendations. Proceedings of the ACM Conference on Recommender Systems, RecSys 2019, Copenhagen, Denmark.10.1145/3298689.3347045 ↗
19. Burke, R. (2017). Multisided Fairness for Recommendation. arXiv.
20. Seymen, S., Abdollahpouri, H., and Malthouse, E.C. (October, January 27). A Constrained Optimization Approach for Calibrated Recommendations. Proceedings of the ACM Conference on Recommender Systems, RecSys 2021, Amsterdam, The Netherlands.10.1145/3460231.3478857 ↗
21. Exploiting personalized calibration and metrics for fairness recommendation10.1016/j.eswa.2021.115112 ↗
22. Li, J., Ren, P., Chen, Z., Ren, Z., Lian, T., and Ma, J. (2017, January 6–10). Neural attentive session-based recommendation. Proceedings of the ACM on Conference on Information and Knowledge Management, CIKM 2017, Singapore.10.1145/3132847.3132926 ↗
23. Tang, J., and Wang, K. (2018, January 5–9). Personalized Top-N Sequential Recommendation via Convolutional Sequence Embedding. Proceedings of the ACM International Conference on Web Search and Data Mining, WSDM 2018, Marina del Rey, CA, USA.10.1145/3159652.3159656 ↗
24. Kang, W., and McAuley, J.J. (2018, January 17–20). Self-Attentive Sequential Recommendation. Proceedings of the IEEE International Conference on Data Mining, ICDM 2018, Singapore.10.1109/ICDM.2018.00035 ↗
25. Long- and short-term self-attention network for sequential recommendation10.1016/j.neucom.2020.10.066 ↗
26. Sun, F., Liu, J., Wu, J., Pei, C., Lin, X., Ou, W., and Jiang, P. (2019, January 3–7). BERT4Rec: Sequential Recommendation with Bidirectional Encoder Representations from Transformer. Proceedings of the International Conference on Information and Knowledge Management, CIKM 2019, Beijing, China.10.1145/3357384.3357895 ↗
27. de Souza Pereira Moreira, G., Rabhi, S., Lee, J.M., Ak, R., and Oldridge, E. (October, January 27). Transformers4Rec: Bridging the Gap between NLP and Sequential / Session-Based Recommendation. Proceedings of the ACM Conference on Recommender Systems, RecSys 2021, Amsterdam, The Netherlands.10.1145/3460231.3474255 ↗
28. Wang, Z., Wei, W., Cong, G., Li, X., Mao, X., and Qiu, M. (2020, January 25–30). Global Context Enhanced Graph Neural Networks for Session-based Recommendation. Proceedings of the International ACM SIGIR Conference on Research and Development in Information Retrieval, SIGIR 2020, Virtual Event, China.10.1145/3397271.3401142 ↗
29. Chen, W., Ren, P., Cai, F., Sun, F., and de Rijke, M. (2020, January 19–23). Improving End-to-End Sequential Recommendations with Intent-aware Diversification. Proceedings of the International Conference on Information and Knowledge Management, CIKM 2020, Virtual Event, Ireland.10.1145/3340531.3411897 ↗
30. Tan, Q., Zhang, J., Yao, J., Liu, N., Zhou, J., Yang, H., and Hu, X. (2021, January 8–12). Sparse-Interest Network for Sequential Recommendation. Proceedings of the ACM International Conference on Web Search and Data Mining, WSDM 2021, Virtual Event, Israel.10.1145/3437963.3441811 ↗
31. Abdollahpouri, H., Mansoury, M., Burke, R., and Mobasher, B. (2020, January 22–26). The Connection Between Popularity Bias, Calibration, and Fairness in Recommendation. Proceedings of the ACM Conference on Recommender Systems, RecSys 2020, Virtual Event, Brazil.10.1145/3383313.3418487 ↗
32. Zhao, X., Zhu, Z., and Caverlee, J. (2021, January 19–23). Rabbit Holes and Taste Distortion: Distribution-Aware Recommendation with Evolving Interests. Proceedings of the Web Conference, WWW 2021, Ljubljana, Slovenia.10.1145/3442381.3450099 ↗
33. Attentive Hybrid Recurrent Neural Networks for sequential recommendation10.1007/s00521-020-05643-7 ↗
34. Ma, J., Zhao, Z., Yi, X., Chen, J., Hong, L., and Chi, E.H. (2018, January 19–23). Modeling Task Relationships in Multi-task Learning with Multi-gate Mixture-of-Experts. Proceedings of the ACM SIGKDD International Conference on Knowledge Discovery & Data Mining, SIGKDD 2018, London, UK.10.1145/3219819.3220007 ↗
35. Tang, H., Liu, J., Zhao, M., and Gong, X. (2020, January 22–26). Progressive Layered Extraction (PLE): A Novel Multi-Task Learning (MTL) Model for Personalized Recommendations. Proceedings of the ACM Conference on Recommender Systems, RecSys 2020, Virtual Event, Brazil.10.1145/3383313.3412236 ↗
36. He, K., Zhang, X., Ren, S., and Sun, J. (2016, January 27–30). Deep Residual Learning for Image Recognition. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, CVPR 2016, Las Vegas, NV, USA.10.1109/CVPR.2016.90 ↗
37. Kingma, D.P., and Ba, J. (2015, January 7–9). Adam: A Method for Stochastic Optimization. Proceedings of the International Conference on Learning Representations, ICLR 2015, San Diego, CA, USA.
38. Xie, X., Sun, F., Liu, Z., Wu, S., Gao, J., Zhang, J., Ding, B., and Cui, B. (2022, January 9–12). Contrastive Learning for Sequential Recommendation. Proceedings of the IEEE International Conference on Data Engineering, ICDE 2022, Kuala Lumpur, Malaysia.10.1109/ICDE53745.2022.00099 ↗
39. Chen, Y., Qian, W., Liu, D., Su, Y., Zhou, Y., Han, J., and Li, R. (2022, January 6–9). Contrastive Learning for Session-Based Recommendation. Proceedings of the International Conference on Artificial Neural Networks, ICANN 2022, Bristol, UK.10.1007/978-3-031-15937-4_30 ↗
40. Wang, Y., and Yao, Q. (2019). Few-shot Learning: A Survey. arXiv.
41. Game theory and non-linear dynamics: The Parrondo Paradox case study10.1016/S0960-0779(02)00397-1 ↗
42. A New Collaborative Filtering Approach Based on Game Theory for Recommendation Systems