BACF: Bayesian Attentional Collaborative Filtering
Source abstract
Abstract
The scarcity of explicit feedback data is a major challenge in the design of recommender systems. Although such data are of a high quality due to users’ voluntary provision of numerical ratings, collecting a sufficient amount in real-world service environments is typically infeasible. As an alternative, implicit feedback data are extensively used. However, because implicit feedback represents observable user actions rather than direct preference statements, it inherently suffers from ambiguity as a signal of true user preference. To address this issue, this study reinterprets the ambiguity of implicit feedback signals as a problem of epistemic uncertainty regarding user preferences and proposes a latent factor model that incorporates this uncertainty within a Bayesian framework. Specifically, the behavioral vector of a user, which is learned from implicit feedback, is restructured within the embedding space using attention mechanisms applied to the user’s interaction history, forming an implicit preference representation. Similarly, item feature vectors are reinterpreted in the context of the target user’s history, resulting in personalized item representations. This study replaces the deterministic attention scores with stochastic attention weights treated as random variables whose distributions are modeled using a Bayesian approach. Through this design, the proposed model effectively captures the uncertainty stemming from implicit feedback within the vector representations of users and items. The experimental results demonstrate that the proposed model not only effectively mitigates the ambiguity of preference signals inherent in implicit feedback data but also achieves better performance improvements than baseline models, particularly on datasets characterized by high user–item interaction sparsity. The proposed model, when integrated with an attention module, generally outperformed other MLP-based models in terms of NDCG@10. Moreover, incorporating the Bayesian attention mechanism yielded an additional performance gain of up to 0.0531 compared to the model using a standard attention module.
Source: crossref · Quality: baseline
Research context
OpenAlex topics: Data Stream Mining Techniques · Recommender Systems and Techniques · Advanced Bandit Algorithms Research
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
Affiliations
Department of Data Science, Kookmin University, Seoul 02707, Republic of Korea
Department of AI, Big Data & Management, Kookmin University, Seoul 02707, Republic of Korea
References (27)
Show source-provided references
1. Lerche, L. (2016). Using Implicit Feedback for Recommender Systems: Characteristics, Applications, and Challenges. [Ph.D. Thesis, TU Dortmund University].
2. Rendle, S., Freudenthaler, C., Gantner, Z., and Schmidt-Thieme, L. (2009, January 18–21). BPR: Bayesian Personalized Ranking from Implicit Feedback. Proceedings of the Twenty-Fifth Conference on Uncertainty in Artificial Intelligence (UAI’09), Montreal, QC, Canada.
3. Hu, Y., Koren, Y., and Volinsky, C. (2008, January 15–19). Collaborative Filtering for Implicit Feedback Datasets. Proceedings of the 2008 Eighth IEEE International Conference on Data Mining (ICDM 2008), Pisa, Italy.10.1109/ICDM.2008.22 ↗
4. Liang, D., Charlin, L., McInerney, J., and Blei, D.M. (2016, January 11–15). Modeling User Exposure in Recommendation. Proceedings of the 25th International Conference on World Wide Web (WWW 2016), Montreal, QC, Canada.10.1145/2872427.2883090 ↗
5. NAIS: Neural Attentive Item Similarity Model for Recommendation10.1109/TKDE.2018.2831682 ↗
6. Cui, C., Qin, J., and Ren, Q. (2022). Deep collaborative recommendation algorithm based on attention mechanism. Appl. Sci., 12.10.3390/app122010594 ↗
7. Salakhutdinov, R., and Mnih, A. (2008, January 5–9). Bayesian probabilistic matrix factorization using Markov chain Monte Carlo. Proceedings of the 25th International Conference on Machine Learning, Hensinki, Finland.10.1145/1390156.1390267 ↗
8. Liang, D., Krishnan, R.G., Hoffman, M.D., and Jebara, T. (2018, January 23–27). Variational autoencoders for collaborative filtering. Proceedings of the 2018 World Wide Web Conference, Lyon, France.10.1145/3178876.3186150 ↗
9. UIFRS-HAN: User interests-aware food recommender system based on the heterogeneous attention network10.1016/j.engappai.2024.108766 ↗
10. Forouzandeh, S., DW, P.M., and Jalili, M. (2025, January 24–28). DistillHGNN: A Knowledge Distillation Approach for High-Speed Hypergraph Neural Networks. Proceedings of the 13th International Conference on Learning Representations, Singapore.
11. Recommender Systems based on Non-negative Matrix Factorization: A Survey10.1109/TAI.2025.3559053 ↗
12. He, X., Liao, L., Zhang, H., Nie, L., Hu, X., and Chua, T.S. (2017, January 3–7). Neural Collaborative Filtering. Proceedings of the 26th International Conference on World Wide Web (WWW ’17), Perth, Australia.10.1145/3038912.3052569 ↗
13. Deng, Z.-H., Huang, L., Wang, C.-D., Lai, J.-H., and Yu, P.S. (February, January 27). DeepCF: A Unified Framework of Representation Learning and Matching Function Learning in Recommender System. Proceedings of the AAAI Conference on Artificial Intelligence (AAAI-19), Honolulu, HI, USA.
14. Luong, M.-T., Pham, H., and Manning, C.D. (2015, January 17–21). Effective Approaches to Attention-based Neural Machine Translation. Proceedings of the 2015 Conference on Empirical Methods in Natural Language Processing (EMNLP 2015), Lisbon, Portugal.10.18653/v1/D15-1166 ↗
15. Bahdanau, D., Cho, K., and Bengio, Y. (2015, January 7–9). Neural Machine Translation by Jointly Learning to Align and Translate. Proceedings of the 3rd International Conference on Learning Representations (ICLR 2015), San Diego, CA, USA.
16. Fan, X., Zhang, S., Chen, B., and Zhou, M. (2020, January 6–12). Bayesian Attention Modules. Proceedings of the Advances in Neural Information Processing Systems 33 (NeurIPS 2020), Vancouver, BC, Canada.
17. Deng, Y., Kim, Y., Chiu, J., Guo, D., and Rush, A.M. (2018, January 2–8). Latent Alignment and Variational Attention. Proceedings of the 32nd Conference on Neural Information Processing Systems (NeurIPS 2018), Montreal, QC, Canada.
18. Shankar, S., and Sarawagi, S. (2019, January 6–9). Posterior Attention Models for Sequence to Sequence Learning. Proceedings of the International Conference on Learning Representations (ICLR 2019), New Orleans, LA, USA.
19. Lawson, D., Chiu, C.-C., Tucker, G., Raffel, C., Swersky, K., and Jaitly, N. (2018, January 15–20). Learning Hard Alignments with Variational Inference. Proceedings of the 2018 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), Calgary, AB, Canada.10.1109/ICASSP.2018.8461977 ↗
20. He, G., Zhao, D., and Ding, L. (2021). Dual-embedding based Neural Collaborative Filtering for Recommender Systems. arXiv.
21. The MovieLens Datasets: History and Context10.1145/2827872 ↗
22. (2025, March 01). Last.fm Website. Available online: http://www.lastfm.com.
23. (2025, March 01). HatRec 2011|GroupLens Website. Available online: https://grouplens.org/datasets/hetrec-2011/.
24. Ni, J., Li, J., and McAuley, J. (2019, January 3–7). Justifying Recommendations using Distantly-Labeled Reviews and Fine-Grained Aspects. Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing (EMNLP-IJCNLP), Hong Kong, China.10.18653/v1/D19-1018 ↗
25. (2025, March 23). Amazon Review Data. Available online: https://cseweb.ucsd.edu/~jmcauley/datasets/amazon_v2/.
26. He, R., and McAuley, J. (2016, January 11–15). Ups and Downs: Modeling the Visual Evolution of Fashion Trends with One-Class Collaborative Filtering. Proceedings of the 25th International World Wide Web Conference (WWW 2016), Montreal, QC, Canada.10.1145/2872427.2883037 ↗
27. (2025, March 23). Amazon Product Data. Available online: https://cseweb.ucsd.edu/~jmcauley/datasets/amazon/links.html.