journal article·2020-04-03Open access

Deep Learning Architecture for Collaborative Filtering Recommender Systems

Jesus Bobadilla, Santiago Alonso, Antonio Hernando

Applied Sciences· Volume 10· Issue 7

Abstract

This paper provides an innovative deep learning architecture to improve collaborative filtering results in recommender systems. It exploits the potential of the reliability concept to raise predictions and recommendations quality by incorporating prediction errors (reliabilities) in the deep learning layers. The underlying idea is to recommend highly predicted items that also have been found as reliable ones. We use the deep learning architecture to extract the existing non-linear relations between predictions, reliabilities, and accurate recommendations. The proposed architecture consists of three related stages, providing three stacked abstraction levels: (a) real prediction errors, (b) predicted errors (reliabilities), and (c) predicted ratings (predictions). In turn, each abstraction level requires a learning process: (a) Matrix Factorization from ratings, (b) Multilayer Neural Network fed with real prediction errors and hidden factors, and (c) Multilayer Neural Network fed with reliabilities and hidden factors. A complete set of experiments has been run involving three representative and open datasets and a state-of-the-art baseline. The results show strong prediction improvements and also important recommendation improvements, particularly for the recall quality measure.
Source: crossref · Quality: baseline

Research context

OpenAlex topics: Recommender Systems and Techniques · Advanced Bandit Algorithms Research · Image and Video Quality Assessment

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

Dpto. Sistemas Informáticos, Escuela Técnica Superior de Ingeniería de Sistemas Informáticos, Universidad Politécnica de Madrid, 28031 Madrid, Spain

References (35)

Show source-provided references
1. Dong, X., Yu, L., Wu, Z., Sun, Y., Yuan, L., and Zhang, F. (2017, January 4–9). A Hybrid Collaborative Filtering Model with Deep Structure for Recommender Systems. Proceedings of the Thirty-First AAAI Conference on Artificial Intelligence, San Francisco, CA, USA. Available online: https://aaai.org/ocs/index.php/AAAI/AAAI17/paper/view/14676.10.1609/aaai.v31i1.10747 ↗
2. A Framework for Collaborative, Content-Based and Demographic Filtering10.1023/A:1006544522159 ↗
3. Ebesu, T., and Fang, Y. (2017, January 7–11). Neural Citation Network for Context-Aware Citation Recommendation. Proceedings of the 40th International ACM SIGIR Conference on Research and Development in Information Retrieval, Tokyo, Japan.10.1145/3077136.3080730 ↗
4. Musto, C., Greco, C., Suglia, A., and Semeraro, G. (2016, January 7–10). Askme Any Rating: A Content-Based Recommender System Based on Recurrent Neural Networks. Proceedings of the IIR, Venezia, Italy.
5. Wang, X., He, X., Nie, L., and Chua, T.-S. (2017, January 7–11). Item Silk Road. Proceedings of the 40th International ACM SIGIR Conference on Research and Development in Information Retrieval, Tokyo, Japan.10.1145/3077136.3080771 ↗
6. Yang, C., Bai, L., Zhang, C., Yuan, Q., and Han, J. (2017, January 20–24). Bridging Collaborative Filtering and Semi-Supervised Learning. Proceedings of the 23rd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, Halifax, NS, Canada.10.1145/3097983.3098094 ↗
7. Yi, B., Shen, X., Zhang, Z., Shu, J., and Liu, H. (2016, January 15–17). Expanded Autoencoder Recommendation Framework and Its Application in Movie Recommendation. Proceedings of the 2016 10th International Conference on Software, Knowledge, Information Management & Applications (SKIMA), Chengdu, China.10.1109/SKIMA.2016.7916236 ↗
8. A hybrid recommendation system considering visual information for predicting favorite restaurants10.1007/s11280-017-0437-1 ↗
9. He, R., and McAuley, J. (2016, January 11–15). Ups and Downs. Proceedings of the 25th International Conference on World Wide Web, Montreal, QC, Canada.10.1145/2872427.2883037 ↗
10. Hsieh, C.-K., Yang, L., Wei, H., Naaman, M., and Estrin, D. (2016, January 11–15). Immersive Recommendation. Proceedings of the 25th International Conference on World Wide Web, Montreal, QC, Canada.10.1145/2872427.2883006 ↗
11. Deep Probabilistic Matrix Factorization Framework for Online Collaborative Filtering10.1109/ACCESS.2019.2900698 ↗
12. Deep Learning Based Recommender System10.1145/3158369 ↗
13. A Survey of Recommender Systems Based on Deep Learning10.1109/ACCESS.2018.2880197 ↗
14. Wang, X., Yu, L., Ren, K., Tao, G., Zhang, W., Yu, Y., and Wang, J. (2017, January 20–24). Dynamic Attention Deep Model for Article Recommendation by Learning Human Editors’ Demonstration. Proceedings of the 23rd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, Halifax, NS, Canada.10.1145/3097983.3098096 ↗
15. Liang, D., Zhan, M., and Ellis, D.P. (2015, January 26–30). Content Aware Collaborative Music Recommendation Using Pre-Trained Neural Networks. Proceedings of the 16th International Society for Music Information Retrieval Conference, ISMIR, Málaga, Spain.
16. Wang, X., and Wang, Y. (2014, January 3–7). Improving Content-Based and Hybrid Music Recommendation Using Deep Learning. Proceedings of the 22nd ACM International Conference on Multimedia, Orlando, FL, USA.10.1145/2647868.2654940 ↗
17. Chen, J., Zhang, H., He, X., Nie, L., Liu, W., and Chua, T.-S. (2017, January 7–11). Attentive Collaborative Filtering. Proceedings of the 40th International ACM SIGIR Conference on Research and Development in Information Retrieval, Tokyo, Japan.10.1145/3077136.3080797 ↗
18. Chen, X., Zhang, Y., Ai, Q., Xu, H., Yan, J., and Qin, Z. (2017, January 7–11). Personalized Key Frame Recommendation. Proceedings of the 40th International ACM SIGIR Conference on Research and Development in Information Retrieval, Tokyo, Japan.10.1145/3077136.3080776 ↗
19. Tang, J., and Wang, K. (2018, January 5–9). Personalized Top-N Sequential Recommendation via Convolutional Sequence Embedding. Proceedings of the Eleventh ACM International Conference on Web Search and Data Mining, Los Angeles, CA, USA.10.1145/3159652.3159656 ↗
20. Suglia, A., Greco, C., Musto, C., De Gemmis, M., Lops, P., and Semeraro, G. (2017, January 9–12). A Deep Architecture for Content-Based Recommendations Exploiting Recurrent Neural Networks. Proceedings of the 25th Conference on User Modeling, Adaptation and Personalization, Bratislava, Slovakia.10.1145/3079628.3079684 ↗
21. Alashkar, T., Jiang, S., Wang, S., and Fu, Y. (2017, January 4–9). Examples-Rules Guided Deep Neural Network for Makeup Recommendation. Proceedings of the Thirty-First AAAI Conference on Artificial Intelligence, San Francisco, CA, USA.10.1609/aaai.v31i1.10626 ↗
22. Zhang, S., Yao, L., and Xu, X. (2017, January 7–11). AutoSVD++. Proceedings of the 40th International ACM SIGIR Conference on Research and Development in Information Retrieval, Tokyo, Japan.10.1145/3077136.3080689 ↗
23. Guo, H., Tang, R., Ye, Y., Li, Z., and He, X. (2017, January 19–25). DeepFM: A Factorization-Machine Based Neural Network for CTR Prediction. Proceedings of the Twenty-Sixth International Joint Conference on Artificial Intelligence, Toronto, ON, Canada.10.24963/ijcai.2017/239 ↗
24. He, X., Liao, L., Zhang, H., Nie, L., Hu, X., and Chua, T.-S. (2017, January 3–7). Neural Collaborative Filtering. Proceedings of the 26th International Conference on World Wide Web Companion, Perth, Australia.10.1145/3038912.3052569 ↗
25. Dziugaite, G.K., and Roy, D.M. (2015). Neural Network Matrix Factorization. arXiv.
26. Cheng, H.-T., Ispir, M., Anil, R., Haque, Z., Hong, L., Jain, V., Liu, X., Shah, H., Koc, L., and Harmsen, J. (2016, January 15). Wide & Deep Learning for Recommender Systems. Proceedings of the 1st Workshop on Deep Learning for Recommender Systems, Boston, MA, USA.10.1145/2988450.2988454 ↗
27. Wide and Deep Model of Multi-Source Information-Aware Recommender System10.1109/ACCESS.2018.2868083 ↗
28. Rendle, S. (2010, January 13–17). Factorization Machines. Proceedings of the 2010 IEEE International Conference on Data Mining, Sydney, NSW, Australia.10.1109/ICDM.2010.127 ↗
29. A deeper graph neural network for recommender systems10.1016/j.knosys.2019.105020 ↗
30. A novel deep multi-criteria collaborative filtering model for recommendation system10.1016/j.knosys.2019.06.019 ↗
31. Classification-based Deep Neural Network Architecture for Collaborative Filtering Recommender Systems
32. Assigning reliability values to recommendations using matrix factorization10.1016/j.jocs.2018.04.009 ↗
33. The MovieLens Datasets10.1145/2827872 ↗
34. Golbeck, J., and Hendler, J. (2006, January 8–10). FilmTrust: Movie Recommendations Using Trust in Web-Based Social Networks. Proceedings of the 3rd IEEE Consumer Communications and Networking Conference, Las Vegas, NV, USA.
35. CF4J: Collaborative filtering for Java10.1016/j.knosys.2018.04.008 ↗