An Image Recommendation Algorithm Based on Target Alternating Attention and User Affiliation Network
Source abstract
Abstract
Currently, how to exploit the deep features of images in image recommender systems to achieve image enhancement still needs further research. In addition, little research has explored the implicit and increasing preferences of users by using the affiliation generated by indirect users and virtual users of the main users, which leads to the phenomenon of information cocoon. An Image Recommendation Algorithm Based on Target Alternating Attention and User Affiliation Network (TAUA) is proposed in this paper that addresses the problems of inadequate extraction of semantic features in an image and information cocoon in image recommender systems. First, to complete the multi-dimensional description of the image, we extract the category, color, and style features of the image through a multi-channel convolutional neural network (MCNN), and we then perform migration and integration on these features. Then, to enhance the pixel-level representation ability of the image and achieve image feature enhancement, we propose target alternating attention to capture the information of surrounding pixels alternately from inside to outside. Finally, a user affiliation network, including indirect users and virtual users, is established according to the user behavior and transaction record, and the users’ increasing preferences and affiliated users are mined through the implicit interaction relationship of users. Experimental results show that compared with baselines on the Amazon dataset, the results of F@10, NDCG@10, and AUC of the proposed algorithm are 4.02%, 5.00%, and 2.14% higher than those of ACF, and 5.76%, 0.86% and 1.16% higher than those of VPOI. On the Flickr dataset, our algorithm outperforms ACF by 5.74%, 5.12%, and 3.68% in F@10, NDCG@10, and AUC, respectively, and outperforms VPOI by 0.45%, 0.47%, and 0.49%. TAUA has better recommendation performance and can significantly improve the recommendation effect.
Source: crossref · Quality: baseline
Research context
OpenAlex topics: Image Retrieval and Classification Techniques · Advanced Image and Video Retrieval Techniques · Visual Attention and Saliency Detection
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
Affiliations
School of Electrical and Information Engineering, Beijing University of Civil Engineering and Architecture, Beijing 100044, China
Beijing Key Laboratory of Intelligent Processing for Building Big Data, Beijing 100044, China
School of Geomatics and Urban Spatial Informatics, Beijing University of Civil Engineering and Architecture, Beijing 100044, China
Network Information Center, Beijing University of Civil Engineering and Architecture, Beijing 100044, China
Funding
National Natural Science Foundation of China · Education and Research Project of Beijing University of Civil Engineering and Architecture · Postgraduate Education and Teaching Quality Improvement Project of Beijing University of Civil Engineering and Architecture, China · BUCEA Post Graduate Innovation Project
References (68)
Show source-provided references
1. Warren, J. (2015). Big Data: Principles and Best Practices of Scalable Realtime Data Systems, Manning.
2. Information without knowledge: The effects of Internet search on learning10.1080/09658211.2021.1882501 ↗
3. Ricci, F., Rokach, L., and Shapira, B. (2015). Recommender Systems Handbook, Springer.10.1007/978-1-4899-7637-6 ↗
4. Bollen, D., Knijnenburg, B.P., Willemsen, M.C., and Graus, M. (2010, January 26–30). Understanding choice overload in recommender systems. Proceedings of the Fourth ACM Conference on Recommender Systems, Barcelona, Spain.10.1145/1864708.1864724 ↗
5. How to crack the information cocoon room under the background of intelligent media
6. Long, J., Shelhamer, E., and Darrell, T. (2015, January 7–12). Fully convolutional networks for semantic segmentation. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Boston, MA, USA.10.1109/CVPR.2015.7298965 ↗
7. Deeplab: Semantic image segmentation with deep convolutional nets, atrous convolution, and fully connected crfs10.1109/TPAMI.2017.2699184 ↗
8. Dai, J., Qi, H., Xiong, Y., Li, Y., Zhang, G., Hu, H., and Wei, Y. (2017, January 22–29). Deformable convolutional networks. Proceedings of the IEEE International Conference on Computer Vision, Venice, Italy.10.1109/ICCV.2017.89 ↗
9. Zhang, H., Dana, K., Shi, J., Zhang, Z., Wang, X., Tyagi, A., and Agrawal, A. (2018, January 18–22). Context encoding for semantic segmentation. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Salt Lake City, UT, USA.10.1109/CVPR.2018.00747 ↗
10. Huang, Z., Wang, X., Huang, L., Huang, C., Wei, Y., and Liu, W. (November, January 27). Ccnet: Criss-cross attention for semantic segmentation. Proceedings of the IEEE/CVF International Conference on Computer Vision, Seoul, Republic of Korea.
11. Ruder, S. (2017). An overview of multi-task learning in deep neural networks. arXiv.
12. Liu, S., Song, Z., Wang, M., Xu, C., Lu, H., and Yan, S. (November, January 29). Street-to-shop: Cross-scenario clothing retrieval via parts alignment and auxiliary set. Proceedings of the 20th ACM International Conference on Multimedia, Nara, Japan.
13. Bossard, L., Dantone, M., Leistner, C., Wengert, C., Quack, T., and Van Gool, L. (2012, January 5–9). Apparel classification with style. Proceedings of the Computer Vision–ACCV 2012: 11th Asian Conference on Computer Vision, Daejeon, Republic of Korea. Revised Selected Papers, Part IV 11.10.1007/978-3-642-37447-0_25 ↗
14. Li, D., Chen, X., and Huang, K. (2017, January 26–29). Multi-attribute learning for pedestrian attribute recognition in surveillance scenarios. Proceedings of the 2015 3rd IAPR Asian Conference on Pattern Recognition (ACPR), Kuala Lumpur, Malaysia.10.1109/ACPR.2015.7486476 ↗
15. Ak, K.E., Lim, J.H., Tham, J.Y., and Kassim, A.A. (2018, January 12–15). Efficient multi-attribute similarity learning towards attribute-based fashion search. Proceedings of the 2018 IEEE Winter Conference on Applications of Computer Vision (WACV), Lake Tahoe, NV, USA.10.1109/WACV.2018.00186 ↗
16. Multi-scale weight sharing network for image recognition10.1016/j.patrec.2020.01.011 ↗
17. Szegedy, C., Liu, W., Jia, Y., Sermanet, P., Reed, S., Anguelov, D., Erhan, D., Vanhoucke, V., and Rabinovich, A. (2015, January 7–12). Going deeper with convolutions. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Boston, MA, USA.10.1109/CVPR.2015.7298594 ↗
18. Spatial pyramid pooling in deep convolutional networks for visual recognition10.1109/TPAMI.2015.2389824 ↗
19. Multi-task CNN model for attribute prediction10.1109/TMM.2015.2477680 ↗
20. Imagenet classification with deep convolutional neural networks10.1145/3065386 ↗
21. McAuley, J., Targett, C., Shi, Q., and Van Den Hengel, A. (2015, January 9–13). Image-based recommendations on styles and substitutes. Proceedings of the 38th International ACM SIGIR Conference on Research and Development in Information Retrieval, Santiago, Chile.10.1145/2766462.2767755 ↗
22. ARPCNN: Auxiliary Review-Based Personalized Attentional CNN for Trustworthy Recommendation10.1109/TII.2022.3169552 ↗
23. TDCTFIC: A novel recommendation framework fusing temporal dynamics, CNN-based text features and item correlation10.1587/transinf.2019EDP7014 ↗
24. Yu, W., Zhang, H., He, X., Chen, X., Xiong, L., and Qin, Z. (2018, January 23–27). Aesthetic-based clothing recommendation. Proceedings of the 2018 World Wide Web Conference, Lyon, France.10.1145/3178876.3186146 ↗
25. Geng, X., Zhang, H., Bian, J., and Chua, T.-S. (2015, January 13–16). Learning image and user features for recommendation in social networks. Proceedings of the IEEE International Conference on Computer Vision, Santiago, Chile.10.1109/ICCV.2015.486 ↗
26. Sha, D., Wang, D., Zhou, X., Feng, S., Zhang, Y., and Yu, G. (2016, January 3–5). An approach for clothing recommendation based on multiple image attributes. Proceedings of the Web-Age Information Management: 17th International Conference, WAIM 2016, Nanchang, China. Part I 17.
27. Review of image low-level feature extraction methods for content-based image retrieval10.1108/SR-04-2019-0092 ↗
28. Global and local contrastive self-supervised learning for semantic segmentation of HR remote sensing images
29. Gatys, L.A., Ecker, A.S., and Bethge, M. (2015). A neural algorithm of artistic style. arXiv.10.1167/16.12.326 ↗
30. Cao, Z., Shaomin, M., Yongyu, X., and Dong, M. (2018, January 14–17). Image retrieval method based on CNN and dimension reduction. Proceedings of the 2018 International Conference on Security, Pattern Analysis, and Cybernetics (SPAC), Jinan, China.10.1109/SPAC46244.2018.8965601 ↗
31. Squeeze-and-Excitation Networks10.1109/TPAMI.2019.2913372 ↗
32. Chen, L.-C., Yang, Y., Wang, J., Xu, W., and Yuille, A.L. (July, January 26). Attention to scale: Scale-aware semantic image segmentation. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Las Vegas, NV, USA.
33. Vaswani, A., Shazeer, N., Parmar, N., Uszkoreit, J., Jones, L., Gomez, A.N., Kaiser, Ł., and Polosukhin, I. (2018). Advances In Neural Information Processing Systems 30, Proceedings of the 31st Annual Conference on Neural Information Processing Systems (NIPS 2017), Long Beach, CA, USA, 4–9 December 2017, Curran Associates, Inc.
34. Zhao, H., Zhang, Y., Liu, S., Shi, J., Loy, C.C., Lin, D., and Jia, J. (2018, January 8–14). Psanet: Point-wise spatial attention network for scene parsing. Proceedings of the European Conference on Computer Vision (ECCV), Munich, Germany.10.1007/978-3-030-01240-3_17 ↗
35. Wang, X., Girshick, R., Gupta, A., and He, K. (2018, January 18–22). Non-local neural networks. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Salt Lake City, UT, USA.10.1109/CVPR.2018.00813 ↗
36. Yang, M., Yu, K., Zhang, C., Li, Z., and Yang, K. (2018, January 18–22). Denseaspp for semantic segmentation in street scenes. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Salt Lake City, UT, USA.10.1109/CVPR.2018.00388 ↗
37. Zhao, H., Shi, J., Qi, X., Wang, X., and Jia, J. (2017, January 22–25). Pyramid scene parsing network. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Honolulu, HI, USA.10.1109/CVPR.2017.660 ↗
38. Liu, Z., Li, X., Ping, L., Chen, C.L., and Tang, X. (2015, January 13–16). Semantic Image Segmentation via Deep Parsing Network. Proceedings of the 2015 IEEE International Conference on Computer Vision (ICCV), Santiago, Chile.10.1109/ICCV.2015.162 ↗
39. Yuan, Y., Huang, L., Guo, J., Zhang, C., Chen, X., and Wang, J. (2018). Ocnet: Object context network for scene parsing. arXiv.
40. Fu, J., Liu, J., Tian, H., Li, Y., Bao, Y., Fang, Z., and Lu, H. (2019, January 16–20). Dual attention network for scene segmentation. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, Long Beach, CA, USA.10.1109/CVPR.2019.00326 ↗
41. Gahier, A.K., and Gujral, S.K. (2021, January 20–21). Cross Domain Recommendation Systems using Deep Learning: A Systematic Literature Review. Proceedings of the International Conference on Innovative Computing & Communication (ICICC), Delhi, India.10.2139/ssrn.3884919 ↗
42. User identity linkage across online social networks: A review10.1145/3068777.3068781 ↗
43. Cross domain recommender systems: A systematic literature review10.1145/3073565 ↗
44. Singh, A.P., and Gordon, G.J. (2008, January 24–27). Relational learning via collective matrix factorization. Proceedings of the 14th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, Las Vegas, NV, USA.10.1145/1401890.1401969 ↗
45. Pan, W., Xiang, E., Liu, N., and Yang, Q. (March, January 22). Transfer learning in collaborative filtering for sparsity reduction. Proceedings of the AAAI Conference on Artificial Intelligence, Virtually.
46. Li, B., Yang, Q., and Xue, X. (2009, January 11–17). Can movies and books collaborate? cross-domain collaborative filtering for sparsity reduction. Proceedings of the Twenty-First International Joint Conference on Artificial Intelligence, Pasadena, CA, USA.
47. Li, B., Yang, Q., and Xue, X. (2009, January 14–18). Transfer learning for collaborative filtering via a rating-matrix generative model. Proceedings of the 26th Annual International Conference on Machine Learning, Montreal, QC, Canada.10.1145/1553374.1553454 ↗
48. On deep neural network for trust aware cross domain recommendations in E-commerce10.1016/j.eswa.2021.114757 ↗
49. Cross-domain recommendation based on latent factor alignment10.1007/s00521-021-05737-w ↗
50. Mobile app cross-domain recommendation with multi-graph neural network10.1145/3442201 ↗
51. Collaborative filtering with a deep adversarial and attention network for cross-domain recommendation10.1016/j.ins.2021.02.009 ↗
52. Birds of a Feather: Homophily in Social Networks10.1146/annurev.soc.27.1.415 ↗
53. Merging user social network into the random walk model for better group recommendation10.1007/s10489-018-1375-z ↗
54. Research of social recommendation based on social tag and trust relation10.1007/s10586-017-0962-9 ↗
55. How friends affect user behaviors? An exploration of social relation analysis for recommendation10.1016/j.knosys.2015.08.005 ↗
56. Ni, J., Li, J., and McAuley, J. (2019, January 3–7). Justifying recommendations using distantly-labeled reviews and fine-grained aspects. Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing (EMNLP-IJCNLP), Hong Kong, China.10.18653/v1/D19-1018 ↗
57. Krasin, I., Duerig, T., Alldrin, N., Ferrari, V., Abu-El-Haija, S., Kuznetsova, A., Rom, H., Uijlings, J., Popov, S., and Veit, A. (2023, March 26). Openimages: A Public Dataset for Large-Scale Multi-Label and Multi-Class Image Classification. Available online: https://github.com/openimages.
58. Visual Semantic Image Recommendation10.1109/ACCESS.2019.2900396 ↗
59. Zhu, Y., Ge, K., Zhuang, F., Xie, R., Xi, D., Zhang, X., Lin, L., and He, Q. (2021, January 11–15). Transfer-meta framework for cross-domain recommendation to cold-start users. Proceedings of the 44th International ACM SIGIR Conference on Research and Development in Information Retrieval, Virtual Event Canada.10.1145/3404835.3463010 ↗
60. Rendle, S., Freudenthaler, C., Gantner, Z., and Schmidt-Thieme, L. (2012). BPR: Bayesian personalized ranking from implicit feedback. arXiv.
61. He, R., and McAuley, J. (March, January 22). VBPR: Visual bayesian personalized ranking from implicit feedback. Proceedings of the AAAI Conference on Artificial Intelligence, Virtually.
62. Kang, W.-C., Fang, C., Wang, Z., and McAuley, J. (2017, January 18–21). Visually-aware fashion recommendation and design with generative image models. Proceedings of the 2017 IEEE International Conference on Data Mining (ICDM), New Orleans, LA, USA.10.1109/ICDM.2017.30 ↗
63. Chen, J., Zhang, H., He, X., Nie, L., Liu, W., and Chua, T.-S. (2017, January 7–11). Attentive collaborative filtering: Multimedia recommendation with item-and component-level attention. Proceedings of the 40th International ACM SIGIR Conference on Research and Development in Information Retrieval, Tokyo, Japan.10.1145/3077136.3080797 ↗
64. Wang, S., Wang, Y., Tang, J., Shu, K., Ranganath, S., and Liu, H. (2017, January 3–7). What your images reveal: Exploiting visual contents for point-of-interest recommendation. Proceedings of the 26th International Conference on World Wide Web, Perth, Australia.10.1145/3038912.3052638 ↗
65. Regression shrinkage and selection via the lasso10.1111/j.2517-6161.1996.tb02080.x ↗
66. Sundheim, B.M. (1992, January 16–18). Overview of the fourth message understanding evaluation and conference. Proceedings of the 4th Conference on Message Understanding, McLean, VA, USA.10.3115/1072064.1072066 ↗
67. Cumulated gain-based evaluation of IR techniques10.1145/582415.582418 ↗
68. AUC: A misleading measure of the performance of predictive distribution models10.1111/j.1466-8238.2007.00358.x ↗