Gate Attentional Factorization Machines: An Efficient Neural Network Considering Both Accuracy and Speed
Source abstract
Abstract
Nowadays, to deal with the increasing data of users and items and better mine the potential relationship between the data, the model used by the recommendation system has become more and more complex. In this case, how to ensure the prediction accuracy and operation speed of the recommendation system has become an urgent problem. Deep neural network is a good solution to the problem of accuracy, we can use more network layers, more advanced feature cross way to improve the utilization of data. However, when the accuracy is guaranteed, little attention is paid to the speed problem. We can only pursue better machine efficiency, and we do not pay enough attention to the speed efficiency of the model itself. Some models with advantages in speed, such as PNN, are slightly inferior in accuracy. In this paper, the Gate Attention Factorization Machine (GAFM) model based on the double factors of accuracy and speed is proposed, and the structure of gate is used to control the speed and accuracy. Extensive experiments have been conducted on data sets in various application scenarios, and the results show that the GAFM model is better than the existing factorization machines in both speed and accuracy.
Source: crossref · Quality: baseline
Research context
OpenAlex topics: Recommender Systems and Techniques · Image Retrieval and Classification Techniques · Text and Document Classification Technologies
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
Affiliations
School of Mechanical and Information Engineering, Shandong University, Weihai 264209, China
Funding
National Natural Science Foundation of China
References (29)
Show source-provided references
1. Genius TV (2012). An Integrated Approach to TV & VOD Recommendations, Red Bee Media. Archived 6 June 2012 at the Wayback Machine.
2. Context-Based Collaborative Filtering for Citation Recommendation10.1109/ACCESS.2015.2481320 ↗
3. Deep Collaborative Filtering Based on Outer Product10.1109/ACCESS.2020.2992519 ↗
4. Shan, H., and Banerjee, A. (2010, January 13–17). Generalized probabilistic matrix factorizations for collaborative filtering. Proceedings of the IEEE International Conference on Data Mining, Sydney, Australia.10.1109/ICDM.2010.116 ↗
5. An efficient non-negative Matrix Factorization-Based approach to collaborative filtering for recommender systems10.1109/TII.2014.2308433 ↗
6. Grimm, L.G., and Yarnold, P.R. (1995). Logistic Regression. Reading and Understanding Multivariate Statistics, American Psychological Association.
7. Wide and Deep Convolutional Neural Networks for Electricity-Theft Detection to Secure Smart Grids10.1109/TII.2017.2785963 ↗
8. Vedaldi, A., and Lenc, K. (2015, January 26–30). Matconvnet: Convolutional neural networks for matlab. Proceedings of the 23rd ACM International Conference on Multimedia, Brisbane, Australia.10.1145/2733373.2807412 ↗
9. Mikolov, T., Karafiát, M., Burget, L., Cernocký, J., and Khudanpur, S. (2010, January 26–30). Recurrent neural network based language model. Proceedings of the Eleventh Annual Conference of the International Speech Communication Association, Chiba, Japan.10.21437/Interspeech.2010-343 ↗
10. Improvements in epoxy resin embedding methods10.1083/jcb.9.2.409 ↗
11. Zhang, W., Du, T., and Wang, J. (2016). Deep Learning over Multi-Field Categorical Data. European Conference on Information Retrieval, Springer.10.1007/978-3-319-30671-1_4 ↗
12. Using collaborative filtering to weave an information tapestry10.1145/138859.138867 ↗
13. Amazon.com recommendations: Item-to-item collaborative filtering10.1109/MIC.2003.1167344 ↗
14. Matrix factorization techniques for recommender systems10.1109/MC.2009.263 ↗
15. Rendle, S. (2010, January 13–17). Factorization machines. Proceedings of the 2010 IEEE International Conference on Data Mining, Sydney, Australia.10.1109/ICDM.2010.127 ↗
16. Sedhain, S., Menon, A.K., Sanner, S., and Xie, L. (2015, January 18–22). Autorec: Autoencoders meet collaborative filtering. Proceedings of the 24th International Conference on World Wide Web, Florence, Italy.10.1145/2740908.2742726 ↗
17. Shan, Y., Hoens, T.R., Jiao, J., Wang, H., Yu, D., and Mao, J.C. (2016, January 13–17). Deep crossing: Web-scale modeling without manually crafted combinatorial features. Proceedings of the 22nd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, San Francisco, CA, USA.10.1145/2939672.2939704 ↗
18. He, X., Liao, L., Zhang, H., Nie, L., Hu, X., and Chua, T.S. (2017, January 3–7). Neural collaborative filtering. Proceedings of the 26th International Conference on World Wide Web, Perth, Australia.10.1145/3038912.3052569 ↗
19. Qu, Y., Cai, H., Ren, K., Zhang, W., Yu, Y., Wen, Y., and Wang, J. (2016, January 12–15). Product-based neural networks for user response prediction. Proceedings of the 2016 IEEE 16th International Conference on Data Mining (ICDM), Barcelona, Spain.10.1109/ICDM.2016.0151 ↗
20. Cheng, H.T., Koc, L., Harmsen, J., Shaked, T., Chandra, T., Aradhye, H., Anderson, G., Corrado, G., Chai, W., and Ispir, M. (2016, January 15). Wide & deep learning for recommender systems. Proceedings of the 1st Workshop on Deep Learning for Recommender Systems, Boston, MA, USA.10.1145/2988450.2988454 ↗
21. Guo, H., Tang, R., Ye, Y., Li, Z., and He, X. (2017). DeepFM: A factorization-machine based neural network for CTR prediction. arXiv.10.24963/ijcai.2017/239 ↗
22. He, X., and Chua, T.S. (2017, January 7–11). Neural factorization machines for sparse predictive analytics. Proceedings of the 40th International ACM SIGIR Conference on Research and Development in Information Retrieval, Tokyo, Japan.10.1145/3077136.3080777 ↗
23. Xiao, J., Ye, H., He, X., Zhang, H., Wu, F., and Chua, T.S. (2017). Attentional factorization machines: Learning the weight of feature interactions via attention networks. arXiv.10.24963/ijcai.2017/435 ↗
24. Sunil Ray (2015). 8 Proven Ways for improving the “Accuracy” of a Machine Learning Model. Anal. Vidhya, 12, Available online: https://www.analyticsvidhya.com/blog/2015/12/improve-machine-learning-results/.
25. Sample Size for Binary Logistic Prediction Models: Beyond Events Per Variable Criteria10.1177/0962280218784726 ↗
26. Juba, B., and Le, H.S. (2018). Precision-Recall versus Accuracy and the Role of Large Data Sets, Association for the Advancement of Artificial Intelligence.10.1609/aaai.v33i01.33014039 ↗
27. Lei, S., Zhang, H., Wang, K., and Su, Z. (2019, January 6–13). How Training Data Affect the Accuracy and Robustness of Neural Networks for Image Classification. Proceedings of the International Conference on Learning Representations, New Orleans, LA, USA.
28. Kohavi, R., and Becker, B. (2005, February 17). UCI Machine Learning Repository: Adult Data Set [EB/OL]. (1996-05-01). Available online: https://archive.ics.uci.edu/ml/datasets/adult.
29. The MovieLens Datasets: History and Context10.1145/2827872 ↗