journal article·2021-10-16Open access

A Two-Phase Deep Learning-Based Recommender System: Enhanced by a Data Quality Inspector

William Lemus Leiva, Meng-Lin Li, Chieh-Yuan Tsai

Applied Sciences· Volume 11· Issue 20

Abstract

Research regarding collaborative filtering recommenders has grown fast lately. However, little attention has been paid to discuss how the input data quality impacts the result. Indeed, some review-rating pairs that a user gave to an item are inconsistent and express a different opinion, making the recommendation result biased. To solve the above drawback, this study proposes a two-phase deep learning-based recommender system. Firstly, a sentiment predictor of textual reviews is created, serving as the quality inspector that cleans and improves the input for a recommender. To build accurate predictors, this phase tries and compares a set of deep learning-based algorithms. Secondly, besides only exploiting the consistent review-rating pairs generated by the quality inspector, this phase builds deep learning-based recommender engines. The experiments on a real-world dataset showed the proposed data quality inspector, based on textual reviews, improves the overall performance of recommenders. On average, applying deep learning-based quality inspectors result in an above 6% improvement in RMSE, and more than a 2% boost in F1 score, and accuracy. This is robust evidence to prove the importance of the input data cleaning process in this field. Moreover, empirical evidence indicates the deep learning approach is suitable for modeling the sentiment predictor, and the core recommendation process, clearly outperforming the traditional machine learning methods.
Source: crossref · Quality: baseline

Research context

OpenAlex topics: Recommender Systems and Techniques · Sentiment Analysis and Opinion Mining · Spam and Phishing Detection

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

Department of Industrial Engineering and Management, Yuan-Ze University, Taoyuan City 320, Taiwan

References (57)

Show source-provided references
1. Hybrid recommender systems: A systematic literature review
2. Monitoring human website interactions for online stores10.1007/978-3-319-16528-8_35 ↗
3. Zins, A.-H., and Bauernfeind, U. (2005, January 26–28). Explaining online purchase planning experiences with recommender websites. Proceedings of the 12th International Conference on Information and Communication Technologies in Travel and Tourism, Innsbruck, Austria.
4. Tsai, C.-Y., Chiu, Y.-F., and Chen, Y.-J. (2021). A Two-Stage Neural Network-Based Cold Start Item Recommender. Appl. Sci., 11.10.3390/app11094243 ↗
5. How consumers attend to online reviews: An eye-tracking and network analysis approach10.1080/02650487.2019.1617651 ↗
6. Sulikowski, P., Zdziebko, T., Coussement, K., Dyczkowski, K., Kluza, K., and Sachpazidu-Wójcicka, K. (2021). Gaze and Event Tracking for Evaluation of Recommendation-Driven Purchase. Sensors, 21.10.3390/s21041381 ↗
7. A literature review and classification of recommender systems research10.1016/j.eswa.2012.02.038 ↗
8. A hybrid neural network approach to combine textual information and rating information for item recommendation10.1007/s10115-020-01528-2 ↗
9. A systematic survey on collaborator finding systems in scientific social networks10.1007/s10115-020-01483-y ↗
10. Recommender systems survey10.1016/j.knosys.2013.03.012 ↗
11. Recommender systems based on user reviews: The state of the art10.1007/s11257-015-9155-5 ↗
12. Approaches, issues and challenges in recommender systems: A systematic review
13. A survey of active learning in collaborative filtering recommender systems10.1016/j.cosrev.2016.05.002 ↗
14. A review on deep learning for recommender systems: Challenges and remedies10.1007/s10462-018-9654-y ↗
15. Raghavan, S., Gunasekar, S., and Ghosh, J. (2012, January 9–13). Review quality aware collaborative filtering. Proceedings of the 6th ACM Conference on Recommender Systems, Dublin, Ireland.10.1145/2365952.2365978 ↗
16. Pero, Š., and Horváth, T. (2013, January 10–14). Opinion-driven matrix factorization for rating prediction. Proceedings of the 21st International Conference on User Modeling, Adaptation, and Personalization, Rome, Italy.10.1007/978-3-642-38844-6_1 ↗
17. Dang, C.-N., Moreno-García, M.-N., and Prieta, F.D.L. (2021). An Approach to Integrating Sentiment Analysis into Recommender Systems. Sensors, 21.10.20944/preprints202107.0070.v1 ↗
18. Sedhain, S., Menon, A., Sanner, S., and Xie, L. (2015, January 18–22). Autorec: Autoencoders meet collaborative filtering. Proceedings of the 24th International Conference on World Wide Web, Florence, Italy.10.1145/2740908.2742726 ↗
19. Zheng, Y., Tang, B., Ding, W., and Zhou, H. (2016, January 19–24). A neural autoregressive approach to collaborative filtering. Proceedings of the 33rd International Conference on Machine Learning, New York, NY, USA.10.1145/2988450.2988453 ↗
20. Du, C., Li, C., Zheng, Y., Zhu, J., Liu, C., Zhou, H., and Zhang, B. (2018, January 2–7). Collaborative filtering with user-item co-autoregressive models. Proceedings of the Thirty-Second AAAI Conference on Artificial Intelligence, New Orleans, LA, USA.10.1609/aaai.v32i1.11884 ↗
21. He, X., Liao, L., Zhang, H., Nie, L., Hu, X., and Chua, T. (2017, January 3–7). Neural Collaborative Filtering. Proceedings of the 26th International Conference on World Wide Web, Perth, Australia.10.1145/3038912.3052569 ↗
22. New avenues in opinion mining and sentiment analysis10.1109/MIS.2013.30 ↗
23. Collobert, R. (2011, January 11–13). Deep learning for efficient discriminative parsing. Proceedings of the 14th International Conference on Artificial Intelligence and Statistics, Ft. Lauderdale, FL, USA.
24. Deep learning sentiment analysis for recommendations in social applications
25. Kim, Y. (2014, January 25–29). Convolutional neural networks for sentence classification. Proceedings of the 2014 Conference on Empirical Methods in Natural Language Processing, Doha, Qatar.10.3115/v1/D14-1181 ↗
26. Xue, B., Fu, C., and Shaobin, Z. (July, January 27). A study on sentiment computing and classification of sina weibo with word2vec. Proceedings of the 2014 IEEE International Congress on Big Data, Anchorage, AK, USA.10.1109/BigData.Congress.2014.59 ↗
27. Dos Santos, C., Xiang, B., and Zhou, B. (2015, January 26–31). Classifying relations by ranking with convolutional neural networks. Proceedings of the 53rd Annual Meeting of the ACL and the 7th International Joint Conference on Natural Language Processing, Beijing, China.10.3115/v1/P15-1061 ↗
28. Factorization machines and deep views-based co-training for improving answer quality prediction in online health expert question-answering services10.1016/j.jbi.2018.09.011 ↗
29. Bahdanau, D., Cho, K., and Bengio, Y. (2014, January 14–16). Neural machine translation by jointly learning to align and translate. Proceedings of the International Conference on Learning Representations ICLR, Banff, AB, Canada.
30. Yang, Z., Yang, D., Dyer, C., He, X., Smola, A., and Hovy, E. (2016, January 12–17). Hierarchical attention networks for document classification. Proceedings of the 2016 Conference of the North American Chapter of the ACL: Human Language Technologies, San Diego, CA, USA.10.18653/v1/N16-1174 ↗
31. Vaswani, A., Shazeer, N., Parmar, N., Uszkoreit, J., Jones, L., Gomez, A., Kaiser, L., and Polosukhin, I. (2017, January 4–9). Attention is all you need. Proceedings of the 31st Conference on Neural Information Processing Systems, Long Beach, CA, USA.
32. Devlin, J., Chang, M., Lee, K., and Toutanova, K. (2019, January 3–7). BERT: Pre-training of deep bidirectional transformers for language understanding. Proceedings of the Annual Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Minneapolis, MN, USA.
33. Movie recommendation system using sentiment analysis from microblogging data10.1109/TCSS.2020.2993585 ↗
34. A survey of collaborative filtering techniques10.1155/2009/421425 ↗
35. Barriere, V., and Kembellec, G. (2018, January 3–5). Short review of sentiment-based recommender systems. Proceedings of the 1st ACM International Digital Tools & Uses Congress, Paris, France.10.1145/3240117.3240120 ↗
36. Leung, C., Chan, S., and Chung, F. (2006, January 28–29). Integrating collaborative filtering and sentiment analysis: A rating inference approach. Proceedings of the ECAI 2006 Workshop on Recommender Systems, Riva del Garda, Italy.
37. Generating virtual ratings from Chinese reviews to augment online recommendations
38. Poirier, D., Fessant, F., and Tellier, I. (September, January 31). Reducing the cold-start problem in content recommendation through opinion classification. Proceedings of the 2010 IEEE/WIC/ACM International Conference on Web Intelligence and Intelligent Agent Technology, Toronto, ON, Canada.10.1109/WI-IAT.2010.87 ↗
39. Ozsoy, M.-G. (2016). From word embeddings to item recommendation. arXiv.
40. Ozsoy, M.-G. (2020). Utilizing fasttext for venue recommendation. arXiv.
41. Alexandridis, G., Siolas, G., and Stafylopatis, A. (2017). ParVecMF: A paragraph vector-based matrix factorization recommender system. arXiv.
42. Alexandridis, G., Tagaris, T., Siolas, G., and Stafylopatis, A. (2019, January 13–17). From free-text user reviews to product recommendation using paragraph vectors and matrix factorization. Proceedings of the 2019 World Wide Web Conference, San Francisco, CA, USA.10.1145/3308560.3316601 ↗
43. Shin, D., Cetintas, S., Lee, K., and Dhillon, I. (2015, January 18–23). Tumblr blog recommendation with boosted inductive matrix completion. Proceedings of the 24th ACM International Conference on Information and Knowledge Management, Melbourne, Australia.10.1145/2806416.2806578 ↗
44. Shen, X., Yi, B., Zhang, Z., Shu, J., and Liu, H. (2016, January 19–21). Automatic recommendation technology for learning resources with convolutional neural network. Proceedings of the International Symposium on Educational Technology, Beijing, China.10.1109/ISET.2016.12 ↗
45. Collaborative filtering and deep learning based recommendation system for cold start items10.1016/j.eswa.2016.09.040 ↗
46. Seo, S., Huang, J., Yang, H., and Liu, Y. (2017, January 27–31). Interpretable convolutional neural networks with dual local and global attention for review rating prediction. Proceedings of the Eleventh ACM Conference on Recommender Systems, Como, Italy.10.1145/3109859.3109890 ↗
47. TransRev: Modeling reviews as translations from users to items
48. (2017, May 22). GeeksforGeeks. Available online: https://www.geeksforgeeks.org/removing-stop-words-nltk-python/.
49. Long short-term memory10.1162/neco.1997.9.8.1735 ↗
50. (2015, August 27). Colah’s Blog. Available online: https://colah.github.io/posts/2015-08-Understanding-LSTMs/.
51. Bidirectional recurrent neural networks10.1109/78.650093 ↗
52. Gradient-based learning applied to document recognition10.1109/5.726791 ↗
53. (2016, August 11). The Data Science Blog. Available online: https://ujjwalkarn.me/2016/08/11/intuitive-explanation-convnets/.
54. (2018, November 11). Towards Data Science. Available online: https://towardsdatascience.com/bert-explained-state-of-the-art-language-model-for-nlp-f8b21a9b6270.
55. (2019, September 17). Towards Machine Learning. Available online: https://towardsml.com/2019/09/17/bert-explained-a-complete-guide-with-theory-and-tutorial/.
56. (2016, September 26). Experiments in Data Science. Available online: http://blog.richardweiss.org/2016/09/25/movie-embeddings.html.
57. Ni, J., Li, J., and McAuley, J. (2019, January 3–7). Justifying recommendations using distantly-labeled reviews and fined-grained aspects. Proceedings of the Annual Conference on EMNLP, Hong Kong, China.10.18653/v1/D19-1018 ↗