journal article·2024-03-15Open access

Enhancing Sequence Movie Recommendation System Using Deep Learning and KMeans

Sophort Siet, Sony Peng, Sadriddinov Ilkhomjon, Misun Kang, Doo-Soon Park

Applied Sciences· Volume 14· Issue 6

Abstract

A flood of information has occurred, making it challenging for people to find and filter their favorite items. Recommendation systems (RSs) have emerged as a solution to this problem; however, traditional Appenrecommendation systems, including collaborative filtering, and content-based filtering, face significant challenges such as data scalability, data scarcity, and the cold-start problem, all of which require advanced solutions. Therefore, we propose a ranking and enhancing sequence movie recommendation system that utilizes the combination model of deep learning to resolve the existing issues. To mitigate these challenges, we design an RSs model that utilizes user information (age, gender, occupation) to analyze new users and match them with others who have similar preferences. Initially, we construct sequences of user behavior to effectively predict the potential next target movie of users. We then incorporate user information and movie sequence embeddings as input features to reduce the dimensionality, before feeding them into a transformer architecture and multilayer perceptron (MLP). Our model integrates a transformer layer with positional encoding for user behavior sequences and multi-head attention mechanisms to enhance prediction accuracy. Furthermore, the system applies KMeans clustering to movie genre embeddings, grouping similar movies and integrating this clustering information with predicted ratings to ensure diversity in the personalized recommendations for target users. Evaluating our model on two MovieLens datasets (100 Kand 1 M) demonstrated significant improvements, achieving RMSE, MAE, precision, recall, and F1 scores of 1.0756, 0.8741, 0.5516, 0.3260, and 0.4098 for the 100 K dataset, and 0.9927, 0.8007, 0.5838, 0.4723, and 0.5222 for the 1 M dataset, respectively. This approach not only effectively mitigates cold-start and scalability issues but also surpasses baseline techniques in Top-N item recommendations, highlighting its efficacy in the contemporary environment of abundant data.
Source: crossref · Quality: baseline

Research context

OpenAlex topics: Recommender Systems and Techniques · Machine Learning in Healthcare · Advanced Bandit Algorithms Research

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

Department of Software Convergence, Soonchunhyang University, Asan-si 31538, Republic of Korea

Department of Computer Software Engineering, Soonchunhyang University, Asan-si 31538, Republic of Korea

Funding

National Research Foundation of Korea · BK21 FOUR

References (47)

Show source-provided references
1. Djedouboum, A.C., Abba Ari, A.A., Gueroui, A.M., Mohamadou, A., and Aliouat, Z. (2018). Big data collection in large-scale wireless sensor networks. Sensors, 18.10.3390/s18124474 ↗
2. Leveraging machine learning and big data for smart buildings: A comprehensive survey10.1109/ACCESS.2019.2926642 ↗
3. Guk, K., Han, G., Lim, J., Jeong, K., Kang, T., Lim, E.K., and Jung, J. (2019). Evolution of wearable devices with real-time disease monitoring for personalized healthcare. Nanomaterials, 9.10.3390/nano9060813 ↗
4. Integrative analysis of multimodal traffic data: Addressing open challenges using big data analytics in the city of Lisbon10.1186/s12544-021-00520-3 ↗
5. Kirmani, S., Mazid, A., Khan, I.A., and Abid, M.A. (2022). Survey on IoT-Enabled Smart Grids: Technologies, Architectures, Applications, and Challenges. Sustainability, 15.10.3390/su15010717 ↗
6. Fayyaz, Z., Ebrahimian, M., Nawara, D., Ibrahim, A., and Kashef, R. (2020). Recommendation systems: Algorithms, challenges, metrics, and business opportunities. Appl. Sci., 10.10.3390/app10217748 ↗
7. Qin, L., Xu, X., and Li, J. (2018). Big Data–BigData 2018: 7th International Congress, Held as Part of the Services Conference Federation, SCF 2018, Seattle, WA, USA, 25–30 June 2018, Proceedings, Springer International Publishing.
8. Rabiu, I., Salim, N., Da’u, A., and Osman, A. (2020). Recommender system based on temporal models: A systematic review. Appl. Sci., 10.10.3390/app10072204 ↗
9. Bennett, J., and Lanning, S. (2007, January 12). The netflix prize. Proceedings of the KDD Cup and Workshop, San Jose, CA, USA.
10. Covington, P., Adams, J., and Sargin, E. (2016, January 15–19). Deep neural networks for youtube recommendations. Proceedings of the 10th ACM Conference on Recommender Systems, Boston, MA, USA.10.1145/2959100.2959190 ↗
11. Two decades of recommender systems at Amazon.com10.1109/MIC.2017.72 ↗
12. Cheng, H.T., Koc, L., Harmsen, J., Shaked, T., Chandra, T., Aradhye, H., Anderson, G., Corrado, G., Chai, W., and Ispir, M. (2016, January 15). Wide & deep learning for recommender systems. Proceedings of the 1st Workshop on Deep Learning for Recommender Systems, Boston, MA, USA.10.1145/2988450.2988454 ↗
13. A systematic review and research perspective on recommender systems10.1186/s40537-022-00592-5 ↗
14. Movie recommendation system based on users’ personal information and movies rated using the method of k-clique and normalized discounted cumulative gain
15. Selimi, D., and Nuci, K.P. (2020). The use of Recommender Systems in web technology and an in-depth analysis of Cold State problem. arXiv.
16. Effective Hybrid Content-Based Collaborative Filtering Approach for Requirements Engineering10.32604/csse.2022.017221 ↗
17. A systematic review: Machine learning based recommendation systems for e-learning10.1007/s10639-019-10063-9 ↗
18. Park, S.T., and Chu, W. (2009, January 23–25). Pairwise preference regression for cold-start recommendation. Proceedings of the 3rd ACM Conference on Recommender Systems, New York, NY, USA.10.1145/1639714.1639720 ↗
19. Deep learning techniques for recommender systems based on collaborative filtering10.1111/exsy.12647 ↗
20. Peng, S., Park, D.S., Kim, D.Y., Yang, Y., Siet, S., Ugli SI, R., and Lee, H. (2022, January 19–21). A Modern Recommendation System Survey in the Big Data Era. Proceedings of the International Conference on Computer Science and Its Applications and the International Conference on Ubiquitous Information Technologies and Applications, Vientiane, Laos.
21. Pazzani, M.J., and Billsus, D. (2007). The Adaptive Web: Methods and Strategies of Web Personalization, Springer.
22. Koren, Y., Rendle, S., and Bell, R. (2021). Recommender Systems Handbook, Springer.
23. Sarwar, B., Karypis, G., Konstan, J., and Riedl, J. (2001, January 1–5). Item-based collaborative filtering recommendation algorithms. Proceedings of the 10th International Conference on World Wide Web, Hong Kong, China.10.1145/371920.372071 ↗
24. Scalable collaborative filtering approaches for large recommender systems
25. Barathy, R., and Chitra, P. (2020, January 6–7). Applying matrix factorization in collaborative filtering recommender systems. Proceedings of the 6th International Conference on Advanced Computing and Communication Systems (ICACCS), Coimbatore, India.10.1109/ICACCS48705.2020.9074227 ↗
26. Rendle, S., Freudenthaler, C., Gantner, Z., and Schmidt-Thieme, L. (2012). BPR: Bayesian personalized ranking from implicit feedback. arXiv.
27. Sun, C., Sun, G., Ding, Z., Liu, Q., and Ma, Z. (2021, January 26–27). A News Recommendation Algorithm Based on SVD and Improved K-means. Proceedings of the 2021 International Conference on Networking, Communications and Information Technology (NetCIT), Manchester, UK.10.1109/NetCIT54147.2021.00033 ↗
28. A comparative study of collaborative filtering in product recommendation10.28991/ESJ-2023-07-01-01 ↗
29. Deep learning based recommender system: A survey and new perspectives10.1145/3158369 ↗
30. Movie recommendation algorithm using social network analysis to alleviate cold-start problem
31. Application of Improved K-Means Algorithm in Collaborative Recommendation System10.1155/2022/2213173 ↗
32. E-commerce personalized recommendation analysis by deeply-learned clustering10.1016/j.jvcir.2019.102735 ↗
33. A disease diagnosis and treatment recommendation system based on big data mining and cloud computing10.1016/j.ins.2018.01.001 ↗
34. Rendle, S., Freudenthaler, C., and Schmidt-Thieme, L. (2010, January 26–30). Factorizing personalized markov chains for next-basket recommendation. Proceedings of the 19th International Conference on World Wide Web, Raleigh, NC, USA.10.1145/1772690.1772773 ↗
35. Tang, J., and Wang, K. (2018, January 5–9). Personalized top-n sequential recommendation via convolutional sequence embedding. Proceedings of the Eleventh ACM International Conference on Web Search and Data Mining, Marina del Rey, CA, USA.10.1145/3159652.3159656 ↗
36. Hidasi, B., Karatzoglou, A., Baltrunas, L., and Tikk, D. (2015). Session-based recommendations with recurrent neural networks. arXiv.
37. Recommendation system with hierarchical recurrent neural network for long-term time series10.1109/ACCESS.2021.3079922 ↗
38. Long short-term enhanced memory for sequential recommendation10.1007/s11280-022-01056-9 ↗
39. Kang, W.C., and McAuley, J. (2018, January 17–20). Self-attentive sequential recommendation. Proceedings of the IEEE International Conference on Data Mining (ICDM), Singapore.10.1109/ICDM.2018.00035 ↗
40. Yu, S., Guo, M., Chen, X., Qiu, J., and Sun, J. (2023). Personalized Movie Recommendations Based on a Multi-Feature Attention Mechanism with Neural Networks. Mathematics, 11.10.3390/math11061355 ↗
41. Chen, Q., Zhao, H., Li, W., Huang, P., and Ou, W. (2019, January 5). Behavior sequence transformer for e-commerce recommendation in alibaba. Proceedings of the 1st International Workshop on Deep Learning Practice for High-Dimensional Sparse Data, Anchorage, AK, USA.10.1145/3326937.3341261 ↗
42. Came: Content-and context-aware music embedding for recommendation10.1109/TNNLS.2020.2984665 ↗
43. Combine temporal information in session-based recommendation with graph neural networks10.1016/j.eswa.2023.121969 ↗
44. Mavrogiorgos, K., Kiourtis, A., Mavrogiorgou, A., Kleftakis, S., and Kyriazis, D. (2022, January 11–13). A multi-layer approach for data cleaning in the healthcare domain. Proceedings of the 2022 8th International Conference on Computing and Data Engineering, Bangkok, Thailand.10.1145/3512850.3512856 ↗
45. Eskandanian, F., Mobasher, B., and Burke, R. (2017, January 9–12). A clustering approach for personalizing diversity in collaborative recommender systems. Proceedings of the 25th Conference on User Modeling, Adaptation and Personalization, Bratislava, Slovakia.10.1145/3079628.3079699 ↗
46. Optimal Diversity of Recommendation List for Recommender Systems based on the Users’ Desire Diversity
47. (2021, December 08). Movielens, GroupLens. Retrieved 31 January 2023. Available online: https://grouplens.org/datasets/movielens/.