journal article·2019-02-18Open access

A Deep Temporal Neural Music Recommendation Model Utilizing Music and User Metadata

Hai-Tao Zheng, Jin-Yuan Chen, Nan Liang, Arun Kumar Sangaiah, Yong Jiang, Cong-Zhi Zhao

Applied Sciences· Volume 9· Issue 4

Abstract

Deep learning shows its superiority in many domains such as computing vision, nature language processing, and speech recognition. In music recommendation, most deep learning-based methods focus on learning users’ temporal preferences using their listening histories. The cold start problem is not addressed, however, and the music characteristics are not fully exploited by these methods. In addition, the music characteristics and the users’ temporal preferences are not combined naturally, which cause the relatively low performance of music recommendation. To address these issues, we proposed a Deep Temporal Neural Music Recommendation model (DTNMR) based on music characteristics and the users’ temporal preferences. We encoded the music metadata into one-hot vectors and utilized the Deep Neural Network to project the music vectors to low-dimensional space and obtain the music characteristics. In addition, Long Short-Term Memory (LSTM) neural networks are utilized to learn about users’ long-term and short-term preferences from their listening histories. DTNMR alleviates the cold start problem in the item side using the music medadata and discovers new users’ preferences immediately after they listen to music. The experimental results show DTNMR outperforms seven baseline methods in terms of recall, precision, f-measure, MAP, user coverage and AUC.
Source: crossref · Quality: baseline

Research context

OpenAlex topics: Music and Audio Processing · Recommender Systems and Techniques · Neuroscience and Music Perception

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

Graduate School at Shenzhen, Tsinghua University, Shenzhen 518055, China

School of Computing Science and Engineering, VIT University, Vellore 632014, India

Giiso Information Technology Co., Ltd., Shenzhen 518055, China

Funding

National Natural Science Foundation of China · Shenzhen Science and Technology Project · Basic Scientific Research Program of Shenzhen City

References (34)

Show source-provided references
1. Resnick, P., Iacovou, N., Suchak, M., Bergstrom, P., and Riedl, J. (1994, January 22–26). GroupLens: An open architecture for collaborative filtering of netnews. Proceedings of the 1994 ACM Conference on Computer Supported Cooperative Work, Chapel Hill, NC, USA.10.1145/192844.192905 ↗
2. Amazon. com recommendations: Item-to-item collaborative filtering10.1109/MIC.2003.1167344 ↗
3. Matrix factorization techniques for recommender systems10.1109/MC.2009.263 ↗
4. Hu, Y., Koren, Y., and Volinsky, C. (2008, January 15–19). Collaborative Filtering for Implicit Feedback Datasets. Proceedings of the Eighth IEEE International Conference on Data Mining, Pisa, Italy.10.1109/ICDM.2008.22 ↗
5. Rendle, S., and Freudenthaler, C. (2014, January 24–28). Improving pairwise learning for item recommendation from implicit feedback. Proceedings of the 7th ACM International Conference on Web Search and Data Mining, New York, NY, USA.10.1145/2556195.2556248 ↗
6. Van den Oord, A., Dieleman, S., and Schrauwen, B. (2013, January 5–10). Deep content-based music recommendation. Proceedings of the 26th International Conference on Neural Information Processing Systems, Lake Tahoe, NV, USA.
7. Mikolov, T., Chen, K., Corrado, G., and Dean, J. (arXiv, 2013). Efficient estimation of word representations in vector space, arXiv.
8. Large-scale user modeling with recurrent neural networks for music discovery on multiple time scales
9. Latent semantic models for collaborative filtering10.1145/963770.963774 ↗
10. Breese, J.S., Heckerman, D., and Kadie, C. (1998, January 24–26). Empirical analysis of predictive algorithms for collaborative filtering. Proceedings of the Fourteenth Conference on Uncertainty in Artificial Intelligence, Madison, WI, USA.
11. Jamali, M., and Ester, M. (July, January 28). Trustwalker: A random walk model for combining trust-based and item-based recommendation. Proceedings of the 15th ACM SIGKDD International Conference On Knowledge Discovery and Data Mining, Paris, France.
12. Random-walk computation of similarities between nodes of a graph with application to collaborative recommendation10.1109/TKDE.2007.46 ↗
13. Do, T.D.T., and Cao, L. (2008, January 13–17). Coupled Poisson Factorization Integrated with User/Item Metadata for Modeling Popular and Sparse Ratings in Scalable Recommendation. Proceedings of the Twenty-Third AAAI Conference on Artificial Intelligence, Chicago, IL, USA.
14. Mak, H., Koprinska, I., Poon, J., Mak, H., and Poon, J. INTIMATE: A Web-Based Movie Recommender Using Text Categorization. Proceedings of the IEEE/WIC International Conference on Web Intelligence (WI 2003), Halifax, NS, Canada.
15. FOAFing the music: Bridging the semantic gap in music recommendation10.1016/j.websem.2008.09.004 ↗
16. Debnath, S., Ganguly, N., and Mitra, P. (2008). Feature Weighting in Content Based Recommendation System Using Social Network Analysis. Proceedings of the 17th International Conference on World Wide Web, ACM. WWW’08.10.1145/1367497.1367646 ↗
17. Bogdanov, D., and Herrera, P. (2011, January 24–28). How Much Metadata Do We Need in Music Recommendation? A Subjective Evaluation Using Preference Sets. Proceedings of the 12th International Society for Music Information Retrieval Conference (ISMIR 2011), Miami, FL, USA.
18. Soleymani, M., Aljanaki, A., Wiering, F., and Veltkamp, R.C. (July, January 29). Content-based music recommendation using underlying music preference structure. Proceedings of the 2015 IEEE International Conference on Multimedia and Expo (ICME), Turin, Italy.10.1109/ICME.2015.7177504 ↗
19. Salakhutdinov, R., Mnih, A., and Hinton, G. (2007, January 20–24). Restricted Boltzmann machines for collaborative filtering. Proceedings of the 24th International Conference on Machine Learning, Corvalis, OR, USA.10.1145/1273496.1273596 ↗
20. Wang, H., Wang, N., and Yeung, D.Y. (2015, January 10–13). Collaborative deep learning for recommender systems. Proceedings of the 21th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, Sydney, Australia.10.1145/2783258.2783273 ↗
21. Web-scale multimedia analysis: Does content matter?10.1109/MMUL.2011.34 ↗
22. Ying, H., Chen, L., Xiong, Y., and Wu, J. (2016, January 19–22). Collaborative deep ranking: A hybrid pair-wise recommendation algorithm with implicit feedback. Proceedings of the Pacific-Asia Conference on Knowledge Discovery and Data Mining, Auckland, New Zealand.10.1007/978-3-319-31750-2_44 ↗
23. Kim, D., Park, C., Oh, J., Lee, S., and Yu, H. (2016, January 15–19). Convolutional matrix factorization for document context-aware recommendation. Proceedings of the 10th ACM Conference on Recommender Systems, Boston, MA, USA.10.1145/2959100.2959165 ↗
24. Sedhain, S., Menon, A.K., Sanner, S., and Xie, L. (2015, January 18–22). Autorec: Autoencoders meet collaborative filtering. Proceedings of the 24th International Conference on World Wide Web, Florence, Italy.10.1145/2740908.2742726 ↗
25. Zhang, S., Yao, L., and Xu, X. (arXiv, 2017). Autosvd++: An efficient hybrid collaborative filtering model via contractive auto-encoders, arXiv.10.1145/3077136.3080689 ↗
26. Representation learning via Dual-Autoencoder for recommendation10.1016/j.neunet.2017.03.009 ↗
27. Chen, W., Zheng, H.T., and Mao, X.X. (2007, January 13–16). Extracting Deep Semantic Information for Intelligent Recommendation. Proceedings of the International Conference on Neural Information Processing, Kitakyushu, Japan.
28. Matsumoto, Y., Harakawa, R., Ogawa, T., and Haseyama, M. (2017, January 24–27). Construction of network using heterogeneous social metadata for music video recommendation. Proceedings of the 2017 IEEE 6th Global Conference on Consumer Electronics (GCCE), Nagoya, Japan.10.1109/GCCE.2017.8229260 ↗
29. Learning to embed music and metadata for context-aware music recommendation10.1007/s11280-017-0521-6 ↗
30. Hidasi, B., Karatzoglou, A., Baltrunas, L., and Tikk, D. (arXiv, 2015). Session-based recommendations with recurrent neural networks, arXiv.
31. Wang, X., Yu, L., Ren, K., Tao, G., Zhang, W., Yu, Y., and Wang, J. (2017, January 13–17). Dynamic attention deep model for article recommendation by learning human editors’ demonstration. Proceedings of the 23rd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, Halifax, NS, Canada.10.1145/3097983.3098096 ↗
32. Smirnova, E., and Vasile, F. (arXiv, 2017). Contextual Sequence Modeling for Recommendation with Recurrent Neural Networks, arXiv.10.1145/3125486.3125488 ↗
33. Devooght, R., and Bersini, H. (2017, January 9–12). Long and Short-Term Recommendations with Recurrent Neural Networks. Proceedings of the Conference on User Modeling, Adaptation and Personalization, Bratislava, Slovakia.10.1145/3079628.3079670 ↗
34. Song, Y., Elkahky, A.M., and He, X. (2016, January 17–21). Multi-rate deep learning for temporal recommendation. Proceedings of the 39th International ACM SIGIR Conference on Research and Development in Information Retrieval, Pisa, Italy.10.1145/2911451.2914726 ↗