journal article·2023-01-22Open access

A Hybrid CNN and RNN Variant Model for Music Classification

Mohsin Ashraf, Fazeel Abid, Ikram Ud Din, Jawad Rasheed, Mirsat Yesiltepe, Sook Fern Yeo, Merve T. Ersoy

Applied Sciences· Volume 13· Issue 3

Abstract

Music genre classification has a significant role in information retrieval for the organization of growing collections of music. It is challenging to classify music with reliable accuracy. Many methods have utilized handcrafted features to identify unique patterns but are still unable to determine the original music characteristics. Comparatively, music classification using deep learning models has been shown to be dynamic and effective. Among the many neural networks, the combination of a convolutional neural network (CNN) and variants of a recurrent neural network (RNN) has not been significantly considered. Additionally, addressing the flaws in the particular neural network classification model, this paper proposes a hybrid architecture of CNN and variants of RNN such as long short-term memory (LSTM), Bi-LSTM, gated recurrent unit (GRU), and Bi-GRU. We also compared the performance based on Mel-spectrogram and Mel-frequency cepstral coefficient (MFCC) features. Empirically, the proposed hybrid architecture of CNN and Bi-GRU using Mel-spectrogram achieved the best accuracy at 89.30%, whereas the hybridization of CNN and LSTM using MFCC achieved the best accuracy at 76.40%.
Source: crossref · Quality: baseline

Research context

OpenAlex topics: Music and Audio Processing · Music Technology and Sound Studies · Neuroscience and Music Perception

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

Department of Computer Science, University of Central Punjab, Lahore 54700, Pakistan

Department of Information Systems, University of Management and Technology, Lahore 54700, Pakistan

Department of Information Technology, University of Haripur, Haripur 22610, Pakistan

Department of Software Engineering, Nisantasi University, Istanbul 34398, Turkey

Department of Mathematical Engineering, Yildiz Technical University, Istanbul 34220, Turkey

Faculty of Business, Multimedia University, Melaka 75450, Malaysia

Department of Business Administration, Daffodil International University, Dhaka 1207, Bangladesh

References (28)

Show source-provided references
1. Combining visual and acoustic features for audio classification tasks10.1016/j.patrec.2017.01.013 ↗
2. Ashraf, M., Guohua, G., Wang, X., and Ahmad, F. (2018, January 17–19). Integration of Speech/ Music Discrimination and Mood Classification with Audio Feature Extraction. Proceedings of the 2018 International Conference on Frontiers of Information Technology (FIT), Islamabad, Pakistan.10.1109/FIT.2018.00046 ↗
3. Music genre recognition using convolutional recurrent neural network architecture10.1111/exsy.12429 ↗
4. Huang, A., and Wu, R. (2016). Deep Learning for Music. arXiv.
5. End-to-end environmental sound classification using a 1D convolutional neural network10.1016/j.eswa.2019.06.040 ↗
6. Murad, A., and Pyun, J.-Y. (2017). Deep Recurrent Neural Networks for Human Activity Recognition. Sensors, 17.10.3390/s17112556 ↗
7. Wu, W., Han, F., Song, G., and Wang, Z. (December, January 30). Music Genre Classification Using Independent Recurrent Neural Network. Proceedings of the 2018 Chinese Automation Congress (CAC), Xi'an, China.10.1109/CAC.2018.8623623 ↗
8. Ashraf, M., Ahmad, F., Rauqir, R., Abid, F., Naseer, M., and Haq, E. (2021, January 17–19). Emotion Recognition Based on Musical Instrument using Deep Neural Network. Proceedings of the 2021 International Conference on Frontiers of Information Technology (FIT), Islamabad, Pakistan.10.1109/FIT53504.2021.00066 ↗
9. Musical genre classification of audio signals10.1109/TSA.2002.800560 ↗
10. Lau, D. (2021, May 30). Music Genre Classification: A Comparative Study between Deep-Learning and Traditional Machine Learning Approaches. Available online: https://riteshajoodha.co.za/sitepad-data/uploads/2021/02/2020-Dhiven.pdf.
11. Nasrullah, Z., and Zhao, Y. (2020, March 30). Music Artist Classification with Convolutional Recurrent Neural Networks. Available online: https://github.com/ZainNasrullah/music-artist-classification-crnn.10.1109/IJCNN.2019.8851988 ↗
12. Kumar, A., Rajpal, A., and Rathore, D. (2018, January 1–3). Genre Classification using Feature Extraction and Deep Learning Techniques. Proceedings of the 2018 10th International Conference on Knowledge and Systems Engineering (KSE), Ho Chi Minh City, Vietnam.10.1109/KSE.2018.8573325 ↗
13. Music Genre Classification Using MFCC, K-NN and SVM Classifier
14. Elbir, A., Cam, H.B., Iyican, M.E., Ozturk, B., and Aydin, N. (2018, January 4–6). Music Genre Classification and Recommendation by Using Machine Learning Techniques. Proceedings of the 2018 Innovations in Intelligent Systems and Applications Conference (ASYU), Adana, Turkey.10.1109/ASYU.2018.8554016 ↗
15. Kumar, D.P., Sowmya, B.J., and Srinivasa, K.G. (2016, January 13–14). A Comparative Study of Classifiers for Music Genre Classification Based on Feature Extractors. Proceedings of the 2016 IEEE Distributed Computing, VLSI, Electrical Circuits and Robotics (DISCOVER), Mangalore, India.10.1109/DISCOVER.2016.7806258 ↗
16. Fulzele, P., Singh, R., Kaushik, N., and Pandey, K. (2018, January 2–4). A Hybrid Model for Music Genre Classification Using LSTM and SVM. Proceedings of the 2018 Eleventh International Conference on Contemporary Computing (IC3), Noida, India.10.1109/IC3.2018.8530557 ↗
17. Goel, A., Sheezan, M., Masood, S., and Saleem, A. (2014, January 26–28). Genre Classification of Songs Using Neural Network. Proceedings of the 2014 International Conference on Computer and Communication Technology (ICCCT), Allahabad, India. Available online: https://ieeexplore.ieee.org/abstract/document/7001506/.10.1109/ICCCT.2014.7001506 ↗
18. Heakl, A., Abdelgawad, A., and Parque, V. (2022, January 18–23). A Study on Broadcast Networks for Music Genre Classification. Proceedings of the 2022 International Joint Conference on Neural Networks (IJCNN), Padua, Italy.10.1109/IJCNN55064.2022.9892651 ↗
19. PMG-Net: Persian music genre classification using deep neural networks10.1016/j.entcom.2022.100518 ↗
20. Research on Architecture for Long-tailed Genre Computer Intelligent Classification with Music Information Retrieval and Deep Learning
21. Jakubik, J. (2017, January 17–19). Evaluation of Gated Recurrent Neural Networks in Music Classification Tasks. Proceedings of the 38th International Conference on Information Systems Architecture and Technology—ISAT 2017, Szklarska Poręba, Poland.10.1007/978-3-319-67220-5_3 ↗
22. A Globally Regularized Joint Neural Architecture for Music Classification10.1109/ACCESS.2020.3043142 ↗
23. Automatic music genre recognition for in-car infotainment10.1016/j.trpro.2019.07.189 ↗
24. Simonyan, K., and Zisserman, A. (2015). Very Deep Convolutional Networks For Large-Scale Image Recognition. arXiv.
25. Music auto-tagging using deep Recurrent Neural Networks10.1016/j.neucom.2018.02.076 ↗
26. The Role of CNN and RNN in the Classification of Audio Music Genres10.21015/vtse.v10i2.793 ↗
27. Dai, J., Liang, S., Xue, W., Ni, C., and Liu, W. (2016, January 17–20). Long Short-Term Memory Recurrent Neural Network Based Segment Features for Music Genre Classification. Proceedings of the 2016 10th International Symposium on Chinese Spoken Language Processing (ISCSLP), Tianjin, China.10.1109/ISCSLP.2016.7918369 ↗
28. Multi-source social media data sentiment analysis using bidirectional recurrent convolutional neural networks10.1016/j.comcom.2020.04.002 ↗