journal article·2020-03-25Open access

Efficient Melody Extraction Based on Extreme Learning Machine

Weiwei Zhang, Qiaoling Zhang, Sheng Bi, Shaojun Fang, Jinliang Dai

Applied Sciences· Volume 10· Issue 7

Abstract

Melody extraction is an important task in music information retrieval community and it is unresolved due to the complex nature of real-world recordings. In this paper, the melody extraction problem is addressed in the extreme learning machine (ELM) framework. More specifically, the input musical signal is first pre-processed to mimic the human auditory system. The music features are then constructed by constant-Q transform (CQT), and the concentration strategy is introduced to make use of contextual information. Afterwards, the rough melody pitches are determined by ELM network, according to its pre-trained parameters. Finally, the rough melody pitches are fine-tuned by the spectral peaks around the frame-wise rough pitches. The proposed method can extract melody from polyphonic music efficiently and effectively, where pitch estimation and voicing detection are conducted jointly. Some experiments have been conducted based on three publicly available datasets. The experimental results reveal that the proposed method achieves higher overall accuracies with very fast speed.
Source: crossref · Quality: baseline

Research context

OpenAlex topics: Music and Audio Processing · Machine Learning and ELM · Speech and Audio Processing

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

Information Science and Technology College, Dalian Maritime University, Dalian 116023, China

School of Information Science and Technology, Zhejiang Sci-Tech University, Hangzhou 310018, China

Sinwt Technology Company Limited, Beijing 100029, China

Funding

National Natural Science Foundation of China · Natural Science Foundation of Liaoning Province

References (29)

Show source-provided references
1. Melody extraction from polyphonic music signals: Approaches, applications, and challenges10.1109/MSP.2013.2271648 ↗
2. Tonal representations for music retrieval: From version identification to query-by-humming10.1007/s13735-012-0026-0 ↗
3. Zhang, W., Chen, Z., and Yin, F. (2018). Melody extraction using chroma-level note tracking and pitch mapping. Appl. Sci., 8.10.3390/app8091618 ↗
4. Gathekar, A.O., and Deshpande, A.M. (2016, January 2–3). Implementation of melody extraction algorithms from polyphonic audio for Music Information Retrieval. Proceedings of the IEEE International Conference on Advances in Electronics, Communication and Computer Technology, Pune, India.10.1109/ICAECCT.2016.7942546 ↗
5. A real-time music-scene-description system: Predominant-F0 estimation for detecting melody and bass lines in real-world audio signals10.1016/j.specom.2004.07.001 ↗
6. Fuentes, B., Liutkus, A., Badeau, R., and Richard, G. (2012, January 25–30). Probabilistic model for main melody extraction using constant-Q transform. Proceedings of the IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), Kyoto, Japan.10.1109/ICASSP.2012.6289131 ↗
7. Melody extraction from polyphonic music signals using pitch contour characteristics10.1109/TASL.2012.2188515 ↗
8. Bosch, J.J., Bittner, R.M., Salamon, J., and Gutiérrez, E.G. (2016, January 7–11). A comparison of melody extraction methods based on source-filter modelling. Proceedings of the 17th International Society for Music Information Retrieval Conference, New York, NY, USA.
9. Bosch, J., and Gómez, E. (September, January 31). Melody extraction based on a source-filter model using pitch contour selection. Proceedings of the Sound and Music Computing Conference, Hamburg, Germany.
10. Main melody extraction from polyphonic music based on modified Euclidean algorithm10.1016/j.apacoust.2016.04.023 ↗
11. Melody extraction from polyphonic music using particle filter and dynamic programming10.1109/TASLP.2018.2834722 ↗
12. Fan, Z.-C., Jang, J.-S.R., and Lu, C.-L. (2016, January 20–22). Singing voice separation and pitch extraction from monaural polyphonic audio music via DNN and adaptive pitch tracking. Proceedings of the International Conference on Multimedia Big Data, Taipei, Taiwan.10.1109/BigMM.2016.56 ↗
13. Rigaud, F., and Radenen, M. (2016, January 7–11). Singing voice melody transcription using deep neural networks. Proceedings of the International Society for Music Information Retrieval Conference, New York, NY, USA.
14. Bittner, R.M., Mcfee, B., Salamon, J., Li, P., and Bello, J.P. (2017, January 23–27). Deep salience representations for F0 estimation in polyphonic music. Proceedings of the International Society for Music Information Retrieval Conference, Suzhou, China.
15. Lu, W.T., and Su, L. (2018, January 23–27). Vocal Melody Extraction with Semantic Segmentation and Audio-symbolic Domain Transfer Learning. Proceedings of the International Society for Music Information Retrieval Conference, Paris, France.
16. Hsieh, T.-H., Su, L., and Yang, Y.-H. (2019, January 12–17). A streamlined encoder/decoder architecture for melody extraction. Proceedings of the International Conference on Acoustics, Speech and Signal Processing, Brighton, UK.10.1109/ICASSP.2019.8682389 ↗
17. Bosch, J. (2017). From Heuristics-Based to Data-Driven Audio Melody Extraction. [Ph.D. Thesis, Universitat Pompeu Fabra].
18. Upper bounds on the number of hidden neurons in feedforward networks with arbitrary bounded nonlinear activation functions10.1109/72.655045 ↗
19. Extreme learning machine: Theory and applications10.1016/j.neucom.2005.12.126 ↗
20. Multi-fault diagnosis of gearbox based on resonance-based signal sparse decomposition and comb filter10.1016/j.measurement.2017.03.006 ↗
21. A methodology for voice classification based on the personalized fundamental frequency estimation10.1016/j.bspc.2018.01.007 ↗
22. Recognition of emotional vocalizations of canine10.3813/AAA.919173 ↗
23. Serre, D. (2002). Matrices: Theory and Applications, Springer.
24. Schörkhuber, C., Klapuri, A., Holighaus, N., and Dörfler, M. (2014, January 26–29). A Matlab toolbox for efficient perfect reconstruction time-frequency transforms with log-frequency resolution. Proceedings of the 53rd International Conference: Semantic Audio Engineering Society Conference, London, UK.
25. Reddy, G., and Rao, K.S. (2017). Predominant Vocal Melody Extraction from Enhanced Partial Harmonic Content, IEEE.
26. Dressler, K. (2011, January 22–24). Pitch estimation by the pair-wise evaluation of spectral peaks. Proceedings of the AES International Conference, Ilmenau, Germany.
27. Distributed marginalized auxiliary particle filter for speaker tracking in distributed microphone networks10.1109/TASLP.2016.2590146 ↗
28. Source/filter model for unsupervised main melody extraction from polyphonic audio signals10.1109/TASL.2010.2041114 ↗
29. On-line melody extraction from polyphonic audio using harmonic cluster tracking10.1109/TASL.2012.2227731 ↗