journal article·2020-01-04Open access

Enhancement of Conventional Beat Tracking System Using Teager–Kaiser Energy Operator

Matej Istvanek, Zdenek Smekal, Lubomir Spurny, Jiri Mekyska

Applied Sciences· Volume 10· Issue 1

Abstract

Beat detection systems are widely used in the music information retrieval (MIR) research field for the computation of tempo and beat time positions in audio signals. One of the most important parts of these systems is usually onset detection. There is an understandable tendency to employ the most accurate onset detector. However, there are options to increase the global tempo (GT) accuracy and also the detection accuracy of beat positions at the expense of less accurate onset detection. The aim of this study is to introduce an enhancement of a conventional beat detector. The enhancement is based on the Teager–Kaiser energy operator (TKEO), which pre-processes the input audio signal before the spectral flux calculation. The proposed approach is first evaluated in terms of the ability to estimate the GT and beat positions accuracy of given audio tracks compared to the same conventional system without the proposed enhancement. The accuracy of the GT and average beat differences (ABD) estimation is tested on the manually labelled reference database. Finally, this system is used for analysis of a string quartet music database. Results suggest that the presence of the TKEO lowers onset detection accuracy but also increases the GT and ABD estimation. The average deviation from the reference GT in the reference database is 9.99 BPM (11.28%), which improves the conventional methodology, where the average deviation is 18.19 BPM (17.74%). This study has a pilot character and provides some suggestions for improving the beat tracking system for music analysis.
Source: crossref · Quality: baseline

Research context

OpenAlex topics: Music and Audio Processing · Speech and Audio Processing · Music Technology and Sound Studies

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

Department of Telecommunications, Faculty of Electrical Engineering and Communication, Brno University of Technology, Technicka 12, 61600 Brno, Czech Republic

Department of Musicology, Faculty of Arts, Masaryk University, Janackovo namesti 2a, 60200 Brno, Czech Republic

Funding

Czech Ministry of Education, Youth and Sports

References (28)

Show source-provided references
1. Benetos, E., and Dixon, S. (2011, January 22–27). Polyphonic music transcription using note onset and offset detection. Proceedings of the International Conference on Acoustics, Speech and Signal Processing (ICASSP), Prague, Czech Republic.10.1109/ICASSP.2011.5946322 ↗
2. A new method of onset and offset detection in ensemble singing10.1080/14015439.2018.1452977 ↗
3. Böck, S., and Widmer, G. (2013, January 2–5). Maximum filter vibrato suppression for onset detection. Proceedings of the 16th International Conference on Digital Audio Effects (DAFx-13), Maynooth, Ireland.
4. Grosche, P., and Müller, M. (2010, January 14–19). Cyclic Tempogram—A Mid-level Tempo Representation for Music Signals. Proceedings of the IEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP), Dallas, TX, USA.10.1109/ICASSP.2010.5495219 ↗
5. Extracting Predominant Local Pulse Information from Music Recordings10.1109/TASL.2010.2096216 ↗
6. Grosche, P., and Müller, M. (2011, January 24–28). Tempogram Toolbox: MATLAB tempo and pulse analysis of music recordings. Proceedings of the 12th International Conference on Music Information Retrieval, Miami, FL, USA.
7. (2020, January 03). LibROSA. Available online: https://librosa.github.io/librosa/.
8. Lartillot, O., and Toiviainen, P. (2007, January 7–9). A Matlab Toolbox for Musical Feature Extraction From Audio. Proceedings of the 31st Annual Conference of the Gesellschaft für Klassifikation e.V., Breisgau, Germany.
9. Multi-feature beat tracking10.1109/TASLP.2014.2305252 ↗
10. Schlüter, J., and Böck, S. (2014, January 4–9). Improved musical onset detection with convolutional neural networks. Proceedings of the International Conference on Acoustics, Speech and Signal Processing, Florence, Italy.10.1109/ICASSP.2014.6854953 ↗
11. Eyben, F., Böck, S., Schuller, B., and Graves, A. (2010, January 9–13). Universal onset detection with bidirectional long-short term memory neural networks. Proceedings of the 11th International Society for Music Information Retrieval Conference (ISMIR), Utrecht, The Netherlands.
12. Beat Tracking by Dynamic Programming10.1080/09298210701653344 ↗
13. Böck, S., Krebs, F., and Widmer, G. (2014, January 27–31). A Multi-Model Approach To Beat Tracking Considering Heterogeneous Music Styles. Proceedings of the 15th International Society for Music Information Retrieval Conference (ISMIR), Taipei, Taiwan.
14. Srinivasamurthy, A. (2016). A Data-Driven Bayesian Approach to Automatic Rhythm Analysis of Indian Art Music. [Ph.D. Thesis, Pompeu Fabra University].
15. (2020, January 03). 2012:MIREX Home. Available online: https://www.music-ir.org/mirex/wiki/2012:MIREX_Home.
16. Cook, N. (2013). Beyond the Score: Music as Performance, Oxford University Press.10.1093/acprof:oso/9780199357406.001.0001 ↗
17. Tempo, duration, and flexibility: Techniques in the analysis of performance10.1080/01411899608574728 ↗
18. Teager-Kaiser Operator improves the accuracy of EMG onset detection independent of signal-to-noise ratio
19. Kopparapu, S.K., Pandharipande, M., and Sita, G. (2010, January 3–5). Music and vocal separation using multiband modulation based features. Proceedings of the Symposium on Industrial Electronics and Applications (ISIEA), Penang, Malaysia.10.1109/ISIEA.2010.5679370 ↗
20. Das, S., and Hansen, J. (2004, January 9–11). Detection of Voice Onset Time (VOT) for Unvoiced Stops (/p/, /t/, /k/) Using the Teager Energy Operator (TEO) for Automatic Detection of Accented English. Proceedings of the 6th Nordic Signal Processing Symposium (NORSIG), Espoo, Finland.
21. A Highly Efficient Generalized Teager-Kaiser-Based Technique for LOS Estimation in WCDMA Mobile Positioning
22. Kvedalen, E. (2003). Signal Processing Using the Teager Energy Operator and Other Nonlinear Operators. [Master’s Thesis, University of Oslo].
23. A Comparison of the Squared Energy and Teager-Kaiser Operators for Short-Term Energy Estimation in Additive Noise10.1109/TSP.2009.2019299 ↗
24. Müller, M. (2015). Fundamentals of Music Processing, Springer.10.1007/978-3-319-21945-5 ↗
25. Konz, V. (2012). Automated Methods for Audio-Based Music Analysis with Applications to Musicology. [Ph.D. Thesis, Saarland University].
26. Selective Sampling for Beat Tracking Evaluation10.1109/TASL.2012.2205244 ↗
27. (2020, January 03). Sonic Visualiser. Available online: https://www.sonicvisualiser.org/.
28. Dixon, S. (2001, January 7–22). An Interactive Beat Tracking and Visualisation System. Proceedings of the 2001 International Computer Music Conference (ICMC 2001), Havana, Cuba.