journal article·2019-09-16Open access

Evaluation of Classical Machine Learning Techniques towards Urban Sound Recognition on Embedded Systems

Bruno da Silva, Axel W. Happi, An Braeken, Abdellah Touhafi

Applied Sciences· Volume 9· Issue 18

Abstract

Automatic urban sound classification is a desirable capability for urban monitoring systems, allowing real-time monitoring of urban environments and recognition of events. Current embedded systems provide enough computational power to perform real-time urban audio recognition. Using such devices for the edge computation when acting as nodes of Wireless Sensor Networks (WSN) drastically alleviates the required bandwidth consumption. In this paper, we evaluate classical Machine Learning (ML) techniques for urban sound classification on embedded devices with respect to accuracy and execution time. This evaluation provides a real estimation of what can be expected when performing urban sound classification on such constrained devices. In addition, a cascade approach is also proposed to combine ML techniques by exploiting embedded characteristics such as pipeline or multi-thread execution present in current embedded devices. The accuracy of this approach is similar to the traditional solutions, but provides in addition more flexibility to prioritize accuracy or timing.
Source: crossref · Quality: baseline

Research context

OpenAlex topics: Music and Audio Processing · Speech and Audio Processing · Animal Vocal Communication and Behavior

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

Department of Engineering Technology (INDI), Vrije Universiteit Brussel (VUB), 1050 Brussels, Belgium

Department of Electronics and Informatics (ETRO), Vrije Universiteit Brussel (VUB), 1050 Brussels, Belgium

References (39)

Show source-provided references
1. Bountourakis, V., Vrysis, L., and Papanikolaou, G. (2015, January 7–9). Machine learning algorithms for environmental sound recognition: Towards soundscape semantics. Proceedings of the Audio Mostly 2015 on Interaction with Sound, Thessaloniki, Greece.10.1145/2814895.2814905 ↗
2. Piczak, K.J. (2015, January 26–30). ESC: Dataset for environmental sound classification. Proceedings of the 23rd ACM international conference on Multimedia, Brisbane, Australia.10.1145/2733373.2806390 ↗
3. Salamon, J., Jacoby, C., and Bello, J.P. (2014, January 3–7). A dataset and taxonomy for urban sound research. Proceedings of the 22nd ACM international conference on Multimedia, Orlando, FL, USA.10.1145/2647868.2655045 ↗
4. Wearable sensor-based human activity recognition from environmental background sounds10.1007/s12652-012-0122-2 ↗
5. Mendoza, J.M., Tan, V., Fuentes, V., Perez, G., and Tiglao, N.M. Audio Event Detection Using Wireless Sensor Networks Based on Deep Learning. International Wireless Internet Conference, Taipei, Taiwan, 15–16 October 2018, Springer.10.1007/978-3-030-06158-6_11 ↗
6. Jakob, A., Marco, G., Stephanie, K., Robert, G., Christian, K., Tobias, C., and Hanna, L. (2018, January 6–8). A Distributed Sensor Network for Monitoring Noise Level and Noise Sources in Urban Environments. Proceedings of the 2018 IEEE 6th International Conference on Future Internet of Things and Cloud (FiCloud), Barcelona, Spain.
7. Siamwala, A., Lochhead, Z., and Abdulla, W. (2019, January 12–14). Environmental Noise Monitoring Using Distributed IoT Sensor Nodes. Proceedings of the IEEE 2019 International Conference on Electronics, Information, and Communication (ICEIC), Beijing, China.10.23919/ELINFOCOM.2019.8706473 ↗
8. Kumari, S., Roy, D., Cartwright, M., Bello, J.P., and Arora, A. (2019, January 20–24). EdgeL^3: Compressing L^3-Net for Mote Scale Urban Noise Monitoring. Proceedings of the 2019 IEEE International Parallel and Distributed Processing Symposium Workshops (IPDPSW), Rio de Janeiro, Brazil.10.1109/IPDPSW.2019.00145 ↗
9. Bello, J.P., Silva, C., Nov, O., DuBois, R.L., Arora, A., Salamon, J., Mydlarz, C., and Doraiswamy, H. (2018). SONYC: A system for the monitoring, analysis and mitigation of urban noise pollution. arXiv.
10. Mydlarz, C., Sharma, M., Lockerman, Y., Steers, B., Silva, C., and Bello, J.P. (2019). The life of a New York City noise sensor network. Sensors, 19.10.3390/s19061415 ↗
11. Font, F., Roma, G., and Serra, X. (2013, January 21–25). Freesound technical demo. Proceedings of the 21st ACM international conference on Multimedia, Barcelona, Spain.10.1145/2502081.2502245 ↗
12. The measurement of power spectra from the point of view of communications engineering—Part I10.1002/j.1538-7305.1958.tb03874.x ↗
13. The WEKA data mining software: an update10.1145/1656274.1656278 ↗
14. Classifying environmental sounds using image recognition networks10.1016/j.procs.2017.08.250 ↗
15. Urban noise recognition with convolutional neural network10.1007/s11042-018-6295-8 ↗
16. Su, Y., Zhang, K., Wang, J., and Madani, K. (2019). Environment Sound Classification Using a Two-Stream CNN Based on Decision-Level Fusion. Sensors, 19.10.3390/s19071733 ↗
17. Piczak, K.J. (2015, January 17–20). Environmental sound classification with convolutional neural networks. Proceedings of the 2015 IEEE 25th International Workshop on Machine Learning for Signal Processing (MLSP), Boston, MA, USA.10.1109/MLSP.2015.7324337 ↗
18. Bogdanov, D., Wack, N., Gómez Gutiérrez, E., Gulati, S., Herrera Boyer, P., Mayor, O., Roma Trepat, G., Salamon, J., Zapata González, J.R., and Serra, X. (2013, January 4–8). Essentia: An audio analysis library for music information retrieval. Proceedings of the 14th Conference of the International Society for Music Information Retrieval (ISMIR), Curitiba, Brazil.10.1145/2502081.2502229 ↗
19. (2019, June 01). pyAudioAnalysis. Available online: https://github.com/tyiannak/pyAudioAnalysis.
20. Giannakopoulos, T. (2015). pyaudioanalysis: An open-source Python library for audio signal analysis. PLoS ONE, 10.10.1371/journal.pone.0144610 ↗
21. (2019, June 01). Yaafe 0.64. Available online: http://yaafe.sourceforge.net/.
22. (2019, June 01). Essentia 2.1. Available online: https://essentia.upf.edu/documentation/index.html.
23. (2019, June 01). aubio 0.4.0. Available online: http://aubio.org/.
24. (2019, June 01). CLAM 1.4.0. Available online: http://clam-project.org/.
25. (2019, June 01). LibROSA 0.6.3. Available online: https://librosa.github.io/librosa/.
26. McFee, B., Raffel, C., Liang, D., Ellis, D.P., McVicar, M., Battenberg, E., and Nieto, O. (2015, January 6–12). librosa: Audio and music signal analysis in Python. Proceedings of the 14th Python in Science Conference, Austin, TX, USA.10.25080/Majora-7b98e3ed-003 ↗
27. (2019, June 01). Matlab Audio Analysis Library. Available online: https://www.mathworks.com/matlabcentral/fileexchange/45831-matlab-audio-analysis-library.
28. (2019, June 01). PyCASP. Available online: https://github.com/egonina/pycasp/.
29. Gonina, E.I. (2013). A Framework for Productive, Efficient and Portable Parallel Computing. [Ph.D. Thesis, EECS Department, University of California].
30. (2019, June 01). Seewave 2.1.3. Available online: https://cran.r-project.org/web/packages/seewave/index.html.
31. (2019, June 01). Bob 2.1.3. Available online: https://www.idiap.ch/software/bob/.
32. Anjos, A., Shafey, L.E., Wallace, R., Günther, M., McCool, C., and Marcel, S. (November, January 29). Bob: A free signal processing and machine learning toolbox for researchers. Proceedings of the 20th ACM Conference on Multimedia Systems (ACMMM), Nara, Japan.
33. (2019, June 01). Scikit-learn 0.21.2. Available online: https://scikit-learn.org/stable/.
34. Comparison of techniques for environmental sound recognition10.1016/S0167-8655(03)00147-8 ↗
35. (2019, August 07). Detection and Classification of Acoustic Scenes and Events (DCASE), Challenge 2019, Task 5: Urban Sound Tagging. Available online: http://dcase.community/challenge2019/task-urban-sound-tagging.
36. Jekic, N., and Pester, A. Environmental Sound Recognition with Classical Machine Learning Algorithms. International Conference on Remote Engineering and Virtual Instrumentation, Duesseldorf, Germany, 21–23 March 2018, Springer.10.1007/978-3-319-95678-7_2 ↗
37. (2019, September 01). FreeSound: collaborative database of creative-commons licensed sound for musicians and sound lovers. Available online: https://freesound.org/.
38. (2019, September 01). FreeSoundEffects. Available online: https://www.freesoundeffects.com/free-sounds/airplane-10004/.
39. Taking AI to the edge: Google’s TPU now comes in a maker-friendly package