Exploiting Balcony Sound Atmospheres for Automatic Prediction of Floors with a Voted-Majority Approach Based on Neural Networks
Source abstract
Abstract
This paper tackles the challenging task of automatically predicting the floor of a balcony based on a sound bound of two minutes recorded on that balcony. The sound fragments are typical of the environment, as nothing out of the usual can be heard in them. However, there is a good probability that, when hearing a fragment in quiet surroundings with consistent metropolitan background noise, it would not be straightforward to determine or estimate the floor height. In our experiments, it was found that sound chunks lasting 5 s can be identified with high accuracy even with a small number of training samples. In addition, when using a late fusion strategy to combine the outputs of classifiers trained on two modalities of the sound tracks, the floors of these bands are perfectly correctly classified. This result was consistent throughout all twenty tests when training and test sets were chosen at random, supporting the viability of the suggested method.
Source: crossref · Quality: baseline
Research context
OpenAlex topics: Music and Audio Processing · Speech and Audio Processing · Anomaly Detection Techniques and Applications
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
Affiliations
Computer Science Laboratory, LIG, Université Grenoble Alpes, 38400 Saint-Martin-d’Hères, France
References (37)
Show source-provided references
1. Why are the Design and Development of Public Spaces Significant for Cities?10.1068/b260879 ↗
2. Jacobs, J. (1993). The Death and Life of Great American Cities, Vintage.
3. Gehl, J., and Mortensen, L. (2010). Cities for People, Island Press.
4. Pirhosseinloo, H. (2019). Habiter la Façade: La Conquête D’une Épaisseur Sensible: Les Dispositifs de Façade Épaisse dans les Logements Collectifs des Écoquartiers: Conception Architecturale et Ambiances. [Ph.D. Thesis, Université Grenoble Alpes].
5. Accon, AECOM, Directorate-General for Environment (European Commission), and The Centre for Strategy & Evaluation Services LLP (CSES) (2016). Evaluation of Directive 2002/49/EC Relating to the Assessment and Management of Environmental Noise: Final Report, Publications Office.
6. Cunha, A.D. (2011). Espaces et Sociétés, Érès.
7. Senses of place: Architectural design for the multisensory mind10.1186/s41235-020-00243-4 ↗
8. Rémy, N., Pirhosseinloo, H., Bardyn, J.L., Chelkoff, G., Said, N.G., and Marchal, T. (2016). Esquis’sons! Outils d’aide à la Conception d’Environnements Sonores Durables, ENSAG. Research Report 88, Cresson; ADEME, Direction Villes et territoires durables.
9. Effects of apartment building façade and balcony design on the reduction of exterior noise10.1016/j.buildenv.2006.10.044 ↗
10. Sehili, M.E.A. (2013). Environmental Sounds Recognition in a Domotic Context. [Ph.D. Thesis, Institut National des Télécommunications].
11. Urban sound tagging with attention-based recurrent neural networks
12. Piczak, K.J. (2015, January 17–20). Environmental sound classification with convolutional neural networks. Proceedings of the 2015 IEEE 25th International Workshop on Machine Learning for Signal Processing (MLSP), Boston, MA, USA.10.1109/MLSP.2015.7324337 ↗
13. A machine learning for environmental noise classification in smart cities
14. Awad, M., and Khanna, R. (2015). Efficient Learning Machines: Theories, Concepts, and Applications for Engineers and System Designers, Apress.10.1007/978-1-4302-5990-9 ↗
15. Mohri, M., Rostamizadeh, A., and Talwalkar, A. (2018). Foundations of Machine Learning, MIT Press. [2nd ed.].
16. Ghahramani, Z. (2004). Advanced Lectures on Machine Learning: ML Summer Schools 2003, Canberra, Australia, 2–14 February 2003, Tübingen, Germany, 4–16 August 2003, Revised Lectures, Springer.
17. Amini, M.R., and Usunier, N. (2015). Learning with Partially Labeled and Interdependent Data, Springer.10.1007/978-3-319-15726-9 ↗
18. Sutton, R.S., and Barto, A.G. (2018). Reinforcement Learning: An Introduction, MIT Press.
19. Pirhosseinloo, H., and Said, N.G. (2017, January 20–21). Towards a typology of listening situations: The balcony as a sonic interface in evolution. Proceedings of the International Conference for Sustainable Design of the Built Environment (SDBE), London, UK.
20. Esquissons (2022, September 18). Présentation d’EsquisSons! 2015–2022. Available online: https://www.esquissons.fr/outils/presentation-desquissons/.
21. Vanderveer, N.J. (1979). Ecological Acoustics: Human Perception of Environmental Sounds. [Ph.D. Thesis, Cornell University].
22. Independent component analysis, A new concept?10.1016/0165-1684(94)90029-9 ↗
23. Lee, T.W. (1998). Independent Component Analysis: Theory and Applications, Kluwer Academic Publishers.10.1007/978-1-4757-2851-4_2 ↗
24. Comparison of Different Implementations of MFCC10.1007/BF02943243 ↗
25. Flanagan, J. (1972). Speech Analysis, Synthesis and Perception, Springer.10.1007/978-3-662-01562-9 ↗
26. Neocognitron: A Self-organizing Neural Network Model for a Mechanism of Pattern Recognition Unaffected by Shift in Position10.1007/BF00344251 ↗
27. Backpropagation applied to handwritten zip code recognition10.1162/neco.1989.1.4.541 ↗
28. Hasanpour, S.H., Rouhani, M., Fayyaz, M., and Sabokrou, M. (2016). Lets keep it simple, Using simple architectures to outperform deeper and more complex architectures. arXiv.
29. Gadzicki, K., Khamsehashari, R., and Zetzsche, C. (2020, January 6–9). Early vs Late Fusion in Multimodal Convolutional Neural Networks. Proceedings of the 2020 IEEE 23rd International Conference on Information Fusion (FUSION), Rustenburg, South Africa.10.23919/FUSION45008.2020.9190246 ↗
30. Vector score alpha integration for classifier late fusion10.1016/j.patrec.2020.05.014 ↗
31. Pattern recognition techniques for provenance classification of archaeological ceramics using ultrasounds10.1016/j.patrec.2020.04.013 ↗
32. Manning, C.D., Raghavan, P., and Schütze, H. (2008). Introduction to Information Retrieval, Cambridge University Press.10.1017/CBO9780511809071 ↗
33. Wolfe, D.A. (2012). Selected Works of E. L. Lehmann, Springer.
34. Hastie, T., Tibshirani, R., and Friedman, J. (2008). The Elements of Statistical Learning, Springer.10.1007/978-0-387-84858-7 ↗
35. Ho, T.K. (1995, January 14–16). Random decision forests. Proceedings of the 3rd International Conference on Document Analysis and Recognition, Montreal, QC, Canada.
36. Usunier, N., Amini, M.R., and Goutte, C. (2011, January 5–9). Multiview Semi-supervised Learning for Ranking Multilingual Documents. Proceedings of the European Conference on Machine Learning and Knowledge Discovery in Databases ECMLPKDD, Athenes, Greece.10.1007/978-3-642-23808-6_29 ↗
37. Rademacher Complexity Bounds for a Penalized Multi-class Semi-supervised Algorithm10.1613/jair.5638 ↗