Constraint-Based Time-Scale Modification of Music Recordings for Noise Beautification
Source abstract
Abstract
In magnetic resonance imaging (MRI), a patient is exposed to beat-like knocking sounds, often interrupted by periods of silence, which are caused by pulsing currents of the MRI scanner. In order to increase the patient’s comfort, one strategy is to play back ambient music to induce positive emotions and to reduce stress during the MRI scanning process. To create an overall acceptable acoustic environment, one idea is to adapt the music to the locally periodic acoustic MRI noise. Motivated by this scenario, we consider in this paper the general problem of adapting a given music recording to fulfill certain temporal constraints. More concretely, the constraints are given by a reference time axis with specified time points (e.g., the time positions of the MRI scanner’s knocking sounds). Then, the goal is to temporally modify a suitable music recording such that its beat positions align with the specified time points. As one technical contribution, we model this alignment task as an optimization problem with the objective to fulfill the constraints while avoiding strong local distortions in the music. Furthermore, we introduce an efficient algorithm based on dynamic programming for solving this task. Based on the computed alignment, we use existing time-scale modification procedures for locally adapting the music recording. To illustrate the outcome of our procedure, we discuss representative synthetic and real-world examples, which can be accessed via an interactive website. In particular, these examples indicate the potential of automated methods for noise beautification within the MRI application scenario.
Source: crossref · Quality: baseline
Research context
OpenAlex topics: Music and Audio Processing · Hearing Loss and Rehabilitation · Neuroscience and Music Perception
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
Affiliations
International Audio Laboratories Erlangen, 91058 Erlangen, Germany
Siemens Healthcare GmbH, 91052 Erlangen, Germany
References (32)
Show source-provided references
1. McRobbie, D.W., Moore, E.A., Graves, M.J., and Prince, M.R. (2003). MRI from Picture to Proton, Cambridge University Press.
2. Nitz, W. (2018, March 12). Method for Operating a Magnetic Resonance Device Using a Gradient Pulse Sequence So That Two Impulses Combine to Form an Acoustic Harmonic So That Mechanical Noise Caused by the Gradient Pulses Is Reduced. Available online: https://register.dpma.de/DPMAregister/pat/PatSchrifteneinsicht?docId=DE10043476A1.
3. Schreiber, A. (2018, March 12). Device for Protecting the Hearing From Loud MRT Sounds. Available online: https://register.dpma.de/DPMAregister/pat/PatSchrifteneinsicht?docId=DE102005000848B3.
4. Schmale, I., and Koehler, T. (2018, March 12). Gradient Coil Noise Masking for Mpi Device. Available online: https://patentscope.wipo.int/search/en/detail.jsf?docId=WO2010018534.
5. The effect of noise-cancelling headphones or music on pain perception and anxiety in men undergoing transrectal prostate biopsy10.1016/j.urology.2011.09.037 ↗
6. Effect of music on level of anxiety in patients undergoing colonoscopy without sedation10.1016/j.jcma.2016.08.010 ↗
7. Popescu, S. (2013). MR synchronous music. J. Tech. Up2date #06.
8. Cliff, D. (2000). Hang the DJ: Automatic Sequencing and Seamless Mixing of Dance-Music Tracks, HP Laboratories. Technical Report.
9. Ishizaki, H., Hoashi, K., and Takishima, Y. (2009, January 26–30). Full-automatic DJ mixing system with Optimal tempo adjustment based on measurement function of user discomfort. Proceedings of the International Society for Music Information Retrieval Conference (ISMIR), Kobe, Japan.
10. Jehan, T. (2005). Creating Music by Listening. [Ph.D. Thesis, Massachusetts Institute of Technology].
11. Moens, B., van Noorden, L., and Leman, M. (2010, January 21–24). D-jogger: Syncing music with walking. Proceedings of the 7th Sound and Music Computing Conference, Barcelona, Spain.
12. Moens, B., Muller, C., van Noorden, L., Franěk, M., Celie, B., Boone, J., Bourgois, J., and Leman, M. (2014). Encouraging Spontaneous Synchronisation with D-Jogger, an Adaptive Music Player that Aligns Movement and Music. PLoS ONE, 9.10.1371/journal.pone.0114234 ↗
13. Liu, Z., Wang, C., Bai, Y., Wang, H., and Wang, J. (December, January 28). Musiz: A Generic Framework for Music Resizing with Stretching and Cropping. Proceedings of the 19th ACM International Conference on Multimedia, Scottsdale, AZ, USA.
14. Data-driven sound track generation
15. Wenger, S., and Magnor, M. (2011, January 11–15). Constrained example-based audio synthesis. Proceedings of the 2011 IEEE International Conference on Multimedia and Expo (ICME 2011), Barcelona, Spain.10.1109/ICME.2011.6011902 ↗
16. Wenger, S., and Magnor, M. (November, January 29). A Genetic Algorithm for Audio Retargeting. Proceedings of the 20th ACM International Conference on Multimedia, Nara, Japan.
17. Scalable Music: Automatic Music Retargeting and Synthesis10.1111/cgf.12054 ↗
18. Cormen, T.H., Leiserson, C.E., Rivest, R.L., and Stein, C. (2009). Introduction to Algorithms, The MIT Press. [3rd ed.].
19. Müller, M. (2007). Information Retrieval for Music and Motion, Springer.10.1007/978-3-540-74048-3 ↗
20. Driedger, J., and Müller, M. (2016). A Review on Time-Scale Modification of Music Signals. Appl. Sci., 6.10.3390/app6020057 ↗
21. Verhelst, W., and Roelands, M. (1993, January 27–30). An overlap-add technique based on waveform similarity (WSOLA) for high quality time-scale modification of speech. Proceedings of the IEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP), Minneapolis, MN, USA.10.1109/ICASSP.1993.319366 ↗
22. Phase Vocoder10.1002/j.1538-7305.1966.tb01706.x ↗
23. Implementation of the digital phase vocoder using the fast Fourier transform10.1109/TASSP.1976.1162810 ↗
24. Improved phase vocoder time-scale modification of audio10.1109/89.759041 ↗
25. Improving Time-Scale Modification of Music Signals using Harmonic- Percussive Separation10.1109/LSP.2013.2294023 ↗
26. Driedger, J., and Müller, M. (2014, January 1–5). TSM Toolbox: MATLAB Implementations of Time-Scale Modification Algorithms. Proceedings of the International Conference on Digital Audio Effects (DAFx), Erlangen, Germany.
27. Müller, M. (2015). Fundamentals of Music Processing, Springer.10.1007/978-3-319-21945-5 ↗
28. A Tutorial on Onset Detection in Music Signals10.1109/TSA.2005.851998 ↗
29. Extracting Predominant Local Pulse Information from Music Recordings10.1109/TASL.2010.2096216 ↗
30. Grosche, P., and Müller, M. (2011, January 24–28). Tempogram Toolbox: MATLAB Tempo and Pulse Analysis of Music Recordings. Proceedings of the Late-Breaking and Demo Session of the 12th International Conference on Music Information Retrieval (ISMIR), Miami, FL, USA.
31. Beat Tracking by Dynamic Programming10.1080/09298210701653344 ↗
32. Werner, N., Balke, S., Stöter, F.R., Müller, M., and Edler, B. (2017, January 21–23). trackswitch.js: A Versatile Web-Based Audio Player for Presenting Scientific Results. Proceedings of the Web Audio Conference (WAC), London, UK.