journal article·2020-05-13Open access

Sonic Watermarking Method for Ensuring the Integrity of Audio Recordings

Robert-Alexandru Dobre, Radu-Ovidiu Preda, Marian Vlădescu

Applied Sciences· Volume 10· Issue 10

Abstract

Methods for inspecting the integrity of audio recordings become a necessity. The evolution of technology allowed the manufacturing of small, performant, recording devices and significantly decreased the difficulty of audio editing. Any person that participates in a conversation can secretly record it, obtaining their own version of the audio captured using their personal device. The recordings can be easily edited afterwards to change the meaning of the message. The challenge is to prove if recordings were tampered with or not. A reliable solution for this was the highly acclaimed Electrical Network Frequency (ENF) criterion. Newer recording devices are built to avoid picking up the electrical network signal because, from the audio content point of view, it represents noise. Thus, the classic ENF criterion becomes less effective for recordings made with newer devices. The paper describes a novel sonic watermarking (i.e., the watermark is acoustically summed with the dialogue) solution, based on an ambient sound that can be easily controlled and is not suspicious to listeners: the ticking of a clock. This signal is used as a masker for frequency-swept (chirp) signals that are used to encode the ENF and embed it into all the recordings made in a room. The ENF embedded using the proposed watermark solution can be extracted and checked at any later moment to determine if a recording has been tampered with, thus allowing the use of the ENF criterion principles in checking the recordings made with newer devices. The experiments highlight that the method offers very good results in ordinary real-world conditions.
Source: crossref · Quality: baseline

Research context

OpenAlex topics: Music and Audio Processing · Speech and Audio Processing · Digital Media Forensic Detection

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

Electronic Technology and Reliability Department, Politehnica University of Bucharest, 061071 Bucharest, Romania

Telecommunications Department, Politehnica University of Bucharest, 061071 Bucharest, Romania

Funding

Operational Programme Human Capital of the Ministry of European Funds through the Financial Agreement “Developing the entrepreneurial skills of the PhD students and postdoctoral students - key to career success (A-Succes)”

References (43)

Show source-provided references
1. Audio authenticity: Detecting ENF discontinuity with high precision phase analysis10.1109/TIFS.2010.2051270 ↗
2. Cooper, A. (2010, January 17–19). Detecting Butt-spliced Edits in Forensic Digital Audio Recordings. Proceedings of the 39th International Conference: Audio Forensics: Practices and Challenges, Hillerod, Denmark.
3. Luo, D., Yang, R., and Huang, J. (2014, January 4–9). Detecting Double Compressed AMR Audio Using Deep Learning. Proceedings of the IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), Florence, Italy.10.1109/ICASSP.2014.6854084 ↗
4. Digital Audio Recording Analysis: The Electric Network Frequency (ENF) Criterion10.1558/sll.2005.12.1.63 ↗
5. Application of the Electrical Network Frequency (ENF) Criterion–A case of a Digital Recording10.1016/j.forsciint.2004.11.015 ↗
6. (2020, March 23). Measurement of the Mains Frequency. Available online: www.mainsfrequency.com.
7. Huijbregtse, M., and Geradts, Z. Using the ENF Criterion for Determining the Time of Recording of Short Digital Audio Recordings. Proceedings of the IWCF ′09: Proceedings of the 3rd International Workshop on Computational Forensics, The Hague, The Netherlands, 13–14 August 2009.10.1007/978-3-642-03521-0_11 ↗
8. (2020, May 07). The Hum that Helps to Fight Crime. Available online: www.bbc.com/news/science-environment-20629671.
9. (2020, May 07). Power Grid Fluctuations Hidden in Audio Recordings Proved a Powerful Tool for Police Forensics. Available online: https://phys.org/news/2018-02-power-grid-fluctuations-hidden-audio.html.
10. Comparison of Discrete Cosine Transforms (DCT), Discrete Fourier Transforms (DFT), and Discrete Wavelet Transforms (DWT) in Digital Image Watermarking
11. Blind audio watermarking in transform domain based on singular value decomposition and exponential-log operations10.13164/re.2017.0552 ↗
12. Robust and high-quality time-domain audio watermarking based on low-frequency amplitude modification10.1109/TMM.2005.861292 ↗
13. Robust audio watermarking using improved TS echo hiding10.1016/j.dsp.2009.04.003 ↗
14. Robust audio watermarking in the time domain10.1109/6046.923822 ↗
15. Patchwork-Based multi-layer audio watermarking10.1109/TASLP.2017.2749001 ↗
16. Xiang, S.J., and Li, Z.H. (2017). Reversible audio data hiding algorithm using noncausal prediction of alterable orders. EURASIP J. Audio Speech Music Process., 4.10.1186/s13636-017-0101-9 ↗
17. Variable-dimensional vector modulation for perceptual-based DWT blind audio watermarking with adjustable payload capacity10.1016/j.dsp.2014.04.014 ↗
18. Twenty years of digital audio watermarking—A comprehensive review10.1016/j.sigpro.2016.04.005 ↗
19. Nita, V.A., and Ciobanu, A. (2018, January 15−20). Tic-Tac, Forgery Time Has Run-Up! Live Acoustic Watermarking For Integrity Check in Forensic Applications. Proceedings of the 2018 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), Calgary, AB, Canada.10.1109/ICASSP.2018.8461538 ↗
20. Dobre, R.A., Preda, R.O., and Marcu, A.E. (2019, January 23−26). TIC-TAC Based Live Acoustic Watermarking With Improved Forgery Detection Performances. Proceedings of the 2019 IEEE 25th International Symposium for Design and Technology in Electronic Packaging (SIITME), Cluj-Napoca, Romania.10.1109/SIITME47687.2019.8990876 ↗
21. An International Comparison of Long-term Average Speech Spectra10.1121/1.410152 ↗
22. (2020, May 12). 7 kHz Audio Coding within 64 kbit/s. ITU-T Rec. G.722. Available online: https://www.itu.int/rec/dologin_pub.asp?lang=f&id=T-REC-G.722-198811-S!!PDF-E&type=items.
23. Matched Filter Bank for Detection of L inear Frequency Modulated Chirp Signals10.1109/TAES.2017.2649162 ↗
24. (2020, May 12). ENTSO-E Policy 1: Load Frequency Control and Performance, Chapter A. Available online: https://erranet.org/wp-content/uploads/2017/02/Policy_1_final.pdf.
25. Wide-area Frequency Monitoring Network (FNET) Architecture and Applications10.1109/TSG.2010.2050345 ↗
26. Spanias, A., Painter, T., and Atti, V. (2007). Audio Signal Processing and Coding, John Wiley & Sons.
27. Auditory Patterns10.1103/RevModPhys.12.47 ↗
28. Gelfand, S.A. (2018). Hearing -An Introduction to Psychological and Physiological Acoustics, CRC Press, Taylor & Francis Group. [6th ed.].10.1201/9781315154718 ↗
29. Auditory perception and cognition10.1109/MSP.2008.918418 ↗
30. Eggermont, J. (2017). Hearing Loss, Academic Press. [1st ed.].10.1016/B978-0-12-805398-0.00009-8 ↗
31. Suggested Formulae for Calculating Auditory-filter Bandwidths and Excitation Patterns10.1121/1.389861 ↗
32. Derivation of Auditory Filter Shapes from Notched-noise Data10.1016/0378-5955(90)90170-T ↗
33. Charles, M.B., and Cook, E. (1967). Radar Signals: An Introduction to Theory and Application, Academic Press. [1st ed.].
34. Achim, H. (2004). Processing of SAR Data: Fundamentals, Signal Processing, Interferometry, Springer. [1st ed.].
35. Edit Detection in Speech Recordings via Instantaneous Electric Network Frequency Variations10.1109/TIFS.2014.2363524 ↗
36. Gay, S.L., and Benesty, J. (2000). Acoustic Signal Processing for Telecommunication, Kluwer Academic Publisher.10.1007/978-1-4419-8644-3 ↗
37. Benesty, J., Paleologu, C., Gänsler, T., and Ciochină, S. (2011). A Perspective on Stereophonic Acoustic Echo Cancellation, Springer-Verlag Berlin Heidelberg.10.1007/978-3-642-22574-1 ↗
38. Linear System Identification Based on a Kronecker Product Decomposition10.1109/TASLP.2018.2842146 ↗
39. Karjalainen, M., Antsalo, P., Mäkivirta, A., and Välimäki, V. (2004, January 8−11). Pereption of Temporal Decay of Low-frequency Room Modes. Proceedings of the AES 116th Convention, Berlin, Germany.
40. Zhang, J., Shen, Y., Jiang, B., and Li, Y. (2018). Sound Absorption Characterization of Natural Materials and Sandwich Structure Composites. Aerospace, 5.10.3390/aerospace5030075 ↗
41. (2020, March 23). Freesound. Available online: www.freesound.org/.
42. (2020, March 23). Aachen Impulse Response Database. Available online: www.iks.rwth-aachen.de/en/research/tools-downloads/databases/aachen-impulse-response-database.
43. (2020, March 23). Carnegie Melon University. Available online: http://www.speech.cs.cmu.edu/cmu_arctic/cmu_us_bdl_arctic/wav/.