journal article·2025-01-03Open access

Reversible Spectral Speech Watermarking with Variable Embedding Locations Against Spectrum-Based Attacks

Xuping Huang, Akinori Ito

Applied Sciences· Volume 15· Issue 1

Abstract

To guarantee the reliability and integrity of audio, data have been focused on as an essential topic as the fast development of generative AI. Significant progress in machine learning and speech synthesis has increased the potential for audio tampering. In this paper, we focus on the digital watermarking method as a promising method to safeguard the authenticity of audio evidence. Due to the integrity of the original data with probative importance, the algorithm requires reversibility, imperceptibility, and reliability. To meet the requirements, we propose a reversible digital watermarking approach that embeds feature data concentrating in high-frequency intDCT coefficients after transforming data from the time domain into the frequency domain. We explored the appropriate hiding locations against spectrum-based attacks with novel proposed methodologies for spectral expansion for embedding. However, the drawback of fixed expansion is that the stego signal is prone to being detected by a spectral analysis. Therefore, this paper proposes two other new expansion methodologies that embed the data into variable locations—random expansion and adaptive expansion with distortion estimation for embedding—which effectively conceal the watermark’s presence while maintaining high perceptual quality with an average segSNR better than 21.363 dB and average MOS value better than 4.085. Our experimental results demonstrate the efficacy of our proposed method in both sound quality preservation and log-likelihood value, indicating the absolute discontinuity of the spectrogram after embedding is proposed to evaluate the effectiveness of the proposed reversible spectral expansion watermarking algorithm. The result of EER indicated that the adaptive hiding performed best against attacks by spectral analysis.
Source: crossref · Quality: baseline

Research context

OpenAlex topics: Advanced Steganography and Watermarking Techniques · Digital Media Forensic Detection · Chaos-based Image/Signal Encryption

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

Department of Communications Engineering, Graduate School of Engineering, Tohoku University, Sendai 980-8577, Japan

Interdisciplinary Faculty of Science and Engineering, Shimane University, Matsue 690-8504, Japan

Funding

JSPS KAKENHI · “Shimane University Grants for Joint Research Project led by Female Researchers” under the MEXT ”Initiative for Realizing Diversity in the Research Environment (Collaboration Type)

References (49)

Show source-provided references
1. Li, X., Li, K., Zheng, Y., Yan, C., Ji, X., and Xu, W. (2024, January 14–18). Safeear: Content privacy-preserving audio deepfake detection. Proceedings of the 2024 on ACM SIGSAC Conference on Computer and Communications Security, Salt Lake City, UT, USA.10.1145/3658644.3670285 ↗
2. AudioGuard: Speech Recognition System Robust against Optimized Audio Adversarial Examples10.1007/s11042-023-15961-2 ↗
3. Huang, P., Wei, Y., Cheng, P., Ba, Z., Lu, L., Lin, F., Wang, Y., and Ren, K. (2024). Phoneme-Based Proactive Anti-Eavesdropping with Controlled Recording Privilege. arXiv.10.1109/TDSC.2024.3473695 ↗
4. Huang, X., and Ito, A. (2024, January 3–6). A Study on Variable Embedding Locations of Reversible Spectral Speech Watermarking. Proceedings of the 2024 APSIPA Annual Summit and Conference, Macau, China.
5. Huang, X., and Ito, A. (2024). Imperceptible and Reversible Acoustic Watermarking Based on Modified Integer Discrete Cosine Transform Coefficient Expansion. Appl. Sci., 14.10.3390/app14072757 ↗
6. Zhang, X., Sun, X., Sun, X., Sun, W., and Jha, S.K. (2022). Robust Reversible Audio Watermarking Scheme for Telemedicine and Privacy Protection. Comput. Mater. Contin., 71.10.32604/cmc.2022.022304 ↗
7. Audio watermarking for security and non-security applications10.1109/ACCESS.2022.3145950 ↗
8. Yan, D., and Wang, R. (2008, January 15–17). Reversible data hiding for audio based on prediction error expansion. Proceedings of the 2008 International Conference on Intelligent Information Hiding and Multimedia Signal Processing, Harbin, China.10.1109/IIH-MSP.2008.27 ↗
9. Nishimura, A. (2011, January 14–16). Reversible audio data hiding using linear prediction and error expansion. Proceedings of the 2011 Seventh International Conference on Intelligent Information Hiding and Multimedia Signal Processing, Dalian, China.10.1109/IIHMSP.2011.76 ↗
10. Construction of auditory media signal processing infrastructure to prevent media clone attacks10.21820/23987073.2020.2.21 ↗
11. Huang, X., Ono, N., Echizen, I., and Nishimura, A. (2013, January 1–4). Reversible audio information hiding based on integer DCT coefficients with adaptive hiding locations. Proceedings of the Digital-Forensics and Watermarking: 12th International Workshop, IWDW 2013, Auckland, New Zealand. Revised Selected Papers 12.
12. An improved DWT-SVD domain watermarking for medical information security10.1016/j.comcom.2020.01.038 ↗
13. Adaptive LSB quantum image watermarking algorithm based on Haar wavelet transforms10.1007/s11128-023-03926-1 ↗
14. A robust technique for biometric image authentication using invisible watermarking10.1007/s11042-022-13314-z ↗
15. A secure DWT-based dual watermarking scheme for image authentication and copyright protection10.1007/s11042-023-14974-1 ↗
16. A perceptual hash based blind-watermarking scheme for image authentication10.1016/j.eswa.2023.120237 ↗
17. A review of image watermarking for identity protection and verification10.1007/s11042-023-16843-3 ↗
18. A comprehensive survey on image authentication for tamper detection with localization10.1007/s11042-022-13312-1 ↗
19. An efficient self-embedding fragile watermarking scheme for image authentication with two chances for recovery capability10.1007/s11042-022-13270-8 ↗
20. A reversible watermarking for image content authentication based on wavelet transform10.1007/s11760-023-02950-z ↗
21. Efficient Robust Reversible Watermarking Based on ZMs and Integer Wavelet Transform10.1109/TII.2023.3321101 ↗
22. Zhan, C., Leng, L., Chang, C.C., and Horng, J.H. (2024). Reversible Image Fragile Watermarking with Dual Tampering Detection. Electronics, 13.10.3390/electronics13101884 ↗
23. Hybrid reversible watermarking algorithm using histogram shifting and pairwise prediction error expansion10.1007/s11042-023-15508-5 ↗
24. Reversible data hiding: Advances in the past two decades10.1109/ACCESS.2016.2573308 ↗
25. Robust, blindly-detectable, and semi-reversible technique of audio watermarking based on cochlear delay characteristics10.1587/transinf.2014MUP0017 ↗
26. Gao, L., Gao, T., Sheng, G., Cao, Y., and Fan, L. (2012, January 15–17). A new reversible watermarking scheme based on Integer DCT for medical images. Proceedings of the 2012 International Conference on Wavelet Analysis and Pattern Recognition, Xi’an, China.10.1109/ICWAPR.2012.6294751 ↗
27. Toward a better understanding of DCT coefficients in watermarking10.1109/PACIIA.2008.167 ↗
28. The human auditory system and audio10.1016/j.apacoust.2023.109507 ↗
29. A universal audio steganalysis scheme based on multiscale spectrograms and DeepResNet10.1109/TDSC.2022.3141121 ↗
30. Carvajal-Gámez, B.E., Castillo-Martínez, M.A., Castañeda-Briones, L.A., Gallegos-Funes, F.J., and Díaz-Casco, M.A. (2024). Audio Steganalysis Estimation with the Goertzel Algorithm. Appl. Sci., 14.10.3390/app14146000 ↗
31. Steganalysis of Compressed Speech Based on Global and Local Correlation Mining10.1109/ACCESS.2022.3194051 ↗
32. MP3 steganalysis based on joint point-wise and block-wise correlations10.1016/j.ins.2019.10.037 ↗
33. Digital video tampering detection: An overview of passive techniques10.1016/j.diin.2016.06.003 ↗
34. Tampering detection in compressed digital video using watermarking10.1109/TIM.2014.2299371 ↗
35. Image watermarking for tamper detection
36. Shallow and deep feature fusion for digital audio tampering detection10.1186/s13634-022-00900-4 ↗
37. Huang, X., Echizen, I., and Nishimura, A. (2010, January 15–17). A new approach of reversible acoustic steganography for tampering detection. Proceedings of the 2010 Sixth International Conference on Intelligent Information Hiding and Multimedia Signal Processing, Darmstadt, Germany.10.1109/IIHMSP.2010.137 ↗
38. Blind tamper detection in audio using chirp based robust watermarking
39. Sripradha, R., and Deepa, K. (2020, January 3–5). A new fragile image-in-audio watermarking scheme for tamper detection. Proceedings of the 2020 3rd International Conference on Intelligent Sustainable Systems (ICISS), Palladam, India.10.1109/ICISS49785.2020.9316132 ↗
40. A survey on digital signatures and its applications
41. Practical Attacks on Digital Signatures Using MD5 Message Digest
42. Grieu, F. (2000, January 14–18). A Chosen Messages Attack on the ISO/IEC 9796-1 Signature Scheme. Proceedings of the International Conference on the Theory and Application of Cryptographic Techniques, Bruges, Belgium.10.1007/3-540-45539-6_5 ↗
43. Attacks on digital watermarks: Classification, estimation based attacks, and benchmarks10.1109/35.940053 ↗
44. Critical review of image steganalysis techniques
45. Shehab, D.A., and Alhaddad, M.J. (2022). Comprehensive survey of multimedia steganalysis: Techniques, evaluations, and trends in future research. Symmetry, 14.10.3390/sym14010117 ↗
46. Current trends in steganalysis: A critical survey10.1109/ICARCV.2004.1468971 ↗
47. International Telecommunication Union (2024, November 27). Perceptual Evaluation of Speech Quality (PESQ): An Objective Method for End-to-End Speech Quality Assessment of Narrow-Band Telephone Networks and Speech Codecs. ITU-T Recommendation P.862.1. Available online: https://cir.nii.ac.jp/crid/1574231874837257984.
48. Dang, M., and Nguyen, T.N. (2023). Digital face manipulation creation and detection: A systematic review. Electronics, 12.10.3390/electronics12163407 ↗
49. Herre, J., and Dick, S. (2019). Psychoacoustic models for perceptual audio coding—A tutorial review. Appl. Sci., 9.10.3390/app9142854 ↗