An Audio Copy-Move Forgery Localization Model by CNN-Based Spectral Analysis
Source abstract
Abstract
In audio copy-move forgery forensics, existing traditional methods typically first segment audio into voiced and silent segments, then compute the similarity between voiced segments to detect and locate forged segments. However, audio collected in noisy environments is difficult to segment and manually set, and heuristic similarity thresholds lack robustness. Existing deep learning methods extract features from audio and then use neural networks for binary classification, lacking the ability to locate forged segments. Therefore, for locating audio copy-move forgery segments, we have improved deep learning methods and proposed a robust localization model by CNN-based spectral analysis. In the localization model, the Feature Extraction Module extracts deep features from Mel-spectrograms, while the Correlation Detection Module automatically decides on the correlation between these deep features. Finally, the Mask Decoding Module visually locates the forged segments. Experimental results show that compared to existing methods, the localization model improves the detection accuracy of audio copy-move forgery by 3.0–6.8%and improves the average detection accuracy of forged audio with post-processing attacks such as noise, filtering, resampling, and MP3 compression by over 7.0%.
Source: crossref · Quality: baseline
Research context
OpenAlex topics: Digital Media Forensic Detection · Music and Audio Processing
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
Affiliations
School of Electronic and Electrical Engineering, Shanghai University of Engineering Science, Shanghai 201620, China
School of Electronic Information and Electrical Engineering, Shanghai Jiao Tong University, Shanghai 200240, China
Funding
Natural Science Foundation of China · Natural Science Foundation of Shanghai · Opening Project of Shanghai Key Laboratory of Integrated Administration Technologies for Information Security · Innovation Fund for Industry-University-Research of Chinese Universities
References (25)
Show source-provided references
1. Bevinamarad, P.R., and Shirldonkar, M.S. (2020, January 15–17). Audio forgery detection techniques: Present and past review. Proceedings of the 2020 4th International Conference on Trends in Electronics and Informatics (ICOEI)(48184), Tirunelveli, India.10.1109/ICOEI48184.2020.9143014 ↗
2. Wang, F., Li, C., and Tian, L. (2017, January 27–30). An algorithm of detecting audio copy-move forgery based on DCT and SVD. Proceedings of the 2017 IEEE 17th International Conference on Communication Technology (ICCT), Chengdu, China.10.1109/ICCT.2017.8359911 ↗
3. Copy and move detection in audio recordings using dynamic time warping algorithm10.35940/ijitee.B6678.129219 ↗
4. Li, C., Sun, Y., Meng, X., and Tian, L. (2019, January 16–19). Homologous audio copy-move tampering detection method based on pitch. Proceedings of the 2019 IEEE 19th International Conference on Communication Technology (ICCT), Xi’an, China.10.1109/ICCT46805.2019.8947002 ↗
5. Liu, Z., and Lu, W. (2017, January 26–29). Fast copy-move detection of digital audio. Proceedings of the 2017 IEEE Second International Conference on Data Science in Cyberspace (DSC), Shenzhen, China.10.1109/DSC.2017.11 ↗
6. Huang, X., Liu, Z., Lu, W., Liu, H., and Xiang, S. (2020). Digital Forensics and Forensic Investigations: Breakthroughs in Research and Practice, IGI Global.
7. Copy-move detection of digital audio based on multi-feature decision
8. Küçükuğurlu, B., Ustubioglu, B., and Ulutas, G. (2020, January 7–9). Duplicated Audio Segment Detection with Local Binary Pattern. Proceedings of the 2020 43rd International Conference on Telecommunications and Signal Processing (TSP), Milan, Italy.10.1109/TSP49548.2020.9163568 ↗
9. Blind detection of copy-move forgery in digital audio forensics10.1109/ACCESS.2017.2717842 ↗
10. Multi-feature decision fused detection and localization method for copy-move forgery of digital audio clips
11. Yan, Q., Yang, R., and Huang, J. (2015, January 19–24). Copy-move detection of audio recording with pitch similarity. Proceedings of the 2015 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), South Brisbane, QLD, Australia.10.1109/ICASSP.2015.7178277 ↗
12. Robust copy–move detection of speech recording using similarities of pitch and formant10.1109/TIFS.2019.2895965 ↗
13. Audio authenticity: Duplicated audio segment detection in waveform audio file10.1007/s12204-014-1515-5 ↗
14. Robust Audio Copy-Move Forgery Detection Using Constant Q Spectral Sketches and GA-SVM10.1109/TDSC.2022.3215280 ↗
15. Robust audio copy-move forgery detection on short forged slices using sliding window
16. Detecting audio copy-move forgery with an artificial neural network10.1007/s11760-023-02856-w ↗
17. Mel spectrogram-based audio forgery detection using CNN10.1007/s11760-022-02436-4 ↗
18. Jo, Y.R., Moon, Y.K., Cho, W.I., and Jo, G.S. (2021, January 6–11). Self-attentive vad: Context-aware detection of voice from noise. Proceedings of the ICASSP 2021–2021 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), Toronto, ON, Canada.10.1109/ICASSP39728.2021.9413961 ↗
19. Shahid, M., Beyan, C., and Murino, V. (2021, January 3–8). S-VVAD: Visual voice activity detection by motion segmentation. Proceedings of the IEEE/CVF Winter Conference on Applications of Computer Vision, Waikoloa, HI, USA.10.1109/WACV48630.2021.00238 ↗
20. Acoustic scene classification based on Mel spectrogram decomposition and model merging10.1016/j.apacoust.2021.108258 ↗
21. Heart sound classification using deep learning techniques based on log-mel spectrogram10.1007/s00034-022-02124-1 ↗
22. Res2net: A new multi-scale backbone architecture10.1109/TPAMI.2019.2938758 ↗
23. Dong, S., Xue, J., Fan, C., Zhu, K., Chen, Y., and Lv, Z. (2023). Multi-perspective Information Fusion Res2Net with RandomSpecmix for Fake Speech Detection. arXiv.
24. A survey on vision transformer10.1109/TPAMI.2022.3152247 ↗
25. Wang, D., and Zhang, X. (2015). Thchs-30: A free chinese speech corpus. arXiv.