journal article·2022-01-29Open access

GANBA: Generative Adversarial Network for Biometric Anti-Spoofing

Alejandro Gomez-Alanis, Jose A. Gonzalez-Lopez, Antonio M. Peinado

Applied Sciences· Volume 12· Issue 3

Abstract

Automatic speaker verification (ASV) is a voice biometric technology whose security might be compromised by spoofing attacks. To increase the robustness against spoofing attacks, presentation attack detection (PAD) or anti-spoofing systems for detecting replay, text-to-speech and voice conversion-based spoofing attacks are being developed. However, it was recently shown that adversarial spoofing attacks may seriously fool anti-spoofing systems. Moreover, the robustness of the whole biometric system (ASV + PAD) against this new type of attack is completely unexplored. In this work, a new generative adversarial network for biometric anti-spoofing (GANBA) is proposed. GANBA has a twofold basis: (1) it jointly employs the anti-spoofing and ASV losses to yield very damaging adversarial spoofing attacks, and (2) it trains the PAD as a discriminator in order to make them more robust against these types of adversarial attacks. The proposed system is able to generate adversarial spoofing attacks which can fool the complete voice biometric system. Then, the resulting PAD discriminators of the proposed GANBA can be used as a defense technique for detecting both original and adversarial spoofing attacks. The physical access (PA) and logical access (LA) scenarios of the ASVspoof 2019 database were employed to carry out the experiments. The experimental results show that the GANBA attacks are quite effective, outperforming other adversarial techniques when applied in white-box and black-box attack setups. In addition, the resulting PAD discriminators are more robust against both original and adversarial spoofing attacks.
Source: crossref · Quality: baseline

Research context

OpenAlex topics: Speech Recognition and Synthesis · Speech and Audio Processing · Digital Media Forensic Detection

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

Department of Signal Theory, Telematics and Communications, University of Granada, 18010 Granada, Spain

Funding

FEDER/Junta de Andalucía-Consejería de 464 Transformación Económica, Industria, Conocimiento y Universidades · Spanish State Research Agency (SRA) · Spanish Ministry of Education · Spanish Ministry of Science, Innovation and Universities

References (50)

Show source-provided references
1. Biometrics: A Tool for Information Security10.1109/TIFS.2006.873653 ↗
2. A Kernel Density Estimation Based Loss Function and its Application to ASV-Spoofing Detection10.1109/ACCESS.2020.3000641 ↗
3. A Gated Recurrent Convolutional Neural Network for Robust Spoofing Detection10.1109/TASLP.2019.2937413 ↗
4. Anti-Spoofing for Text-Independent Speaker Verification: An Initial Database, Comparison of Countermeasures, and Human Performance10.1109/TASLP.2016.2526653 ↗
5. ISO (2021, December 28). Presentation Attack Detection. Available online: https://www.iso.org/standard/67381.html.
6. Wu, Z., Kinnunen, T., Evans, N.W.D., Yamagishi, J., Hanilçi, C., Sahidullah, M., and Sizov, A. (2015, January 6–10). ASVspoof 2015: The First Automatic Speaker Verification Spoofing and Countermeasures Challenge. Proceedings of the Sixteenth Annual Conference of the International Speech Communication Association, Dresden, Germany.10.21437/Interspeech.2015-462 ↗
7. Korshunov, P., Marcel, S., Muckenhirn, H., Gonçalves, A.R., Souza Mello, A.G., Velloso Violato, R.P., Simoes, F.O., Neto, M.U., de Assis Angeloni, M., and Stuchi, J.A. (2016, January 6–9). Overview of BTAS 2016 speaker anti-spoofing competition. Proceedings of the 2016 IEEE 8th International Conference on Biometrics Theory, Applications and Systems (BTAS), Niagara Falls, NY, USA.10.1109/BTAS.2016.7791200 ↗
8. Kinnunen, T., Sahidullah, M., Delgado, H., Todisco, M., Evans, N.W.D., Yamagishi, J., and Lee, K.A. (2017, January 20–24). The ASVspoof 2017 Challenge: Assessing the Limits of Replay Spoofing Attack Detection. Proceedings of the Interspeech 2017, Stockholm, Sweden.10.21437/Interspeech.2017-1111 ↗
9. Todisco, M., Wang, X., Vestman, V., Sahidullah, M., Delgado, H., Nautsch, A., Yamagishi, J., Evans, N., Kinnunen, T., and Lee, K. (2019, January 15–19). ASVspoof 2019: Future Horizons in Spoofed and Fake Audio Detection. Proceedings of the Interspeech 2019, Graz, Austria.10.21437/Interspeech.2019-2249 ↗
10. Yamagishi, J., Wang, X., Todisco, M., Sahidullah, M., Patino, J., Nautsch, A., Liu, X., Lee, K.A., Kinnunen, T., and Evans, N. (2021, January 16). ASVspoof 2021: Accelerating progress in spoofed and deepfake speech detection. Proceedings of the 2021 Edition of the Automatic Speaker Verification and Spoofing Countermeasures Challenge, Online.10.21437/ASVSPOOF.2021-8 ↗
11. On Joint Optimization of Automatic Speaker Verification and Anti-spoofing in the Embedding Space10.1109/TIFS.2020.3039045 ↗
12. Gomez-Alanis, A., Peinado, A.M., Gonzalez, J.A., and Gomez, A.M. (2018, January 2–6). A Deep Identity Representation for Noise Robust Spoofing Detection. Proceedings of the Interspeech 2018, Hyderabad, India.10.21437/Interspeech.2018-1909 ↗
13. Gomez-Alanis, A., Peinado, A.M., Gonzalez, J.A., and Gomez, A.M. (2018, January 21–23). Performance evaluation of front- and back-end techniques for ASV spoofing detection systems based on deep features. Proceedings of the Iberspeech 2018, Barcelona, Spain.10.21437/IberSPEECH.2018-10 ↗
14. Gomez-Alanis, A., Peinado, A.M., Gonzalez, J.A., and Gomez, A.M. (2019, January 15–19). A Light Convolutional GRU-RNN Deep Feature Extractor for ASV Spoofing Detection. Proceedings of the Interspeech 2019, Graz, Austria.10.21437/Interspeech.2019-2212 ↗
15. Gomez-Alanis, A., Peinado, A.M., and Gonzalez, J.A. (2021, January 24-25). Adversarial Transformation of Spoofing Attacks for Voice Biometrics. Proceedings of the Iberspeech 2020, Valladolid, Spain.10.21437/IberSPEECH.2021-54 ↗
16. Liu, S., Wu, H., Lee, H.Y., and Meng, H. (2019, January 14–18). Adversarial Attacks on Spoofing Countermeasures of Automatic Speaker Verification. Proceedings of the IEEE Automatic Speech Recognition and Understanding Workshop (ASRU), Singapore.10.1109/ASRU46091.2019.9003763 ↗
17. Zhang, Y., Jiang, Z., Villalba, J., and Dehak, N. (2020, January 25–29). Black-box Attacks on Spoofing Countermeasures Using Transferability of Adversarial Examples. Proceedings of the Interspeech 2020, Shanghai, China.10.21437/Interspeech.2020-2834 ↗
18. Adversarial Attacks and Defenses in Deep Learning10.1016/j.eng.2019.12.012 ↗
19. Szegedy, C., Zaremba, W., Sutskever, I., Bruna, J., Erhan, D., Goodfellow, I., and Fergus, R. (2014, January 14–16). Intriguing properties of neural networks. Proceedings of the International Conference on Learning Representations (ICLR), Banf, AB, Canada.
20. Speaker Recognition by Machines and Humans: A Tutorial Review10.1109/MSP.2015.2462851 ↗
21. Snyder, D., Garcia-Romero, D., Sell, G., Povey, D., and Khudanpur, S. (2018, January 15–20). X-Vectors: Robust DNN Embeddings for Speaker Recognition. Proceedings of the 2018 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), Calgary, AB, Canada.10.1109/ICASSP.2018.8461375 ↗
22. Prince, S., and Elder, J.H. (2007, January 14–21). Probabilistic Linear Discriminant Analysis for Inferences About Identity. Proceedings of the IEEE International Conference on Computer Vision, Rio de Janeiro, Brazil.10.1109/ICCV.2007.4409052 ↗
23. Ioffe, S. (2006, January 7–13). Probabilistic Linear Discriminant Analysis. Proceedings of the European Conference on Computer Vision (ECCV), Graz, Austria.10.1007/11744085_41 ↗
24. Sizov, A., Lee, K.A., and Kinnunen, T. (2014, January 20–22). Unifying Probabilistic Linear Discriminant Analysis Variants in Biometric Authentication. Proceedings of the Structural and Syntactic Pattern Recognition, Joensuu, Finland.10.1007/978-3-662-44415-3_47 ↗
25. Kenny, P. (28–1, January 28). Bayesian Speaker Verification with Heavy-Tailed Priors. Proceedings of the Odyssey 2010, Brno, Czech Republic.
26. Brümmer, N., and de Villiers, E. (28–1, January 28). The Speaker Partitioning Problem. Proceedings of the Odyssey 2010, Brno, Czech Republic.
27. Maximum Likelihood from Incomplete Data via the EM Algorithm10.1111/j.2517-6161.1977.tb01600.x ↗
28. Lee, H.S., Tso, Y., Chang, Y.F., Wang, H.M., and Jeng, S.K. (2014, January 4–9). Speaker Verification using Kernel-based Binary Classifiers with Binary Operation Derived Features. Proceedings of the IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), Florence, Italy.10.1109/ICASSP.2014.6853880 ↗
29. Chingovska, I., Anjos, A., and Marcel, S. (2013, January 23–28). Anti-spoofing in Action: Joint Operation with a Verification System. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Portland, OR, USA.10.1109/CVPRW.2013.22 ↗
30. van Leeuwen, D.A., and Brümmer, N. (2007). An Introduction to Application-Independent Evaluation of Speaker Recognition Systems. Speaker Classification I: Fundamentals and Methods, Springer.10.1007/978-3-540-74200-5_19 ↗
31. The NIST Speaker Recognition Evaluation—Overview, Methodology, Systems, Results, Perspective10.1016/S0167-6393(99)00080-1 ↗
32. Sahidullah, M., Kinnunen, T., and Hanilçi, C. (2015, January 6–10). A Comparison of Features for Synthetic Speech Detection. Proceedings of the Interspeech 2015, Dresden, Germany.10.21437/Interspeech.2015-472 ↗
33. Lavrentyeva, G., Novoselov, S., Malykh, E., Kozlov, A., Kudashev, O., and Shchemelinin, V. (2017, January 20–24). Audio Replay Attack Detection with Deep Learning Frameworks. Proceedings of the Interspeech 2017, Stockholm, Sweden.10.21437/Interspeech.2017-360 ↗
34. Constant-Q Cepstral Coefficients: A Spoofing Countermeasure for Automatic Speaker Verification10.1016/j.csl.2017.01.001 ↗
35. Muckenhirn, H., Magimai-Doss, M., and Marcel, S. (2017, January 20–24). End-to-End Convolutional Neural Network-Based Voice Presentation Attack Detection. Proceedings of the Interspeech 2017, Stockholm, Sweden.10.1109/BTAS.2017.8272715 ↗
36. Tandem Assessment of Spoofing Countermeasures and Automatic Speaker Verification: Fundamentals10.1109/TASLP.2020.3009494 ↗
37. Evaluation of Speaker Verification Security and Detection of HMM-Based Synthetic Speech10.1109/TASL.2012.2201472 ↗
38. Joint Speaker Verification and Antispoofing in the i-Vector Space10.1109/TIFS.2015.2407362 ↗
39. Kinnunen, T., Lee, K., Delgado, H., Evans, N., Todisco, M., Sahidullah, M., Yamagishi, J., and Reynolds, D. (2018, January 26–29). t-DCF: A Detection Cost Function for the Tandem Assessment of Spoofing Countermeasures and Automatic Speaker Verification. Proceedings of the Odyssey 2018, Les Sables d’Olonne, France.10.21437/Odyssey.2018-44 ↗
40. Goodfellow, I.J., Shlens, J., and Szegedy, C. (2015, January 7–9). Explaining and Harnessing Adversarial Examples. Proceedings of the International Conference on Learning Representations (ICLR), San Diego, CA, USA.
41. Deng, Y., and Karam, L.J. (2020, January 25–28). Universal Adversarial Attack Via Enhanced Projected Gradient Descent. Proceedings of the IEEE International Conference on Image Processing (ICIP), Abu Dhabi, United Arab Emirates.10.1109/ICIP40778.2020.9191288 ↗
42. Pedroni, V.A. (2013). Finite State Machines in Hardware: Theory and Design (with VHDL and SystemVerilog), The MIT Press.10.7551/mitpress/9657.001.0001 ↗
43. Wang, X., Yamagishi, J., Todisco, M., Delgado, H., Nautsch, A., Evans, N., Ling, Z.H., Becker, M., Kinnunen, T., and Vestman, V. (2020). ASVspoof 2019: A large-scale public database of synthetized, converted and replayed speech. Computer Speech and Language, Elsevier.10.1016/j.csl.2020.101114 ↗
44. Nagrani, A., Chung, J.S., and Zisserman, A. (2017, January 20–24). VoxCeleb: A Large-Scale Speaker Identification Dataset. Proceedings of the Interspeech 2017, Stockholm, Sweden.10.21437/Interspeech.2017-950 ↗
45. Kaldi ASR (2021, December 28). SRE16 Xvector Model. Available online: http://kaldi-asr.org/models/m3.
46. Lai, C.I., Chen, N., Villalba, J., and Dehak, N. (2019, January 15–19). ASSERT: Anti-Spoofing with Squeeze-Excitation and Residual Networks. Proceedings of the Interspeech 2019, Graz, Austria.10.21437/Interspeech.2019-1794 ↗
47. Kingma, D.P., and Ba, J. (2015, January 7–9). Adam: A Method for Stochastic Optimization. Proceedings of the International Conference on Learning Representations (ICLR), San Diego, CA, USA.
48. Paszke, A., Gross, S., Chintala, S., Chanan, G., Yang, E., Devito, Z., Lin, Z., Desmaison, A., Antiga, L., and Lerer, A. (2017, January 4–9). Automatic differentiation in PyTorch. Proceedings of the Neural Information Processing Systems (NIPS), Long Beach, CA, USA.
49. Uesato, J., O’Donoghue, B., Kohli, P., and van den Oord, A. (2018, January 10–15). Adversarial Risk and the Dangers of Evaluating Against Weak Attacks. Proceedings of the 35th International Conference on Machine Learning, Stockholm, Sweden.
50. Korshunov, P., and Marcel, S. (2016, January 8–12). Cross-Database Evaluation of Audio-Based Spoofing Detection Systems. Proceedings of the Interspeech 2017, San Francisco, CA, USA.10.21437/Interspeech.2016-1326 ↗