Deep Watermarking Based on Swin Transformer for Deep Model Protection
Source abstract
Abstract
This study improves existing protection strategies for image processing models by embedding invisible watermarks into model outputs to verify the sources of images. Most current methods rely on CNN-based architectures, which are limited by their local perception capabilities and struggle to effectively capture global information. To address this, we introduce the Swin-UNet, originally designed for medical image segmentation tasks, into the watermark embedding process. The Swin Transformer’s ability to capture global information enhances the visual quality of the embedded image compared to CNN-based approaches. To defend against surrogate attacks, data augmentation techniques are incorporated into the training process, enhancing the watermark extractor’s robustness specifically against surrogate attacks. Experimental results show that the proposed watermarking approach reduces the impact of watermark embedding on visual quality. On a deraining task with color images, the average PSNR reaches 45.85 dB, while on a denoising task with grayscale images, the average PSNR reaches 56.60 dB. Additionally, watermarks extracted from surrogate attacks closely match those from the original framework, with an accuracy of 99% to 100%. These results confirm the Swin Transformer’s effectiveness in preserving visual quality.
Source: crossref · Quality: baseline
Research context
OpenAlex topics: Advanced Steganography and Watermarking Techniques · Digital Media Forensic Detection · Generative Adversarial Networks and Image Synthesis
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
Affiliations
Faculty of Applied Sciences, Macao Polytechnic University, Macao, China
References (34)
Show source-provided references
1. Krizhevsky, A., Sutskever, I., and Hinton, G.E. (2012, January 3–6). ImageNet classification with deep convolutional neural networks. Proceedings of the 26th International Conference on Neural Information Processing Systems-Volume 1, Lake Tahoe, NV, USA.
2. Devlin, J., Chang, M.-W., Lee, K., and Toutanova, K. (2018). Bert: Pre-training of deep bidirectional transformers for language understanding. arXiv.
3. Human-level control through deep reinforcement learning10.1038/nature14236 ↗
4. Parisi, L., Neagu, D., Ma, R., and Campean, F. (2020). QReLU and m-QReLU: Two novel quantum activation functions to aid medical diagnostics. arXiv.
5. Ge, Z., Liu, S., Wang, F., Li, Z., and Sun, J. (2021). Yolox: Exceeding yolo series in 2021. arXiv.
6. Wolf, T., Debut, L., Sanh, V., Chaumond, J., Delangue, C., Moi, A., and Rush, A.M. (2019). Huggingface’s transformers: State-of-the-art natural language processing. arXiv.10.18653/v1/2020.emnlp-demos.6 ↗
7. Papernot, N., McDaniel, P., Goodfellow, I., Jha, S., Celik, Z.B., and Swami, A. (2017, January 2–6). Practical black-box attacks against machine learning. Proceedings of the 2017 ACM on Asia Conference on Computer and Communications Security, Abu Dhabi, United Arab Emirates.10.1145/3052973.3053009 ↗
8. Carlini, N., and Wagner, D. (2017, January 22–24). Towards evaluating the robustness of neural networks. Proceedings of the 2017 IEEE Symposium on Security and Privacy (sp), San Jose, CA, USA.10.1109/SP.2017.49 ↗
9. Uchida, Y., Nagai, Y., Sakazawa, S., and Satoh, S. (2017, January 6–9). Embedding watermarks into deep neural networks. Proceedings of the 2017 ACM on International Conference on Multimedia Retrieval, Bucharest, Romania.10.1145/3078971.3078974 ↗
10. Adi, Y., Baum, C., Cisse, M., Pinkas, B., and Keshet, J. (2018). Turning Your Weakness Into a Strength: Watermarking Deep Neural Networks by Backdooring. arXiv.
11. Dekel, T., Rubinstein, M., Liu, C., and Freeman, W.T. (2017, January 21–26). On the Effectiveness of Visible Watermarks. Proceedings of the 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Honolulu, HI, USA.10.1109/CVPR.2017.726 ↗
12. Choi, K.-C., and Pun, C.-M. (April, January 29). Difference Expansion Based Robust Reversible Watermarking with Region Filtering. Proceedings of the 2016 13th International Conference on Computer Graphics, Imaging and Visualization (CGiV), Beni Mellal, Morocco.10.1109/CGiV.2016.61 ↗
13. Liu, Y. (2020). Multilingual denoising pre-training for neural machine translation. arXiv.10.1162/tacl_a_00343 ↗
14. Ledig, C., Theis, L., Huszár, F., Caballero, J., Cunningham, A., Acosta, A., Aitken, A.P., Tejani, A., Totz, J., and Wang, Z. (2017, January 21–26). Photo-realistic single image super-resolution using a generative adversarial network. Proceedings of the IEEE Conference on Computer Vision And Pattern Recognition, Honolulu, HI, USA.10.1109/CVPR.2017.19 ↗
15. Zhu, J.-Y., Park, T., Isola, P., and Efros, A.A. (2017, January 22–29). Unpaired image-to-image translation using cycle-consistent adversarial networks. Proceedings of the IEEE International Conference on Computer Vision, Venice, Italy.10.1109/ICCV.2017.244 ↗
16. Digital image watermarking using discrete cosine transformation based linear modulation10.1186/s13677-023-00468-w ↗
17. Islam, S.M.M., Debnath, R., and Hossain, S.K.A. (2007, January 7–9). DWT Based Digital Watermarking Technique and its Robustness on Image Rotation, Scaling, JPEG compression, Cropping and Multiple Watermarking. Proceedings of the 2007 International Conference on Information and Communication Technology, Dhaka, Bangladesh.10.1109/ICICT.2007.375386 ↗
18. Exploring the Learning Capabilities of Convolutional Neural Networks for Robust Image Watermarking10.1016/j.cose.2016.11.016 ↗
19. Vukotic, V., Chappelier, V., and Furon, T. (2018, January 11–13). Are Deep Neural Networks good for blind image watermarking?. Proceedings of the 2018 IEEE International Workshop on Information Forensics and Security (WIFS), Singapore.10.1109/WIFS.2018.8630768 ↗
20. Watermarking Deep Neural Networks in Image Processing10.1109/TNNLS.2020.2991378 ↗
21. Jing, J., Deng, X., Xu, M., Wang, J., and Guan, Z. (2021, January 10–17). HiNet: Deep Image Hiding by Invertible Network. Proceedings of the 2021 IEEE/CVF International Conference on Computer Vision (ICCV), Montreal, QC, Canada.10.1109/ICCV48922.2021.00469 ↗
22. DeepMIH: Deep Invertible Network for Multiple Image Hiding10.1109/TPAMI.2022.3141725 ↗
23. Tancik, M., Mildenhall, B., and Ng, R. (2020, January 13–19). Stegastamp: Invisible hyperlinks in physical photographs. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, Seattle, WA, USA.10.1109/CVPR42600.2020.00219 ↗
24. Watermarking Neural Networks With Watermarked Images10.1109/TCSVT.2020.3030671 ↗
25. Deep model intellectual property protection via deep watermarking
26. Jain, N., Joshi, A., and Earles, M. (2025). iNatAg: Multi-Class Classification Models Enabled by a Large-Scale Benchmark Dataset with 4.7 M Images of 2959 Crop and Weed Species. arXiv.
27. Yang, R., and Zhang, S. (2024). Enhancing Retinal Vascular Structure Segmentation in Images with a Novel Design Two-Path Interactive Fusion Module Model. arXiv.
28. Tian, Y., Han, J., Chen, H., Xi, Y., Ding, N., and Hu, J. (2024). Instruct-ipt: All-in-one image processing transformer via weight modulation. arXiv.
29. Resolution enhancement processing on low quality images using swin transformer based on interval dense connection strategy10.1007/s11042-023-16088-0 ↗
30. Wang, Q., Wu, B., Zhu, P., Li, P., Zuo, W., and Hu, Q. (2020, January 13–19). ECA-Net: Efficient channel attention for deep convolutional neural networks. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, Seattle, WA, USA.10.1109/CVPR42600.2020.01155 ↗
31. Hu, J., Shen, L., and Sun, G. (2018, January 18–23). Squeeze-and-excitation networks. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Salt Lake City, UT, USA.10.1109/CVPR.2018.00745 ↗
32. Zhang, H., and Patel, V.M. (2018, January 18–23). Density-aware single image de-raining using a multi-stream dense network. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Salt Lake City, UT, USA.10.1109/CVPR.2018.00079 ↗
33. Liang, J., Cao, J., Sun, G., Zhang, K., Van Gool, L., and Timofte, R. (2021, January 10–17). Swinir: Image restoration using swin transformer. Proceedings of the IEEE/CVF International Conference on Computer Vision, Montreal, BC, Canada.10.1109/ICCVW54120.2021.00210 ↗
34. Zhu, J. (2018). HiDDeN: Hiding data with deep networks. arXiv.10.1007/978-3-030-01267-0_40 ↗