journal article·2024-12-25Open access

Edge-Aware Dual-Task Image Watermarking Against Social Network Noise

Hao Jiang, Jiahao Wang, Yuhan Yao, Xingchen Li, Feifei Kou, Xinkun Tang, Limei Qi

Applied Sciences· Volume 15· Issue 1

Abstract

In the era of widespread digital image sharing on social media platforms, deep-learning-based watermarking has shown great potential in copyright protection. To address the fundamental trade-off between the visual quality of the watermarked image and the robustness of watermark extraction, we explore the role of structural features and propose a novel edge-aware watermarking framework. Our primary innovation lies in the edge-aware secret hiding module (EASHM), which achieves adaptive watermark embedding by aligning watermarks with image structural features. To realize this, the EASHM leverages knowledge distillation from an edge detection teacher and employs a dual-task encoder that simultaneously performs edge detection and watermark embedding through maximal parameter sharing. The framework is further equipped with a social network noise simulator (SNNS) and a secret recovery module (SRM) to enhance robustness against common image noise attacks. Extensive experiments on three public datasets demonstrate that our framework achieves superior watermark imperceptibility, with PSNR and SSIM values exceeding 40.82 dB and 0.9867, respectively, while maintaining an over 99% decoding accuracy under various noise attacks, outperforming existing methods by significant margins.
Source: crossref · Quality: baseline

Research context

OpenAlex topics: Advanced Steganography and Watermarking Techniques · Digital Media Forensic Detection · Generative Adversarial Networks and Image Synthesis

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

Academy of Broadcasting Science, National Radio and Television Administration, Beijing 100866, China

School of Computer Science (National Pilot Software Engineering School), Beijing University of Posts and Telecommunications, Beijing 100876, China

Funding

National Key Research and Development Program Young Scientists Project of Research on Application Technology of Property Right Evaluation and Right Confirmation Mark of Cultural Products · Basic Scientific Research Operating Expenses of the Academy of Broadcasting Science, NRTA

References (53)

Show source-provided references
1. Robust image watermarking theories and techniques: A review10.1016/S1665-6423(14)71612-8 ↗
2. A digital watermark10.1109/ICIP.1994.413536 ↗
3. Holub, V., and Fridrich, J. (2012, January 2–5). Designing steganographic distortion using directional filters. Proceedings of the 2012 IEEE International Workshop on Information Forensics and Security (WIFS), Costa Adeje, Spain.10.1109/WIFS.2012.6412655 ↗
4. Multiple Watermark Scheme based on DWT-DCT Quantization for Medical Images
5. Das, U.K., Samaddar, S.G., and Keserwani, P.K. (2017, January 1–2). Digital forensic enabled image authentication using least significant bit (lsb) with tamper localization based hash function. Proceedings of the Intelligent Communication and Computational Technologies: Proceedings of Internet of Things for Technological Development, IoT4TD 2017, Gandhinagar, India.10.1007/978-981-10-5523-2_14 ↗
6. Robust and blind image watermarking in DCT domain using inter-block coefficient correlation10.1016/j.ins.2019.11.005 ↗
7. Digital image watermarking using deep learning: A survey10.1016/j.cosrev.2024.100662 ↗
8. Learning-based image steganography and watermarking: A survey10.1016/j.eswa.2024.123715 ↗
9. Zhong, X., Das, A., Alrasheedi, F., and Tanvir, A. (2023). A brief, in-depth survey of deep learning-based image watermarking. Appl. Sci., 13.10.3390/app132111852 ↗
10. Zhu, J., Kaplan, R., Johnson, J., and Fei-Fei, L. (2018, January 8–14). Hidden: Hiding data with deep networks. Proceedings of the European Conference on Computer Vision (ECCV), Munich, Germany.10.1007/978-3-030-01267-0_40 ↗
11. ReDMark: Framework for residual diffusion watermarking based on deep networks10.1016/j.eswa.2019.113157 ↗
12. WFormer: A Transformer-Based Soft Fusion Model for Robust Image Watermarking10.1109/TETCI.2024.3386916 ↗
13. Tancik, M., Mildenhall, B., and Ng, R. (2020, January 13–19). Stegastamp: Invisible hyperlinks in physical photographs. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, Seattle, WA, USA.10.1109/CVPR42600.2020.00219 ↗
14. Jia, Z., Fang, H., and Zhang, W. (2021, January 20–24). Mbrs: Enhancing robustness of dnn-based watermarking by mini-batch of real and simulated jpeg compression. Proceedings of the 29th ACM International Conference on Multimedia, Virtual.10.1145/3474085.3475324 ↗
15. De-END: Decoder-driven watermarking Network10.1109/TMM.2022.3223559 ↗
16. Multitask learning10.1023/A:1007379606734 ↗
17. An overview of multi-task learning10.1093/nsr/nwx105 ↗
18. Crawshaw, M. (2020). Multi-task learning with deep neural networks: A survey. arXiv.
19. A survey on multi-task learning10.1109/TKDE.2021.3070203 ↗
20. Multi-task learning in natural language processing: An overview10.1145/3679013 ↗
21. Chowdhuri, S., Pankaj, T., and Zipser, K. (2019, January 7–11). Multinet: Multi-modal multi-task learning for autonomous driving. Proceedings of the 2019 IEEE Winter Conference on Applications of Computer Vision (WACV), Waikoloa, HI, USA.10.1109/WACV.2019.00164 ↗
22. Effective adaptation in multi-task co-training for unified autonomous driving
23. Hinton, G. (2015). Distilling the Knowledge in a Neural Network. arXiv.
24. Zhu, X., and Gong, S. (2018). Knowledge distillation by on-the-fly native ensemble. Adv. Neural Inf. Process. Syst., 31.
25. Romero, A., Ballas, N., Kahou, S.E., Chassang, A., Gatta, C., and Bengio, Y. (2014). Fitnets: Hints for thin deep nets. arXiv.
26. Zagoruyko, S., and Komodakis, N. (2016). Paying more attention to attention: Improving the performance of convolutional neural networks via attention transfer. arXiv.
27. Paraphrasing complex network: Network compression via factor transfer
28. A survey: Digital image watermarking techniques
29. Begum, M., and Uddin, M.S. (2020). Digital image watermarking techniques: A review. Information, 11.10.3390/info11020110 ↗
30. A comprehensive survey on robust image watermarking10.1016/j.neucom.2022.02.083 ↗
31. Cross-scale feature fusion-based JND estimation for robust image watermarking in quaternion DWT domain10.1016/j.ijleo.2022.170371 ↗
32. Jiang, Z.y., Pun, C.M., Yuan, X.C., and Liu, T. (2023). Robust Digital Watermarking Method Based on Adaptive Feature Area Extraction and Local Histogram Shifting. arXiv.
33. Ma, R., Guo, M., Hou, Y., Yang, F., Li, Y., Jia, H., and Xie, X. (2022, January 10–14). Towards blind watermarking: Combining invertible and non-invertible mechanisms. Proceedings of the 30th ACM International Conference on Multimedia, Lisboa, Portugal.10.1145/3503161.3547950 ↗
34. Fernandez, P., Sablayrolles, A., Furon, T., Jégou, H., and Douze, M. (2022, January 23–27). Watermarking images in self-supervised latent spaces. Proceedings of the ICASSP 2022—2022 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), Singapore.10.1109/ICASSP43922.2022.9746058 ↗
35. ARWGAN: Attention-guided robust image watermarking model based on GAN
36. Arab, M.A., Ghorbanpour, A., and Hefeeda, M. (2024, January 15–18). FlexMark: Adaptive Watermarking Method for Images. Proceedings of the 15th ACM Multimedia Systems Conference, Bari, Italy.10.1145/3625468.3647611 ↗
37. When Multitask Learning Meets Partial Supervision: A Computer Vision Review10.1109/JPROC.2024.3435012 ↗
38. Upper gastrointestinal anatomy detection with multi-task convolutional neural networks10.1049/htl.2019.0066 ↗
39. Ming, Z., Xia, J., Luqman, M.M., Burie, J.C., and Zhao, K. (2019). Dynamic multi-task learning for face recognition with facial expression. arXiv.
40. Adaptive multi-teacher multi-level knowledge distillation10.1016/j.neucom.2020.07.048 ↗
41. Xie, Q., Luong, M.T., Hovy, E., and Le, Q.V. (2020, January 13–19). Self-training with noisy student improves imagenet classification. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, Seattle, WA, USA.10.1109/CVPR42600.2020.01070 ↗
42. Teacher–student curriculum learning10.1109/TNNLS.2019.2934906 ↗
43. Li, Y., Yuan, L., and Vasconcelos, N. (2019, January 15–20). Bidirectional learning for domain adaptation of semantic segmentation. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, Long Beach, CA, USA.10.1109/CVPR.2019.00710 ↗
44. Ghiasi, G., Zoph, B., Cubuk, E.D., Le, Q.V., and Lin, T.Y. (2021, January 10–17). Multi-task self-training for learning general representations. Proceedings of the IEEE/CVF International Conference on Computer Vision, Montreal, QC, Canada.10.1109/ICCV48922.2021.00873 ↗
45. Xie, S., and Tu, Z. (2015, January 7–13). Holistically-nested edge detection. Proceedings of the IEEE International Conference on Computer Vision, Santiago, Chile.10.1109/ICCV.2015.164 ↗
46. Yu, Z., Feng, C., Liu, M.Y., and Ramalingam, S. (2017, January 21–26). Casenet: Deep category-aware semantic edge detection. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Honolulu, HI, USA.10.1109/CVPR.2017.191 ↗
47. Mirza, M. (2014). Conditional generative adversarial nets. arXiv.
48. Collobert, R., Kavukcuoglu, K., and Farabet, C. (2011, January 16–17). Torch7: A matlab-like environment for machine learning. Proceedings of the BigLearn, NIPS Workshop, Sierra Nevada, Spain.
49. Diederik, P.K. (2014). Adam: A method for stochastic optimization. arXiv.
50. Zhang, H., Wang, H., Cao, Y., Shen, C., and Li, Y. (2020). Robust data hiding using inverse gradient attention. arXiv.
51. Lin, T.Y., Maire, M., Belongie, S., Hays, J., Perona, P., Ramanan, D., Dollár, P., and Zitnick, C.L. (2014, January 6–12). Microsoft coco: Common objects in context. Proceedings of the Computer Vision—ECCV 2014: 13th European Conference, Zurich, Switzerland. Part V 13.10.1007/978-3-319-10602-1_48 ↗
52. Agustsson, E., and Timofte, R. (2017, January 21–26). NTIRE 2017 challenge on single image super-resolution: Dataset and study. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition Workshops, Honolulu, HI, USA.10.1109/CVPRW.2017.150 ↗
53. Improved ArtGAN for conditional synthesis of natural image and artwork10.1109/TIP.2018.2866698 ↗