LKAW: A Robust Watermarking Method Based on Large Kernel Convolution and Adaptive Weight Assignment
Source abstract
Abstract
Robust watermarking requires finding invariant features under multiple attacks to ensure correct extraction. Deep learning has extremely powerful in extracting features, and watermarking algorithms based on deep learning have attracted widespread attention. Most existing methods use small kernel convolution to extract image features and embed the watermarking. However, the effective perception fields for small kernel convolution are extremely confined, so the pixels that each watermarking can affect are restricted, thus limiting the performance of the watermarking. To address these problems, we propose a watermarking network based on large kernel convolution and adaptive weight assignment for loss functions. It uses large-kernel depth-wise convolution to extract features for learning large-scale image information and subsequently projects the watermarking into a high-dimensional space by convolution to achieve adaptability in the channel dimension. Subsequently, the modification of the embedded watermarking on the cover image is extended to more pixels. Because the magnitude and convergence rates of each loss function are different, an adaptive loss weight assignment strategy is proposed to make the weights participate in the network training together and adjust the weight dynamically. Further, a high-frequency wavelet loss is proposed, by which the watermarking is restricted to only the low-frequency wavelet sub-bands, thereby enhancing the robustness of watermarking against image compression. The experimental results show that the peak signal-to-noise ratio (PSNR) of the encoded image reaches 40.12, the structural similarity (SSIM) reaches 0.9721, and the watermarking has good robustness against various types of noise.
Source: openalex_inverted_index · Quality: baseline
Research context
OpenAlex topics: Advanced Steganography and Watermarking Techniques · Digital Media Forensic Detection · Advanced Neural Network Applications
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
References (42)
Show source-provided references
1. Deformation expression of soft tissue based on BP neural network10.32604/iasc.2022.016543 ↗
2. HiDDeN: Hiding data with deep networks
3. Distortion agnostic deep watermarking
4. Very deep convolutional networks for large-scale image recognition
5. Deep residual learning for image recognition
6. M. H. Guo, C. Z. Lu, Z. N. Liu, M. M. Cheng and S. M. Hu, “Visual attention network,” arXiv: 2202.09741, 2022.
7. Scaling up your kernels to 31 × 31: Revisiting large kernel design in CNNs
8. A ConvNet for the 2020s
9. RSOD: Real-time small object detection algorithm in UAV-based traffic monitoring10.1007/s10489-021-02893-3 ↗
10. A self-adaptive mutation neural architecture search algorithm based on blocks10.1109/MCI.2021.3084435 ↗
11. Multi-task learning using uncertainty to weigh losses for scene geometry and semantics
12. Stegastamp: Invisible hyperlinks in physical photographs
13. S. M. Mun, S. H. Nam, H. U. Jang, D. Kim and H. K. Lee, “A robust blind watermarking using convolutional neural network,” arXiv: 1704.03248, 2017.
14. Exploring the learning capabilities of convolutional neural networks for robust image watermarking10.1016/j.cose.2016.11.016 ↗
15. Universal deep hiding for steganography, watermarking, and light field messaging
16. An automated and robust image watermarking scheme based on deep neural networks10.1109/TMM.2020.3006415 ↗
17. A novel two-stage separable deep learning framework for practical blind watermarking
18. A. Dosovitskiy, L. Beyer, K. Alexander, D. Weissenborn, X. H. Zhai et al., “An image is worth 16 × 16 words: Transformers for image recognition at scale,” arXiv:2010.11929, 2020.
19. Swin transformer: Hierarchical vision transformer using shifted windows
20. Generative steganography based on long readable text generation
21. A lightweight CNN based on transfer learning for COVID-19 diagnosis10.32604/cmc.2022.024589 ↗
22. MetaFormer is actually what you need for vision
23. MLP-Mixer: An all-MLP architecture for vision
24. Fine-grained vehicle type classification using lightweight convolutional neural network with feature optimization and joint learning strategy10.1007/s11042-020-09171-3 ↗
25. Multi-objective feature selection with missing data in classification10.1109/TETCI.2021.3074147 ↗
26. Multi-task learning10.1023/A:1007379606734 ↗
27. TBE-Net: A three-branch embedding network with part-aware ability and feature complementary learning for vehicle re-identification10.1109/TITS.2021.3130403 ↗
28. Data query mechanism based on hash computing power of blockchain in Internet of things
29. B. Wen and S. Aydore, “ROMark: A robust watermarking system using adversarial training,” arXiV: 1910.01221, 2019.
30. ReDMark: Framework for residual diffusion watermarking based on deep networks10.1016/j.eswa.2019.113157 ↗
31. End-to-end multi-task learning with attention
32. U-Net: Convolutional networks for biomedical image segmentation
33. The unreasonable effectiveness of deep features as a perceptual metric
34. Imagenet classification with deep convolutional neural networks10.1145/3065386 ↗
35. Improved training of Wasserstein GANs
36. Squeeze-and-excitation networks
37. Microsoft COCO: Common objects in context
38. NTIRE 2017 challenge on single image super-resolution: Dataset and study
39. L. Wright and N. Demeure, “Ranger21: A synergistic deep learning optimizer,” arXiv:2106.13731, 2021.
40. Lookahead optimizer: k steps forward, 1 step back
41. Image quality assessment: From error visibility to structural similarity10.1109/TIP.2003.819861 ↗
42. MBRS: Enhancing robustness of DNN-based watermarking by mini-batch of real and simulated JPEG compression