journal article·2024-12-25Open access

Generative Image Steganography via Encoding Pose Keypoints

Yi Cao, Wentao Ge, Chengsheng Yuan, Quan Wang

Applied Sciences· Volume 15· Issue 1

Abstract

Existing generative image steganography methods typically encode secret information into latent vectors, which are transformed into the entangled features of generated images. This approach faces two main challenges: (1) Transmission can degrade the quality of stego-images, causing bit errors in information extraction. (2) High embedding capacity often reduces the accuracy of information extraction. To overcome these limitations, this paper presents a novel generative image steganography via encoding pose keypoints. This method employs an LSTM-based sequence generation model to embed secret information into the generation process of pose keypoint sequences. Each generated sequence is drawn as a keypoint connectivity graph, which serves as input with an original image to a trained pose-guided person image generation model (DPTN-TA) to generate an image with the target pose. The sender uploads the generated images to a public channel to transmit the secret information. On the receiver’s side, an improved YOLOv8 pose estimation model extracts the pose keypoints from the stego-images and decodes the embedded secret information using the sequence generation model. Extensive experiments on the DeepFashion dataset show that the proposed method significantly outperforms state-of-the-art methods in information extraction accuracy, achieving 99.94%. It also achieves an average hiding capacity of 178.4 bits per image. This method is robust against common image attacks, such as salt and pepper noise, median filtering, compression, and screenshots, with an average bit error rate of less than 0.87%. Additionally, the method is optimized for fast inference and lightweight deployment, enhancing its real-world applicability.
Source: crossref · Quality: baseline

Research context

OpenAlex topics: Advanced Steganography and Watermarking Techniques · Digital Media Forensic Detection · Chaos-based Image/Signal Encryption

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

School of Computer Science, Nanjing University of Information Science & Technology, Nanjing 210044, China

Wuxi City Internet of Vehicles Key Laboratory, Wuxi University, Wuxi 214105, China

School of Internet of Things Engineering, Wuxi University, Wuxi 214105, China

Funding

‘Taihu Light’ Science and Technology Project of Wuxi · Open Project of National Engineering Technology Research Center For Sensor Network · Jiangsu Universities’ General Project for Philosophy and Social Science Research · Wuxi University Special Fund for the Introduction of Talent Research · National Natural Science Foundation of China · Postgraduate Research and Practice Innovation Program of Jiangsu Province · Excellent Universities’ Team in Jiangsu Province for Science and Technology Innovation (Real-time Industrial Internet of Things)

References (39)

Show source-provided references
1. Fridrich, J. (2009). Steganography in Digital Media: Principles, Algorithms, and Applications, Cambridge University Press.10.1017/CBO9781139192903 ↗
2. Overview of steganography on multimedia10.11834/jig.211272 ↗
3. Detecting LSB steganography in color, and gray-scale images10.1109/93.959097 ↗
4. Universal distortion function for steganography in an arbitrary domain10.1186/1687-417X-2014-1 ↗
5. Li, B., Wang, M., Huang, J.W., and Li, X.L. (2014, January 27–30). A new cost function for spatial image steganography. Proceedings of the 2014 IEEE International Conference on Image Processing (ICIP), Paris, France.10.1109/ICIP.2014.7025854 ↗
6. Pevný, T., Filler, T., and Bas, P. (2010, January 28–30). Using High-Dimensional Image Models to Perform Highly Undetectable Steganography. Proceedings of the Information Hiding, Calgary, AB, Canada.10.1007/978-3-642-16435-4_13 ↗
7. Holub, V., and Fridrich, J. (2012, January 2–5). Designing steganographic distortion using directional filters. Proceedings of the IEEE International Workshop on Information Forensics and Security, Costa Adeje, Spain.10.1109/WIFS.2012.6412655 ↗
8. Automatic steganographic distortion learning using a generative adversarial network10.1109/LSP.2017.2745572 ↗
9. Structural Design of Convolutional Neural Networks for Steganalysis10.1109/LSP.2016.2548421 ↗
10. Deep Learning Hierarchical Representations for Image Steganalysis10.1109/TIFS.2017.2710946 ↗
11. Robust coverless image steganography based on DCT and LDA topic classification10.1109/TMM.2018.2838334 ↗
12. Robust coverless image steganography based on human pose estimation10.1016/j.knosys.2024.111873 ↗
13. A Novel Image Steganography Method Via Deep Convolutional Generative Adversarial Networks10.1109/ACCESS.2018.2852771 ↗
14. Li, J., Niu, K., Liao, L.W., Wang, L.J., Liu, J., Lei, Y.Z., and Zhang, M.Q. (2020, January 17–20). A Generative Steganography Method Based on WGANGP. Proceedings of the ICAIS 2020, Hohhot, China.10.1007/978-981-15-8083-3_34 ↗
15. Liu, X., Ma, Z., Ma, J., Zhang, J., Schaefer, G., and Fang, H. (2022, January 18–24). Image Disentanglement Autoencoder for Steganography without Embedding. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, New Orleans, LA, USA.10.1109/CVPR52688.2022.00234 ↗
16. Coverless information hiding based on generative adversarial networks
17. Coverless information hiding based on the generation of anime characters10.1186/s13640-020-00524-4 ↗
18. Novel Coverless Steganography Method Based on Image Selection and StarGAN10.1109/TNSE.2020.3041529 ↗
19. Long Short-term Memory10.1162/neco.1997.9.8.1735 ↗
20. Varghese, R., and Sambath, M. (2024, January 18–19). YOLOv8: A Novel Object Detection Algorithm with Enhanced Performance and Robustness. Proceedings of the International Conference on Advances in Data Engineering and Intelligent Computing Systems, Chennai, India.10.1109/ADICS58448.2024.10533619 ↗
21. Zhao, Y., Lv, W., Xu, S., Wei, J., Wang, G., Dang, Q., Liu, Y., and Chen, J. (2024, January 16–22). DETRs Beat YOLOs on Real-time Object Detection. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Seattle, WA, USA.10.1109/CVPR52733.2024.01605 ↗
22. StegaStyleGAN: Towards Generic and Practical Generative Image Steganography
23. Sun, Y., Liu, J., and Zhang, R. (2023, January 10–14). A Robust Generative Image Steganography Method based on Guidance Features in Image Synthesis. Proceedings of the 2023 IEEE International Conference on Multimedia and Expo (ICME), Brisbane, Australia.10.1109/ICME55011.2023.00018 ↗
24. Esser, P., Sutter, E., and Ommer, B. (2018, January 18–23). A Variational U-net for Conditional Appearance and Shape Generation. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Salt Lake City, UT, USA.10.1109/CVPR.2018.00923 ↗
25. Zhu, Z., Huang, T., Shi, B., Yu, M., Wang, B., and Bai, X. (2019, January 16–20). Progressive Pose Attention Transfer for Person Image Generation. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Long Beach, CA, USA.10.1109/CVPR.2019.00245 ↗
26. Tang, H., Bai, S., Zhang, L., Torr, P.H., and Sebe, N. (2020, January 23–28). XingGAN for Person Image Generation. Proceedings of the 16th European Conference, Glasgow, UK.10.1007/978-3-030-58595-2_43 ↗
27. Zhang, J., Li, K., Lai, Y.-K., and Yang, J. (2021, January 19–25). PISE: Person image synthesis and editing with decoupled GAN. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Nashville, TN, USA.10.1109/CVPR46437.2021.00789 ↗
28. Pose Guided Person Image Generation Via Dual-Task Correlation and Affinity Learning10.1109/TVCG.2023.3286394 ↗
29. Toshev, A., and Christian, S. (2014, January 23–28). DeepPose: Human Pose Estimation via Deep Neural Networks. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Columbus, OH, USA.10.1109/CVPR.2014.214 ↗
30. Cao, Z., Simon, T., Wei, S.E., and Sheikh, Y. (2017, January 21–26). Realtime Multi-person 2d Pose Estimation Using Part Affinity Fields. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Honolulu, HI, USA.10.1109/CVPR.2017.143 ↗
31. ROpenPose: A Rapider OpenPose Model for Astronaut Operation Attitude Detection10.1109/TIE.2020.3048285 ↗
32. Ding, X., Zhang, X., Ma, N., Han, J., Ding, G., and Sun, J. (2021, January 19–25). Repvgg: Making vgg-style convnets great again. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Nashville, TN, USA.10.1109/CVPR46437.2021.01352 ↗
33. Liu, Z.W., Luo, P., Qiu, S., Wang, X., and Tang, X. (July, January 26). DeepFashion: Powering Robust Clothes Recognition and Retrieval with Rich Annotations. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Las Vegas, NV, USA.
34. A Novel Hybrid Image Synthesis-Mapping Framework for Steganography Without Embedding10.1109/ACCESS.2023.3324050 ↗
35. Deep High-Resolution Representation Learning for Visual Recognition10.1109/TPAMI.2020.2983686 ↗
36. Provably Secure Robust Image Steganography10.1109/TMM.2023.3330098 ↗
37. Jing, J., Deng, X., Xu, M., Wang, J., and Guan, Z. (2021, January 10–17). HiNet: Deep Image Hiding by Invertible Network. Proceedings of the IEEE/CVF International Conference on Computer Vision 2021, Montreal, QC, Canada.10.1109/ICCV48922.2021.00469 ↗
38. Liu, Z., Luo, P., Wang, X., and Tang, X. (2015, January 13–16). Deep learning face attributes in the wild. Proceedings of the IEEE/CVF International Conference on Computer Vision 2021, Santiago, Chile.
39. Isola, P., Zhu, J.-Y., Zhou, T., and Efros, A.A. (2017, January 21–26). Image-to-Image Translation with Conditional Adversarial Networks. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition 2017, Honolulu, HI, USA.10.1109/CVPR.2017.632 ↗