Robust Template-Based Watermarking for DIBR 3D Images
Source abstract
Abstract
Several depth image-based rendering (DIBR) watermarking methods have been proposed, but they have various drawbacks, such as non-blindness, low imperceptibility and vulnerability to signal or geometric distortion. This paper proposes a template-based DIBR watermarking method that overcomes the drawbacks of previous methods. The proposed method exploits two properties to resist DIBR attacks: the pixel is only moved horizontally by DIBR, and the smaller block is not distorted by DIBR. The one-dimensional (1D) discrete cosine transform (DCT) and curvelet domains are adopted to utilize these two properties. A template is inserted in the curvelet domain to restore the synchronization error caused by geometric distortion. A watermark is inserted in the 1D DCT domain to insert and detect a message from the DIBR image. Experimental results of the proposed method show high imperceptibility and robustness to various attacks, such as signal and geometric distortions. The proposed method is also robust to DIBR distortion and DIBR configuration adjustment, such as depth image preprocessing and baseline distance adjustment.
Source: crossref · Quality: baseline
Research context
OpenAlex topics: Advanced Steganography and Watermarking Techniques · Video Coding and Compression Technologies · Advanced Vision and Imaging
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
Affiliations
School of Computing, Korea Advanced Institute of Science and Technology, Daejeon 305701, Korea
Funding
National Research Foundation of Korea
References (52)
Show source-provided references
1. Fehn, C. (2003, January 8–10). A 3D-TV approach using depth-image-based rendering (DIBR). Proceedings of the 2003VIIP 3rd International Conference, Visualization Imaging and Image Processing, Benalmadena, Spain.
2. Fehn, C. (2004, January 21). Depth-image-based rendering (DIBR), compression, and transmission for a new approach on 3D-TV. Proceedings of the Electronic Imaging 2004 International Society for Optics and Photonics, San Jose, CA, USA.10.1117/12.524762 ↗
3. Stereoscopic image generation based on depth images for 3D TV10.1109/TBC.2005.846190 ↗
4. Chen, W.Y., Chang, Y.L., Lin, S.F., Ding, L.F., and Chen, L.G. (2005, January 6–9). Efficient depth image based rendering with edge dependent depth filter and interpolation. Proceedings of the IEEE International Conference on IEEE, ICME 2005 Multimedia and Expo, Amsterdam, The Netherlands.
5. An investigation of methods for determining depth from focus10.1109/34.192482 ↗
6. Battiato, S., Curti, S., La Cascia, M., Tortora, M., and Scordato, E. (2004, January 20–22). Depth map generation by image classification. Proceedings of the Electronic Imaging 2004, International Society for Optics and Photonics, San Jose, CA, USA.10.1117/12.526634 ↗
7. Stereoscopic video generation based on efficient layered structure and motion estimation from a monoscopic image sequence10.1109/TCSVT.2005.852401 ↗
8. Tam, W.J., and Zhang, L. (2006, January 9–12). 3D-TV content generation: 2D-to-3D conversion. Proceedings of the 2006 IEEE International Conference on Multimedia and Expo, Toronto, ON, Canada.10.1109/ICME.2006.262919 ↗
9. 3D-TV content creation: Automatic 2D-to-3D video conversion10.1109/TBC.2011.2122930 ↗
10. Object-based 2D-to-3D video conversion for effective stereoscopic content generation in 3D-TV applications10.1109/TBC.2011.2131030 ↗
11. Three-Dimensional Displays: A Review and Applications Analysis10.1109/TBC.2011.2130930 ↗
12. State of the Art in Stereoscopic and Autostereoscopic Displays10.1109/JPROC.2010.2098351 ↗
13. Merkle, P., Smolic, A., Müller, K., and Wiegand, T. (2007, January 16–19). Multi-view video plus depth representation and coding. Proceedings of the IEEE ICIP 2007 International Conference on Image Processing, San Antonio, TX, USA.10.1109/ICIP.2007.4378926 ↗
14. Spatio-Temporally Consistent Novel View Synthesis Algorithm From Video-Plus-Depth Sequences for Autostereoscopic Displays10.1109/TBC.2011.2139090 ↗
15. Smolic, A., Mueller, K., Merkle, P., Kauff, P., and Wiegand, T. (2009, January 6–8). An overview of available and emerging 3D video formats and depth enhanced stereo as efficient generic solution. Proceedings of the PCS 2009 Picture Coding Symposium, Chicago, IL, USA.10.1109/PCS.2009.5167358 ↗
16. Shade, J., Gortler, S., He, L.W., and Szeliski, R. (1998, January 19–24). Layered depth images. Proceedings of the 25th Annual Conference on Computer Graphics and Interactive Techniques, Orlando, FL, USA.10.1145/280814.280882 ↗
17. Display-independent 3D-TV production and delivery using the layered depth video format10.1109/TBC.2011.2120790 ↗
18. A digital blind watermarking for depth-image-based rendering 3D images10.1109/TBC.2011.2131470 ↗
19. Franco-Contreras, J., Baudry, S., and Doërr, G. (2011, January 11–14). Virtual view invariant domain for 3D video blind watermarking. Proceedings of the 2011 18th IEEE International Conference on Image Processing (ICIP), Brussels, Belgium.10.1109/ICIP.2011.6116242 ↗
20. Robust DT-CWT watermarking for DIBR 3D images10.1109/TBC.2012.2206851 ↗
21. Watermarking for DIBR 3D images based on SIFT feature points10.1016/j.measurement.2013.10.028 ↗
22. Miao, H., Lin, Y.H., and Wu, J.L. (2014). Image descriptor based digital semi-blind watermarking for DIBR 3D images. International Workshop on Digital Watermarking, Springer.10.1007/978-3-319-19321-2_7 ↗
23. A novel watermarking for DIBR 3D images with geometric rectification based on feature points10.1007/s11042-015-3028-0 ↗
24. Depth-based view-invariant blind 3D image watermarking
25. Rana, S., and Sur, A. (September, January 31). 3D video watermarking using DT-DWT to resist synthesis view attack. Proceedings of the 2015 23rd European IEEE Signal Processing Conference (EUSIPCO), Nice, France.10.1109/EUSIPCO.2015.7362342 ↗
26. Asikuzzaman, M., Alam, M.J., Lambert, A.J., and Pickering, M.R. (2014, January 27–30). A blind watermarking scheme for depth-image-based rendered 3D video using the dual-tree complex wavelet transform. Proceedings of the 2014 IEEE International Conference on Image Processing (ICIP), Paris, France.10.1109/ICIP.2014.7026112 ↗
27. Robust DT CWT-Based DIBR 3D Video Watermarking Using Chrominance Embedding10.1109/TMM.2016.2589208 ↗
28. Fleet, D.J., and Heeger, D.J. (1997, January 26–29). Embedding invisible information in color images. Proceedings of the IEEE International Conference on Image Processing, Santa Barbara, CA, USA.
29. Robust template matching for affine resistant image watermarks10.1109/83.846253 ↗
30. Effectiveness of exhaustive search and template matching against watermark desynchronization10.1109/LSP.2004.840872 ↗
31. A survey of RST invariant image watermarking algorithms10.1145/1242471.1242473 ↗
32. Tam, W.J., Alain, G., Zhang, L., Martin, T., and Renaud, R. (2004, January 25–28). Smoothing depth maps for improved steroscopic image quality. Proceedings of the Optics East International Society for Optics and Photonics, Philadelphia, PA, USA.10.1117/12.583105 ↗
33. Fu, D., Zhao, Y., and Yu, L. (2010, January 8–10). Temporal consistency enhancement on depth sequences. Proceedings of the 2010 IEEE, Picture Coding Symposium (PCS), Nagoya, Japan.10.1109/PCS.2010.5702503 ↗
34. Nongeometric distortion smoothing approach for depth map preprocessing10.1109/TMM.2010.2100372 ↗
35. Oh, K.J., Yea, S., and Ho, Y.S. (2009, January 6–8). Hole filling method using depth based in-painting for view synthesis in free viewpoint television and 3-D video. Proceedings of the IEEE 2009 PCS Picture Coding Symposium, Chicago, IL, USA.
36. Chen, K.Y., Tsung, P.K., Lin, P.C., Yang, H.J., and Chen, L.G. (2010, January 7–9). Hybrid motion/depth-oriented inpainting for virtual view synthesis in multiview applications. Proceedings of the 2010 IEEE 3DTV-Conference: The True Vision-Capture, Transmission and Display of 3D Video (3DTV-CON), Tampere, Finland.10.1109/3DTV.2010.5506309 ↗
37. Cox, I., Miller, M., Bloom, J., Fridrich, J., and Kalker, T. (2007). Digital Watermarking and Steganography, Morgan Kaufmann.10.1016/B978-012372585-1.50015-2 ↗
38. Candes, E.J., and Donoho, D.L. (2000). Curvelets: A surprisingly Effective Nonadaptive Representation for Objects with Edges, Stanford University. Technical Report, DTIC Document.
39. New multiscale transforms, minimum total variation synthesis: Applications to edge-preserving image reconstruction10.1016/S0165-1684(02)00300-6 ↗
40. New tight frames of curvelets and optimal representations of objects with piecewise C2 singularities10.1002/cpa.10116 ↗
41. Fast discrete curvelet transforms10.1137/05064182X ↗
42. Sumana, I.J., Islam, M.M., Zhang, D., and Lu, G. (2008, January 8–10). Content based image retrieval using curvelet transform. Proceedings of the 2008 IEEE 10th Workshop on IEEE Multimedia Signal Processing, Cairns, Australia.10.1109/MMSP.2008.4665041 ↗
43. Islam, M.M., Zhang, D., and Lu, G. (July, January 28). Rotation invariant curvelet features for texture image retrieval. Proceedings of the IEEE ICME 2009 International Conference on IEEE, Multimedia and Expo, New York, NY, USA.10.1109/ICME.2009.5202558 ↗
44. Secure spread spectrum watermarking for multimedia10.1109/83.650120 ↗
45. A DCT-domain system for robust image watermarking10.1016/S0165-1684(98)00015-2 ↗
46. Rusinkiewicz, S., and Levoy, M. (June, January 28). Efficient variants of the ICP algorithm. Proceedings of the Third International Conference on IEEE, 3-D Digital Imaging and Modeling, Quebec City, QC, Canada.
47. Scharstein, D., and Szeliski, R. (2003, January 18–20). High-accuracy stereo depth maps using structured light. Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition, Madison, WI, USA.
48. Scharstein, D., and Pal, C. (2007, January 17–22). Learning conditional random fields for stereo. Proceedings of the CVPR’07 IEEE Conference on. IEEE, Computer Vision and Pattern Recognition, Minneapolis, MN, USA.10.1109/CVPR.2007.383191 ↗
49. Hirschmüller, H., and Scharstein, D. (2007, January 17–22). Evaluation of cost functions for stereo matching. Proceedings of the 2007 CVPR’07 IEEE Conference on Computer Vision and Pattern Recognition, Minneapolis, MN, USA.10.1109/CVPR.2007.383248 ↗
50. Scharstein, D., Hirschmüller, H., Kitajima, Y., Krathwohl, G., Nešić, N., Wang, X., and Westling, P. (2014). High-resolution stereo datasets with subpixel-accurate ground truth. German Conference on Pattern Recognition, Springer.10.1007/978-3-319-11752-2_3 ↗
51. High-quality video view interpolation using a layered representation10.1145/1015706.1015766 ↗
52. Image quality assessment: From error visibility to structural similarity10.1109/TIP.2003.819861 ↗