Texture-Guided Graph Transform Optimization for Point Cloud Attribute Compression
Source abstract
Abstract
There is a pressing need across various applications for efficiently compressing point clouds. While the Moving Picture Experts Group introduced the geometry-based point cloud compression (G-PCC) standard, its attribute compression scheme falls short of eliminating signal frequency-domain redundancy. This paper proposes a texture-guided graph transform optimization scheme for point cloud attribute compression. We formulate the attribute transform coding task as a graph optimization problem, considering both the decorrelation capability of the graph transform and the sparsity of the optimized graph within a tailored joint optimization framework. First, the point cloud is reorganized and segmented into local clusters using a Hilbert-based scheme, enhancing spatial correlation preservation. Second, the inter-cluster attribute prediction and intra-cluster prediction are conducted on local clusters to remove spatial redundancy and extract texture priors. Third, the underlying graph structure in each cluster is constructed in a joint rate–distortion–sparsity optimization process, guided by geometry structure and texture priors to achieve optimal coding performance. Finally, point cloud attributes are efficiently compressed with the optimized graph transform. Experimental results show the proposed scheme outperforms the state of the art with significant BD-BR gains, surpassing G-PCC by 31.02%, 30.71%, and 32.14% in BD-BR gains for Y, U, and V components, respectively. Subjective evaluation of the attribute reconstruction quality further validates the superiority of our scheme.
Source: crossref · Quality: baseline
Research context
OpenAlex topics: Computer Graphics and Visualization Techniques · 3D Shape Modeling and Analysis · Advanced Vision and Imaging
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
Affiliations
School of Electronic and Computer Engineering, Peking University, Shenzhen 518055, China
Peng Cheng Laboratory, Shenzhen 518066, China
Media Laboratory, Tencent, Palo Alto, CA 94306-2028, USA
Funding
National Natural Science Foundation of China
References (40)
Show source-provided references
1. He, Y., Liang, B., Yang, J., Li, S., and He, J. (2017). An iterative closest points algorithm for registration of 3D laser scanner point clouds with geometric features. Sensors, 17.10.3390/s17081862 ↗
2. Yue, Y., Li, X., and Peng, Y. (2024). A 3D Point Cloud Classification Method Based on Adaptive Graph Convolution and Global Attention. Sensors, 24.10.3390/s24020617 ↗
3. Feng, Y., Zeng, S., and Liang, T. (2024). Part2Point: A Part-Oriented Point Cloud Reconstruction Framework. Sensors, 24.10.3390/s24010034 ↗
4. Zhuang, L., Tian, J., Zhang, Y., and Fang, Z. (2023). Variable Rate Point Cloud Geometry Compression Method. Sensors, 23.10.3390/s23125474 ↗
5. An overview of ongoing point cloud compression standardization activities: Video-based (V-PCC) and geometry-based (G-PCC)10.1017/ATSIP.2020.12 ↗
6. Emerging MPEG standards for point cloud compression10.1109/JETCAS.2018.2885981 ↗
7. Cao, C., Preda, M., and Zaharia, T. (2019, January 26–28). 3D point cloud compression: A survey. Proceedings of the 24th International Conference on 3D Web Technology, Los Angeles, CA, USA.10.1145/3329714.3338130 ↗
8. Sparse Tensor-Based Multiscale Representation for Point Cloud Geometry Compression
9. Rate-distortion optimized quantization for geometry-based point cloud compression10.1117/1.JEI.32.1.013047 ↗
10. Zhang, J., Chen, T., Ding, D., and Ma, Z. (November, January 29). YOGA: Yet Another Geometry-based Point Cloud Compressor. Proceedings of the 31st ACM International Conference on Multimedia, Ottawa, ON, Canada.
11. Do, T.T., Chou, P.A., and Cheung, G. (2023, January 4–10). Volumetric Attribute Compression for 3D Point Clouds Using Feedforward Network with Geometric Attention. Proceedings of the ICASSP 2023–2023 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), Rhodes Island, Greece.10.1109/ICASSP49357.2023.10096559 ↗
12. A hybrid compression framework for color attributes of static 3D point clouds10.1109/TCSVT.2021.3069838 ↗
13. Wang, J., Ding, D., and Ma, Z. (2023, January 21–24). Lossless Point Cloud Attribute Compression Using Cross-scale, Cross-group, and Cross-color Prediction. Proceedings of the 2023 Data Compression Conference (DCC), Snowbird, UT, USA.10.1109/DCC55655.2023.00031 ↗
14. Fine-grained patch segmentation and rasterization for 3-d point cloud attribute compression10.1109/TCSVT.2021.3101126 ↗
15. Yang, X., Shao, Y., Liu, S., Li, T.H., and Li, G. (November, January 29). PDE-based Progressive Prediction Framework for Attribute Compression of 3D Point Clouds. Proceedings of the 31st ACM International Conference on Multimedia, Ottawa, ON, Canada.
16. Shao, Y., Zhang, Q., Li, G., Li, Z., and Li, L. (2018, January 22–26). Hybrid point cloud attribute compression using slice-based layered structure and intra prediction. Proceedings of the 26th ACM international conference on Multimedia, Seoul, Republic of Korea.10.1145/3240508.3240696 ↗
17. (2021). G-PCC Test Model v16 (Standard No. ISO/IEC JTC 1/SC 29/WG 7).
18. Block-Adaptive Point Cloud Attribute Coding with Region-Aware Optimized Transform10.1109/TCSVT.2023.3235891 ↗
19. Graph signal processing: Overview, challenges, and applications10.1109/JPROC.2018.2820126 ↗
20. Graph signal processing for machine learning: A review and new perspectives10.1109/MSP.2020.3014591 ↗
21. Graph signal processing for geometric data and beyond: Theory and applications10.1109/TMM.2021.3111440 ↗
22. Zhang, C., Florencio, D., and Loop, C. (2022, January 4–6). Point cloud attribute compression with graph transform. Proceedings of the 2014 IEEE International Conference on Image Processing (ICIP), Chongqing, China.10.1109/ICIP.2014.7025414 ↗
23. Octree-based Point-Cloud Compression
24. A generic scheme for progressive point cloud coding10.1109/TVCG.2007.70441 ↗
25. Hilbert space filling curve based scan-order for point cloud attribute compression10.1109/TIP.2022.3186532 ↗
26. Cohen, R.A., Tian, D., and Vetro, A. (2016, January 25–28). Attribute compression for sparse point clouds using graph transforms. Proceedings of the 2016 IEEE International Conference on Image Processing (ICIP), Phoenix, AZ, USA.10.1109/ICIP.2016.7532583 ↗
27. Shao, Y., Zhang, Z., Li, Z., Fan, K., and Li, G. (2017, January 10–13). Attribute compression of 3D point clouds using Laplacian sparsity optimized graph transform. Proceedings of the 2017 IEEE Visual Communications and Image Processing (VCIP), St. Petersburg, FL, USA.10.1109/VCIP.2017.8305131 ↗
28. Predictive generalized graph Fourier transform for attribute compression of dynamic point clouds10.1109/TCSVT.2020.3015901 ↗
29. Compression of 3D point clouds using a region-adaptive hierarchical transform10.1109/TIP.2016.2575005 ↗
30. Analyzing the optimality of predictive transform coding using graph-based models10.1109/LSP.2012.2230165 ↗
31. Learning Laplacian matrix in smooth graph signal representations10.1109/TSP.2016.2602809 ↗
32. Kalofolias, V. (2016, January 9–11). How to learn a graph from smooth signals. Proceedings of the Artificial intelligence and statistics, PMLR, Cadiz, Spain.
33. Feature graph learning for 3D point cloud denoising10.1109/TSP.2020.2978617 ↗
34. (2023). G-PCC Performance Evaluation and Anchor Results (Standard No. ISO/IEC JTC 1/SC 29/WG 7).
35. The CIEDE2000 color-difference formula: Implementation notes, supplementary test data, and mathematical observations10.1002/col.20070 ↗
36. Multiresolution graph fourier transform for compression of piecewise smooth images10.1109/TIP.2014.2378055 ↗
37. Kalofolias, V., and Perraudin, N. (2019, January 6–9). Large Scale Graph Learning From Smooth Signals. Proceedings of the 7th International Conference on Learning Representations, ICLR, New Orleans, LA, USA.
38. Playing with duality: An overview of recent primal? dual approaches for solving large-scale optimization problems10.1109/MSP.2014.2377273 ↗
39. (2023). Common Test Conditions for G-PCC (Standard No. ISO/IEC JTC2/SC29/WG7 MPEG Output Document N00650).
40. Bjontegaard, G. (2024, May 05). Calculation of Average PSNR Differences between RD-Curves. ITU SG16 Doc. VCEG-M33. Available online: https://www.itu.int/wf-tp3/av-arch/video-site/0104_Aus/VCEG-M33.doc.