Improved Patch Packing and Refining Segmentation for the V-PCC Standard
Source abstract
Abstract
High-performance coding solutions are urgently needed for the storage and transmission of 3D point clouds due to the development of 3D data acquisition facilities and the increasing scale of acquired point clouds. Video-based point cloud compression (V-PCC) is the most advanced international standard for compressing dynamic point clouds. However, it still has serious issues of time consumption and the large size of the occupancy map. Considering the aforementioned issues, based on V-PCC, we propose the Voxel Selection-based Refining Segmentation (VS-RS), which is used to accelerate the refining segmentation process of the point cloud. Furthermore, the data-adaptive patch packing (DAPP) is proposed to reduce the size of the occupancy map. In order to specify the effect of the improvement, we also designed novel evaluation indicators. Experimental results show that the proposed method achieves a Bjøntegaard Delta rate (BD-rate) gain of −1.58% in the V-PCC benchmark. Additionally, it reduces encoding time by up to 31.86% and reduces the size of the occupancy map by up to 20.14%.
Source: crossref · Quality: baseline
Research context
OpenAlex topics: Video Coding and Compression Technologies · Advanced Data Compression Techniques · Color Science and Applications
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
Affiliations
School of Computer Science and Technology, Changchun University of Science and Technology, Changchun 130022, China
Funding
National Key R&D Program of China
References (40)
Show source-provided references
1. Building high-fidelity human body models from user-generated data10.1109/TMM.2020.3001540 ↗
2. Learning-based rate control for video-based point cloud compression10.1109/TIP.2022.3152065 ↗
3. Efficient projected frame padding for video-based point cloud compression10.1109/TMM.2020.3016894 ↗
4. Advanced 3D motion prediction for video-based dynamic point cloud compression10.1109/TIP.2019.2931621 ↗
5. Ahmmed, A., Paul, M., and Pickering, M. (2021, January 23–26). Dynamic point cloud texture video compression using the edge position difference oriented motion model. Proceedings of the 2021 Data Compression Conference (DCC), Snowbird, UT, USA.10.1109/DCC50243.2021.00075 ↗
6. Compression of sparse and dense dynamic point clouds—Methods and standards10.1109/JPROC.2021.3085957 ↗
7. Video-based point-cloud-compression standard in MPEG: From evidence collection to committee draft [standards in a nutshell]10.1109/MSP.2019.2900721 ↗
8. Bitstream-Based Perceptual Quality Assessment of Compressed 3D Point Clouds10.1109/TIP.2023.3253252 ↗
9. Akhtar, A., Li, Z., and Van der Auwera, G. (2022). Inter-frame compression for dynamic point cloud geometry coding. arXiv.10.1109/ICASSP43922.2022.9747105 ↗
10. Liu, Y., Yang, Q., and Xu, Y. (2022, January 13–16). Reduced Reference Quality Assessment for Point Cloud Compression. Proceedings of the 2022 IEEE International Conference on Visual Communications and Image Processing (VCIP), Suzhou, China.10.1109/VCIP56404.2022.10008813 ↗
11. Video-based point cloud compression artifact removal10.1109/TMM.2021.3090148 ↗
12. Reduced reference perceptual quality model with application to rate control for video-based point cloud compression10.1109/TIP.2021.3096060 ↗
13. Model-based joint bit allocation between geometry and color for video-based 3D point cloud compression10.1109/TMM.2020.3023294 ↗
14. A hybrid compression framework for color attributes of static 3D point clouds10.1109/TCSVT.2021.3069838 ↗
15. MPEG (2021). G-PCC Codec Description v12, MPEG. ISO/IEC JTC 1/SC 29/WG 7.
16. An overview of ongoing point cloud compression standardization activities: Video-based (V-PCC) and geometry-based (G-PCC)10.1017/ATSIP.2020.12 ↗
17. MPEG (2020). V-PCC Codec Description v10, MPEG. ISO/IEC JTC 1/SC 29/WG7.
18. Emerging MPEG standards for point cloud compression10.1109/JETCAS.2018.2885981 ↗
19. Overview of the high efficiency video coding (HEVC) standard10.1109/TCSVT.2012.2221191 ↗
20. Faramarzi, E., and Budagavi, M. (2019). On Complexity Reduction of TMC2 Encoder, MPEG. ISO/IEC JTC1/SC29/WG11.
21. Faramarzi, E., Budagavi, M., and Joshi, R. (2019). Grid-Based Partitioning, MPEG. ISO/IEC JTC1/SC29/WG11.
22. Faramarzi, E., Joshi, R., Budagavi, M., Rhyu, S., and Song, J. (2019). CE2.27 Report on Encoder’s Speedup, MPEG. ISO/IEC JTC1/SC29/WG11.
23. Becerra, H., Higa, R., Garcia, P., and Testoni, V. (2019). V-PCC Encoder Performance Analysis, MPEG. ISO/IEC JTC1/SC29/WG11.
24. Higa, R., Garcia, P., and Testoni, V. (2020). V-PCC Encoder Performance Optimization and Speed Up, MPEG. ISO/IEC JTC1/SC29/WG11.
25. Fast grid-based refining segmentation method in video-based point cloud compression10.1109/ACCESS.2021.3084180 ↗
26. Kim, Y., and Kim, Y.-H. (2022, January 26–28). Low Complexity Fast Grid-Based Refining Segmentation in the V-PCC encoder. Proceedings of the 2022 IEEE International Conference on Consumer Electronics-Asia (ICCE-Asia), Yeosu, Republic of Korea.10.1109/ICCE-Asia57006.2022.9954713 ↗
27. Sheikhipour, N., Pesonen, M., Schwarz, S., and Vadakital, V.K.M. (2019, January 28–31). Improved single-layer coding of volumetric data. Proceedings of the 2019 8th European Workshop on Visual Information Processing (EUVIP), Rome, Italy.10.1109/EUVIP47703.2019.8946131 ↗
28. View-dependent dynamic point cloud compression10.1109/TCSVT.2020.2985911 ↗
29. Occupancy-map-based rate distortion optimization and partition for video-based point cloud compression10.1109/TCSVT.2020.2966118 ↗
30. Contextual homogeneity-based patch decomposition method for higher point cloud compression10.1109/ACCESS.2020.3038800 ↗
31. Wang, D., Zhu, W., Xu, Y., and Xu, Y. (2021, January 22–28). Visual quality optimization for view-dependent point cloud compression. Proceedings of the 2021 IEEE International Symposium on Circuits and Systems (ISCAS), Daegu, Republic of Korea.10.1109/ISCAS51556.2021.9401619 ↗
32. Lu, C.-L., Chou, H.-S., Huang, Y.-Y., Chan, M.-L., Lin, S.-Y., and Chen, S.-L. (2023, January 17–19). High Compression Rate Architecture For Texture Padding Based on V-PCC. Proceedings of the 2023 International Conference on Consumer Electronics-Taiwan (ICCE-Taiwan), PingTung, Taiwan.10.1109/ICCE-Taiwan58799.2023.10227018 ↗
33. MPEG (2019). V-PCC Codec Description v7, MPEG. ISO/IEC JTC1/SC29/WG11.
34. Costa, A., Dricot, A., Brites, C., Ascenso, J., and Pereira, F. (2019, January 27–29). Improved patch packing for the MPEG V-PCC standard. Proceedings of the 2019 IEEE 21st International Workshop on Multimedia Signal Processing (MMSP), Kuala Lumpur, Malaysia.10.1109/MMSP.2019.8901690 ↗
35. Yuan, H., Gao, W., Li, G., and Li, Z. (2022, January 10–14). Rate-Distortion-Guided Learning Approach with Cross-Projection Information for V-PCC Fast CU Decision. Proceedings of the 30th ACM International Conference on Multimedia, New York, NY, USA.10.1145/3503161.3548215 ↗
36. Calculation of average PSNR differences between RD-curves
37. MPEG (2020). Common Test Conditions for PCC, MPEG. ISO/IEC JTC1/SC29/WG11.
38. The effectiveness of the finite differences method on physical and medical images based on a heat diffusion equation10.1088/1742-6596/1999/1/012080 ↗
39. Maja Krivokuća, P.A.C., and Savill, P. (2023, November 02). 8i Voxelized Surface Light Field (8iVSLF) Dataset. Available online: https://mpeg-pcc.org/index.php/pcc-content-database/8i-voxelized-surface-light-field-8ivslf-dataset/.
40. Xu, Y., Lu, Y., and Wen, Z. (2023, November 02). Owlii Dynamic Human Mesh Sequence Dataset. Available online: https://mpeg-pcc.org/index.php/pcc-content-database/owlii-dynamic-human-textured-mesh-sequence-dataset/.