High-Fold 3D Gaussian Splatting Model Pruning Method Assisted by Opacity
Source abstract
Abstract
Recent advancements in 3D scene representation have underscored the potential of Neural Radiance Fields (NeRFs) for producing high-fidelity renderings of complex scenes. However, NeRFs are hindered by the significant computational burden of volumetric rendering. To address this, 3D Gaussian Splatting (3DGS) has emerged as an efficient alternative, utilizing Gaussian-based representations and rasterization techniques to achieve faster rendering speeds without sacrificing image quality. Despite these advantages, the large number of Gaussian points and associated internal parameters result in high storage demands. To address this challenge, we propose a pruning strategy applied during the Gaussian densification and pruning phases. Our approach integrates learnable Gaussian masks with a contribution-based pruning mechanism, further enhanced by an opacity update strategy to facilitate the pruning process. This method effectively eliminates redundant Gaussian points and those with minimal contributions to scene construction. Additionally, during the Gaussian parameter compression phase, we employ a combination of teacher–student models and vector quantization to compress the spherical harmonic coefficients. Extensive experimental results demonstrate that our approach reduces the storage requirements of original 3D Gaussian models by over 30 times, with only a minor degradation in rendering quality.
Source: crossref · Quality: baseline
Research context
OpenAlex topics: Image and Object Detection Techniques · Video Surveillance and Tracking Methods · Industrial Vision Systems and Defect Detection
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
Affiliations
Qingdao Institute of Software, College of Computer Science and Technology, China University of Petroleum (East China), Qingdao 266500, China
Funding
Natural Science Foundation of Shandong Province · National Natural Science Foundation of China · Qingdao Natural Science Foundation
References (48)
Show source-provided references
1. Nerf: Representing scenes as neural radiance fields for view synthesis10.1145/3503250 ↗
2. Reiser, C., Peng, S., Liao, Y., and Geiger, A. (2021, January 10–17). Kilonerf: Speeding up neural radiance fields with thousands of tiny mlps. Proceedings of the IEEE/CVF International Conference on Computer Vision, Montreal, QC, Canada.10.1109/ICCV48922.2021.01407 ↗
3. Hu, T., Liu, S., Chen, Y., Shen, T., and Jia, J. (2022, January 18–24). Efficientnerf efficient neural radiance fields. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, New Orleans, LA, USA.10.1109/CVPR52688.2022.01256 ↗
4. Li, S., Li, H., Wang, Y., Liao, Y., and Yu, L. (2023, January 17–24). Steernerf: Accelerating nerf rendering via smooth viewpoint trajectory. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, Vancouver, BC, Canada.10.1109/CVPR52729.2023.01983 ↗
5. Garbin, S.J., Kowalski, M., Johnson, M., Shotton, J., and Valentin, J. (2021, January 10–17). Fastnerf: High-fidelity neural rendering at 200fps. Proceedings of the IEEE/CVF International Conference on Computer Vision, Montreal, QC, Canada.10.1109/ICCV48922.2021.01408 ↗
6. Yu, A., Li, R., Tancik, M., Li, H., Ng, R., and Kanazawa, A. (2021, January 10–17). Plenoctrees for real-time rendering of neural radiance fields. Proceedings of the IEEE/CVF International Conference on Computer Vision, Montreal, QC, Canada.10.1109/ICCV48922.2021.00570 ↗
7. 3d gaussian splatting for real-time radiance field rendering10.1145/3592433 ↗
8. Instant neural graphics primitives with a multiresolution hash encoding
9. Barron, J.T., Mildenhall, B., Verbin, D., Srinivasan, P.P., and Hedman, P. (2022, January 18–24). Mip-nerf 360: Unbounded anti-aliased neural radiance fields. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, New Orleans, LA, USA.10.1109/CVPR52688.2022.00539 ↗
10. Matsuki, H., Murai, R., Kelly, P.H., and Davison, A.J. (2024, January 16–22). Gaussian splatting slam. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, Seattle, WA, USA.10.1109/CVPR52733.2024.01708 ↗
11. Guo, C., Gao, C., Bai, Y., and Lv, X. (2024). RD-SLAM: Real-Time Dense SLAM Using Gaussian Splatting. Appl. Sci., 14.10.3390/app14177767 ↗
12. Wu, G., Yi, T., Fang, J., Xie, L., Zhang, X., Wei, W., Liu, W., Tian, Q., and Wang, X. (2024, January 16–22). 4d gaussian splatting for real-time dynamic scene rendering. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, Seattle, WA, USA.10.1109/CVPR52733.2024.01920 ↗
13. Ren, J., Pan, L., Tang, J., Zhang, C., Cao, A., Zeng, G., and Liu, Z. (2023). Dreamgaussian4d: Generative 4d gaussian splatting. arXiv.
14. Yang, Z., Yang, H., Pan, Z., Zhu, X., and Zhang, L. (2023). Real-time photorealistic dynamic scene representation and rendering with 4d gaussian splatting. arXiv.
15. Li, X., Wang, H., and Tseng, K.K. (2023). Gaussiandiffusion: 3d gaussian splatting for denoising diffusion probabilistic models with structured noise. arXiv.
16. Zhou, X., Lin, Z., Shan, X., Wang, Y., Sun, D., and Yang, M.H. (2024, January 16–22). Drivinggaussian: Composite gaussian splatting for surrounding dynamic autonomous driving scenes. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, Seattle, WA, USA.10.1109/CVPR52733.2024.02044 ↗
17. Huang, Y., Cui, B., Bai, L., Guo, Z., Xu, M., Islam, M., and Ren, H. (2024). Endo-4dgs: Endoscopic monocular scene reconstruction with 4d gaussian splatting. International Conference on Medical Image Computing and Computer-Assisted Intervention, Springer Nature.10.1007/978-3-031-72089-5_19 ↗
18. Liu, Y., Luo, C., Fan, L., Wang, N., Peng, J., and Zhang, Z. (2025). Citygaussian: Real-time high-quality large-scale scene rendering with gaussians. European Conference on Computer Vision, Springer.10.1007/978-3-031-72640-8_15 ↗
19. Schonberger, J.L., and Frahm, J.M. (2016, January 27–30). Structure-from-motion revisited. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Las Vegas, NV, USA.10.1109/CVPR.2016.445 ↗
20. Lee, J.C., Rho, D., Sun, X., Ko, J.H., and Park, E. (2024, January 16–22). Compact 3d gaussian representation for radiance field. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, Seattle, WA, USA.10.1109/CVPR52733.2024.02052 ↗
21. Fan, Z., Wang, K., Wen, K., Zhu, Z., Xu, D., and Wang, Z. (2023). Lightgaussian: Unbounded 3d gaussian compression with 15x reduction and 200+ fps. arXiv.
22. Cheng, Y., Wang, D., Zhou, P., and Zhangs, T. (2017). A survey of model compression and acceleration for deep neural networks. arXiv.
23. A comprehensive survey on model compression and acceleration10.1007/s10462-020-09816-7 ↗
24. Tencent, A.I. (2024). Pixel-GS: Density Control with Pixel-Aware Gradient for 3D Gaussian Splatting. European Conference on Computer Vision, Springer Nature.
25. Tang, J., Ren, J., Zhou, H., Liu, Z., and Zengs, G. (2023). Dreamgaussian: Generative gaussian splatting for efficient 3d content creation. arXiv.
26. Wang, J., Fang, J., Zhang, X., Xie, L., and Tian, Q. (2024, January 16–22). Gaussianeditor: Editing 3d gaussians delicately with text instructions. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, Seattle, WA, USA.10.1109/CVPR52733.2024.01975 ↗
27. Chen, Y., Chen, Z., Zhang, C., Wang, F., Yang, X., Wang, Y., Cai, Z., Yang, L., Liu, H., and Lins, G. (2024, January 16–22). Gaussianeditor: Swift and controllable 3d editing with gaussian splatting. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, Seattle, WA, USA.10.1109/CVPR52733.2024.02029 ↗
28. Hinton, G. (2015). Distilling the Knowledge in a Neural Network. arXiv.
29. Knowledge distillation: A survey10.1007/s11263-021-01453-z ↗
30. Romero, A., Ballas, N., Kahou, S.E., Chassang, A., Gatta, C., and Bengio, Y. (2014). FitNets: Hints for Thin Deep Nets. arXiv.
31. Passalis, N., and Tefas, A. (2018, January 8–14). Learning Deep Representations with Probabilistic Knowledge Transfer. Proceedings of the European Conference on Computer Vision (ECCV), Munich, Germany.10.1007/978-3-030-01252-6_17 ↗
32. Mirzadeh, S.I., Farajtabar, M., Li, A., and Ghasemzadeh, H. (2020, January 7–12). Improved Knowledge Distillation via Teacher Assistant. Proceedings of the AAAI Conference on Artificial Intelligence, New York, NY, USA.10.1609/aaai.v34i04.5963 ↗
33. Dutt, A., Lunawat, I., and Kaur, M. (2024). Mutli-View 3D Reconstruction using Knowledge Distillation. arXiv.
34. Vector Quantization10.1109/MASSP.1984.1162229 ↗
35. Gersho, A., and Gray, R.M. (1992). Vector Quantization and Signal Compression, Springer.10.1007/978-1-4615-3626-0 ↗
36. Neural Discrete Representation Learning
37. Vector quantization in speech coding10.1109/PROC.1985.13340 ↗
38. Navaneet, K.L., Pourahmadi Meibodi, K., Abbasi Koohpayegani, S., and Pirsiavash, H. (2025). Compgs: Smaller and faster gaussian splatting with vector quantization. European Conference on Computer Vision, Springer.10.1007/978-3-031-73411-3_19 ↗
39. Rota Bulò, S., Porzi, L., and Kontschieder, P. (2025). Revising Densification in Gaussian Splatting. European Conference on Computer Vision, Springer.10.1007/978-3-031-73036-8_20 ↗
40. Bengio, Y., Léonard, N., and Courville, A. (2013). Estimating or propagating gradients through stochastic neurons for conditional computation. arXiv.
41. Qin, H., Gong, R., Liu, X., Shen, M., Wei, Z., Yu, F., and Song, J. (2020, January 14–19). Forward and backward information retention for accurate binary neural networks. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, Seattle, WA, USA.10.1109/CVPR42600.2020.00232 ↗
42. Liu, Z., Wu, B., Luo, W., Yang, X., Liu, W., and Cheng, K.T. (2018, January 8–14). Bi-real net: Enhancing the performance of 1-bit cnns with improved representational capability and advanced training algorithm. Proceedings of the European Conference on Computer Vision (ECCV), Munich, Germany.10.1007/978-3-030-01267-0_44 ↗
43. Rotated binary neural network
44. Genetic K-means algorithm10.1109/3477.764879 ↗
45. Tanks and temples: Benchmarking large-scale scene reconstruction10.1145/3072959.3073599 ↗
46. Local light field fusion: Practical view synthesis with prescriptive sampling guidelines10.1145/3306346.3322980 ↗
47. Niedermayr, S., Stumpfegger, J., and Westermann, R. (2024, January 16–22). Compressed 3d gaussian splatting for accelerated novel view synthesis. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, Seattle, WA, USA.10.1109/CVPR52733.2024.00985 ↗
48. Fridovich-Keil, S., Yu, A., Tancik, M., Chen, Q., Recht, B., and Kanazawa, A. (2022, January 18–24). Plenoxels: Radiance fields without neural networks. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, New Orleans, LA, USA.10.1109/CVPR52688.2022.00542 ↗