journal article·2026-01-05Open access

Large-Scale Point Cloud Completion Through Registration and Fusion of Object-Level Reconstructions

Taiming He, Yixuan Fang, Keyuan Li, Lu Yang

Applied Sciences· Volume 16· Issue 1

Abstract

Existing 3D reconstruction algorithms commonly struggle with modeling specific local objects within large-scale scenes, often resulting in a lack of local detail and incomplete geometric structures. While current mainstream point cloud completion methods can restore these missing structures to some degree, they are fundamentally based on generative in-filling, a process that relies on geometric priors learned from large-scale datasets. Consequently, the physical realism and geometric accuracy of the results cannot be guaranteed. To address these limitations, this paper proposes a novel, data-driven framework for point cloud completion. Our core method involves the high-precision, heterogeneous data registration and seamless fusion of an object-level point cloud—reconstructed with high-fidelity appearance and geometry by our optimized Neural Radiance Fields (NeRF) framework—with our target large-scale scene point cloud. By using high-precision, physically based data as a strong prior for geometric completion, we offer an alternative route to conventional generative completion methods. Concurrently, we employ unsupervised evaluation metrics to assess the intrinsic quality of the final results. This work provides a robust and high-fidelity solution to the problem of completing local objects within large-scale scenes. Evaluated on our self-constructed UAV-Recon dataset, the proposed method achieved a Structural Plausibility ≥ 0.995, Geometric Smoothness ≤ 0.19, and Distribution Uniformity ≈ 1.2, offering a robust solution for the high-fidelity completion of local objects within large-scale scenes.
Source: crossref · Quality: baseline

Research context

OpenAlex topics: 3D Shape Modeling and Analysis · Robotics and Sensor-Based Localization · 3D Surveying and Cultural Heritage

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

School of Automation Engineering, University of Electronic Science and Technology of China, Chengdu 611731, China

References (31)

Show source-provided references
1. Visual odometry for ground vehicle applications10.1002/rob.20103 ↗
2. ORB-SLAM2: An Open-Source SLAM System for Monocular, Stereo, and RGB-D Cameras10.1109/TRO.2017.2705103 ↗
3. Sucar, E., Liu, S., Ortiz, J., and Davison, A.J. (2021, January 10–17). iMAP: Implicit mapping and positioning in real-time. Proceedings of the IEEE/CVF International Conference on Computer Vision, Montreal, QC, Canada.10.1109/ICCV48922.2021.00617 ↗
4. Bloesch, M., Czarnowski, J., Clark, R., Leutenegger, S., and Davison, A.J. (2018, January 18–23). Codeslam—Learning a compact, optimisable representation for dense visual slam. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Salt Lake City, UT, USA.10.1109/CVPR.2018.00271 ↗
5. Guo, Z.C., Forbes, J.R., and Barfoot, T.D. (2025, January 19–23). Marginalizing and Conditioning Gaussians onto Linear Approximations of Smooth Manifolds with Applications in Robotics. Proceedings of the 2025 IEEE International Conference on Robotics and Automation (ICRA), Atlanta, GA, USA.10.1109/ICRA55743.2025.11128000 ↗
6. Mildenhall, B., Srinivasan, P.P., Tancik, M., Barron, J.T., Ramamoorthi, R., and Ng, R. (2020). NeRF: Representing Scenes as Neural Radiance Fields for View Synthesis. arXiv.10.1007/978-3-030-58452-8_24 ↗
7. Chen, A., Xu, Z., Geiger, A., Yu, J., and Su, H. (2022, January 23–27). TensoRF: Tensorial radiance fields. Proceedings of the European Conference on Computer Vision, Tel Aviv, Israel.10.1007/978-3-031-19824-3_20 ↗
8. Fridovich-Keil, S., Yu, A., Tancik, M., Chen, Q., Recht, B., and Kanazawa, A. (2022, January 18–24). Plenoxels: Radiance fields without neural networks. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, New Orleans, LA, USA.10.1109/CVPR52688.2022.00542 ↗
9. Yang, Y., Zhang, S., Huang, Z., Zhang, Y., and Tan, M. (2023, January 1–6). Cross-ray neural radiance fields for novel-view synthesis from unconstrained image collections. Proceedings of the IEEE/CVF International Conference on Computer Vision, Paris, France.10.1109/ICCV51070.2023.01457 ↗
10. Qi, C.R., Su, H., Mo, K., and Guibas, L.J.J.I. (2017, January 21–26). PointNet: Deep Learning on Point Sets for 3D Classification and Segmentation. Proceedings of the 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Honolulu, HI, USA.
11. Pointnext: Revisiting pointnet++ with improved training and scaling strategies
12. Yuan, W., Khot, T., Held, D., Mertz, C., and Hebert, M.J.I. (2018, January 5–8). PCN: Point Completion Network. Proceedings of the 2018 International Conference on 3D Vision (3DV), Verona, Italy.10.1109/3DV.2018.00088 ↗
13. Dai, A., Ritchie, D., Bokeloh, M., Reed, S., Sturm, J., and Niener, M. (2017). ScanComplete: Large-Scale Scene Completion and Semantic Segmentation for 3D Scans. arXiv.10.1109/CVPR.2018.00481 ↗
14. Mezghanni, M., Boulkenafed, M., Lieutier, A., and Ovsjanikov, M. (2021, January 20–25). Physically-aware generative network for 3d shape modeling. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, Nashville, TN, USA.10.1109/CVPR46437.2021.00921 ↗
15. Li, A., Zimmer-Dauphinee, J.R., Kalyanam, R., Lindsay, I., VanValkenburgh, P., Wernke, S., and Aliaga, D. (2025, January 10–17). Self-Supervised Large Scale Point Cloud Completion for Archaeological Site Restoration. Proceedings of the Computer Vision and Pattern Recognition Conference, Nashville, TN, USA.10.1109/CVPR52734.2025.01098 ↗
16. 4-points congruent sets for robust pairwise surface registration10.1145/1360612.1360684 ↗
17. Fan, H., Su, H., and Guibas, L. (2017, January 21–26). A Point Set Generation Network for 3D Object Reconstruction from a Single Image. Proceedings of the 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Honolulu, HI, USA.10.1109/CVPR.2017.264 ↗
18. Kazhdan, M., Bolitho, M., and Hoppe, H. (2006, January 26–28). Poisson surface reconstruction. Proceedings of the Fourth Eurographics Symposium on Geometry Processing, Cagliari Sardinia, Italy.
19. Surface reconstruction from unorganized points10.1145/142920.134011 ↗
20. Chang, A.X., Funkhouser, T., Guibas, L., Hanrahan, P., Huang, Q., Li, Z., Savarese, S., Savva, M., Song, S., and Su, H. (2015). ShapeNet: An Information-Rich 3D Model Repository. arXiv.
21. Achlioptas, P., Diamanti, O., Mitliagkas, I., and Guibas, L. (2017). Learning Representations and Generative Models for 3D Point Clouds. arXiv.
22. Estimating Uncertain Spatial Relationships in Robotics
23. Cui, H., Shen, S., Gao, W., and Wang, Z. (2018, January 5–8). Progressive large-scale structure-from-motion with orthogonal MSTs. Proceedings of the 2018 International Conference on 3D Vision (3DV), Verona, Italy.10.1109/3DV.2018.00020 ↗
24. Zhu, S., Zhang, R., Zhou, L., Shen, T., Fang, T., Tan, P., and Quan, L. (2018, January 18–23). Very large-scale global sfm by distributed motion averaging. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Salt Lake City, UT, USA.10.1109/CVPR.2018.00480 ↗
25. Ding, Y., Zhu, Q., Liu, X., Yuan, W., Zhang, H., and Zhang, C. (2022, January 23–27). Kd-mvs: Knowledge distillation based self-supervised learning for multi-view stereo. Proceedings of the European Conference on Computer Vision, Tel Aviv, Israel.10.1007/978-3-031-19821-2_36 ↗
26. Zhu, Q., Min, C., Wei, Z., Chen, Y., and Wang, G. (2021). Deep learning for multi-view stereo via plane sweep: A survey. arXiv.
27. Learning representations by back-propagating errors10.1038/323533a0 ↗
28. Rusu, R.B., Blodow, N., and Beetz, M. (2009, January 12–17). Fast point feature histograms (FPFH) for 3D registration. Proceedings of the 2009 IEEE International Conference on Robotics and Automation, Kobe, Japan.10.1109/ROBOT.2009.5152473 ↗
29. Random sample consensus: A paradigm for model fitting with applications to image analysis and automated cartography10.1145/358669.358692 ↗
30. RANSAC back to SOTA: A two-stage consensus filtering for real-time 3D registration10.1109/LRA.2024.3502056 ↗
31. Blitz-SLAM: A semantic SLAM in dynamic environments10.1016/j.patcog.2021.108225 ↗