journal article·2023-10-27Open access

Multi-Scale Indoor Scene Geometry Modeling Algorithm Based on Segmentation Results

Changfa Wang, Tuo Yao, Qinghua Yang

Applied Sciences· Volume 13· Issue 21

Abstract

Due to the numerous objects with regular structures in indoor environments, identifying and modeling the regular objects in scenes aids indoor robots in sensing unknown environments. Typically, point cloud preprocessing can obtain highly complete object segmentation results in scenes which can be utilized as the objects for geometric analysis and modeling, thus ensuring modeling accuracy and speed. However, due to the lack of a complete object model, it is not possible to recognize and model segmented objects through matching methods. To achieve a greater understanding of scene point clouds, this paper proposes a direct geometric modeling algorithm based on segmentation results, which focuses on extracting regular geometries in the scene, rather than objects with geometric details or combinations of multiple primitives. This paper suggests using simpler geometric models to describe the corresponding point cloud data. By fully utilizing the surface structure information of segmented objects, the paper analyzes the types of faces and their relationships to classify regular geometric objects into two categories: planar and curved. Different types of geometric objects are fitted using random sampling consistency algorithms with type classification results as prior knowledge, and segmented results are modeled through a combination of size information associated with directed bounding boxes. For indoor scenes with occlusion and stacking, utilizing a higher-level semantic expression can effectively simplify the scene, complete scene abstraction and structural modeling, and aid indoor robots’ understanding and further operation in unknown environments.
Source: crossref · Quality: baseline

Research context

OpenAlex topics: Robotics and Sensor-Based Localization · 3D Surveying and Cultural Heritage · Remote Sensing and LiDAR Applications

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

School of Mechatronic Engineering and Automation, Shanghai University, Shanghai 200444, China

References (23)

Show source-provided references
1. Liu, M., Zhu, Y., Cai, H., Han, S., Ling, Z., Porikli, F., and Su, H. (2023, January 18–22). Partslip: Low-shot part segmentation for 3d point clouds via pretrained image-language models. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, Vancouver, BC, Canada.10.1109/CVPR52729.2023.02082 ↗
2. Deep learning for image and point cloud fusion in autonomous driving: A review10.1109/TITS.2020.3023541 ↗
3. An overview of object detection from building point cloud data10.1088/1742-6596/1878/1/012058 ↗
4. Robotic online path planning on point cloud10.1109/TCYB.2015.2430526 ↗
5. A framework for using point cloud data of heritage buildings toward geometry modeling in a BIM context: A case study on Santa Maria La Real De Mave Church
6. Berger, M., Tagliasacchi, A., Seversky, L.M., Alliez, P., Levine, J.A., Sharf, A., and Silva, C.T. (2014, January 7–11). State of the art in surface reconstruction from point clouds. Proceedings of the 35th Annual Conference of the European Association for Computer Graphics, Eurographics 2014-State of the Art Reports, Strasbourg, France.
7. A novel radar point cloud generation method for robot environment perception10.1109/TRO.2022.3185831 ↗
8. Geometric primitives in LiDAR point clouds: A review10.1109/JSTARS.2020.2969119 ↗
9. A survey of simple geometric primitives detection methods for captured 3D data10.1111/cgf.13451 ↗
10. Ahn, S.J., Effenberger, I., Rauh, W., Cho, H., and Westkämper, E. (2002, January 12–14). Automatic segmentation and model identification in unordered 3D point cloud. Proceedings of the Optomechatronic Systems III, Stuttgart, Germany.10.1117/12.467726 ↗
11. Indoor point cloud segmentation using iterative gaussian mapping and improved model fitting10.1109/TGRS.2020.2984943 ↗
12. Li, D., and Feng, C. (2019, January 21–24). Primitive fitting using deep geometric segmentation. Proceedings of the International Symposium on Automation and Robotics in Construction, ISARC, Banff, AB, Canada.10.22260/ISARC2019/0105 ↗
13. An adaptive process of reverse engineering from point clouds to CAD models10.1080/0951192X.2020.1803501 ↗
14. Abstraction and understanding of indoor scenes from single-view RGB-D scanning data
15. Stanescu, A., Fleck, P., Schmalstieg, D., and Arth, C. (2018, January 16–20). Semantic segmentation of geometric primitives in dense 3D point clouds. Proceedings of the 17th IEEE International Symposium on Mixed and Augmented Reality, Munich, Germany.10.1109/ISMAR-Adjunct.2018.00068 ↗
16. Development of a multispectral fluorescence LiDAR for point cloud segmentation of plants10.1364/OE.490004 ↗
17. Octree-based region growing for point cloud segmentation10.1016/j.isprsjprs.2015.01.011 ↗
18. Tang, L., Zhan, Y., Chen, Z., Yu, B., and Tao, D. (2022, January 18–24). Contrastive boundary learning for point cloud segmentation. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, New Orleans, LA, USA.10.1109/CVPR52688.2022.00830 ↗
19. Te, G., Hu, W., Zheng, A., and Guo, Z. (2018, January 22–26). Rgcnn: Regularized graph cnn for point cloud segmentation. Proceedings of the 26th ACM international conference on Multimedia, Seoul, Republic of Korea.10.1145/3240508.3240621 ↗
20. Hernández, J., and Marcotegui, B. (2009, January 20–22). Point cloud segmentation towards urban ground modeling. Proceedings of the IEEE Joint Urban Remote Sensing Event, Shanghai, China.10.1109/URS.2009.5137562 ↗
21. Zhang, F., Fang, J., Wah, B., and Torr, P. (2020, January 23–28). Deep fusionnet for point cloud semantic segmentation. Proceedings of the Computer Vision–ECCV 2020: 16th European Conference, Glasgow, UK.10.1007/978-3-030-58586-0_38 ↗
22. Point cloud segmentation for urban scene classification. Int. Arch. Photogramm
23. Lu, Y., Jiang, Q., Chen, R., Hou, Y., Zhu, X., and Ma, Y. (2023, January 2–3). See more and know more: Zero-shot point cloud segmentation via multi-modal visual data. Proceedings of the IEEE/CVF International Conference on Computer Vision, Paris, France.10.1109/ICCV51070.2023.01981 ↗