3D City Reconstruction: A Novel Method for Semantic Segmentation and Building Monomer Construction Using Oblique Photography
Source abstract
Abstract
Existing 3D city reconstruction via oblique photography can only produce surface models, lacking semantic information about the urban environment and the ability to incorporate all individual buildings. Here, we propose a method for the semantic segmentation of 3D model data from oblique photography and for building monomer construction and implementation. Mesh data were converted into and mapped as point sets clustered to form superpoint sets via rough geometric segmentation, facilitating subsequent feature extractions. In the local neighborhood computation of semantic segmentation, a neighborhood search method based on geodesic distances, improved the rationality of the neighborhood. In addition, feature information was retained via the superpoint sets. Considering the practical requirements of large-scale 3D datasets, this study offers a robust and efficient segmentation method that combines traditional random forest and Markov random field models to segment 3D scene semantics. To address the need for modeling individual and unique buildings, our methodology utilized 3D mesh data of buildings as a data source for specific contour extraction. Model monomer construction and building contour extractions were based on mesh model slices and assessments of geometric similarity, which allowed the simultaneous and automatic achievement of these two processes.
Source: crossref · Quality: baseline
Research context
OpenAlex topics: Remote Sensing and LiDAR Applications · 3D Surveying and Cultural Heritage · Robotics and Sensor-Based Localization
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
Affiliations
School of Geosciences and Info-Physics, Central South University, Changsha 410083, China
Changsha Urban Planning Information Service Center, Changsha 410083, China
Funding
National Natural Science Foundation of China · R&D Project Plan of the Ministry of Housing and Urban–Rural Development of China
References (44)
Show source-provided references
1. Stereoscopic 3D teaching material usability analysis for interactive boards10.1002/cav.2041 ↗
2. Oblique Image Based Automatic Aerotriangulation and its Application in 3D City Model Reconstruction
3. Research progress of GRC photogrammetry
4. Wang, Q.D. (2017). A Semantic Modeling Framework-Based Method for 3D Building Reconstruction from Airborne LiDAR Point. [Ph.D. Thesis, Wuhan University].
5. Extended Gaussian images10.1109/PROC.1984.13073 ↗
6. Learning High-Level Feature by Deep Belief Networks for 3-D Model Retrieval and Recognition10.1109/TMM.2014.2351788 ↗
7. Zhang, R. (2018). Research on Semantic Segmentation of Polymorphic Objects in Complex 3D Scene Based on Laser Point Cloud. [Ph.D. Thesis, Strategic Support Force Information Engineering University].
8. Fully Convolutional Networks for Semantic Segmentation10.1109/TPAMI.2016.2572683 ↗
9. SegNet: A Deep Convolutional Encoder-Decoder Architecture for Image Segmentation10.1109/TPAMI.2016.2644615 ↗
10. DeepLab: Semantic Image Segmentation with Deep Convolutional Nets, Atrous Convolution, and Fully Connected CRFs10.1109/TPAMI.2017.2699184 ↗
11. Segmentation based classification of 3D urban point clouds: A super-voxel approach for evaluation10.3390/rs5041624 ↗
12. Hang, S., Maji, S., Kalogerakis, E., and Learned-Miller, E. (2015, January 7–13). Multi-view Convolutional Neural Networks for 3D Shape Recognition. Proceedings of the IEEE International Conference on Computer Vision, Santiago, Chile.
13. Kalogerakis, E., Averkiou, M., Maji, S., and Chaudhuri, S. (2017, January 21–26). 3D Shape Segmentation with Projective Convolutional Networks. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Honolulu, HI, USA.10.1109/CVPR.2017.702 ↗
14. Xu, X., Corrigan, D., Dehghani, A., Caulfield, S., and Moloney, D. (2016). Articulated Motion and Deformable Objects, Proceedings of the 9th International Conference, AMDO 2016, Palma de Mallorca, Spain, 13–15 July 2016, Springer International Publishing.
15. Li, Y., Pirk, S., Su, H., Qi, C.R., and Guibas, L.J. (2016). Advances in Neural Information Processing Systems 29, Annual Conference on Neural Information Processing Systems 2016, Barcelona, Spain, 5–10 December 2016, MIT Press.
16. Chen, Y. (2017). Research on Building Monomer Extraction Technology Based on Oblique Image Dense Matching Point Cloud. [Master’s Thesis, PLA Information Engineering University].
17. Cai, X.Y. (2018). Building Monomer Method Based on UAV Oblique Photography Scene Modeling. [Master’s Thesis, Nanjing Normal University].
18. Research on the monomer technology of oblique photography three-dimensional model based on vector cutting
19. Neighborhood Systems for Airborne Laser Data10.14358/PERS.71.6.743 ↗
20. Distinguishing license plate numbers using discrete wavelet transform technology based deep learning
21. New algorithm based on deep learning for number recognition
22. The effectiveness of discrete hermite wavelet filters technique in digital image watermarking
23. The effectiveness of the Hermite wavelet discrete filter technique in modify a convolutional neural network for person identification
24. Elaksher, A.F., and Bethel, J.S. (2002, January 9–13). Reconstructing 3D Buildings from LIDAR Data. Proceedings of the ISPRS Commission III Symposium, Photogrammetric and Computer Vision, Graz, Austria.
25. The use of anisotropic height texture measures for the segmentation of airborne laser scanner data
26. Güler, O., and Yücedağ, I. (2018, January 19–21). Developing an CNC lathe augmented reality application for industrial maintanance training. Proceedings of the 2018 2nd International Symposium on Multidisciplinary Studies and Innovative Technologies (ISMSIT), Ankara, Turkey.10.1109/ISMSIT.2018.8567255 ↗
27. Research on the Automatic ID Method of Oblique Photography Model
28. Landrieu, L., and Simonovsky, M. (2018, January 18–22). Large-scale Point Cloud Semantic Segmentation with Superpoint Graphs. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Salt Lake City, UT, USA.10.1109/CVPR.2018.00479 ↗
29. Creating Large-scale City Models from 3D-point Clouds: A Robust Approach with Hybrid Representation10.1007/s11263-012-0517-8 ↗
30. Semantic Point Cloud Interpretation based on Optimal Neighborhoods, Relevant Features and Efficient Classifiers10.1016/j.isprsjprs.2015.01.016 ↗
31. Perceptual organization of 3D surface points
32. Linsen, L., and Prautzsch, H. (2001, January 2–3). Local Versus Global Triangulations. Proceedings of the Eurographics, Manchester, UK.
33. Pauly, M., Gross, M., and Kobbelt, L.P. (2002, January 27). Efficient simplification of point-sampled surfaces. Proceedings of the IEEE Visualization, Boston, MA, USA.
34. Hoppe, H., Derose, T., Duchamp, T., McDonald, J., and Stuetzle, W. (1992, January 26). Surface Reconstruction from Unorganized Points. Proceedings of the 19th Annual Conference on Computer Graphics and Interactive Techniques, Chicago, IL, USA.10.1145/133994.134011 ↗
35. Zhang, L.W. (2009). Research on 3D Surface Reconstruction Technology of Scattered Point Cloud. [Ph.D. Thesis, National University of Defense Technology].
36. Gao, Y.L. (2017). 3D Model Reconstruction of Tilted Photographic Buildings Based on Vehicle-Mounted Point Cloud Enhancement. [Ph.D. Dissertation, Wuhan University].
37. Fast Semantic Segmentation of 3D Point Clouds with Strongly Varying Density
38. Mount, D.M. (1998). ANN Programming Manual, Department of Computer Science, University of Maryland. Technical Report.
39. Yan, D.M., Wintz, J., Mourrain, B., Wang, W., Boudon, F., and Godin, C. (2009, January 19–21). Efficient and robust reconstruction of botanical branching structure from laser scanned points. Proceedings of the 2009 11th IEEE International Conference on Computer-Aided Design and Computer Graphics, Huangshan, China.10.1109/CADCG.2009.5246837 ↗
40. Shapovalov, R., and Velizhev, A. (2011, January 16–19). Cutting-plane training of non-associative Markov for 3D point cloud segmentation. Proceedings of the 2011 International Conference on 3D Imaging, Modeling, Processing, Visualization and Transmission, Hangzhou, China.10.1109/3DIMPVT.2011.10 ↗
41. Li, S.Z. (2009). Markov Random Field Modeling in Image Analysis, Springer.
42. Fast approximate energy minimization via graph cuts10.1109/34.969114 ↗
43. Computational Approach to Edge Detection10.1109/TPAMI.1986.4767851 ↗
44. Lipkin, B.S., and Rosenfeld, A. (1970). Picture Processing and Psychopictorics, Academic Press.