journal article·2026-02-02Open access

GA-HRNet: High-Precision Building Extraction for Individualization of Oblique Photogrammetry 3D Models

Jiacui Zou, Yongchuan Zhang, Feng Li, Ruibing Wang, Jiajun Wu, Yang Qiao

Applied Sciences· Volume 16· Issue 3

Abstract

Building individualization is a critical preprocessing step for refined applications of oblique photogrammetry 3D models, yet existing semantic segmentation methods encounter accuracy bottlenecks when applied to ultra-high-resolution orthophotos. To overcome this challenge, this study constructs an automated technical framework following a workflow from orthophoto generation to high-precision semantic segmentation, and finally to dynamic 3D rendering. The framework comprises three stages: (1) converting the 3D model into a 2D orthophoto to ensure that the extracted building contours can be precisely registered with the original 3D model in space; (2) utilizing the proposed Gated-ASPP High-Resolution Network (GA-HRNet) to extract building contours, enhancing segmentation accuracy by synergizing HRNet’s spatial detail preservation capability with ASPP’s multi-scale context awareness; (3) mapping the extracted 2D vector contours back to the 3D model and achieving interactive building individualization via dynamic rendering technology. Evaluated on a custom-built Hong Kong urban building dataset, GA-HRNet achieved an Intersection over Union (IoU) of 91.25%, an F1-Score of 95.41%, a Precision of 93.31%, and a Recall of 97.70%. Its performance surpassed that of various comparative models, including FCN, U-Net, MBR-HRNet, and others, with an IoU lead of 1.46 to 5.62 percentage points. This method enables precise building extraction and dynamic highlighting within 3D scenes, providing an efficient and reliable technical path for the refined application of large-scale urban oblique photogrammetry models.
Source: crossref · Quality: baseline

Research context

OpenAlex topics: Remote Sensing and LiDAR Applications · 3D Modeling in Geospatial Applications · 3D Surveying and Cultural Heritage

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

School of Smart City, Chongqing Jiaotong University, Chongqing 400074, China

Key Laboratory of Monitoring, Evaluation and Early Warning of Territorial Spatial Planning Implementation, Ministry of Natural Resources, Chongqing 401147, China

Chongqing Academy of Surveying and Mapping, Chongqing 401121, China

Chongqing Planning and Natural Resources Information Center, Chongqing 401147, China

School of Information Science and Engineering, Chongqing Jiaotong University, Chongqing 400074, China

Funding

Open Fund of Key Laboratory of Monitoring, Evaluation and Early Warning of Territorial Space Planning, Ministry of Natural Resources · Performance Incentive Guidance Program for Scientific Research Institutions of Chongqing Municipality · Key Research and Development Program of Ningxia Hui Autonomous Region · Research Project of Chongqing Planning and Natural Resources Bureau

References (46)

Show source-provided references
1. Riaz, K., McAfee, M., and Gharbia, S.S. (2023). Management of climate resilience: Exploring the potential of digital twin technology, 3D city modelling, and early warning systems. Sensors, 23.10.3390/s23052659 ↗
2. Virtual reality visualisation of automatic crack detection for bridge inspection from 3D digital twin generated by UAV photogrammetry10.1016/j.measurement.2024.115931 ↗
3. Survey on 3D Reconstruction Techniques: Large-Scale Urban City Reconstruction and Requirements10.1109/TVCG.2025.3540669 ↗
4. Automated Assessment of Wind Damage to Windows of Buildings at a City Scale Based on Oblique Photography, Deep Learning and CFD10.1016/j.jobe.2022.104355 ↗
5. Proposition of UAV multi-angle nap-of-the-object image acquisition framework based on a quality evaluation system for a 3D real scene model of a high-steep rock slope
6. Rapid integration strategy for oblique photogrammetry terrain and highway BIM models in large-scale scenarios10.1016/j.autcon.2025.106354 ↗
7. Fixed-Lens camera setup and calibrated image registration for multifocus multiview 3D reconstruction10.1007/s00521-021-05926-7 ↗
8. Verykokou, S., and Ioannidis, C. (2023). An overview on image-based and scanner-based 3D modeling technologies. Sensors, 23.10.3390/s23020596 ↗
9. Deep learning based multi-view stereo matching and 3D scene reconstruction from oblique aerial images10.1016/j.isprsjprs.2023.08.015 ↗
10. NMSCANet: Stereo Matching Network for Speckle Variations in Single-Shot Speckle Projection Profilometry
11. Automatic classification of rural building characteristics using deep learning methods on oblique photography10.1007/s12273-021-0872-x ↗
12. Automatic Extraction of Building Geometries Based on Centroid Clustering and Contour Analysis on Oblique Images Taken by Unmanned Aerial Vehicles10.1080/13658816.2021.1937632 ↗
13. Wang, S., Li, X., Lin, L., Lu, H., Jiang, Y., Zhang, N., Wang, W., Yue, J., and Li, Z. (2024). A Single Data Extraction Algorithm for Oblique Photographic Data Based on the U-Net. Remote Sens., 16.10.3390/rs16060979 ↗
14. Ma, X.Y., Zhang, X.P., and Shi, L. (2018, January 12–14). Research on the Algorithm of Building Object Boundary Extraction Based on Oblique Photographic Model. Proceedings of the IEEE 3rd Advanced Information Technology, Electronic and Automation Control Conference (IAEAC), Chongqing, China.10.1109/IAEAC.2018.8577559 ↗
15. Modelling of buildings from aerial LiDAR point clouds using TINs and label maps10.1016/j.isprsjprs.2019.06.003 ↗
16. Automatic 3D building reconstruction from multi-view aerial images with deep learning10.1016/j.isprsjprs.2020.11.011 ↗
17. Automatic voxel-based 3D indoor reconstruction and room partitioning from triangle meshes10.1016/j.isprsjprs.2021.07.002 ↗
18. A comprehensive overview of deep learning techniques for 3D point cloud classification and semantic segmentation10.1007/s00138-024-01543-1 ↗
19. Xu, W., Zeng, Y., and Yin, C. (2023). 3D City Reconstruction: A Novel Method for Semantic Segmentation and Building Monomer Construction Using Oblique Photography. Appl. Sci., 13.10.3390/app13158795 ↗
20. Deep Learning-Based Building Footprint Extraction With Missing Annotations10.1109/LGRS.2021.3072589 ↗
21. Le, Q.H., Shin, H., Kwon, N., Ho, J., and Ahn, Y. (2022). Deep Learning Based Urban Building Coverage Ratio Estimation Focusing on Rapid Urbanization Areas. Appl. Sci., 12.10.3390/app122211428 ↗
22. From Footprints to Functions: A Comprehensive Global and Semantic Building Footprint Dataset10.1038/s41597-025-06132-z ↗
23. The Digital Twin of the City of Zurich for Urban Planning
24. Evaluation of the urban heat island effect based on 3D modeling and planning indicators for urban planning proposals10.1080/13467581.2024.2412129 ↗
25. BIM, IoT, and GIS integration in construction resource monitoring10.1016/j.autcon.2025.106149 ↗
26. Digital Twin: A Comprehensive Survey of Security Threats10.1109/COMST.2022.3171465 ↗
27. Chen, M., Wu, J., Liu, L., Zhao, W., Tian, F., Shen, Q., Zhao, B., and Du, R. (2021). DR-Net: An Improved Network for Building Extraction from High Resolution Remote Sensing Image. Remote Sens., 13.10.3390/rs13020294 ↗
28. PCL–PTD Net: Parallel cross-learning-based pixel transferred deconvolutional network for building extraction in dense building areas with shadow10.1109/JSTARS.2022.3230149 ↗
29. Han, R., Fan, X., and Liu, J. (2024). EUNet: Edge-UNet for Accurate Building Extraction and Edge Emphasis in Gaofen-7 Images. Remote Sens., 16.10.3390/rs16132397 ↗
30. SFGNet: Salient-feature-guided real-time building extraction network for remote sensing images10.1016/j.knosys.2025.113413 ↗
31. ARC-Net: An Efficient Network for Building Extraction From High-Resolution Aerial Images10.1109/ACCESS.2020.3015701 ↗
32. Shao, Z., Tang, P., Wang, Z., Saleem, N., Yam, S., and Sommai, C. (2020). BRRNet: A Fully Convolutional Neural Network for Automatic Building Extraction From High-Resolution Remote Sensing Images. Remote Sens., 12.10.3390/rs12061050 ↗
33. MAP-Net: Multiple Attending Path Neural Network for Building Footprint Extraction From Remote Sensed Imagery10.1109/TGRS.2020.3026051 ↗
34. Moghalles, K., Li, H.C., Al-Huda, Z., and Hezzam, E.A. (2021, January 22–24). Multi-task deep network for semantic segmentation of building in very high resolution imagery. Proceedings of the 2021 International Conference of Technology, Science and Administration (ICTSA), Taiz, Yemen.10.1109/ICTSA52017.2021.9406538 ↗
35. FwSVM-Net: A novel deep learning-based automatic building extraction from aerial images10.1016/j.jobe.2024.110473 ↗
36. Building Extraction with Vision Transformer
37. Yang, F., Jiang, F., Li, J., and Lu, L. (2024). MSTrans: Multi-Scale Transformer for Building Extraction from HR Remote Sensing Images. Electronics, 13.10.3390/electronics13234610 ↗
38. Yilmaz, E.O., and Kavzoglu, T. (2025). DeepSwinLite: A Swin transformer-based light deep learning model for building extraction using VHR aerial imagery. Remote Sens., 17.10.3390/rs17183146 ↗
39. Cheng, B., Misra, I., Schwing, A.G., Kirillov, A., and Girdhar, R. (2022, January 19–24). Masked-attention Mask Transformer for Universal Image Segmentation. Proceedings of the 2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), New Orleans, LA, USA.10.1109/CVPR52688.2022.00135 ↗
40. Deep High-Resolution Representation Learning for Visual Recognition10.1109/TPAMI.2020.2983686 ↗
41. Chen, L.-C., Zhu, Y., Papandreou, G., Schroff, F., and Adam, H. (2018, January 8–14). Encoder-Decoder with Atrous Separable Convolution for Semantic Image Segmentation. Proceedings of the European Conference on Computer Vision (ECCV), Munich, Germany.10.1007/978-3-030-01234-2_49 ↗
42. Zhao, Z., Jiang, G., and Li, Y. (2023). A Novel Method for Digital Orthophoto Generation from Top View Constrained Dense Matching. Remote Sens., 15.10.3390/rs15010177 ↗
43. Ortho-NeRF: Generating a True Digital Orthophoto Map Using the Neural Radiance Field from Unmanned Aerial Vehicle Images10.1080/10095020.2023.2296014 ↗
44. Wang, Y., Zhao, Q., Wu, Y., Tian, W., and Zhang, G. (2023). SCA-Net: Multiscale Contextual Information Network for Building Extraction Based on High-Resolution Remote Sensing Images. Remote Sens., 15.10.3390/rs15184466 ↗
45. Yan, G., Jing, H., Li, H., Guo, H., and He, S. (2023). Enhancing Building Segmentation in Remote Sensing Images: Advanced Multi-Scale Boundary Refinement with MBR-HRNet. Remote Sens., 15.10.3390/rs15153766 ↗
46. Easy-Net: A Lightweight Building Extraction Network Based on Building Features