journal article·2022-10-01Open access

Building Function Recognition Using the Semi-Supervised Classification

Xuejing Xie, Yawen Liu, Yongyang Xu, Zhanjun He, Xueye Chen, Xiaoyun Zheng, Zhong Xie

Applied Sciences· Volume 12· Issue 19

Abstract

The functional classification of buildings is important for creating and managing urban zones and assisting government departments. Building function recognition is incredibly valuable for wide applications ranging from the determination of energy demand. By aiming at the topic of urban function classification, a semi-supervised graph structure network combined unified message passing model was introduced. The data of this model include spatial location distribution of buildings, building characteristics and the information mined from points of interesting (POIs). In order to extract the context information, each building was regarded as a graph node. Building characteristics and corresponding POIs information were embedded to mine the building function by the graph convolutional neural network. When training the model, several node labels in the graph were masked, and then these labels were predicted by the trained model so that this work could take full advantage of the node label and the feature information of all nodes in both the training and prediction stages. Quasi-experiments proved that the proposed method for building function classification using multi-source data enables the model to capture more meaningful information with limited labels, and it achieves better function classification results.
Source: crossref · Quality: baseline

Research context

OpenAlex topics: Human Mobility and Location-Based Analysis · Remote-Sensing Image Classification · Remote Sensing and Land Use

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

Key Laboratory of Urban Land Resources Monitoring and Simulation, Ministry of Natural Resources, Shenzhen 518034, China

National Engineering Research Center of Geographic Information System, China University of Geosciences, Wuhan 430074, China

State Key Laboratory of Information Engineering in Surveying Mapping and Remote Sensing, Wuhan University, Wuhan 430079, China

School of Computer Science, China University of Geosciences, Wuhan 430074, China

Funding

Key Laboratory of Urban Land Resources Monitoring and Simulation, Ministry of Natural Resources, China

References (55)

Show source-provided references
1. Guo, M., Liu, H., Xu, Y., and Huang, Y. (2020). Building extraction based on U-Net with an attention block and multiple losses. Remote Sens., 12.10.3390/rs12091400 ↗
2. Building function classification in Nanjing, China, using deep learning10.1111/tgis.12934 ↗
3. Sun, W., and Chen, J. (2016). Time Utilization Activity Based Classification of Architectural Functions. Hous. Sci.
4. Building types’ classification using shape-based features and linear discriminant functions10.1109/JSTARS.2015.2465131 ↗
5. An approach for the classification of urban building structures based on discriminant analysis techniques10.1111/j.1467-9671.2008.01085.x ↗
6. Mining spatiotemporal association patterns from complex geographic phenomena10.1080/13658816.2019.1566549 ↗
7. Urban function classification at road segment level using taxi trajectory data: A graph convolutional neural network approach10.1016/j.compenvurbsys.2021.101619 ↗
8. Sensing spatial distribution of urban land use by integrating points-of-interest and Google Word2Vec model10.1080/13658816.2016.1244608 ↗
9. Extracting urban functional regions from points of interest and human activities on location-based social networks10.1111/tgis.12289 ↗
10. Spectral clustering for sensing urban land use using Twitter activity10.1016/j.engappai.2014.06.019 ↗
11. A new insight into land use classification based on aggregated mobile phone data10.1080/13658816.2014.913794 ↗
12. Beyond Word2vec: An approach for urban functional region extraction and identification by combining Place2vec and POIs10.1016/j.compenvurbsys.2018.11.008 ↗
13. Chen, S., Zhang, H., and Yang, H. (2021). Urban Functional Zone Recognition Integrating Multisource Geographic Data. Remote Sens., 13.10.3390/rs13234732 ↗
14. Urban land use extraction from Very High Resolution remote sensing imagery using a Bayesian network10.1016/j.isprsjprs.2016.10.007 ↗
15. Quality assessment of building footprint data using a deep autoencoder network10.1080/13658816.2017.1341632 ↗
16. Xu, Y., Xie, Z., Feng, Y., and Chen, Z. (2018). Road extraction from high-resolution remote sensing imagery using deep learning. Remote Sens., 10.10.3390/rs10091461 ↗
17. Mapping hydrothermally altered minerals with AST_07XT, AST_05 and Hyperion datasets using a voting-based extreme learning machine algorithm10.1016/j.oregeorev.2019.103116 ↗
18. Hydrothermally altered mineral mapping using synthetic application of Sentinel-2A MSI, ASTER and Hyperion data in the Duolong area, Tibetan Plateau, China10.1016/j.oregeorev.2018.07.017 ↗
19. Hu, B., Xu, Y., Huang, X., Cheng, Q., Ding, Q., Bai, L., and Li, Y. (2021). Improving Urban Land Cover Classification with Combined Use of Sentinel-2 and Sentinel-1 Imagery. ISPRS Int. J. Geo-Inf., 10.10.3390/ijgi10080533 ↗
20. Geospatial big data: Challenges and opportunities10.1016/j.bdr.2015.01.003 ↗
21. Using multi-source geospatial big data to identify the structure of polycentric cities10.1016/j.rse.2017.06.039 ↗
22. Building classification from lidar data for spatio-temporal assessment of 3D urban developments10.1016/j.proeng.2017.04.308 ↗
23. Identifying architectural style in 3d city models with support vector machines
24. Automatic classification of building types in 3D city models10.1007/s10707-011-0131-x ↗
25. Raise the roof: Towards generating LOD2 models without aerial surveys using machine learning10.5194/isprs-annals-IV-4-W8-27-2019 ↗
26. Castelluccio, M., Poggi, G., Sansone, C., and Verdoliva, L. (2015). Land use classification in remote sensing images by convolutional neural networks. arXiv.
27. Application of a graph convolutional network with visual and semantic features to classify urban scenes10.1080/13658816.2022.2048834 ↗
28. Cao, R., Zhu, J., Tu, W., Li, Q., Cao, J., Liu, B., Zhang, Q., and Qiu, G. (2018). Integrating aerial and street view images for urban land use classification. Remote Sens., 10.10.3390/rs10101553 ↗
29. Synthesizing location semantics from street view images to improve urban land-use classification10.1080/13658816.2020.1831515 ↗
30. Multiscale analysis of the influence of street built environment on crime occurrence using street-view images10.1016/j.compenvurbsys.2022.101865 ↗
31. Hoffmann, E.J., Wang, Y., Werner, M., Kang, J., and Zhu, X. (2019). Model fusion for building type classification from aerial and street view images. Remote Sens., 11.10.3390/rs11111259 ↗
32. Taoufiq, S., Nagy, B., and Benedek, C. (2020). HierarchyNet: Hierarchical CNN-Based Urban Building Classification. Remote Sens., 12.10.3390/rs12223794 ↗
33. A unified deep learning framework for urban functional zone extraction based on multi-source heterogeneous data10.1016/j.rse.2021.112830 ↗
34. Bao, H., Ming, D., Guo, Y., Zhang, K., Zhou, K., and Du, S. (2020). DFCNN-based semantic recognition of urban functional zones by integrating remote sensing data and POI data. Remote Sens., 12.10.3390/rs12071088 ↗
35. Kipf, T.N., and Welling, M. (2016). Semi-supervised classification with graph convolutional networks. arXiv.
36. A Bayesian characterization of urban land use configurations from VHR remote sensing images
37. Wang, L., Wang, C., Zhang, X., Lan, T., and Li, J. (2021). S-AT GCN: Spatial-Attention Graph Convolution Network based Feature Enhancement for 3D Object Detection. arXiv.
38. Multi-stream attention-aware graph convolution network for video salient object detection10.1109/TIP.2021.3070200 ↗
39. Cheng, K., Zhang, Y., He, X., Chen, W., Cheng, J., and Lu, H. (2020, January 13–19). Skeleton-based action recognition with shift graph convolutional network. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, Seattle, WA, USA.10.1109/CVPR42600.2020.00026 ↗
40. Liu, H., Chen, Z., and Yang, B. (2020, January 25–29). Lip Graph Assisted Audio-Visual Speech Recognition Using Bidirectional Synchronous Fusion. Proceedings of the Interspeech 2020, Shanghai, China.10.21437/Interspeech.2020-3146 ↗
41. Applying machine learning and natural language processing to detect phishing email10.1016/j.cose.2021.102414 ↗
42. A graph convolutional neural network for classification of building patterns using spatial vector data10.1016/j.isprsjprs.2019.02.010 ↗
43. A framework for urban land use classification by integrating the spatial context of points of interest and graph convolutional neural network method10.1016/j.compenvurbsys.2022.101807 ↗
44. Bruna, J., Zaremba, W., Szlam, A., and Le, C. (2013). Spectral networks and locally connected networks on graphs. arXiv.
45. A comprehensive survey on graph neural networks10.1109/TNNLS.2020.2978386 ↗
46. Discovering the joint influence of urban facilities on crime occurrence using spatial co-location pattern mining10.1016/j.cities.2020.102612 ↗
47. Identifying urban building function by integrating remote sensing imagery and POI data10.1109/JSTARS.2021.3107543 ↗
48. Classification of Building Function using available sources of VGI10.5194/isprs-archives-XLII-4-209-2018 ↗
49. A spatial query based on shape similarity cognition
50. Xu, S., Qing, L., Han, L., Liu, M., Peng, Y., and Shen, L. (2020). A new remote sensing images and point-of-interest fused (RPF) model for sensing urban functional regions. Remote Sens., 12.10.3390/rs12061032 ↗
51. Functional urban land use recognition integrating multi-source geospatial data and cross-correlations10.1016/j.compenvurbsys.2019.101374 ↗
52. The Cluster of City Buildings Based on the SOM Neural Network10.1088/1755-1315/57/1/012047 ↗
53. Geometry and Gerrymandering10.1080/10724117.2002.11974602 ↗
54. An efficient measure of compactness for two-dimensional shapes and its application in regionalization problems10.1080/13658816.2012.752093 ↗
55. Xu, Y., Wu, L., Xie, Z., and Chen, Z. (2018). Building extraction in very high resolution remote sensing imagery using deep learning and guided filters. Remote Sens., 10.10.3390/rs10010144 ↗