journal article·2022-07-23Open access

Application of Deep Learning Approach for the Classification of Buildings’ Degradation State in a BIM Methodology

Fernanda Rodrigues, Victoria Cotella, Hugo Rodrigues, Eugénio Rocha, Felipe Freitas, Raquel Matos

Applied Sciences· Volume 12· Issue 15

Abstract

Currently, there is extensive research focused on automatic strategies for the segmentation and classification of 3D point clouds, which can accelerate the study of a landmark and integrate it with heterogeneous data and attributes, useful to facilitate the digital management of architectural heritage data. In this work, an automated image-based survey has been exploited a Region- Based Convolutional Neural Network. The training phase has been executed providing examples of images with the anomalies to be detected. At the same time, a laser scanning process was conducted to obtain a point cloud, which acts as a reference for the BIM process. In a final step, a process of projecting information from the images onto the BIM recreates the pathology shapes on the model’s objects, which generates a decision support system for the built environment. The innovation of this research concerns the development of a workflow in which it is possible to automatize the recognition and classification of defects in historical buildings, to finally interpolate this geometric and numerical information with a BIM methodology, obtaining a representation and quantification of the information adapted to the facility management process. The use of innovative techniques such as artificial intelligence algorithms and different plug-ins becomes the main strength of this project.
Source: crossref · Quality: baseline

Research context

OpenAlex topics: 3D Surveying and Cultural Heritage · Infrastructure Maintenance and Monitoring · Remote Sensing and LiDAR Applications

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

RISCO—Research Center for Risks and Sustainability in Construction, Department of Civil Engineering, University of Aveiro, 3810-193 Aveiro, Portugal

DIARC—Department of Architecture, University of Naples Federico II, 80134 Napoli, NA, Italy

CIDMA—Center for Research & Development in Mathematics and Applications, Department of Mathematics, University of Aveiro, 3810-193 Aveiro, Portugal

Funding

Portuguese Government · Foundation for Science and Technology (FCT)-Aveiro Research Centre for Risks and Sustainability in Construction (RISCO), Universidade de Aveiro

References (40)

Show source-provided references
1. 3D Imaging in Construction and Infrastructure Management: Technological Assessment and Future Research Directions
2. Construction Scene Parsing (CSP): Structured Annotations of Image Segmentation for Construction Semantic Understanding
3. A SLAM Integrated Approach for Digital Heritage Documentation
4. Conceptualising the FinDD API plug-in: A study of BIM-FM integration10.1016/j.autcon.2017.03.015 ↗
5. Industry Revolution IR 4.0: Future Opportunities and Challenges in Construction Industry10.1051/matecconf/201820302010 ↗
6. Building information modeling for facilities management: A literature review and future research directions10.1016/j.jobe.2019.100755 ↗
7. Advances in Engineering Software BIM-based integrated delivery technologies for intelligent MEP management in the operation and maintenance phase10.1016/j.advengsoft.2017.08.007 ↗
8. From BIM Towards Digital Twin: Strategy and Future Development for Smart Asset Management10.1007/978-3-030-27477-1_30 ↗
9. Condition assessment of RC bridges. Integrating machine learning, photogrammetry and BIM10.5194/isprs-archives-XLII-2-W15-201-2019 ↗
10. Remote inspection of RC structures using unmanned aerial vehicles and heuristic image processing10.1016/j.engfailanal.2020.104813 ↗
11. From 2D to 3D supervised segmentation and classification for cultural heritage applications10.5194/isprs-archives-XLII-2-399-2018 ↗
12. A Guide to Convolutional Neural Networks for Computer Vision
13. Gradient-based learning applied to document recognition10.1109/5.726791 ↗
14. Krizhevsky, A. (2009). Learning Multiple Layers of Features from Tiny Images, University of Toronto. Technical Report TR-2009.
15. Imagenet classification with deep convolutional neural networks
16. He, K., Zhang, X., Ren, S., and Sun, J. (2016, January 27–30). Deep residual learning for image recognition. Proceedings of the 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Las Vegas, NV, USA.10.1109/CVPR.2016.90 ↗
17. Scikit-Learn (2022, June 23). Sklearn.metrics.f1_score. Available online: https://scikit-learn.org/stable/modules/generated/sklearn.metrics.f1_score.html#.
18. Bradski, G., and Kaehler, A. (2009). Learning OpenCV—Computer Vision with the OpenCV Library, O’Reilly Media, Inc.
19. Fisher, R.B., Breckon, T.P., Dawson-Howe, K., Fitzgibbon, A., Robertson, C., Trucco, E., and Williams, C.K.I. (2016). Dictionary of Computer Vision and Image Processing. Dict. Comput. Vis. Image Process.10.1002/9781119286462 ↗
20. Parametric 3D modeling in building construction with examples from precast concrete10.1016/S0926-5805(03)00043-8 ↗
21. Bishop, C.M. (2006). Pattern Recognition and Machine Learning–CERN Document Server, Springer.
22. Galle, P. (2002). Computer Age Statistical Inference–Bradley Efron, Trevor Hastie–Google Livros, Institute of Mathematical Statistics Monographs, Cambridge University Press.
23. Rogers, S., and Girolami, M. (2017). A first course in machine learning. Chapman & Hall/CRC Machine Learning & Pattern Recognition Series, Taylor & Francis Group. A Chapman & Hall, book.
24. Xu, X. (2021, January 19–21). Integrating Segmentation and association Relationship for image Recognition. Proceedings of the 2021 the 11th International Workshop on Computer Science and Engineering (WCSE2021), Shanghai, China.
25. Application of Machine and Deep Learning Strategies for the Classification of Heritage Point Clouds10.5194/isprs-archives-XLII-4-W18-447-2019 ↗
26. Mo.Se.: Mosaic image segmentation based on deep cascading learning10.4995/var.2021.14179 ↗
27. Crack detection using image processing: A critical review and analysis10.1016/j.aej.2017.01.020 ↗
28. Shin, H.K., Ahn, Y.H., Lee, S.H., and Kim, H.Y. (2020). Automatic Concrete Damage Recognition Using Multi-Level Attention Convolutional Neural Network. Materials, 13.10.3390/ma13235549 ↗
29. Building crack identification and total quality management method based on deep learning10.1016/j.patrec.2021.01.034 ↗
30. Intelligent detection of building cracks based on deep learning10.1016/j.imavis.2020.103987 ↗
31. Machine learning model for predicting the crack detection and pattern recognition of geopolymer concrete beams10.1016/j.conbuildmat.2021.123785 ↗
32. Kim, B., and Cho, S. (2018). Automated Vision-Based Detection of Cracks on Concrete Surfaces Using a Deep Learning Technique. Sensors, 18.10.3390/s18103452 ↗
33. Automatic recognition of concrete spall using image processing and metaheuristic optimized LogitBoost classification tree10.1016/j.advengsoft.2021.103031 ↗
34. Paszke, A., Gross, S., Massa, F., Lerer, A., Bradbury, J., Chanan, G., Killen, T., Lin, Z., Gimelshein, N., and Antiga, L. (2019, January 8-–14). PyTorch: An imperative style, high-performance deep learning library. Proceedings of the 33rd International Conference on Neural Information Processing System, Vancouver, BC, Canada.
35. Scikit-learn: Machine Learning in Python
36. Portuguese General Direction of Cultural Heritage—Portuguese Ministry of Culture (2022, June 23). Church of Santa Casa de Miser-icórdia of Aveiro, Available online: http://www.monumentos.gov.pt/Site/APP_PagesUser/SIPA.aspx?id=5173.
37. A comparative study of state-of-the-art evolutionary image registration methods for 3D modeling10.1016/j.cviu.2011.05.006 ↗
38. Howard, S., and Gugger, J. (2020). AI Deep Applications Without a PhD. Learning for Coders with Fastai & Pytorch, O’Reilly Media, Inc.
39. Learning long-term dependencies with gradient descent is difficult10.1109/72.279181 ↗
40. Kingma, D.P., and Ba, J.L. (2015, January 7–9). Adam: A method for stochastic optimization. Proceedings of the 3rd International Conference for Learning Representations, San Diego, CA, USA.