Vision method based on deep learning for detecting concrete vibration quality
Source abstract
Abstract
The vibration quality of concrete is crucial to ensure the long-term safe operation of concrete structural components. In recent years, computer vision technology based on deep learning has achieved excellent results in the field of concrete quality inspection. However, when used for assisting construction inspection, this technology relies heavily on large-scale, labeled, high-quality image data. To solve this drawback, this study proposes a vision-based method that integrates semi-supervised learning and data augmentation for detecting the concrete vibration quality. Initially, StyleGAN2 was adopted as the data augmentation strategy to improve the diversity of the dataset. Then, SE-ResNet50, a model that couples an attention mechanism module and residual network, was employed as a classifier for accurately extracting information contained in images. Subsequently, in order to reduce the workload of data annotation, a novel semi-supervised learning method (Co-MixMatch) was proposed to train the model by coupling MixMatch with co-training. Finally, the trained model was deployed on mobile devices to assist onsite construction workers in detecting the quality of concrete vibration. A real-world concrete dam dataset was employed to verify the proposed method. Based on the experimental results, the proposed method improves the accuracy of the baseline method by 3.62% on average. Additionally, the proposed method achieves an accuracy of 0.9600, which is only 0.67% lower than that of supervised learning, while only requiring 20% of the labeled data. Therefore, the proposed method has great application prospects and can further promote the intelligent development of concrete vibration inspection.
Source: openalex_inverted_index · Quality: baseline
Research context
OpenAlex topics: Infrastructure Maintenance and Monitoring · 3D Surveying and Cultural Heritage
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
References (59)
Show source-provided references
1. The segregation tendency in the vibration of high fluidity concrete10.1016/S0008-8846(03)00249-7 ↗
2. Real-time tracking of concrete vibration effort for intelligent concrete consolidation10.1016/j.autcon.2015.03.017 ↗
3. M. Štefanič, V. Stankovski, A review of technologies and applications for smart construction, Proc. Inst. Civ. Eng. – Civ. Eng. 172 (2019) 83–87. https://doi.org/10.1680/jcien.17.00050.10.1680/jcien.17.00050 ↗
4. Visual monitoring method on fresh concrete vibration10.1007/s12205-013-0475-x ↗
5. Development of real-time visual monitoring system for vibration effects on fresh concrete10.1016/j.autcon.2018.11.025 ↗
6. Working state determination for concrete internal vibrator using genetic simulated annealing clustering method
7. S.G. Lee, M.J. Skibniewski, Monitoring of Concrete Placement and Vibration for Real-Time Quality Control, in: Proceedings of the Creative Construction Conference, 2019. https://doi.org/10.3311/CCC2019–011.10.3311/CCC2019-011 ↗
8. Ministry of Water Resources of the People’s Republic of China, SL677–2014 Specifications for Hydraulic Concrete Construction, China Water&Power Press, Beijing, China, 2014. https://oss.henan.gov.cn/typtfile/20210412/26e3171c04da4a59a1a5f9324e3f9ac3.pdf.
9. A survey on image data augmentation for deep learning10.1186/s40537-019-0197-0 ↗
10. Development of an image data set of construction machines for deep learning object detection10.1061/(ASCE)CP.1943-5487.0000945 ↗
11. Deep-learning-based visual data analytics for smart construction management10.1016/j.autcon.2021.103892 ↗
12. Advanced deep-learning techniques for salient and category-specific object detection: a survey10.1109/MSP.2017.2749125 ↗
13. Real-time monitoring for vibration quality of fresh concrete using convolutional neural networks and IoT technology10.1016/j.autcon.2020.103510 ↗
14. Efficiency of convolutional neural networks (CNN) based image classification for monitoring construction related activities: A case study on aggregate mining for concrete production
15. Quick image analysis of concrete pore structure based on deep learning10.1016/j.conbuildmat.2019.03.006 ↗
16. Rockfill material segmentation and gradation calculation based on deep learning
17. Crack detection and segmentation using deep learning with 3D reality mesh model for quantitative assessment and integrated visualization10.1061/(ASCE)CP.1943-5487.0000890 ↗
18. Robust pixel-level crack detection using deep fully convolutional neural networks10.1061/(ASCE)CP.1943-5487.0000854 ↗
19. Automated crack pattern recognition from images for condition assessment of concrete structures10.1016/j.autcon.2021.103765 ↗
20. Automated defect quantification in concrete bridges using robotics and deep learning10.1061/(ASCE)CP.1943-5487.0000915 ↗
21. In-situ concrete slump test incorporating deep learning and stereo vision10.1016/j.autcon.2020.103432 ↗
22. E.D. Cubuk, B. Zoph, D. Mané, V. Vasudevan, Q. v Le, AutoAugment: Learning Augmentation Strategies From Data, in: 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), IEEE, New York, 2019: pp. 113–123. https://doi.org/10.1109/CVPR.2019.00020.10.1109/CVPR.2019.00020 ↗
23. S.C. Wong, A. Gatt, V. Stamatescu, M.D. McDonnell, Understanding Data Augmentation for Classification: When to Warp?, in: 2016 International Conference on Digital Image Computing: Techniques and Applications (DICTA), IEEE, New York, 2016: pp. 1–6. https://doi.org/10.1109/DICTA.2016.7797091.10.1109/DICTA.2016.7797091 ↗
24. A. Radford, L. Metz, S. Chintala, Unsupervised representation learning with deep convolutional generative adversarial networks, in: 4th International Conference on Learning Representations, ICLR, La Jolla, 2016. https://doi.org/10.48550/arXiv.1511.06434.
25. J.-Y. Zhu, T. Park, P. Isola, A.A. Efros, Unpaired Image-to-Image Translation Using Cycle-Consistent Adversarial Networks, in: 2017 IEEE International Conference on Computer Vision (ICCV), IEEE, New York, 2017: pp. 2242–2251. https://doi.org/10.1109/ICCV.2017.244.10.1109/ICCV.2017.244 ↗
26. A style-based generator architecture for generative adversarial networks10.1109/TPAMI.2020.2970919 ↗
27. T. Karras, S. Laine, M. Aittala, J. Hellsten, J. Lehtinen, T. Aila, Analyzing and Improving the Image Quality of StyleGAN, in: 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), IEEE, New York, 2020: pp. 8107–8116. https://doi.org/10.1109/CVPR42600.2020.00813.10.1109/CVPR42600.2020.00813 ↗
28. GAN-based synthetic medical image augmentation for increased CNN performance in liver lesion classification10.1016/j.neucom.2018.09.013 ↗
29. L. Wei, S. Zhang, W. Gao, Q. Tian, Person Transfer GAN to Bridge Domain Gap for Person Re-identification, in: 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition, IEEE, New York, 2018: pp. 79–88. https://doi.org/10.1109/CVPR.2018.00016.10.1109/CVPR.2018.00016 ↗
30. Improving speech emotion recognition with adversarial data augmentation network10.1109/TNNLS.2020.3027600 ↗
31. Conditional generative adversarial networks with adversarial attack and defense for generative data augmentation10.1061/(ASCE)CP.1943-5487.0001015 ↗
32. Image augmentation to improve construction resource detection using generative adversarial networks, cut-and-paste, and image transformation techniques10.1016/j.autcon.2020.103198 ↗
33. Automatic recognition of tunnel lining elements from GPR images using deep convolutional networks with data augmentation10.1016/j.autcon.2021.103830 ↗
34. Semi-supervised learning
35. Revisiting consistency regularization for semi-supervised learning
36. Y. Grandvalet, Y. Bengio, Semi-supervised Learning by Entropy Minimization, in: Advances in Neural Information Processing Systems, Curran Associates, Inc., New York, 2004. https://proceedings.neurips.cc/paper/2004/file/96f2b50b5d3613adf9c27049b2a888c7-Paper.pdf.
37. S. Laine, T. Aila, Temporal ensembling for semi-supervised learning, in: 5th International Conference on Learning Representations, ICLR, La Jolla, 2017. https://doi.org/10.48550/arXiv.1610.02242.
38. A. Tarvainen, H. Valpola, Mean teachers are better role models: Weight-averaged consistency targets improve semi-supervised deep learning results, in: Advances in Neural Information Processing Systems, Curran Associates, Inc., New York, 2017: pp. 1195–1204. https://doi.org/10.48550/arXiv.1703.01780.
39. Virtual adversarial training: a regularization method for supervised and semi-supervised learning10.1109/TPAMI.2018.2858821 ↗
40. Semi-supervised learning based on convolutional neural network and uncertainty filter for façade defects classification10.1111/mice.12632 ↗
41. A semi-supervised learning detection method for vision-based monitoring of construction sites by integrating teacher-student networks and data augmentation10.1016/j.aei.2021.101372 ↗
42. Semi-supervised learning with GAN for automatic defect detection from images10.1016/j.autcon.2021.103764 ↗
43. Self-supervised structure learning for crack detection based on cycle-consistent generative adversarial networks10.1061/(ASCE)CP.1943-5487.0000883 ↗
44. Pavement anomaly detection based on transformer and self-supervised learning10.1016/j.autcon.2022.104544 ↗
45. Semi-supervised semantic segmentation using adversarial learning for pavement crack detection10.1109/ACCESS.2020.2980086 ↗
46. A novel constrained dense convolutional autoencoder and DNN-based semi-supervised method for shield machine tunnel geological formation recognition10.1016/j.ymssp.2021.108353 ↗
47. Unsupervised spectral clustering for shield tunneling machine monitoring data with complex network theory10.1016/j.autcon.2019.102924 ↗
48. Multiscale and adversarial learning-based semi-supervised semantic segmentation approach for crack detection in concrete structures10.1109/ACCESS.2020.3022786 ↗
49. Evaluation of compaction quality based on SVR with CFA: case study on compaction quality of earth-rock dam10.1061/(ASCE)CP.1943-5487.0000742 ↗
50. K. He, X. Zhang, S. Ren, J. Sun, Deep Residual Learning for Image Recognition, in: 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), IEEE, New York, 2016: pp. 770–778. https://doi.org/10.1109/CVPR.2016.90.10.1109/CVPR.2016.90 ↗
51. J. Hu, L. Shen, G. Sun, Squeeze-and-Excitation Networks, in: 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition, IEEE, New York, 2018: pp. 7132–7141. https://doi.org/10.1109/CVPR.2018.00745.10.1109/CVPR.2018.00745 ↗
52. D. Berthelot, N. Carlini, I. Goodfellow, A. Oliver, N. Papernot, C. Raffel, MixMatch: A holistic approach to semi-supervised learning, in: Advances in Neural Information Processing Systems, Curran Associates, Inc., New York, 2019: pp. 5049–5059. https://doi.org/10.48550/arXiv.1905.02249.
53. A. Blum, T. Mitchell, Combining labeled and unlabeled data with co-training, in: Proceedings of the Annual ACM Conference on Computational Learning Theory, Association for Computing Machinery, New York, 1998: pp. 92–100. https://doi.org/10.1145/279943.279962.10.1145/279943.279962 ↗
54. H. Zhang, M. Cisse, Y.N. Dauphin, D. Lopez-Paz, MixUp: Beyond empirical risk minimization, in: 6th International Conference on Learning Representations, ICLR, La Jolla, 2018. https://doi.org/10.48550/arXiv.1710.09412.
55. Model selection and evaluation
56. Clustering with t-SNE, Provably10.1137/18M1216134 ↗
57. DBSCAN revisited, revisited: Why and how you should (still) use DBSCAN10.1145/3068335 ↗
58. T. Chen, S. Kornblith, M. Norouzi, G. Hinton, A Simple Framework for Contrastive Learning of Visual Representations, in: Proceedings of the 37th International Conference on Machine Learning, PMLR, New York, 2020: pp. 1597–1607. https://proceedings.mlr.press/v119/chen20j.html.
59. A. Chattopadhay, A. Sarkar, P. Howlader, V.N. Balasubramanian, Grad-CAM++: Generalized Gradient-Based Visual Explanations for Deep Convolutional Networks, in: 2018 IEEE Winter Conference on Applications of Computer Vision (WACV), IEEE, New York, 2018: pp. 839–847. https://doi.org/10.1109/WACV.2018.00097.10.1109/WACV.2018.00097 ↗