journal article·2023-04-11Open access

Deep-Learning-Based Sound Classification Model for Concrete Pouring Work Monitoring at a Construction Site

Inchie Kim, Yije Kim, Sangyoon Chin

Applied Sciences· Volume 13· Issue 8

Abstract

In the present study, the utilization of sound data in research and technology is examined, data classification techniques are analyzed, and the applicability and necessity of these techniques are explored in order to propose an acoustic classification model that differentiates between normal and abnormal sounds during concrete pouring. The paper presents an experiment in which normal sound data occurring during concrete pouring, main noise data from construction, and symptom data that could affect structural quality or even cause a collapse incident were collected. By analyzing sound data from actual construction sites and experiments, a deep-learning-based classification model was developed with the aim of preventing events that could compromise the quality and safety of structures in advance. In the classification model, both CNN (convolutional neural network) and RNN (recurrent neural network) exhibited high accuracies of 94.38% and 93.26%, respectively, demonstrating remarkable performance in identifying the status of concrete placement. Unlike previous research that only collected and sorted normal construction-related sound data, the current study developed a sorting model that addresses quality- and safety-related matters by including sound data that may influence material separation, concrete leakage, and formwork collapse during concrete placement, and differentiating these sounds from normal concrete pouring sounds. The research findings are expected to contribute to the improvement of safety management and work efficiency at construction sites.
Source: crossref · Quality: baseline

Research context

OpenAlex topics: Infrastructure Maintenance and Monitoring · BIM and Construction Integration · Occupational Health and Safety Research

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

Department of Convergence Engineering for Future City, Sungkyunkwan University, Suwon 16419, Republic of Korea

School of Civil, Architectural Engineering & Landscape Architecture, Sungkyunkwan University, Suwon 16419, Republic of Korea

Funding

National Research Foundation of Korea (NRF)

References (46)

Show source-provided references
1. Haduong, A., Kim, J.J., Balali, V., and Assistant, G. (2018, January 2–4). Statistical Results on Incidents for Formwork Safety in Concrete Structures. Proceedings of the Construction Research Congress 2018, New Orleans, LA, USA.10.1061/9780784481288.063 ↗
2. Computer Vision Techniques for Construction Safety and Health Monitoring10.1016/j.aei.2015.02.001 ↗
3. Lee, Y.J., Park, M.W., and Brilakis, I. (2016, January 18–21). Entity Matching across Stereo Cameras for Tracking Construction Workers. Proceedings of the ISARC 2016—33rd International Symposium on Automation and Robotics in Construction, Auburn, AL, USA.10.22260/ISARC2016/0081 ↗
4. A Service-Oriented Integrated Information Framework for RFID/WSN-Based Intelligent Construction Supply Chain Management10.1016/j.autcon.2010.12.002 ↗
5. Cho, C., Lee, Y.-C., Zhang, T., and Student, P.D. (2017, January 25–27). Sound Recognition Techniques for Multi-Layered Construction Activities and Events. Proceedings of the Computing in Civil Engineering 2017, Seattle, WA, USA.10.1061/9780784480847.041 ↗
6. Construction Worker Detection in Video Frames for Initializing Vision Trackers10.1016/j.autcon.2012.06.001 ↗
7. Site Installation and Testing of a Continuous Acoustic Monitoring10.1016/j.conbuildmat.2006.04.008 ↗
8. Advanced Sound Classifiers and Performance Analyses for Accurate Audio-Based Construction Project Monitoring10.1061/(ASCE)CP.1943-5487.0000911 ↗
9. ProSynth: An Integrated Prosodic Approach to Device-Independent, Natural-Sounding Speech Synthesis10.1006/csla.2000.0141 ↗
10. Acoustic Analysis of Pathological Voices: A Voice Analysis System for the Screening and Laryngeal Diseases10.1109/51.603651 ↗
11. Kavitha, S., Sanjana, N., Yogajeeva, K., and Sathyavathi, S. (2021, January 8–9). Speech Emotion Recognition Using Different Activation Function. Proceedings of the 2021 International Conference on Advancements in Electrical, Electronics, Communication, Computing and Automation, ICAECA 2021, Coimbatore, India.10.1109/ICAECA52838.2021.9675789 ↗
12. Audio Surveillance of Roads: A System for Detecting Anomalous Sounds10.1109/TITS.2015.2470216 ↗
13. Cough Sound Description in Relation to Respiratory Diseases in Dairy Calves10.1016/j.prevetmed.2010.06.013 ↗
14. Forensic Voice Comparison and the Paradigm Shift10.1016/j.scijus.2009.09.002 ↗
15. Mental Status Assessment of Disaster Relief Personnel by Vocal Affect Display Based on Voice Emotion Recognition10.1186/s40696-017-0032-0 ↗
16. Kochlan, M., Hodon, M., Cechovic, L., Kapitulik, J., and Jurecka, M. (2014, January 7–10). WSN for Traffic Monitoring Using Raspberry Pi Board. Proceedings of the 2014 Federated Conference on Computer Science and Information Systems, FedCSIS 2014, Warsaw, Poland.10.15439/2014F310 ↗
17. Efficient Multi-Camera Vehicle Detection, Tracking, and Identification in a Tunnel Surveillance Application10.1016/j.cviu.2012.02.006 ↗
18. Lee, K.B., and Shin, H.S. (2019, January 26–28). An Application of a Deep Learning Algorithm for Automatic Detection of Unexpected Accidents under Bad CCTV Monitoring Conditions in Tunnels. Proceedings of the 2019 International Conference on Deep Learning and Machine Learning in Emerging Applications, Deep-ML 2019, Istanbul, Turkey.10.1109/Deep-ML.2019.00010 ↗
19. Wireless Sensor Network System for Landslide Monitoring and Warning10.1109/TIM.2018.2861999 ↗
20. Cheng, C.F., Rashidi, A., Davenport, M.A., and Anderson, D. (2016, January 18–21). Audio Signal Processing for Activity Recognition of Construction Heavy Equipment. Proceedings of the ISARC 2016—33rd International Symposium on Automation and Robotics in Construction, Auburn, AL, USA.10.22260/ISARC2016/0078 ↗
21. RFID-Based Real-Time Locating System for Construction Safety Management10.1061/(ASCE)CP.1943-5487.0000144 ↗
22. Integrated Leakage Detection and Localization Model for Gas Pipelines Based on the Acoustic Wave Method10.1016/j.jlp.2013.11.006 ↗
23. Deep Learning-Based Data Analytics for Safety in Construction10.1016/j.autcon.2022.104302 ↗
24. Novel Machine-Learning Model for Estimating Construction Costs Considering Economic Variables and Indexes10.1061/(ASCE)CO.1943-7862.0001570 ↗
25. Deep Learning Applications and Challenges in Big Data Analytics10.1186/s40537-014-0007-7 ↗
26. Identifying Impact of Variables in Deep Learning Models on Bankruptcy Prediction of Construction Contractors10.1108/ECAM-06-2020-0386 ↗
27. Machine-Learning-Aided Improvement of Mechanics-Based Code-Conforming Shear Capacity Equation for RC Elements with Stirrups10.1016/j.engstruct.2022.114665 ↗
28. Machine Learning in Concrete Science: Applications, Challenges, and Best Practices10.1038/s41524-022-00810-x ↗
29. Attribute-Based Safety Risk Assessment. I: Analysis at the Fundamental Level10.1061/(ASCE)CO.1943-7862.0000980 ↗
30. Application of Machine Learning to Construction Injury Prediction10.1016/j.autcon.2016.05.016 ↗
31. A Novel Time-Depended Evolutionary Fuzzy SVM Inference Model for Estimating Construction Project at Completion10.1016/j.engappai.2011.09.022 ↗
32. Estimate at Completion for Construction Projects Using Evolutionary Support Vector Machine Inference Model10.1016/j.autcon.2010.02.008 ↗
33. A Multiple Kernel Learning-Based Decision Support Model for Contractor Pre-Qualification10.1016/j.autcon.2010.11.019 ↗
34. Assessment of Catastrophic Risk Using Bayesian Network Constructed from Domain Knowledge and Spatial Data10.1111/j.1539-6924.2010.01429.x ↗
35. A Hybrid Model for Prediction in Asphalt Pavement Performance Based on Support Vector Machine and Grey Relation Analysis
36. Building Energy Modeling (BEM) Using Clustering Algorithms and Semi-Supervised Machine Learning Approaches10.1016/j.autcon.2016.08.002 ↗
37. Trees vs Neurons: Comparison between Random Forest and ANN for High-Resolution Prediction of Building Energy Consumption10.1016/j.enbuild.2017.04.038 ↗
38. Hitimana, E., Bajpai, G., Musabe, R., Sibomana, L., and Kayalvizhi, J. (2021). Implementation of Iot Framework with Data Analysis Using Deep Learning Methods for Occupancy Prediction in a Building. Future Internet, 13.10.3390/fi13030067 ↗
39. Tracking Multiple Workers on Construction Sites Using Video Cameras10.1016/j.aei.2010.06.008 ↗
40. Automatic Detection Method of Cracks from Concrete Surface Imagery Using Two-Step Light Gradient Boosting Machine10.1111/mice.12564 ↗
41. Rachmawati, T.S.N., and Kim, S. (2022). Unmanned Aerial Vehicles (UAV) Integration with Digital Technologies toward Construction 4.0: A Systematic Literature Review. Sustainability, 14.10.3390/su14095708 ↗
42. Johnson, D.S., Lorenz, W., Taenzer, M., Mimilakis, S., Grollmisch, S., Abeßer, J., and Lukashevich, H. (2021, January 23–27). DESED-FL and URBAN-FL: Federated Learning Datasets for Sound Event Detection. Proceedings of the European Signal Processing Conference, EUSIPCO, Dublin, Ireland.10.23919/EUSIPCO54536.2021.9616102 ↗
43. Muda, L., Begam, M., and Elamvazuthi, I. (2010). Voice Recognition Algorithms Using Mel Frequency Cepstral Coefficient (MFCC) and Dynamic Time Warping (DTW) Techniques. arXiv.
44. An Approach to Extract Feature Using MFCC10.9790/3021-04812125 ↗
45. Review on Convolutional Neural Networks (CNN) in Vegetation Remote Sensing10.1016/j.isprsjprs.2020.12.010 ↗
46. Pascanu, R., Gulcehre, C., Cho, K., and Bengio, Y. (2013). How to Construct Deep Recurrent Neural Networks. arXiv.