journal article·2022-10-26Open access

Concrete Strength Prediction Using Machine Learning Methods CatBoost, k-Nearest Neighbors, Support Vector Regression

Alexey N. Beskopylny, Sergey A. Stel’makh, Evgenii M. Shcherban’, Levon R. Mailyan, Besarion Meskhi, Irina Razveeva, Andrei Chernil’nik, Nikita Beskopylny

Applied Sciences· Volume 12· Issue 21

Abstract

Currently, one of the topical areas of application of machine learning methods in the construction industry is the prediction of the mechanical properties of various building materials. In the future, algorithms with elements of artificial intelligence form the basis of systems for predicting the operational properties of products, structures, buildings and facilities, depending on the characteristics of the initial components and process parameters. Concrete production can be improved using artificial intelligence methods, in particular, the development, training and application of special algorithms to determine the characteristics of the resulting concrete. The aim of the study was to develop and compare three machine learning algorithms based on CatBoost gradient boosting, k-nearest neighbors and support vector regression to predict the compressive strength of concrete using our accumulated empirical database, and ultimately to improve the production processes in construction industry. It has been established that artificial intelligence methods can be applied to determine the compressive strength of self-compacting concrete. Of the three machine learning algorithms, the smallest errors and the highest coefficient of determination were observed in the KNN algorithm: MAE was 1.97; MSE, 6.85; RMSE, 2.62; MAPE, 6.15; and the coefficient of determination R2, 0.99. The developed models showed an average absolute percentage error in the range 6.15−7.89% and can be successfully implemented in the production process and quality control of building materials, since they do not require serious computing resources.
Source: crossref · Quality: baseline

Research context

OpenAlex topics: Material Properties and Failure Mechanisms · Machine Learning in Materials Science · Innovative concrete reinforcement materials

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

Department of Transport Systems, Faculty of Roads and Transport Systems, Don State Technical University, 344003 Rostov-on-Don, Russia

Department of Unique Buildings and Constructions Engineering, Don State Technical University, Gagarin Sq. 1, 344003 Rostov-on-Don, Russia

Department of Engineering Geology, Bases, and Foundations, Don State Technical University, 344003 Rostov-on-Don, Russia

Department of Roads, Don State Technical University, 344003 Rostov-on-Don, Russia

Department of Life Safety and Environmental Protection, Faculty of Life Safety and Environmental Engineering, Don State Technical University, 344003 Rostov-on-Don, Russia

Department of Mathematics and Informatics, Faculty of IT-Systems and Technology, Don State Technical University, Gagarin Sq. 1, 344003 Rostov-on-Don, Russia

Department Hardware and Software Engineering, Faculty of IT-Systems and Technology, Don State Technical University, 344003 Rostov-on-Don, Russia

References (54)

Show source-provided references
1. Influence of superplasticizer type and dosage on the slump loss of Portland cement mortars—Part II10.1016/S0008-8846(02)00838-4 ↗
2. Farooq, F., Czarnecki, S., Niewiadomski, P., Aslam, F., Alabduljabbar, H., Ostrowski, K.A., Śliwa-Wieczorek, K., Nowobilski, T., and Malazdrewicz, S. (2021). A Comparative Study for the Prediction of the Compressive Strength of Self-Compacting Concrete Modified with Fly Ash. Materials, 14.10.3390/ma14174934 ↗
3. Beskopylny, A.N., Shcherban’, E.M., Stel’makh, S.A., Mailyan, L.R., Meskhi, B., Evtushenko, A., Varavka, V., and Beskopylny, N. (2022). Nano-Modified Vibrocentrifuged Concrete with Granulated Blast Slag: The Relationship between Mechanical Properties and Micro-Structural Analysis. Materials, 15.10.3390/ma15124254 ↗
4. Beskopylny, A.N., Stel’makh, S.A., Shcherban’, E.M., Mailyan, L.R., Meskhi, B., Beskopylny, N., El’shaeva, D., and Kotenko, M. (2022). The Investigation of Compacting Cement Systems for Studying the Fundamental Process of Cement Gel Formation. Gels, 8.10.3390/gels8090530 ↗
5. Stel’makh, S.A., Shcherban’, E.M., Beskopylny, A., Mailyan, L.R., Meskhi, B., Beskopylny, N., and Zherebtsov, Y. (2022). Development of High-Tech Self-Compacting Concrete Mixtures Based on Nano-Modifiers of Various Types. Materials, 15.10.3390/ma15082739 ↗
6. Beskopylny, A.N., Stel’makh, S.A., Shcherban’, E.M., Mailyan, L.R., Meskhi, B., Varavka, V., Beskopylny, N., and El’shaeva, D. (2022). A Study on the Cement Gel Formation Process during the Creation of Nanomodified High-Performance Concrete Based on Nanosilica. Gels, 8.10.3390/gels8060346 ↗
7. Beskopylny, A.N., Meskhi, B., Stel’makh, S.A., Shcherban’, E.M., Mailyan, L.R., Veremeenko, A., Akopyan, V., Shilov, A.V., Chernil’nik, A., and Beskopylny, N. (2022). Numerical Simulation of the Bearing Capacity of Variotropic Short Concrete Beams Reinforced with Polymer Composite Reinforcing Bars. Polymers, 14.10.3390/polym14153051 ↗
8. The use of artificial intelligence and information technology for measurements in mechanical engineering and in process automation systems in Industry 4.010.1088/1742-6596/1889/5/052011 ↗
9. A machine learning framework to predict local strain distribution and the evolution of plastic anisotropy & fracture in additively manufactured alloys10.1016/j.ijplas.2020.102867 ↗
10. A Study on Intelligent Algorithm to Control Welding Parameters for Lap-joint10.1016/j.promfg.2019.02.008 ↗
11. Artificial Intelligence: Prospect in Mechanical Engineering Field-A Review10.1007/978-981-15-4474-3_31 ↗
12. Tosee, S.V.R., Faridmehr, I., Bedon, C., Sadowski, Ł., Aalimahmoody, N., Nikoo, M., and Nowobilski, T. (2021). Metaheuristic Prediction of the Compressive Strength of Environmentally Friendly Concrete Modified with Eggshell Powder Using the Hybrid ANN-SFL Optimization Algorithm. Materials, 14.10.3390/ma14206172 ↗
13. Ahmad, A., Ahmad, W., Chaiyasarn, K., Ostrowski, K.A., Aslam, F., Zajdel, P., and Joyklad, P. (2021). Prediction of Geopolymer Concrete Compressive Strength Using Novel Machine Learning Algorithms. Polymers, 13.10.3390/polym13193389 ↗
14. Beskopylny, A., Lyapin, A., Anysz, H., Meskhi, B., Veremeenko, A., and Mozgovoy, A. (2020). Artificial Neural Networks in Classification of Steel Grades Based on Non-Destructive Tests. Materials, 13.10.3390/ma13112445 ↗
15. Liu, F., Xu, J., Tan, S., Gong, A., and Li, H. (2022). Orthogonal Experiments and Neural Networks Analysis of Concrete Performance. Water, 14.10.3390/w14162520 ↗
16. Islam, M.M., Hossain, M.B., Akhtar, M.N., Moni, M.A., and Hasan, K.F. (2022). CNN Based on Transfer Learning Models Using Data Augmentation and Transformation for Detection of Concrete Crack. Algorithms, 15.10.3390/a15080287 ↗
17. Ni, X., and Duan, K. (2022). Machine Learning-Based Models for Shear Strength Prediction of UHPFRC Beams. Mathematics, 10.10.3390/math10162918 ↗
18. Rahman, S.K., and Al-Ameri, R. (2022). Experimental and Artificial Neural Network-Based Study on the Sorptivity Characteristics of Geopolymer Concrete with Recycled Cementitious Materials and Basalt Fibres. Recycling, 7.10.3390/recycling7040055 ↗
19. Shah, H.A., Yuan, Q., Akmal, U., Shah, S.A., Salmi, A., Awad, Y.A., Shah, L.A., Iftikhar, Y., Javed, M.H., and Khan, M.I. (2022). Application of Machine Learning Techniques for Predicting Compressive, Splitting Tensile, and Flexural Strengths of Concrete with Metakaolin. Materials, 15.10.3390/ma15155435 ↗
20. Prediction of the compressive strength of normal and high-performance concretes using M5P model tree algorithm10.1016/j.conbuildmat.2017.03.061 ↗
21. Predicting modulus elasticity of recycled aggregate concrete using M5′ model tree algorithm10.1016/j.conbuildmat.2015.06.055 ↗
22. Compressive strength prediction of environmentally friendly concrete using artificial neural networks10.1016/j.jobe.2018.01.007 ↗
23. Artificial neural network based modelling approach for strength prediction of concrete incorporating agricultural and construction wastes10.1016/j.conbuildmat.2018.09.097 ↗
24. Hadzima-Nyarko, M., Nyarko, E.K., Ademović, N., Miličević, I., and Kalman Šipoš, T. (2019). Modelling the Influence of Waste Rubber on Compressive Strength of Concrete by Artificial Neural Networks. Materials, 12.10.3390/ma12040561 ↗
25. De-Prado-Gil, J., Palencia, C., Jagadesh, P., and Martínez-García, R. (2022). A Study on the Prediction of Compressive Strength of Self-Compacting Recycled Aggregate Concrete Utilizing Novel Computational Approaches. Materials, 15.10.3390/ma15155232 ↗
26. Ghafor, K. (2022). Multifunctional Models, Including an Artificial Neural Network, to Predict the Compressive Strength of Self-Compacting Concrete. Appl. Sci., 12.10.3390/app12168161 ↗
27. To predict the compressive strength of self compacting concrete with recycled aggregates utilizing ensemble machine learning models
28. Chandramouli, P., Jayaseelan, R., Pandulu, G., Sathish Kumar, V., Murali, G., and Vatin, N.I. (2022). Estimating the Axial Compression Capacity of Concrete-Filled Double-Skin Tubular Columns with Metallic and Non-Metallic Composite Materials. Materials, 15.10.3390/ma15103567 ↗
29. Kuppusamy, Y., Jayaseelan, R., Pandulu, G., Sathish Kumar, V., Murali, G., Dixit, S., and Vatin, N.I. (2022). Artificial Neural Network with a Cross-Validation Technique to Predict the Material Design of Eco-Friendly Engineered Geopolymer Composites. Materials, 15.10.3390/ma15103443 ↗
30. Amin, M.N., Ahmad, A., Khan, K., Ahmad, W., Ehsan, S., and Alabdullah, A.A. (2022). Predicting the Rheological Properties of Super-Plasticized Concrete Using Modeling Techniques. Materials, 15.10.3390/ma15155208 ↗
31. Ilyas, I., Zafar, A., Afzal, M.T., Javed, M.F., Alrowais, R., Althoey, F., Mohamed, A.M., Mohamed, A., and Vatin, N.I. (2022). Advanced Machine Learning Modeling Approach for Prediction of Compressive Strength of FRP Confined Concrete Using Multiphysics Genetic Expression Programming. Polymers, 14.10.3390/polym14091789 ↗
32. Koo, S., Shin, D., and Kim, C. (2021). Application of Principal Component Analysis Approach to Predict Shear Strength of Reinforced Concrete Beams with Stirrups. Materials, 14.10.3390/ma14133471 ↗
33. Faridmehr, I., Nehdi, M.L., Huseien, G.F., Baghban, M.H., Sam, A.R.M., and Algaifi, H.A. (2021). Experimental and Informational Modeling Study of Sustainable Self-Compacting Geopolymer Concrete. Sustainability, 13.10.3390/su13137444 ↗
34. Amin, M.N., Iqtidar, A., Khan, K., Javed, M.F., Shalabi, F.I., and Qadir, M.G. (2021). Comparison of Machine Learning Approaches with Traditional Methods for Predicting the Compressive Strength of Rice Husk Ash Concrete. Crystals, 11.10.3390/cryst11070779 ↗
35. Dabbaghi, F., Rashidi, M., Nehdi, M.L., Sadeghi, H., Karimaei, M., Rasekh, H., and Qaderi, F. (2021). Experimental and Informational Modeling Study on Flexural Strength of Eco-Friendly Concrete Incorporating Coal Waste. Sustainability, 13.10.3390/su13137506 ↗
36. Wu, N.-J. (2021). Predicting the Compressive Strength of Concrete Using an RBF-ANN Model. Appl. Sci., 11.10.3390/app11146382 ↗
37. Bu, L., Du, G., and Hou, Q. (2021). Prediction of the Compressive Strength of Recycled Aggregate Concrete Based on Artificial Neural Network. Materials, 14.10.3390/ma14143921 ↗
38. Ahmad, A., Chaiyasarn, K., Farooq, F., Ahmad, W., Suparp, S., and Aslam, F. (2021). Compressive Strength Prediction via Gene Expression Programming (GEP) and Artificial Neural Network (ANN) for Concrete Containing RCA. Buildings, 11.10.3390/buildings11080324 ↗
39. Suescum-Morales, D., Salas-Morera, L., Jiménez, J.R., and García-Hernández, L. (2021). A Novel Artificial Neural Network to Predict Compressive Strength of Recycled Aggregate Concrete. Appl. Sci., 11.10.3390/app112211077 ↗
40. Song, H., Ahmad, A., Ostrowski, K.A., and Dudek, M. (2021). Analyzing the Compressive Strength of Ceramic Waste-Based Concrete Using Experiment and Artificial Neural Network (ANN) Approach. Materials, 14.10.3390/ma14164518 ↗
41. Kekez, S., and Kubica, J. (2021). Application of Artificial Neural Networks for Prediction of Mechanical Properties of CNT/CNF Reinforced Concrete. Materials, 14.10.3390/ma14195637 ↗
42. Maqsoom, A., Aslam, B., Gul, M.E., Ullah, F., Kouzani, A.Z., Mahmud, M.A.P., and Nawaz, A. (2021). Using Multivariate Regression and ANN Models to Predict Properties of Concrete Cured under Hot Weather. Sustainability, 13.10.3390/su131810164 ↗
43. Kovačević, M., Lozančić, S., Nyarko, E.K., and Hadzima-Nyarko, M. (2021). Modeling of Compressive Strength of Self-Compacting Rubberized Concrete Using Machine Learning. Materials, 14.10.3390/ma14154346 ↗
44. Ahmad, A., Ostrowski, K.A., Maślak, M., Farooq, F., Mehmood, I., and Nafees, A. (2021). Comparative Study of Supervised Machine Learning Algorithms for Predicting the Compressive Strength of Concrete at High Temperature. Materials, 14.10.3390/ma14154222 ↗
45. Stel’makh, S.A., Shcherban’, E.M., Beskopylny, A.N., Mailyan, L.R., Meskhi, B., Razveeva, I., Kozhakin, A., and Beskopylny, N. (2022). Prediction of Mechanical Properties of Highly Functional Lightweight Fiber-Reinforced Concrete Based on Deep Neural Network and Ensemble Regression Trees Methods. Materials, 15.10.3390/ma15196740 ↗
46. Rajadurai, R.-S., and Kang, S.-T. (2021). Automated Vision-Based Crack Detection on Concrete Surfaces Using Deep Learning. Appl. Sci., 11.10.3390/app11115229 ↗
47. Bin Khairul Anuar, M.A.R., Ngamkhanong, C., Wu, Y., and Kaewunruen, S. (2021). Recycled Aggregates Concrete Compressive Strength Prediction Using Artificial Neural Networks (ANNs). Infrastructures, 6.10.3390/infrastructures6020017 ↗
48. Palevičius, P., Pal, M., Landauskas, M., Orinaitė, U., Timofejeva, I., and Ragulskis, M. (2022). Automatic Detection of Cracks on Concrete Surfaces in the Presence of Shadows. Sensors, 22.10.3390/s22103662 ↗
49. Sarir, P., Armaghani, D.J., Jiang, H., Sabri, M.M.S., He, B., and Ulrikh, D.V. (2022). Prediction of Bearing Capacity of the Square Concrete-Filled Steel Tube Columns: An Application of Metaheuristic-Based Neural Network Models. Materials, 15.10.3390/ma15093309 ↗
50. Deifalla, A., and Salem, N.M. (2022). A Machine Learning Model for Torsion Strength of Externally Bonded FRP-Reinforced Concrete Beams. Polymers, 14.10.3390/polym14091824 ↗
51. Kim, B., Choi, S.-W., Hu, G., Lee, D.-E., and Serfa Juan, R.O. (2022). An Automated Image-Based Multivariant Concrete Defect Recognition Using a Convolutional Neural Network with an Integrated Pooling Module. Sensors, 22.10.3390/s22093118 ↗
52. Khokhar, S.A., Ahmed, T., Khushnood, R.A., Ali, S.M. (2021). A Predictive Mimicker of Fracture Behavior in Fiber Reinforced Concrete Using Machine Learning. Materials, 14.10.3390/ma14247669 ↗
53. Lavercombe, A., Huang, X., and Kaewunruen, S. (2021). Machine Learning Application to Eco-Friendly Concrete Design for Decarbonisation. Sustainability, 13.10.3390/su132413663 ↗
54. Nafees, A., Javed, M.F., Khan, S., Nazir, K., Farooq, F., Aslam, F., Musarat, M.A., and Vatin, N.I. (2021). Predictive Modeling of Mechanical Properties of Silica Fume-Based Green Concrete Using Artificial Intelligence Approaches: MLPNN, ANFIS, and GEP. Materials, 14.10.3390/ma14247531 ↗