A novel approach to explain the black-box nature of machine learning in compressive strength predictions of concrete using Shapley additive explanations (SHAP)
Source abstract
Abstract
Machine learning (ML) techniques are often employed for the accurate prediction of the compressive strength of concrete. Despite higher accuracy, previous ML models failed to interpret the rationale behind predictions. Model interpretability is essential to appeal to the interest of domain experts. Therefore, overcoming research gaps identified, this research study proposes a way to predict the compressive strength of concrete using supervised ML algorithms (Decision tree, Extra tree, Adaptive boost (AdaBoost), Extreme gradient boost (XGBoost), Light gradient boosting method (LGBM), and Laplacian Kernel Ridge Regression (LKRR). Alternatively, SHapley Additive exPlainations (SHAP) – a novel black-box interpretation approach - was employed to elucidate the predictions. The comparison revealed that tree-based algorithms and LKRR provide acceptable accuracy for compressive strength predictions. Moreover, XGBoost and LKRR algorithms evinced superior performance (R = 0.98). According to SHAP interpretation, XGBoost predictions capture complex relationships among the constituents. On the other hand, SHAP provides unified measures on feature importance and the impact of a variable for a prediction. Interestingly, SHAP interpretations were in accordance with what is generally observed in the compressive behavior of concrete, thus validating the causality of ML predictions.
Source: openalex_inverted_index · Quality: baseline
Research context
OpenAlex topics: Infrastructure Maintenance and Monitoring · Concrete Corrosion and Durability · Non-Destructive Testing Techniques
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
References (100+)
Show source-provided references
1. Efficient machine learning models for prediction of concrete strengths10.1016/j.conbuildmat.2020.120950 ↗
2. Nature-inspired metaheuristic regression system: programming and implementation for civil engineering applications10.1061/(ASCE)CP.1943-5487.0000561 ↗
3. Water-cement ratio as a basis of concrete quality
4. Analysis of concrete strength versus water-cement ratio relationship
5. Strength of concrete in warm and dry environment10.1007/BF02485923 ↗
6. A comparison of machine learning methods for predicting the compressive strength of field-placed concrete10.1016/j.conbuildmat.2019.08.042 ↗
7. Characterisation of fly ashes. Potential reactivity as alkaline cements☆10.1016/S0016-2361(03)00194-7 ↗
8. Effect of curing on the compressive strength, resistance to chloride-ion penetration and porosity of concretes incorporating slag, fly ash or silica fume10.1016/0958-9465(95)00005-W ↗
9. Effect of curing methods in hot weather on the properties of high-strength concretes10.1016/j.jksues.2017.04.004 ↗
10. Prediction of compressive strength of concrete containing construction and demolition waste using artificial neural networks10.1016/j.conbuildmat.2012.09.026 ↗
11. Machine learning-based compressive strength prediction for concrete: an adaptive boosting approach10.1016/j.conbuildmat.2019.117000 ↗
12. Assessment of compressive strength of Ultra-high Performance Concrete using deep machine learning techniques10.1016/j.asoc.2020.106552 ↗
13. Concrete compressive strength using artificial neural networks10.1007/s00521-019-04663-2 ↗
14. Prediction of the compressive strength of normal and high-performance concretes using M5P model tree algorithm10.1016/j.conbuildmat.2017.03.061 ↗
15. Machine learning study of the mechanical properties of concretes containing waste foundry sand10.1016/j.conbuildmat.2020.118152 ↗
16. Machine learning prediction of mechanical properties of concrete:critical review10.1016/j.conbuildmat.2020.119889 ↗
17. Prediction of high performance concrete strength using genetic programming with geometric semantic genetic operators10.1016/j.eswa.2013.06.037 ↗
18. Prediction of concrete compressive strength due to long term sulfate attack using neural network10.1016/j.aej.2014.04.002 ↗
19. Predicting the compressive strength of normal and high-performance concretes using ANN and ANFIS hybridized with grey wolf optimizer10.1016/j.conbuildmat.2019.117266 ↗
20. A comparative investigation using machine learning methods for concrete compressive strength estimation
21. A generalized method to predict the compressive strength of high-performance concrete by improved random forest algorithm10.1016/j.conbuildmat.2019.07.315 ↗
22. Machine learning-based prediction for compressive and flexural strengths of steel fiber-reinforced concrete10.1016/j.conbuildmat.2020.121117 ↗
23. Data-driven model for ternary-blend concrete compressive strength prediction using machine learning approach10.1016/j.conbuildmat.2021.124152 ↗
24. Compressive strength prediction models for cementitious composites with fly ash using machine learning techniques10.1016/j.conbuildmat.2020.121584 ↗
25. Predicting the compressive strength of concrete with fly ash admixture using machine learning algorithms10.1016/j.conbuildmat.2021.125021 ↗
26. Compressive strength prediction of fly ash-based geopolymer concrete via advanced machine learning techniques
27. Parametric sensitivity analysis and modelling of mechanical properties of normal- and high-strength recycled aggregate concrete using grey theory, multiple nonlinear regression and artificial neural networks10.1016/j.conbuildmat.2019.03.234 ↗
28. Optimizing the prediction accuracy of concrete compressive strength based on a comparison of data-mining techniques10.1061/(ASCE)CP.1943-5487.0000088 ↗
29. Short-term wind speed forecasting using recurrent neural networks with error correction10.1016/j.energy.2020.119397 ↗
30. Predicting compressive strength of high-performance concrete using metaheuristic-optimized least squares support vector regression10.1061/(ASCE)CP.1943-5487.0000506 ↗
31. Prediction of compressive strength of self-compacting concrete containing bottom ash using artificial neural networks10.1016/j.advengsoft.2011.05.016 ↗
32. Estimation of compressive strength of self compacting concrete containing polypropylene fiber and mineral additives exposed to high temperature using artificial neural network10.1016/j.conbuildmat.2011.07.028 ↗
33. Experimental investigation and comparative machine-learning prediction of compressive strength of recycled aggregate concrete10.1007/s00500-021-05571-1 ↗
34. Prediction of compressive strength of self-compacting concrete using least square support vector machine and relevance vector machine10.1007/s12205-014-0524-0 ↗
35. Evaluation of mechanical properties of concretes containing coarse recycled concrete aggregates using multivariate adaptive regression splines (MARS), M5 model tree (M5Tree), and least squares support vector regression (LSSVR) models10.1007/s00521-018-3630-y ↗
36. Compressive strength prediction of recycled concrete based on deep learning10.1016/j.conbuildmat.2018.04.169 ↗
37. Prediction of mechanical properties of recycled aggregate concretes containing silica fume using artificial neural networks and fuzzy logic10.1016/j.commatsci.2007.06.011 ↗
38. Compressive strength prediction of environmentally friendly concrete using artificial neural networks10.1016/j.jobe.2018.01.007 ↗
39. A modified firefly algorithm-artificial neural network expert system for predicting compressive and tensile strength of high-performance concrete10.1016/j.conbuildmat.2018.05.201 ↗
40. Artificial intelligence approaches for prediction of compressive strength of geopolymer concrete10.3390/ma12060983 ↗
41. Prediction of the compressive strength of normal and high-performance concretes using M5P model tree algorithm10.1016/j.conbuildmat.2017.03.061 ↗
42. Machine learning study of the mechanical properties of concretes containing waste foundry sand10.1016/j.conbuildmat.2020.118152 ↗
43. Comparison of data mining techniques for predicting compressive strength of environmentally friendly concrete10.1061/(ASCE)CP.1943-5487.0000596 ↗
44. Evaluating compressive strength of concrete made with recycled concrete aggregates using machine learning approach10.1016/j.conbuildmat.2022.126578 ↗
45. Modeling of compressive strength and UPV of high-volume mineral-admixtured concrete using rule-based M5 rule and tree model M5P classifiers10.1016/j.conbuildmat.2015.06.029 ↗
46. A generalized method to predict the compressive strength of high-performance concrete by improved random forest algorithm10.1016/j.conbuildmat.2019.07.315 ↗
47. Machine learning prediction of mechanical properties of concrete: critical review10.1016/j.conbuildmat.2020.119889 ↗
48. Prediction of high performance concrete strength using genetic programming with geometric semantic genetic operators10.1016/j.eswa.2013.06.037 ↗
49. New formulation for compressive strength of CFRP confined concrete cylinders using linear genetic programming10.1617/s11527-009-9559-y ↗
50. Principles and practice of explainable machine learning10.3389/fdata.2021.688969 ↗
51. Explainable machine learning for scientific insights and discoveries10.1109/ACCESS.2020.2976199 ↗
52. Explainable AI: a brief survey on history, research areas, approaches and challenges
53. An explainable machine learning model to predict and elucidate the compressive behavior of high-performance concrete10.1016/j.rineng.2021.100245 ↗
54. An explainable prediction framework for engineering problems: case studies in reinforced concrete members modeling10.1108/EC-02-2021-0096 ↗
55. K. Broelemann and G. Kasneci, A gradient-based split criterion for highly accurate and transperent model trees, in Proceedings of the twenty eighth international joint conference on artificial intellignece, Germany, pp. 2030–2037.10.24963/ijcai.2019/281 ↗
56. Study and analysis of decision tree based classification algorithms
57. Modeling of strength of high-performance concrete using artificial neural networks10.1016/S0008-8846(98)00165-3 ↗
58. M.A. Ahmad, C. Eckert, and A. Teredesai, Interpretable Machine Learning in Healthcare, in Proceedings of the 2018 ACM International Conference on Bioinformatics, Computational Biology, and Health Informatics, New York, NY, USA, Aug. 2018, pp. 559–560. doi: 10.1145/3233547.3233667.10.1145/3233547.3233667 ↗
59. Explainable decision forest: transforming a decision forest into an interpretable tree10.1016/j.inffus.2020.03.013 ↗
60. Explaining the black-box model: a survey of local interpretation methods for deep neural networks10.1016/j.neucom.2020.08.011 ↗
61. A. Ross and F. Doshi velez, Improving the Adversarial Robustness and Interpretability of Deep Neural Networks by Regularizing their Input Gradients, Nov. 2017.10.1609/aaai.v32i1.11504 ↗
62. M.D. Zeiler, R. Fergus, Vis. Underst. Convolutional Netw., Comput. Vis. – ECCV 2014 Sep. 2014 818 833 doi: 10.1007/978-3-319-10590-1_53.10.1007/978-3-319-10590-1_53 ↗
63. B.N. Patro, M. Lunayach, S. Patel, V.P. Namboodiri, U-CAM: Vis. Explan. Using Uncertain. Based Cl. Act. Maps 2019 7444 7453.Accessed: Jun. 17, 2021. [Online]. Available〈https://openaccess.thecvf.com/content_ICCV_2019/html/Patro_U-CAM_Visual_Explanation_Using_Uncertainty_Based_Class_Activation_Maps_ICCV_2019_paper.html〉.10.1109/ICCV.2019.00754 ↗
64. R.R. Selvaraju, M. Cogswell, A. Das, R. Vedantam, D. Parikh, and D. Batra, Grad-CAM: Visual Explanations from Deep Networks via Gradient-Based Localization, in 2017 IEEE International Conference on Computer Vision (ICCV), Oct. 2017, pp. 618–626. doi: 10.1109/ICCV.2017.74.10.1109/ICCV.2017.74 ↗
65. B. Zhou, A. Khosla, A. Lapedriza, A. Oliva, and A. Torralba, Learning Deep Features for Discriminative Localization, in 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Jun. 2016, pp. 2921–2929. doi: 10.1109/CVPR.2016.319.10.1109/CVPR.2016.319 ↗
66. Layer-wise relevance propagation for neural networks with local renormalization layers
67. M. Sundararajan, A. Taly, and Q. Yan, Axiomatic attribution for deep networks, in Proceedings of the 34th International Conference on Machine Learning - Volume 70 , Sydney, NSW, Australia, Aug. 2017, pp. 3319–3328.
68. Top-down neural attention by excitation backprop10.1007/s11263-017-1059-x ↗
69. Q. Zhang, Y.N. Wu, S.-C. Zhu, Interpret. Convolutional Neural Netw. 2018 8827 8836.Accessed: Jun. 17, 2021. [Online]. Available〈https://openaccess.thecvf.com/content_cvpr_2018/html/Zhang_Interpretable_Convolutional_Neural_CVPR_2018_paper.html〉.10.1109/CVPR.2018.00920 ↗
70. C. Etmann, S. Lunz, P. Maass, and C. Schoenlieb, On the Connection Between Adversarial Robustness and Saliency Map Interpretability, in International Conference on Machine Learning, May 2019, pp. 1823–1832. Accessed: Jun. 17, 2021. [Online]. Available: 〈http://proceedings.mlr.press/v97/etmann19a.html〉.
71. G. Tao, S. Ma, Y. Liu, and X. Zhang, Attacks Meet Interpretability: Attribute-steered Detection of Adversarial Samples, ArXiv181011580 Cs Stat, Oct. 2018, Accessed: Jun. 17, 2021. [Online]. Available: http://arxiv.org/abs/1810.11580.
72. A. Ghorbani, J. Wexler, J. Zou, and B. Kim, Towards Automatic Concept-based Explanations, ArXiv190203129 Cs Stat, Oct. 2019, Accessed: Jun. 17, 2021. [Online]. Available: http://arxiv.org/abs/1902.03129.
73. Interpretable basis decomposition for visual explanation
74. Blotch detection in archive films based on visual saliency map10.1155/2020/5965387 ↗
75. R. Fong A. Vedaldi, Interpretable Explanations of Black Boxes by Meaningful Perturbation, 2017 IEEE Int. Conf. Comput. Vis. ICCV, pp. 3449–3457, Oct. 2017, doi: 10.1109/ICCV.2017.371.10.1109/ICCV.2017.371 ↗
76. M.T. Ribeiro, S. Singh, C. Guestrin, ‘Why Should I Trust You?’: Explaining the Predictions of Any Classifier HLT-NAACL Demos 2016 doi: 10.1145/2939672.2939778.10.1145/2939672.2939778 ↗
77. V. Petsiuk, A. Das, and K. Saenko, RISE: Randomized Input Sampling for Explanation of Black-box Models, ArXiv180607421 Cs, Jun. 2018, Accessed: Apr. 11, 2021. [Online]. Available:〈http://arxiv.org/abs/1806.07421〉,
78. S.M. Lundberg and S.-I. Lee, A unified approach to interpreting model predictions, in Proceedings of the 31st International Conference on Neural Information Processing Systems, Red Hook, NY, USA, Dec. 2017, pp. 4768–4777.
79. Post-hoc explanation of black-box classifiers using confident itemsets10.1016/j.eswa.2020.113941 ↗
80. Decision tree regression for soft classification of remote sensing data10.1016/j.rse.2005.05.008 ↗
81. L. Breiman, J. Friedman, R. Olshen, C.J. Stone, Classif. Regres. Trees 1983 doi: 10.2307/2530946.
82. M.W. Ahmad, J. Reynolds Y. Rezgui Predict. Model. Sol. Therm. Energy Syst.: A Comp. Support Vector Regres., Random For., Extra trees Regres. trees vol., 203, 1, 2018, pp. 810–821 doi: 10.1016/j.jclepro.2018.08.207.10.1016/j.jclepro.2018.08.207 ↗
83. Machine learning predictive models for mineral prospectivity: an evaluation of neural networks, random forest, regression trees and support vector machines10.1016/j.oregeorev.2015.01.001 ↗
84. Extremely randomized trees
85. Real-time lane estimation using deep features and extra trees regression
86. Critical assessment of regression-based machine learning methods for polymer dielectrics10.1016/j.commatsci.2016.08.039 ↗
87. Y. Freund and R.E. Schapire, Experiments with a New Boosting Algorithm, in In Proceedings of the Thirteenth International Conference on Machine Learning, 1996, pp. 148–156.
88. D.P. Solomaitine and D.L. Shresthra, AdaBoost RT: A boosting algorithm for regression problems, in IEEE international joint conference oon neural networks, 2004, vol. 2, pp. 1163–1168. doi: 10.1109/IJCNN.2004.1380102.10.1109/IJCNN.2004.1380102 ↗
89. A study of predicting irradiation-induced transition temperature shift for RPV steels with XGBoost modeling10.1016/j.net.2021.02.015 ↗
90. G. Ke et al., LightGBM: A Highly Efficient Gradient Boosting Decision Tree, Nov. 2017, Accessed: Apr. 11, 2021. [Online]. Available: 〈https://www.microsoft.com/en-us/research/publication/lightgbm-a-highly-efficient-gradient-boosting-decision-tree/〉.
91. Light gradient boosting machine: an efficient soft computing model for estimating daily reference evapotranspiration with local and external meteorological data10.1016/j.agwat.2019.105758 ↗
92. GMDH-type neural network approach for modeling the discharge coefficient of rectangular sharp-crested side weirs
93. Modeling concrete strength with augment-neuron networks10.1061/(ASCE)0899-1561(1998)10:4(263) ↗
94. Design of high-performance concrete mixture using neural networks and nonlinear programming10.1061/(ASCE)0887-3801(1999)13:1(36) ↗
95. Analysis of strength of concrete using design of experiments and neural networks10.1061/(ASCE)0899-1561(2006)18:4(597) ↗
96. Towards UCI+: a mindful repository design10.1016/j.ins.2013.08.059 ↗
97. SVM parameter optimization using grid search and genetic algorithm to improve classification performance
98. Goodfellow · 2016
99. A modified firefly algorithm-artificial neural network expert system for predicting compressive and tensile strength of high-performance concrete10.1016/j.conbuildmat.2018.05.201 ↗
100. Artificial intelligence approaches for prediction of compressive strength of geopolymer concrete10.3390/ma12060983 ↗