Undersampling Strategy for Machine-learned Deterioration Regression Model in Concrete Bridges
Source abstract
Abstract
Inspection data of actual concrete structures should be analyzed to elucidate the deterioration mechanism and construct a regression model. Although machine learning can be applied to this problem, inspection data are not suitable because machine learning targets big data with a uniform density and a balanced distribution. This study applies machine learning to a regression model of the crack damage grade in concrete bridges, using imbalanced inspection data. The model performance is improved by analyzing the influence of undersampling. Undersampling is conducted step-wise, and the models are constructed by learning all the undersampled data. The cross-validation of these models yielded the regression errors on each crack damage grade to evaluate the model performance considering the bias of data imbalance. Based on the results, the effect of undersampling on the model performance is analyzed, and the appropriate model is selected. Additionally, the influence of the model difference on the evaluation is investigated via historical change or factor analysis to confirm the effect of undersampling. This article not only presents a case study of a regression task for crack damage grades in concrete bridges, but also describes a strategy to maximize the use of imbalanced data for regression problems.
Source: openalex_inverted_index · Quality: baseline
Research context
OpenAlex topics: Infrastructure Maintenance and Monitoring · Non-Destructive Testing Techniques · Imbalanced Data Classification Techniques
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
Affiliations
Kagawa University, 2217-20 Hayashi, Takamatsu, Kagawa, Japan.
Saitama University, Shimo-Okubo 255, Sakura-ku, Saitama-shi, Saitama, Japan.
The University of Tokyo, 7-3-1, Hongo, Bunkyo-ku, Tokyo, Japan.
References (35)
Show source-provided references
1. 1) Akagi, M., Nakamura, Y., Higaki, T., Narita, K., Honda, Y., Zhou, J., Yu, Z., Akino, N. and Awai, K., (2019). “Deep learning reconstruction improves image quality of abdominal ultra-high-resolution CT.” European Radiology, 29(11), 6163-6171.10.1007/s00330-019-06170-3 ↗
2. 2) Amezquita-Sanchez, J. P. and Adeli, H., (2015). “Synchrosqueezed wavelet transform-fractality model for locating, detecting, and quantifying damage in smart highrise building structures.” Smart Materials and Structures, 24(6), Article ID 065034.10.1088/0964-1726/24/6/065034 ↗
3. 3) Bishop, C. M., (2006). “Pattern recognition and machine learning.” New York: Springer Science and Business Media LLC.
4. 4) Chawla, N. V., Bowyer, K. W., Hall, L. O. and Kegelmeyer, W. P., (2002). “SMOTE: Synthetic minority over-sampling technique.” Journal of Artificial Intelligence Research, 16, 321-357.10.1613/jair.953 ↗
5. 5) Chawla, N. V., Japkowicz, N. and Kotcz, A., (2004). “Editorial: Special issue on learning from imbalanced data sets.” ACM Special Interest Group on Knowledge Discovery in Data Explorations Newsletter, 6(1), 1-6.10.1145/1007730.1007733 ↗
6. 6) Dubey, R., Zhou, J., Wang, Y., Thompson, P. M., Ye, J. and Initiative, A. S. D. N., (2014). “Analysis of sampling techniques for imbalanced data: An n = 648 ADNI study.” NeuroImage, 87, 220-241.10.1016/j.neuroimage.2013.10.005 ↗
7. 7) Fang, J., Ishida, T. and Yamazaki, T., (2018). “Quantitative evaluation of risk factors affecting the deterioration of RC deck slab components in East Japan and Tokyo regions using survival analysis.” Applied Sciences, 8(9), 1470.10.3390/app8091470 ↗
8. 8) Friedman, J. H., Bentley, J. L. and Finkel, R. A., (1977). “An algorithm for finding best matches in logarithmic expected time.” ACM Transactions on Mathematical Software, 3(3), 209-226.10.1145/355744.355745 ↗
9. 9) Galar, M., Fernández, A., Barrenechea, E. and Herrera, F., (2013). “EUSBoost: Enhancing ensembles for highly imbalanced data-sets by evolutionary undersampling.” Pattern Recognition, 46(12), 3460-3471.10.1016/j.patcog.2013.05.006 ↗
10. 10) García, V., Sánchez, J. S. and Mollineda, R. A., (2012). “On the effectiveness of preprocessing methods when dealing with different levels of class imbalance.” Knowledge-Based Systems, 25(1), 13-21.10.1016/j.knosys.2011.06.013 ↗
11. 11) Haixiang, G., Yijing, L., Shang, J., Mingyun, G., Yuanyue, H. and Bing, G., (2017). “Learning from class-imbalanced data: Review of methods and applications.” Expert Systems with Applications, 73, 220-239.10.1016/j.eswa.2016.12.035 ↗
12. 12) Japkowicz, N., (2000). “Learning from imbalanced data sets: A comparison of various strategies.” In: Proc. AAAI Workshop on Learning from Imbalanced Data Sets, Austin, Texas, USA 31 July 2000. Menlo Park, California, USA: The AAAI Press, 10-15.
13. 13) Jiang, Y., Saito, M. and Sinha, K. C., (1988). “Bridge performance prediction model using the Markov chain.” Transportation Research Record, 1180(1), 25-32.
14. 14) Kim, M. J. and Kang, D. K., (2010). “Ensemble with neural networks for bankruptcy prediction.” Expert Systems with Applications, 37(4), 3373-3379.10.1016/j.eswa.2009.10.012 ↗
15. 15) Loyola-González, O., Martínez-Trinidad, J. F., Carrasco-Ochoa, J. A. and García-Borroto, M., (2016). “Study of the impact of resampling methods for contrast pattern based classifiers in imbalanced databases.” Neurocomputing, 175, 935-947.10.1016/j.neucom.2015.04.120 ↗
16. 16) Maalouf, M. and Siddiqi, M., (2014). “Weighted logistic regression for large-scale imbalanced and rare events data.” Knowledge-Based Systems, 59, 142-148.10.1016/j.knosys.2014.01.012 ↗
17. 17) Maekawa, K., Ishida, T. and Kishi, T., (2003). “Multi-scale modeling of concrete performance.” Journal of Advanced Concrete Technology, 1(2), 91-126.10.3151/jact.1.91 ↗
18. 18) MLIT, (2018a). “Bridge periodic inspection procedures.” Tokyo: Road and Disaster Prevention Section of the Ministry of Land, Infrastructure, Transport and Tourism. (in Japanese)
19. 19) MLIT, (2018b). “Road bridge periodic inspection procedures.” Tokyo: Road and Disaster Prevention Section of the Ministry of Land, Infrastructure, Transport and Tourism. (in Japanese)
20. 20) Morcous, G., (2006). “Performance prediction of bridge deck systems using Markov chains.” Journal of Performance of Constructed Facilities, 20(2), 146-155.10.1061/(ASCE)0887-3828(2006)20:2(146) ↗
21. 21) Ng, S. K. and Moses, F., (1998). “Bridge deterioration modeling using semi-Markov theory.” In: N. Shiraishi, M. Shinozuka and Y. K. Wen, Eds. Proc. 7th International Conference on Structural Safety and Reliability, Kyoto, Japan 24-28 November 1997. Amsterdam: A. A. Balkema Publishers, 1, 113-120.
22. 22) Okazaki, Y., Okazaki, S., Asamoto, S. and Chun, P. J., (2020). “Applicability of machine learning to a crack model in concrete bridges.” Computer Aided Civil and Infrastructure Engineering, 35, 775-792.10.1111/mice.12532 ↗
23. 23) Perez-Ramirez, C. A., Amezquita-Sanchez, J. P., Valtierra-Rodriguez, M., Adeli, H., Dominguez-Gonzalez, A. and Romero-Troncoso, R. J., (2019). “Recurrent neural network model with Bayesian training and mutual information for response prediction of large buildings.” Engineering Structures, 178, 603-615.10.1016/j.engstruct.2018.10.065 ↗
24. 24) Prasanna, P., Dana, K. J., Gucunski, N., Basily, B. B., La, H. M., Lim, R. S. and Parvardeh, H., (2014). “Automated crack detection on concrete bridges.” IEEE Transactions on Automation Science and Engineering, 13(2), 591-599.10.1109/TASE.2014.2354314 ↗
25. 25) Rafiei, M. H. and Adeli, H., (2017). “A novel machine learning-based algorithm to detect damage in high-rise building structures.” The Structural Design of Tall and Special Buildings, 26(18), e1400.10.1002/tal.1400 ↗
26. 26) Rasmussen, C. E., (2006). “Gaussian processes in machine learning.” In: O. Bousquet, U. von Luxburg and G. Rätsch, Eds. Summer School on Machine Learning, ML 2003: Advanced Lectures on Machine Learning, Lecture Notes in Computer Science. Berlin and Heidelberg: Springer-Verlag, 63-71.
27. 27) Sun, Y., Kamel, M. S., Wong, A. K. and Wang, Y., (2007). “Cost-sensitive boosting for classification of imbalanced data.” Pattern Recognition, 40(12), 3358-3378.10.1016/j.patcog.2007.04.009 ↗
28. 28) Tanaka, Y., Takahashi, Y. and Maekawa, K., (2017). “Remaining fatigue life assessment of damaged RC decks: Data assimilation of multi-scale model and site inspection.” Journal of Advanced Concrete Technology, 15(7), 328-345.10.3151/jact.15.328 ↗
29. 29) Thanathamathee, P. and Lursinsap, C., (2013). “Handling imbalanced data sets with synthetic boundary data generation using bootstrap re-sampling and AdaBoost techniques.” Pattern Recognition Letters, 34(12), 1339-1347.10.1016/j.patrec.2013.04.019 ↗
30. 30) Torgo, L., (2016). “Data mining with R: Learning with case studies.” New York: CRC Press.
31. 31) Torgo, L., Branco, P., Ribeiro, R. P. and Pfahringer, B., (2015). “Resampling strategies for regression.” Expert Systems, 32(3), 465-476.10.1111/exsy.12081 ↗
32. 32) Veshosky, D., Beidleman, C. R., Buetow, G. W. and Demir, M., (1994). “Comparative analysis of bridge superstructure deterioration.” Journal of Structural Engineering, 120(7), 2123-2136.10.1061/(ASCE)0733-9445(1994)120:7(2123) ↗
33. 33) Wellalage, N. K. W., Zhang, T., Dwight, R. and El-Akruti, K., (2013). “Bridge deterioration modeling by Markov Chain Monte Carlo (MCMC) simulation method.” In: P. W. T. Tse, J. Mathew, K. Wong, R. Lam, and C. N. Ko, Eds. Proc. 8th World Congress on Engineering Asset Management and 3rd International Conference on Utility Management and Safety, Hongkong 30 October - 1 November 2013, 545-556.
34. 34) Yamaguchi, T. and Hashimoto, S., (2010). “Fast crack detection method for large-size concrete surface images using percolation-based image processing.” Machine Vision and Applications, 21(5), 797-809.10.1007/s00138-009-0189-8 ↗
35. 35) Zhou, L., (2013). “Performance of corporate bankruptcy prediction models on imbalanced dataset: The effect of sampling methods.” Knowledge-Based Systems, 41, 16-25.10.1016/j.knosys.2012.12.007 ↗