journal article·2024-07Open access

Language model enhanced surface chloride concentration determination for concrete within splash environment based on limited field records

Xin-Rui Ma, Xiao Liang, Shuai Wang, Shi-Zhi Chen

Abstract

Chloride ion is severely harmful to reinforced concrete (RC) structures in marine environments. For maintaining the durability and safety of the designed RC structures, the determination of chloride ion concentration on concrete surfaces is critical. Currently, surface chloride ion concentration can be determined using empirical formulas and machine learning (ML) approaches. However, these approaches only rely on the numerical information within field records, disregarding valuable semantic and background information in the records, leading to low accuracy. Meanwhile, in splash environments, it presents a significant challenge to obtain chloride ion concentration records due to the complex environment and high costs involved. Therefore, based on limited field records of surface ion concentrations in splash environments, and utilizing a state-of-the-art language model (LM), this study proposes an LM-based information generation (LMIG) model to improve the accuracy of determination of surface chloride concentrations on RC structures. This paper utilizes the numerical and semantic information in 70 sets of field records to fine-tune the LMIG model and generates 200 sets of high-quality records. These records are then used to train ML algorithms for predicting chloride ion concentrations on concrete surfaces. After conducting comparative research, it was found that incorporating records generated by the LMIG model significantly enhances the accuracy of the ML algorithm. Specifically, the predictive accuracy using the random forest algorithm increased by 33.1%. Furthermore, this paper also conducts a comparative study on the LMIG model and the generative adversarial network (GAN)-assisted data-driven method. The results demonstrate that integrating semantic and numerical information into the LMIG model shows significant advantages in enhancing ML algorithms’ accuracy.
Source: openalex_inverted_index · Quality: baseline

Research context

OpenAlex topics: Geophysical Methods and Applications · Concrete Corrosion and Durability · Non-Destructive Testing Techniques

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

References (67)

Show source-provided references
1. Mechanism of corrosion protection in reinforced concrete marine structures10.1038/258514a0 ↗
2. The role of different ratios of biochar in the artificial lightweight cold-bonded aggregates (alcbas) containing high volume of red mud (rm)10.1016/j.conbuildmat.2024.135815 ↗
3. The vertical non-uniform corrosion of reinforced concrete exposed to the marine environments10.1016/j.conbuildmat.2018.06.015 ↗
4. Electrochemical corrosion monitoring of galvanized steel under cyclic wet-dry conditions10.1016/S0010-938X(99)00057-8 ↗
5. Effect of Heat Treatment on the Corrosion Behavior of AISI 4135 Steel under Natural Seawater Film at Different Temperatures10.1016/S1452-3981(23)08048-3 ↗
6. Prediction of long term chloride concentration in concrete10.1007/BF02473426 ↗
7. Investigation of the cyclic separation of dioxins from municipal solid waste incineration fly ash by using fat
8. Practical model for predicting corrosion rate of steel reinforcement in concrete structures10.1016/j.conbuildmat.2013.12.046 ↗
9. Probabilistic modeling of chloride-induced corrosion in concrete structures using first- and second-order reliability methods10.1016/j.cemconcomp.2012.05.001 ↗
10. Test and theoretical prediction of chloride ion diffusion in recycled fine aggregate mortar under uniaxial compression10.1016/j.conbuildmat.2022.126384 ↗
11. Experimental investigation on the effect of sulfate attack on chloride diffusivity of cracked concrete subjected to composite solution10.1016/j.conbuildmat.2019.117643 ↗
12. Effects of W/B ratios and fly ash finenesses on chloride diffusion coefficient of concrete in marine environment10.1617/s11527-008-9398-2 ↗
13. The performance and microstructure of alkali-activated artificial aggregates prepared from municipal solid waste incineration bottom ash10.1016/j.conbuildmat.2023.133012 ↗
14. Investigation of natural diffusion behavior in concrete using iodide replacing chloride ions: The impact of mineral admixtures types and dosages10.1016/j.jmrt.2024.01.206 ↗
15. A study of the factors affecting the surface chloride maximum phenomenon in submerged concrete samples10.1016/j.cemconcomp.2018.09.006 ↗
16. Prediction of time dependent chloride transport in concrete structures exposed to a marine environment10.1016/j.cemconres.2009.09.023 ↗
17. General guidelines for durability design and redesign: DuraCrete, probabilistic performance based durability design of concrete structures, [Gouda]: [CUR], 2000.〈http://lib.ugent.be/catalog/rug01:001386862〉.
18. Factors influencing chloride transport in concrete structures exposed to marine environments10.1016/j.cemconcomp.2007.09.005 ↗
19. On the mathematics of time-dependent apparent chloride diffusion coefficient in concrete10.1016/j.cemconres.2007.01.006 ↗
20. Prediction of surface chloride concentration of marine concrete using ensemble machine learning10.1016/j.cemconres.2020.106164 ↗
21. Development of Deep Learning Algorithms, Frameworks and Hardwares
22. Probabilistic machine-learning methods for performance prediction of structure and infrastructures through natural gradient boosting10.1061/(ASCE)ST.1943-541X.0003401 ↗
23. Study on data-driven identification method of hinge joint damage under moving vehicle excitation
24. Ensemble machine learning model for corrosion initiation time estimation of embedded steel reinforced self-compacting concrete10.1016/j.measurement.2020.108141 ↗
25. Hybrid support vector regression - particle swarm optimization for prediction of compressive strength and rcpt of concretes containing metakaolin10.1016/j.conbuildmat.2012.02.038 ↗
26. Prediction of chloride diffusion in cement mortar using multi-gene genetic programming and multivariate adaptive regression splines10.1016/j.measurement.2017.08.031 ↗
27. A survey on image data augmentation for deep learning10.1186/s40537-019-0197-0 ↗
28. Ensemble learning based approach for frp-concrete bond strength prediction10.1016/j.conbuildmat.2021.124230 ↗
29. Sustainable utilization of concrete slurry waste in eco-friendly artificial lightweight cold-bonded aggregates: An alternative pathway for efficiently sequestrating co210.1016/j.conbuildmat.2024.135759 ↗
30. Gaussian copula regression in r10.18637/jss.v077.i08 ↗
31. Machine learning prediction of structural response of steel fiber-reinforced concrete beams subjected to far-field blast loading10.1016/j.cemconcomp.2021.104378 ↗
32. N. Patki, R. Wedge, K. Veeramachaneni, The synthetic data vault, in: IEEE International Conference on Data Science and Advanced Analytics (DSAA), 2016, 399-410.10.1109/DSAA.2016.49.10.1109/DSAA.2016.49 ↗
33. Attention is all you need
34. A. Vaswani, N. Shazeer, N. Parmar, J. Uszkoreit, L. Jones, A.N. Gomez, L. Kaiser, I. Polosukhin, Attention Is All You Need, arXiv:1706.03762 [cs](2023). 〈http://arxiv.org/abs/1706.03762〉.
35. Transformers in medical imaging: A survey10.1016/j.media.2023.102802 ↗
36. Transformer-based attention network for stock movement prediction10.1016/j.eswa.2022.117239 ↗
37. V. Borisov, K. Seßler, T. Leemann, M. Pawelczyk, G. Kasneci, Language Models are Realistic Tabular Data Generators (2023).
38. V. Borisov, K. Seßler, T. Leemann, M. Pawelczyk, G. Kasneci, Language models are realistic tabular data generators, arXiv preprint arXiv:2210.06280 (2022).
39. Deep learning enabled semantic communication systems10.1109/TSP.2021.3071210 ↗
40. A. Radford, K. Narasimhan, T. Salimans, I. Sutskever, et al., Improving language understanding by generative pre-training (2018).
41. J. Devlin, M.-W. Chang, K. Lee, K. Toutanova, Bert: Pre-training of deep bidirectional transformers for language understanding, arXiv preprint arXiv:1810.04805 (2018).
42. Gpt-3: Its nature, scope, limits, and consequences10.1007/s11023-020-09548-1 ↗
43. Y. Liu, M. Lapata, Text summarization with pretrained encoders, CoRR abs/1908.08345(2019). arXiv:1908.08345.〈http://arxiv.org/abs/1908.08345〉.
44. Z. Lan, M. Chen, S. Goodman, K. Gimpel, P. Sharma, R. Soricut, ALBERT: A lite BERT for self-supervised learning of language representations, CoRR abs/1909.11942(2019). arXiv:1909.11942.〈http://arxiv.org/abs/1909.11942〉.
45. Y. Zhang, S. Sun, M. Galley, Y. Chen, C. Brockett, X. Gao, J. Gao, J. Liu, B. Dolan, Dialogpt: Large-scale generative pre-training for conversational response generation, CoRR abs/1911.00536(2019). arXiv:1911.00536.〈http://arxiv.org/abs/1911.00536〉.
46. M.D. Zeiler, R. Fergus, Visualizing and understanding convolutional networks, In: Computer Vision–ECCV 2014: 13th European Conference, Zurich, Switzerland, September 6–12, 2014, Proceedings, Part I 13, Springer, 2014, 818-833.10.1007/978-3-319-10590-1_53 ↗
47. Hugging face
48. T.K. Ho, Random decision forests, in: Proceedings of 3rd international conference on document analysis and recognition, Vol. 1, IEEE, 1995, 278-282.10.1109/ICDAR.1995.598994 ↗
49. The Elements of Statistical Learning10.1007/978-0-387-21606-5 ↗
50. L. Gautheron, P. Germain, A. Habrard, G. Metzler, E. Morvant, M. Sebban, V. Zantedeschi, Landmark-based ensemble learning with random fourier features and gradient boosting, In: Machine Learning and Knowledge Discovery in Databases: European Conference, ECML PKDD 2020, Ghent, Belgium, September 14–18, 2020, Proceedings, Part III, Springer, 2021, 141-157.10.1007/978-3-030-67664-3_9 ↗
51. Data analytics in asset management: Cost-effective prediction of the pavement condition index10.1061/(ASCE)IS.1943-555X.0000512 ↗
52. Multilayer perceptron and neural networks
53. Chapter 3 - Machine learning techniques
54. Multifidelity approach for data-driven prediction models of structural behaviors with limited data10.1111/mice.12817 ↗
55. J. Snoek, H. Larochelle, R.P. Adams, Practical bayesian optimization of machine learning algorithms (2012). arXiv:1206.2944.
56. T. Akiba, S. Sano, T. Yanase, T. Ohta, M. Koyama, Optuna: A Next-generation Hyperparameter Optimization Framework, arXiv:1907.10902 [cs, stat](2019). 10.48550/arXiv.1907.10902, 〈http://arxiv.org/abs/1907.10902〉.10.1145/3292500.3330701 ↗
57. Seni · 2010
58. On over-fitting in model selection and subsequent selection bias in performance evaluation
59. S.I. Wang, C.D. Manning, Baselines and bigrams: Simple, good sentiment and topic classification, in: Proceedings of the 50th Annual Meeting of the Association for Computational Linguistics (Volume 2: Short Papers), 2012, 90-94.
60. Representation learning: A review and new perspectives10.1109/TPAMI.2013.50 ↗
61. L.S. Shapley, Notes on the n-person game—ii: The value of an n-person game (1951).
62. Roth · 1988
63. A unified approach to interpreting model predictions
64. Peeking inside the black box: Visualizing statistical learning with plots of individual conditional expectation10.1080/10618600.2014.907095 ↗
65. Hastie · 2009
66. Improved model for surface chloride concentration of concrete in marine tidal and splash zones
67. T. Chen, C. Guestrin, Xgboost: A scalable tree boosting system, in: Proceedings of the 22nd acm sigkdd international conference on knowledge discovery and data mining, 2016, 785-794.10.1145/2939672.2939785 ↗