A hybrid framework of attention-based tabular network and ensemble learning with generative adversarial network for stiffness modulus prediction
Source abstract
Abstract
The dynamic modulus is a fundamental property in pavement engineering, quantifying the viscoelastic stiffness of asphalt mixtures under cyclic loading and critical in mechanistic-empirical design frameworks for modeling pavement responses to traffic loads and temperature variations. However, its in-situ measurement remains costly, time-consuming, and technically demanding, creating a pressing need for accurate and efficient predictive models. Traditional machine learning approaches have been explored to estimate the dynamic modulus, but their predictive capabilities are often constrained by scarce, heterogeneous datasets, limiting generalization. To address these challenges, this study proposes a hybrid learning framework that integrates Attention Based Tabular Network (TabNet)-Extreme Gradient Boosting (XGB) with Conditional Tabular Generative Adversarial Networks (CTGAN) for synthetic data augmentation. The framework leverages TabNet’s attention-based deep feature representation and XGB’s boosting capabilities to enhance predictive accuracy and robustness under data-scarce conditions. A comprehensive evaluation using different statistical metrics demonstrated that the proposed model trained on CTGAN-synthesized data consistently outperformed models trained solely on real data and those using alternative augmentation methods, achieving a superior coefficient of determination (R²) of 0.98. SHapley Additive exPlanations analysis further identified Marshall Stability (28.7 %), Flow (18.8 %), and asphalt content (13.4 %) as the most influential features in dynamic modulus prediction. The CTGAN-augmented proposed hybrid model reduced Mean Absolute Erro by 67.30 %, improved R² by 13.27 %, and decreased Standard Error Ratio by 59.38 %, reflecting significant improvements across all evaluation metrics. These findings highlight the transformative potential of GAN-based data augmentation to advance predictive modeling and promote more efficient data-driven practices in pavement engineering. • A novel TabNet-XGB hybrid model is proposed to predict the stiffness modulus of asphalt mixtures with high accuracy and generalization. • CTGAN-based data synthesis effectively addressed data scarcity by generating statistically consistent synthetic datasets. • The CTGAN-augmented TabNet-XGB framework and achieves superior accuracy, cutting MAE by 67.30 %, improving R² by 13.27 %, and lowering SER by 59.38 %. • SHAP analysis identifies Marshall Stability, Flow, and asphalt content as the most influential features affecting stiffness predictions. • The framework minimizes reliance on labor-intensive testing, enables scalable pavement modeling, and supports efficient pavement design.
Source: openalex_inverted_index · Quality: baseline
Research context
OpenAlex topics: Industrial Vision Systems and Defect Detection · Infrastructure Maintenance and Monitoring · Anomaly Detection Techniques and Applications
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
References (63)
Show source-provided references
1. Implementation of ensemble artificial neural network and MEMS wireless sensors for in-situ asphalt mixture dynamic modulus prediction10.1016/j.conbuildmat.2023.131118 ↗
2. Machine learning models for predicting physical properties in asphalt road construction: a systematic review10.1016/j.conbuildmat.2024.137397 ↗
3. Enhanced asphalt dynamic modulus prediction: a detailed analysis of artificial hummingbird algorithm-optimised boosted trees10.1016/j.jreng.2024.05.001 ↗
4. Adaptive autonomous UAV scouting for rice lodging assessment using edge computing with deep learning EDANet10.1016/j.compag.2020.105817 ↗
5. Enhancing grain moisture prediction in multiple crop seasons using domain adaptation AI10.1016/j.compag.2025.110058 ↗
6. Precision assessment of rice grain moisture content using UAV multispectral imagery and machine learning10.1016/j.compag.2024.109813 ↗
7. Enhancing asphalt mix design with transfer learning and hybrid artificial intelligence
8. Design method for polyurethane-modified asphalt by using Kriging-Particle swarm optimization algorithm10.1016/j.engappai.2022.105609 ↗
9. Enhancing marshall stability of asphalt concrete using a hybrid deep neural network and ensemble learning
10. Enhancing asphalt mix design with transfer learning and hybrid artificial intelligence
11. Deep learning-based methodological approach for prediction of dynamic modulus and phase angle of asphalt concrete10.1016/j.engappai.2025.110269 ↗
12. Prediction of stiffness modulus of bituminous mixtures using the applications of multi-expression programming and gene expression programming10.1080/14680629.2022.2126383 ↗
13. Protection of high-performance concrete on the durability of GFRP bars: deterioration mechanism and tensile strength prediction
14. Durability evaluation of modified basalt fiber reinforced concrete in high altitude cold regions: based on AE, DIC and deep learning prediction
15. A comparative performance analysis of machine learning models for compressive strength prediction in Fly ash-based geopolymers concrete using reference data
16. Optimized data-driven method to study the self-healing and durability of ultra-high-performance concrete10.1016/j.engappai.2025.110043 ↗
17. Architecture for pavement pothole evaluation using deep learning, machine vision, and fuzzy logic
18. Bayesian dynamic modelling for probabilistic prediction of pavement condition10.1016/j.engappai.2024.108637 ↗
19. Explainable pavement surface condition classification using a TabNet-CatBoost hybrid machine learning framework
20. Prediction of the fundamental viscoelasticity of asphalt mixtures using ML algorithms10.1016/j.conbuildmat.2024.137573 ↗
21. A novel technique for multi-objective sustainable decisions for pavement maintenance and rehabilitation
22. Real-time pavement temperature prediction through ensemble machine learning10.1016/j.engappai.2024.108870 ↗
23. An ensemble tree-based prediction of marshall mix design parameters and resilient modulus in stabilized base materials10.1016/j.conbuildmat.2023.132833 ↗
24. Evaluation of measured and predicted resilient modulus of rubberized stone mastic asphalt (SMA) modified with truck tire rubber powder
25. Improved predictions of asphalt concretes’ dynamic modulus and phase angle using decision-tree based categorical boosting model10.1016/j.conbuildmat.2023.132709 ↗
26. Improved estimation of dynamic modulus for hot mix asphalt using deep learning10.1016/j.conbuildmat.2020.119912 ↗
27. Stiffness modulus and marshall parameters of hot mix asphalts: laboratory data modeling by artificial neural networks characterized by cross-validation10.3390/app9173502 ↗
28. Predicting the dynamic modulus of asphalt mixture using machine learning techniques: an application of multi biogeography-based programming10.1016/j.conbuildmat.2020.120983 ↗
29. Exploring the use of machine learning to predict metrics related to asphalt mixture performance10.1016/j.conbuildmat.2021.123585 ↗
30. A case study of resilient modulus prediction leveraging an explainable metaheuristic-based XGB10.1016/j.trgeo.2024.101216 ↗
31. Development of machine learning models for forecasting the strength of resilient modulus of subgrade soil: genetic and artificial neural network approaches10.1038/s41598-024-69316-4 ↗
32. Prediction models for marshall mix parameters using bio-inspired genetic programming and deep machine learning approaches: a comparative study
33. Strength prediction of asphalt mixture under interactive conditions based on BPNN and SVM
34. Optimized machine learning approaches for the prediction of viscoelastic behavior of modified asphalt binders
35. Interpretable knowledge-guided framework for modeling minimum miscible pressure of CO₂–oil system in CO₂-EOR projects10.1016/j.engappai.2022.105687 ↗
36. Data management for production quality deep learning models: challenges and solutions10.1016/j.jss.2022.111359 ↗
37. Enhancing pavement temperature prediction using XGB transfer learning for data-scarce scenarios
38. Developing an advanced ANN-based approach to estimate compaction characteristics of highway subgrade10.1016/j.aei.2023.102023 ↗
39. Application of KRR, K-NN and GPR algorithms for predicting the soaked CBR of fine-grained plastic soils10.1007/s13369-023-07962-y ↗
40. Enhancing the predictive accuracy of marshall design tests using generative adversarial networks and advanced machine learning techniques
41. Virtual generation of pavement crack images based on improved deep convolutional generative adversarial network10.1016/j.engappai.2021.104376 ↗
42. Generative design and topology optimization research for single–layer aluminum alloy grid shell connections
43. A data-driven prediction for concrete crack propagation path based on deep learning method
44. Automated detection of weld defects in TOFD images for steel bridges using generative adversarial networks
45. Development of machine learning-based burst capacity models for pipelines containing dent-gouges with synthetic full-scale burst test data generated using tabular generative adversarial network10.1016/j.engappai.2024.108090 ↗
46. Conditional generative adversarial networks for spectrum-compatible ground motion generation of scenario earthquakes10.1016/j.engappai.2025.110755 ↗
47. Application of tabular data synthesis using generative adversarial networks on machine learning-based multiaxial fatigue life prediction10.1016/j.ijpvp.2022.104779 ↗
48. Predicting penetration depth in ultra-high-performance concrete targets under ballistic impact: an interpretable machine learning approach augmented by deep generative adversarial network10.1016/j.rineng.2024.103909 ↗
49. A two-stream conditional generative adversarial network for improving semantic predictions in urban driving scenes10.1016/j.engappai.2024.108290 ↗
50. A traffic-weather generative adversarial network for traffic flow prediction for road networks under bad weather10.1016/j.engappai.2024.109125 ↗
51. A novel generative adversarial network for improving crash severity modeling with imbalanced data10.1016/j.trc.2024.104642 ↗
52. Aggregation segregation generative adversarial network (AG-GAN) facilitated multi-scale segregation detection in asphalt pavement paving stage10.1016/j.engappai.2023.107663 ↗
53. Real-time crash prediction on expressways using deep generative models10.1016/j.trc.2020.102697 ↗
54. GenerativeMTD: a deep synthetic data generation framework for small datasets10.1016/j.knosys.2023.110956 ↗
55. Fake it till you make it: synthetic data for emerging carsharing programs10.1016/j.trd.2024.104067 ↗
56. Dataset used to develop soft computing models that predict the stiffness modulus of bituminous mixtures10.1016/j.dib.2024.110382 ↗
57. TabNet: attentive interpretable tabular learning
58. XGB: a scalable tree boosting system10.1145/2939672.2939785 ↗
59. A novel stacked generalization ensemble-based hybrid LGBM-XGB-MLP model for short-term load forecasting10.1016/j.energy.2020.118874 ↗
60. Generative adversarial nets
61. Generation of synthetic full-scale burst test data for corroded pipelines using the tabular generative adversarial network10.1016/j.engappai.2022.105308 ↗
62. A Bayesian-physical informed conditional tabular generative adversarial network framework for low-carbon concrete data augmentation and hyperparameter optimization10.1016/j.engappai.2025.110811 ↗
63. Modeling tabular data using conditional GAN