journal article·2025-08-19Open access

Acoustic Analysis of Semi-Rigid Base Asphalt Pavements Based on Transformer Model and Parallel Cross-Gate Convolutional Neural Network

Changfeng Hao, Min Ye, Boyan Li, Jiale Zhang

Applied Sciences· Volume 15· Issue 16

Abstract

Semi-rigid base asphalt pavements, a common highway structure in China, often suffer from debonding defects which reduce road stability and shorten service life. In this study, a new method of road debonding detection based on the acoustic vibration method is proposed to address the needs of hidden debonding defects which are difficult to detect. The approach combines the Transformer model and the Transformer-based Parallel Cross-Gated Convolutional Neural Network (T-PCG-CNN) to classify and recognize semi-rigid base asphalt pavement acoustic data. Firstly, over a span of several years, an excitation device was designed and employed to collect acoustic data from different road types, creating a dedicated multi-sample dataset specifically for semi-rigid base asphalt pavements. Secondly, the improved Mel frequency cepstral coefficient (MFCC) feature and its first-order differential features (ΔMFCC) and second-order differential features (Δ2MFCC) are adopted as the input data of the network for different sample acoustic signal characteristics. Then, the proposed T-PCG-CNN model fuses the multi-frequency feature extraction advantage of a parallel cross-gate convolutional network and the long-time dependency capture ability of the Transformer model to improve the classification performance of different road acoustic features. Comprehensive experiments were conducted to analyze parameter sensitivity, feature combination strategies, and comparisons with existing classification algorithms. The results demonstrate that the proposed model achieves high accuracy and weighted F1 score. The confusion matrix indicates high per-class recall (including debonding), and the one-vs-rest ROC curves (AUC ≥ 0.95 for all classes) confirm strong class separability with low false-alarm trade-offs across operating thresholds. Moreover, the use of blockwise self-attention with global tokens and shared weight matrices significantly reduces model complexity and size. In the multi-type road data classification test, the classification accuracy reaches 0.9208 and the weighted F1 value reaches 0.9315, which is significantly better than the existing methods, demonstrating its generalizability in the identification of multiple road defect types.
Source: crossref · Quality: baseline

Research context

OpenAlex topics: Advanced Algorithms and Applications · Advanced Sensor and Control Systems · Civil and Geotechnical Engineering Research

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

National Engineering Research Center of Highway Maintenance Equipment, Chang’an University, Xi’an 710018, China

Henan Gaoyuan Highway Maintenance Technology Co., Ltd., Xinxiang 453000, China

School of Information Engineering, Chang’an University, Xi’an 710018, China

School of Engineering Machinery, Xi’an University of Science and Technology, Xi’an 710018, China

Funding

National Key Research and Development Project · Key Research and Development Special Project

References (67)

Show source-provided references
1. Performance evaluation of asphalt pavement with semi-rigid base and fine-sand subgrade by indoor large-scale accelerated pavement testing10.1007/978-3-030-55236-7_9 ↗
2. An innovative evaluation method for performance of in-service asphalt pavement with semi-rigid base10.1016/j.conbuildmat.2019.117376 ↗
3. Mechanical behavior analysis of asphalt pavement based on measured axial load data10.1007/s42947-022-00248-w ↗
4. Theoretical analysis of reflective cracking in asphalt pavement with semi-rigid base10.1007/s40996-018-0154-8 ↗
5. Chen, J., Li, H., Zhao, Z., Hou, X., Luo, J., Xie, C., Liu, H., and Ren, T. (2022). Investigation of transverse crack spacing in an asphalt pavement with a semi-rigid base. Sci. Rep., 12.10.1038/s41598-022-23122-y ↗
6. Overview of the application of ground-penetrating radar, laser, infrared thermal imaging, and ultrasonic in nondestructive testing of road surface10.1016/j.measurement.2023.113927 ↗
7. Pedersen, L. (2013). Viscoelastic Modelling of Road Deflections for Use with the Traffic Speed Deflectometer. [Master’s Thesis, Department of Civil Engineering, Technical University of Denmark].
8. Flintsch, G., Katicha, S., Bryce, J., Ferne, B., Nell, S., and Diefenderfer, B. (2013). Assessment of Continuous Pavement Deflection Measuring Technologies, The National Academies Press.10.17226/22766 ↗
9. Dynamic response analysis of asphalt pavement under three directional nonuniform moving load
10. Detection of road cavities in urban cities by 3D ground penetrating radar10.1190/geo2020-0384.1 ↗
11. Utilization of air-launched ground penetrating radar (GPR) for pavement condition assessment10.1016/j.conbuildmat.2017.02.105 ↗
12. Ling, J.Y., Qian, R.Y., Shang, K., Guo, L., Zhao, Y., and Liu, D. (2022). Research on the dynamic monitoring technology of road subgrades with time-lapse full-coverage 3D ground penetrating radar (GPR). Remote Sens., 14.10.3390/rs14071593 ↗
13. Soren, R., Lisbeth, A., Susanne, B., and Jorgen, K. (2008, January 21–24). A comparison of two years of network level measurements with the traffic speed deflectometer. Proceedings of the TRA2008: Transport Research Arena Conference, Ljubljana, Slovenia.
14. Graczyk, M., Zofka, A., and Sudyka, J. (2014, January 19–22). Analytical solution of pavement deflections and its application to the TSD measurements. Proceedings of the 26th ARRB Conference, Sydney, Australia.
15. Revised approach to assessing traffic speed deflectometer data and field validation of deflection bowl predictions10.1080/10298436.2012.715646 ↗
16. Alternative approach for interpreting traffic speed deflectometer results10.3141/2457-02 ↗
17. Determination of cement concrete pavement foundation emptying by acoustic vibration method
18. Identification of concrete pavement slab cavitation based on transient impact response
19. Experimental study on determination of cement concrete pavement emptying by acoustic vibration method
20. Use of the burnt rock of coal deposits slag heaps in the concrete products manufacturing10.1016/j.conbuildmat.2018.05.222 ↗
21. Application of phenol-cresol-formaldehyde resin as an adhesion promoter for bitumen and asphalt concrete10.1080/14680629.2020.1808518 ↗
22. Cho, Y.S., and Hong, S.U. (2008, January 21–23). The ANN simulation of stress wave based NDT on concrete structures. Proceedings of the International Conference on System Science and Simulation Engineering, Venice, Italy.
23. Block-based high performance CNN architectures for frame-level overlapping speech detection10.1109/TASLP.2020.3036237 ↗
24. Hershey, S., Chaudhuri, S., Ellis, D.P., Gemmeke, J.F., Jansen, A., Moore, R.C., Plakal, M., Platt, D., Saurous, R.A., and Seybold, B. (2016). CNN architectures for large-scale audio classification. arXiv.10.1109/ICASSP.2017.7952132 ↗
25. Liu, M., Wang, J., Li, S., Xiang, F., Yao, Y., and Yang, L. (2022, January 23–27). MOS predictor for synthetic speech with i-vector inputs. Proceedings of the IEEE International Conference on Acoustics, Speech, and Signal Processing, Singapore.10.1109/ICASSP43922.2022.9747533 ↗
26. Jeancolas, L., Petrovska-Delacrétaz, D., Mangone, G., Benkelfat, B.E., Corvol, J.C., Vidailhet, M., Lehéricy, S., and Benali, H. (2021). X-vectors: New quantitative biomarkers for early Parkinson’s disease detection from speech. Front. Neuroinform., 15.10.3389/fninf.2021.578369 ↗
27. Wazir, A.S.B., Karim, H.A., Abdullah, M.H.L., Mansor, S., AlDahoul, N., Fauzi, M.F.A., and See, J. (2020, January 21–24). Spectrogram-based classification of spoken foul language using deep CNN. Proceedings of the 2020 IEEE 22nd International Workshop on Multimedia Signal Processing (MMSP), Tampere, Finland.10.1109/MMSP48831.2020.9287133 ↗
28. Sainath, T.N., Mohamed, A.R., Kingsbury, B., and Ramabhadran, B. (2015, January 19–24). Deep convolutional neural networks for LVCSR. Proceedings of the 2015 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), Brisbane, Australia.
29. Piczak, K.J. (2015, January 17–20). Environmental acoustic classification with convolutional neural networks. Proceedings of the 2015 IEEE 25th International Workshop on Machine Learning for Signal Processing (MLSP), Boston, MA, USA.10.1109/MLSP.2015.7324337 ↗
30. Hershey, S., Chaudhuri, S., Ellis, D.P.W., Gemmeke, J.F., Jansen, A., Moore, R.C., Plakal, M., Platt, D., Saurous, R.A., and Seybold, B. (2017, January 5–9). CNN architectures for large-scale audio classification. Proceedings of the 2017 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), New Orleans, LA, USA.10.1109/ICASSP.2017.7952132 ↗
31. Learning robust feature representations for audio event detection
32. Attention is all you need
33. Zhang, H., Li, J., Cai, G., Chen, Z., and Zhang, H. (2023). A CNN-based method for enhancing boring vibration with time-domain convolution-augmented transformer. Insects, 14.10.3390/insects14070631 ↗
34. Analysis on transformer vibration signal recognition based on convolutional neural network10.21595/jve.2020.21626 ↗
35. Research on transformer condition recognition based on acoustic signal and one-dimensional convolutional neural networks10.1088/1742-6596/2005/1/012078 ↗
36. Dai, Z., Yang, Z., Yang, Y., Carbonell, J., Le, Q.V., and Salakhutdinov, R. (August, January 28). Transformer-XL: Attentive language models beyond a fixed-length context. Proceedings of the Annual Meeting of the Association for Computational Linguistics, Florence, Italy.
37. Geng, Q.S., Wang, F.H., and Zhou, D.X. (2019, January 21–23). Mechanical fault diagnosis of power transformer by GFCC time-frequency map of acoustic signal and convolutional neural network. Proceedings of the 2019 IEEE Sustainable Power and Energy Conference (iSPEC), Beijing, China.10.1109/iSPEC48194.2019.8975318 ↗
38. Wu, Y., Zhang, Z., Xiao, R., Jiang, P., Dong, Z., and Deng, J. (2021). Operation state identification method for converter transformers based on vibration detection technology and deep belief network optimization algorithm. Actuators, 10.10.3390/act10030056 ↗
39. Chen, H., Yu, Y., and Li, P. (2023). Transformer-based denoising of mechanical vibration signals. arXiv.
40. Vibro-acoustic methods in the condition assessment of power transformers: A survey10.1109/ACCESS.2019.2923809 ↗
41. MITDCNN: A multi-modal input Transformer-based deep convolutional neural network for misfire signal detection in high-noise diesel engines10.1016/j.eswa.2023.121797 ↗
42. Ahmed, H.O.A., and Nandi, A.K. (2023). Convolutional-Transformer Model with Long-Range Temporal Dependencies for Bearing Fault Diagnosis Using Vibration Signals. Machines, 11.10.3390/machines11070746 ↗
43. Hu, J., Shen, L., and Sun, G. (2018, January 18–23). Squeeze-and-Excitation Networks. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Salt Lake City, UT, USA.10.1109/CVPR.2018.00745 ↗
44. Zhang, J.C., Yan, W.Y., and Zhang, Y. (2022). A new speech feature fusion method with cross gate parallel CNN for speaker recognition. arXiv.
45. Cross channel interaction based ECA-Net using gated recurrent convolutional network for speech enhancement10.1007/s11042-024-19744-1 ↗
46. Brain-inspired multisensory integration neural network for cross-modal recognition through spatiotemporal dynamics and deep learning10.1007/s11571-023-09932-4 ↗
47. Yang, M., Yeh, C.H., Zhou, Y., and Cerqueira, J.P. (2018, January 11–15). A 1μW voice activity detector using analog feature extraction and digital deep neural network. Proceedings of the 2018 IEEE International Solid-State Circuits Conference-(ISSCC), San Francisco, CA, USA.10.1109/ISSCC.2018.8310326 ↗
48. Crowdsensing for Road Pavement Condition Monitoring: Trends, Limitations, and Opportunities10.1109/ACCESS.2023.3332667 ↗
49. A nondestructive evaluation method for semi-rigid base cracking condition of asphalt pavement10.1016/j.conbuildmat.2017.12.157 ↗
50. Research on relationships among different distress types of asphalt pavements with semi-rigid bases in China using association rule mining: A statistical point of view
51. Environmental acoustic recognition with time-frequency audio features10.1109/TASL.2009.2017438 ↗
52. An overview on acoustic features in time and frequency domain
53. Automated heart acoustic activity detection from PCG signal using time-frequency-domain deep neural network
54. Acoustic source localization method-based time-domain signal feature using deep learning10.1016/j.apacoust.2023.109626 ↗
55. Collecting comprehensive traffic information using pavement vibration monitoring data10.1111/mice.12448 ↗
56. Real-time localization of micro-damage in concrete beams using DIC technology and wavelet packet analysis10.1016/j.cemconcomp.2021.104198 ↗
57. Pengenalan ucapan menggunakan metode linear predictive coding (LPC) dan K-nearest neighbor (K-NN)
58. Mini, P.P., Thomas, T.A., and Kumari, R.G. (2021). EEG-based direct speech BCI system using a fusion of SMRT and MFCC/LPCC features with ANN classifier. Biomed. Signal Process. Control, 68.10.1016/j.bspc.2021.102625 ↗
59. Two-stage supervised learning-based method to detect screams and cries in urban environments10.1109/TASLP.2015.2506264 ↗
60. Boosting contextual information for deep neural network based voice activity detection10.1109/TASLP.2015.2505415 ↗
61. Research on speech recognition method in low SNR environment
62. Mitra, V., Wang, W., Franco, H., and Lei, Y. (2014, January 14–16). Evaluating robust features on deep neural networks for speech recognition in noisy and channel mismatched conditions. Proceedings of the International Conference on Speech and Language Processing, Grenoble, France.10.21437/Interspeech.2014-224 ↗
63. Autocorrelation-based noise subtraction method with smoothing, overestimation, energy, and cepstral mean and variance normalization for noisy speech recognition10.1186/s13636-017-0110-8 ↗
64. Deep learning-based multimodal emotion recognition from audio, visual, and text modalities: A systematic review of recent advancements and prospects10.1016/j.eswa.2023.121692 ↗
65. A data-driven structural damage detection framework based on parallel convolutional neural network and bidirectional gated recurrent unit10.1016/j.ins.2021.02.064 ↗
66. Choromanski, K.M., Likhosherstov, V., Dohan, D., Song, X., Gane, A., Sarlos, T., Hawkins, P., Davis, J.Q., Mohiuddin, A., and Kaiser, L. (2021, January 3–7). Rethinking Attention with Performers. Proceedings of the International Conference on Learning Representations (ICLR), Virtual Event, Vienna, Austria.
67. Leng, D., Zheng, L., Wen, Y., Zhang, Y., Wu, L., Wang, J., Wang, M., Zhang, Z., He, S., and Bo, X. (2022). A benchmark study of deep learning-based multi-omics data fusion methods for cancer. Genome Biol., 23.10.1186/s13059-022-02739-2 ↗