A Review of Road Surface Anomaly Detection and Classification Systems Based on Vibration-Based Techniques
Source abstract
Abstract
Road surfaces suffer from sources of deterioration, such as weather conditions, constant usage, loads, and the age of the infrastructure. These sources of decay generate anomalies that could cause harm to vehicle users and pedestrians and also develop a high cost to repair the irregularities. These drawbacks have motivated the development of systems that automatically detect and classify road anomalies. This study presents a narrative review focused on road surface anomaly detection and classification based on vibration-based techniques. Three methodologies were surveyed: threshold-based methods, feature extraction techniques, and deep learning techniques. Furthermore, datasets, signals, preprocessing steps, and feature extraction techniques are also presented. The results of this review show that road surface anomaly detection and classification performed through vibration-based methods have achieved relatively high performance. However, there are challenges related to the reproduction and heterogeneity of the results that have been reported that are influenced by the limited testing conditions, sample size, and lack of publicly available datasets. Finally, there is potential to standardize the features computed through the time or frequency domains and evaluate and compare the diverse set of settings of time-frequency methods used for feature extraction and signal representation.
Source: crossref · Quality: baseline
Research context
OpenAlex topics: Infrastructure Maintenance and Monitoring · Anomaly Detection Techniques and Applications · Traffic Prediction and Management Techniques
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
Affiliations
Tecnologico de Monterrey, School of Engineering and Sciences, Mexico City 14380, Mexico
Funding
Tecnologico de Monterrey · National Council for Science and Technology (CONACYT)
References (84)
Show source-provided references
1. A deep learning approach to automatic road surface monitoring and pothole detection10.1007/s00779-019-01234-z ↗
2. Effect of combining algorithms in smartphone based pothole detection10.1007/s42947-020-0033-0 ↗
3. Road anomaly detection through deep learning approaches10.1109/ACCESS.2020.3004590 ↗
4. Seraj, F., Zwaag, B.J.v.d., Dilo, A., Luarasi, T., and Havinga, P. (2015). RoADS: A road pavement monitoring system for anomaly detection using smart phones. Big Data Analytics in the Social and Ubiquitous Context, Springer.10.1007/978-3-319-29009-6_7 ↗
5. Celaya-Padilla, J.M., Galván-Tejada, C.E., López-Monteagudo, F.E., Alonso-González, O., Moreno-Báez, A., Martínez-Torteya, A., Galván-Tejada, J.I., Arceo-Olague, J.G., Luna-García, H., and Gamboa-Rosales, H. (2018). Speed bump detection using accelerometric features: A genetic algorithm approach. Sensors, 18.10.3390/s18020443 ↗
6. Queiroz, C.A., and Gautam, S. (1992). Road Infrastructure and Economic Development: Some Diagnostic Indicators, World Bank Publications.
7. Importance of road infrastructure in the economic development and competitiveness
8. Towards a practical crowdsensing system for road surface conditions monitoring10.1109/JIOT.2018.2807408 ↗
9. E17 Committee (2020). Practice for Roads and Parking Lots Pavement Condition Index Surveys, ASTM International. Technical Report.
10. Sattar, S., Li, S., and Chapman, M. (2018). Road surface monitoring using smartphone sensors: A review. Sensors, 18.10.3390/s18113845 ↗
11. Developing a near real-time road surface anomaly detection approach for road surface monitoring10.1016/j.measurement.2021.109990 ↗
12. Martinelli, A., Meocci, M., Dolfi, M., Branzi, V., Morosi, S., Argenti, F., Berzi, L., and Consumi, T. (2022). Road Surface Anomaly Assessment Using Low-Cost Accelerometers: A Machine Learning Approach. Sensors, 22.10.3390/s22103788 ↗
13. Shaghlil, N., and Khalafallah, A. (2018, January 2–4). Automating highway infrastructure maintenance using unmanned aerial vehicles. Proceedings of the Construction Research Congress, New Orleans, LA, USA.10.1061/9780784481295.049 ↗
14. Evaluation of detection approaches for road anomalies based on accelerometer readings—Addressing who’s who10.1109/TITS.2017.2773084 ↗
15. Ganguly, B., Dey, D., and Munshi, S. (2022). An Unsupervised Learning Approach for Road Anomaly Segmentation Using RGB-D Sensor for Advanced Driver Assistance System. IEEE Trans. Intell. Transp. Syst., 1–12.10.1109/TITS.2022.3164847 ↗
16. Kim, Y.M., Kim, Y.G., Son, S.Y., Lim, S.Y., Choi, B.Y., and Choi, D.H. (2022). Review of Recent Automated Pothole-Detection Methods. Appl. Sci., 12.10.3390/app12115320 ↗
17. Becoming Smarter at Characterizing Potholes and Speed Bumps from Smartphone Data—Introducing a Second-Generation Inference Problem10.1109/TMC.2019.2947443 ↗
18. How to get best predictions for road monitoring using machine learning techniques10.7717/peerj-cs.941 ↗
19. Tian, B., Yuan, Y., Zhou, H., and Yang, Z. (2020). Pavement management utilizing mobile crowd sensing. Adv. Civ. Eng., 2020.10.1155/2020/4192602 ↗
20. A Review on Negative Road Anomaly Detection Methods10.1109/ACCESS.2020.2982220 ↗
21. A fused method of machine learning and dynamic time warping for road anomalies detection10.1109/TITS.2020.3016288 ↗
22. Nguyen, V.K., Renault, É., and Milocco, R. (2019). Environment monitoring for anomaly detection system using smartphones. Sensors, 19.10.3390/s19183834 ↗
23. QDetect: Time series querying based road anomaly detection10.1109/ACCESS.2020.2994461 ↗
24. A review on evaluation metrics for data classification evaluations10.5121/ijdkp.2015.5201 ↗
25. A review of machine learning in hypertension detection and blood pressure estimation based on clinical and physiological data10.1016/j.bspc.2021.102813 ↗
26. Wu, C., Wang, Z., Hu, S., Lepine, J., Na, X., Ainalis, D., and Stettler, M. (2020). An automated machine-learning approach for road pothole detection using smartphone sensor data. Sensors, 20.10.3390/s20195564 ↗
27. A mobile application for road surface quality control: UNIquALroad10.1016/j.sbspro.2012.09.828 ↗
28. Rishiwal, V., and Khan, H. (June, January 30). Automatic pothole and speed breaker detection using android system. Proceedings of the 2016 39th International Convention on Information and Communication Technology, Electronics and Microelectronics (MIPRO), Opatija, Croatia.10.1109/MIPRO.2016.7522334 ↗
29. Mednis, A., Strazdins, G., Zviedris, R., Kanonirs, G., and Selavo, L. (2011, January 27–29). Real time pothole detection using android smartphones with accelerometers. Proceedings of the 2011 International conference on distributed computing in sensor systems and workshops (DCOSS), Casa Convalescencia, Barcelona.10.1109/DCOSS.2011.5982206 ↗
30. Toward crowdsourcing-based road pavement monitoring by mobile sensing technologies10.1109/TITS.2014.2378511 ↗
31. Li, X., Huo, D., Goldberg, D.W., Chu, T., Yin, Z., and Hammond, T. (2019). Embracing crowdsensing: An enhanced mobile sensing solution for road anomaly detection. ISPRS Int. J. Geo-Inf., 8.10.3390/ijgi8090412 ↗
32. Toward practical crowdsourcing-based road anomaly detection with scale-invariant feature10.1109/ACCESS.2019.2918754 ↗
33. Gareth, J., Daniela, W., Trevor, H., and Robert, T. (2013). An Introduction to Statistical Learning: With Applications in R, Spinger.
34. Wolpert, D.H. (2002). The supervised learning no-free-lunch theorems. Soft Comput. Ind., 25–42.10.1007/978-1-4471-0123-9_3 ↗
35. Bustamante-Bello, R., García-Barba, A., Arce-Saenz, L.A., Curiel-Ramirez, L.A., Izquierdo-Reyes, J., and Ramirez-Mendoza, R.A. (2022). Visualizing Street Pavement Anomalies through Fog Computing V2I Networks and Machine Learning. Sensors, 22.10.3390/s22020456 ↗
36. Smart pothole detection system using vehicle-mounted sensors and machine learning10.1007/s13349-019-00323-0 ↗
37. Smartphone-based road manhole cover detection and classification10.1016/j.autcon.2022.104344 ↗
38. Julio-Rodríguez, J.d.C., Rojas-Ruiz, C.A., Santana-Díaz, A., Bustamante-Bello, M.R., and Ramirez-Mendoza, R.A. (2022). Environment Classification Using Machine Learning Methods for Eco-Driving Strategies in Intelligent Vehicles. Appl. Sci., 12.10.3390/app12115578 ↗
39. Scale and translation-invariance for novel objects in human vision10.1038/s41598-019-57261-6 ↗
40. Baldini, G., Giuliani, R., and Geib, F. (2020). On the Application of Time Frequency Convolutional Neural Networks to Road Anomalies’ Identification with Accelerometers and Gyroscopes. Sensors, 20.10.3390/s20226425 ↗
41. Tiwari, S., Bhandari, R., and Raman, B. (2020, January 15–17). Roadcare: A deep-learning based approach to quantifying road surface quality. Proceedings of the 3rd ACM SIGCAS Conference on Computing and Sustainable Societies, Guayaquil, Ecuador.10.1145/3378393.3402284 ↗
42. A machine learning approach to road surface anomaly assessment using smartphone sensors10.1109/JSEN.2019.2952857 ↗
43. Road surface type classification based on inertial sensors and machine learning10.1007/s00607-021-00914-0 ↗
44. A three-tier road condition classification system using a spiking neural network model
45. A multi-spiking neural network learning model for data classification10.1109/ACCESS.2020.2985257 ↗
46. Opening the black box: The promise and limitations of explainable machine learning in cardiology10.1016/j.cjca.2021.09.004 ↗
47. Behaviour analysis of multilayer perceptrons with multiple hidden neurons and hidden layers10.7763/IJCTE.2011.V3.328 ↗
48. New road anomaly detection and characterization algorithm for autonomous vehicles10.1016/j.aci.2018.05.002 ↗
49. Learning roadway surface disruption patterns using the bag of words representation10.1109/TITS.2017.2662483 ↗
50. Nonuniform sampling and spectral aliasing10.1016/j.jmr.2009.04.006 ↗
51. Meyers, R.A. (2002). Encyclopedia of Physical Science and Technology, Academic.
52. Goldstein, H., Poole, C., and Safko, J. (2022, September 05). Classical Mechanics. Available online: https://physicsgg.files.wordpress.com/2014/12/classical_mechanics_goldstein_3ed.pdf.
53. Passaro, V.M., Cuccovillo, A., Vaiani, L., De Carlo, M., and Campanella, C.E. (2017). Gyroscope technology and applications: A review in the industrial perspective. Sensors, 17.10.3390/s17102284 ↗
54. Cabral, F.S., Pinto, M., Mouzinho, F.A., Fukai, H., and Tamura, S. (August, January 31). An automatic survey system for paved and unpaved road classification and road anomaly detection using smartphone sensor. Proceedings of the 2018 IEEE International Conference on Service Operations and Logistics, and Informatics (SOLI), Singapore.10.1109/SOLI.2018.8476788 ↗
55. Semmlow, J. (2011). Signals and Systems for Bioengineers: A MATLAB-Based Introduction, Academic Press.
56. Andrades, I.S., Castillo Aguilar, J.J., García, J.M.V., Carrillo, J.A.C., and Lozano, M.S. (2020). Low-cost road-surface classification system based on self-organizing maps. Sensors, 20.10.3390/s20216009 ↗
57. Proakis, J.G., and Manolakis, D.G. (2004). Digital Signal Processing, PHI Publication.
58. Historical notes on the fast Fourier transform10.1109/PROC.1967.5959 ↗
59. Alim, S.A., and Rashid, N.K.A. (2018). Some Commonly Used Speech Feature Extraction Algorithms, IntechOpen.
60. Gupta, G.S., Bhatnagar, M., Mohanta, D.K., and Sinha, R.K. (2020). Prototype algorithm for three-class motor imagery data classification: A step toward development of human–computer interaction-based neuro-aid. Smart Biosensors in Medical Care, Elsevier.10.1016/B978-0-12-820781-9.00001-2 ↗
61. Feature extraction from smartphone inertial signals for human activity segmentation10.1016/j.sigpro.2015.09.029 ↗
62. Perceptual linear predictive (PLP) analysis of speech10.1121/1.399423 ↗
63. Cabral, F.S., Fukai, H., and Tamura, S. (2019). Feature extraction methods proposed for speech recognition are effective on road condition monitoring using smartphone inertial sensors. Sensors, 19.10.3390/s19163481 ↗
64. Jaeger, D., and Jung, R. (2013). Time-Frequency Analysis. Encyclopedia of Computational Neuroscience, Springer.10.1007/978-1-4614-7320-6 ↗
65. Brunton, S.L., and Kutz, J.N. (2019). Data-Driven Science and Engineering: Machine Learning, Dynamical Systems, and Control, Cambridge University Press.10.1017/9781108380690 ↗
66. Sequences with minimal time–frequency uncertainty10.1016/j.acha.2014.07.001 ↗
67. Rhif, M., Ben Abbes, A., Farah, I.R., Martínez, B., and Sang, Y. (2019). Wavelet transform application for/in non-stationary time-series analysis: A review. Appl. Sci., 9.10.3390/app9071345 ↗
68. Wavelet transform for real-time detection of action potentials in neural signals10.3389/fneng.2011.00007 ↗
69. Fugal, D.L. (2009). Conceptual Wavelets in Digital Signal Processing: An In-Depth, Practical Approach for the Non-Mathematician, Space & Signals Technical Pub.
70. Mallat, S. (1999). A Wavelet Tour of Signal Processing, Elsevier.10.1016/B978-012466606-1/50008-8 ↗
71. Wavelet analysis and interpretation of road roughness10.1061/(ASCE)0733-947X(2005)131:2(120) ↗
72. Kohavi, R. (1995, January 19–21). A study of cross-validation and bootstrap for accuracy estimation and model selection. Proceedings of the Ijcai, Montreal, QC, Canada.
73. A comprehensive survey on transfer learning10.1109/JPROC.2020.3004555 ↗
74. Offline signature verification using deep learning convolutional neural network (CNN) architectures GoogLeNet inception-v1 and inception-v310.1016/j.procs.2019.11.147 ↗
75. Krizhevsky, A., Sutskever, I., and Hinton, G.E. (2012). Imagenet classification with deep convolutional neural networks. Adv. Neural Inf. Process. Syst., 25.
76. He, K., Zhang, X., Ren, S., and Sun, J. (2016, January 27–30). Deep residual learning for image recognition. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Las Vegas, NV, USA.10.1109/CVPR.2016.90 ↗
77. Huang, G., Liu, Z., Van Der Maaten, L., and Weinberger, K.Q. (2017, January 21–26). Densely connected convolutional networks. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Honolulu, HI, USA.10.1109/CVPR.2017.243 ↗
78. Do machine learning platforms provide out-of-the-box reproducibility?10.1016/j.future.2021.06.014 ↗
79. Efficacy of Hilbert and wavelet transforms for time-frequency analysis
80. Feature selection in machine learning: A new perspective10.1016/j.neucom.2017.11.077 ↗
81. Silva, N., Shah, V., Soares, J., and Rodrigues, H. (2018). Road anomalies detection system evaluation. Sensors, 18.10.3390/s18071984 ↗
82. A study on the use of smartphones for road roughness condition estimation
83. Seraj, F., Zhang, K., Turkes, O., Meratnia, N., and Havinga, P.J. (2015, January 9–11). A smartphone based method to enhance road pavement anomaly detection by analyzing the driver behavior. Proceedings of the 2015 ACM International Joint Conference on Pervasive and Ubiquitous Computing and 2015 ACM International Symposium on Wearable Computers, Umeda, Osaka.10.1145/2800835.2800981 ↗
84. Boashash, B. (2015). Time-Frequency Signal Analysis and Processing: A Comprehensive Reference, Academic Press.