journal article·2023Open access

Intelligent Traffic Surveillance through Multi-Label Semantic Segmentation and Filter-Based Tracking

Asifa Mehmood Qureshi, Nouf Abdullah Almujally, Saud S. Alotaibi, Mohammed Hamad Alatiyyah, Jeongmin Park

Computers, Materials & Continua· Volume 76· Issue 3

Abstract

Road congestion, air pollution, and accident rates have all increased as a result of rising traffic density and worldwide population growth. Over the past ten years, the total number of automobiles has increased significantly over the world. In this paper, a novel method for intelligent traffic surveillance is presented. The proposed model is based on multilabel semantic segmentation using a random forest classifier which classifies the images into five classes. To improve the results, mean-shift clustering was applied to the segmented images. Afterward, the pixels given the label for the vehicle were extracted and blob detection was applied to mark each vehicle. For the validation of each detection, a vehicle verification method based on the structural similarity index is proposed. The tracking of vehicles across the image frames is done using the Identifier (ID) assignment technique and particle filter. Also, vehicle counting in each frame along with trajectory estimation was done for each object. Our proposed system demonstrated a remarkable vehicle detection rate of 0.83 over Vehicle Aerial Imaging from Drone (VAID), 0.86 over AU-AIR, and 0.75 over the Unmanned Aerial Vehicle Benchmark Object Detection and Tracking (UAVDT) dataset during the experimental evaluation. The proposed system can be used for several purposes, such as vehicle identification in traffic, traffic density estimation at intersections, and traffic congestion sensing on a road.
Source: openalex_inverted_index · Quality: baseline

Research context

OpenAlex topics: Video Surveillance and Tracking Methods · Traffic Prediction and Management Techniques · Fire Detection and Safety Systems

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

References (35)

Show source-provided references
1. Real time classification and tracking of multiple vehicles in highways10.1016/j.patrec.2005.01.010 ↗
2. Video object tracking using adaptive Kalman filter10.1016/j.jvcir.2006.03.004 ↗
3. An intelligent framework for recognizing social human-object interactions contextual scene understanding10.32604/cmc.2022.025671 ↗
4. Semantic recognition of human-object interactions via Gaussian-based elliptical modeling and pixel-level labeling10.1109/ACCESS.2021.3101716 ↗
5. A vehicle detection algorithm based on three-frame differencing and background subtraction
6. Scene-aware deep networks for semantic segmentation of images10.1109/ACCESS.2019.2918700 ↗
7. An unmanned aerial vehicle detection algorithm based on semantic segmentation and visual attention mechanism
8. AirCamRTM: Enhancing vehicle detection for efficient aerial camera-based road traffic monitoring
9. Efficient vehicle detection and tracking strategy in aerial videos by employing morphological operations and feature points motion analysis10.1007/s11042-020-09242-5 ↗
10. Edge computing driven low-light image dynamic enhancement for object detection
11. Moving object detection in top-view aerial videos improved by image stacking10.1117/1.OE.56.8.083102 ↗
12. Particle filter-based vehicle tracking via HOG features after image stabilisation in intelligent drive system10.1049/iet-its.2018.5334 ↗
13. Monitoring and surveillance of urban road traffic using low altitude drone images: A deep learning approach10.1007/s11042-021-11146-x ↗
14. Vehicle detection in aerial imaginary using a miniature CNN architecture
15. Deep learning approach for car detection in UAV imagery10.3390/rs9040312 ↗
16. Real-time detection, tracking and classification of multiple moving objects in UAV videos
17. Maximum entropy scaled super pixels segmentation for multi-object detection and scene recognition via deep belief network
18. Automated sustainable multi-object segmentation and recognition via modified sampling consensus and kernel sliding perceptron10.3390/sym12111928 ↗
19. Scene semantic recognition based on modified fuzzy C-mean and maximum entropy using object-to-object relations10.1109/ACCESS.2021.3058986 ↗
20. Improved watershed transform for medical image segmentation using prior information10.1109/TMI.2004.824224 ↗
21. Improve semantic segmentation of remote sensing images with K-mean pixel clustering: A semantic segmentation post-processing method based on k-means clustering
22. Smart traffic monitoring through pyramid pooling vehicle detection and filter-based tracking on aerial images10.1109/ACCESS.2023.3234281 ↗
23. Comparisions of robert, prewitt, sobel operator based edge detection methods for real time uses on FPGA
24. Mean shift-based clustering10.1016/j.patcog.2007.02.006 ↗
25. An operational system for estimating road traffic information from aerial images10.3390/rs61111315 ↗
26. Image quality assessment through FSIM, SSIM, MSE and PSNR—A comparative study10.4236/jcc.2019.73002 ↗
27. ORB: An efficient alternative to SIFT or SURF
28. Target tracking via particle filter and convolutional network10.1155/2018/5381962 ↗
29. Vehicle detection and tracking using Kalman filter over Aerial images
30. AU-AIR: A multi-modal unmanned aerial vehicle dataset for low altitude traffic surveillance
31. The unmanned aerial vehicle benchmark: Object detection, tracking and baseline10.1007/s11263-019-01266-1 ↗
32. Performance comparison of small object detection algorithms of UAV based aerial images
33. VAID: An aerial image dataset for vehicle detection and classification10.1109/ACCESS.2020.3040290 ↗
34. D2DET: Towards high quality object detection and instance segmentation
35. Multiple vehicle detection and tracking in highway traffic surveillance video based on sift feature matching