journal article·2023Open access

Convolutional Neural Network for Overcrowded Public Transportation Pickup Truck Detection

Jakkrit Suttanuruk, Sajjakaj Jomnonkwao, Vatanavong Ratanavaraha, Sarunya Kanjanawattana

Computers, Materials & Continua· Volume 74· Issue 3

Abstract

Thailand has been on the World Health Organization (WHO)’s notorious deadliest road list for several years, currently ranking eighth on the list. Among all types of road fatalities, pickup trucks converted into vehicles for public transportation are found to be the most problematic due to their high occupancy and minimal passenger safety measures, such as safety belts. Passenger overloading is illegal, but it is often overlooked. The country often uses police checkpoints to enforce traffic laws. However, there are few or no highway patrols to apprehend offending drivers. Therefore, in this study, we propose the use of existing closed-circuit television (CCTV) traffic cameras with deep learning techniques to classify overloaded public transport pickup trucks (PTPT) to help reduce accidents. As the said type of vehicle and its passenger occupancy characteristics are unique, a new model is deemed necessary. The contributions of this study are as follows: First, we used various state-of-the-art object detection YOLOv5 (You Only Look Once) models to obtain the optimum overcrowded model pretrained on our manually labeled dataset. Second, we made our custom dataset available. Upon investigation, we compared all the latest YOLOv5 models and discovered that the YOLOv5L yielded the optimal performance with a mean average precision (mAP) of 95.1% and an inference time of 33 frames per second (FPS) on a graphic processing unit (GPU). We aim to deploy the selected model on traffic control computers to alert the police of such passenger-overloading violations. The use of a chosen algorithm is feasible and is expected to help reduce traffic-related fatalities.
Source: openalex_inverted_index · Quality: baseline

Research context

OpenAlex topics: Advanced Neural Network Applications · Vehicle License Plate Recognition · Autonomous Vehicle Technology and Safety

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

References (36)

Show source-provided references
1. World Health Organization, “Global status report on road safety,” Geneva, Switzerland, 7 November 2018.
2. Development model of participation to prevent road traffic accident by engaging multilateral networks in lamphun province
3. Department of Land Transportation, “Transport statistics report in 2021,” Bangkok, Thailand, 2021.
4. A. M. Kayid, “Performance of cpus/gpus for deep learning workloads,” Research report, Faculty of Media Engineering and Technology, The German University in Cairo, Cairo, Egypt, 2018.
5. Performance analysis of google colaboratory as a tool for accelerating deep learning applications10.1109/ACCESS.2018.2874767 ↗
6. C. -Y. Wang, I. -H. Yeh and H. -Y. M. Liao, “You only learn one representation: Unified network for multiple tasks,” arXiv:2105.04206, pp. 1–11, 2021.
7. Z. Ge, S. Liu, F. Wang, Z. Li and J. Sun, “Yolox: Exceeding yolo series in 2021,” arXiv:2107.08430, pp. 1–7, 2021.
8. On the performance of one-stage and two-stage object detectors in autonomous vehicles using camera data10.3390/rs13010089 ↗
9. Comparison of faster-rcnn, yolo, and ssd for real-time vehicle type recognition
10. Real-time and deep learning based vehicle detection and classification using pixel-wise code exposure measurements10.3390/electronics9061014 ↗
11. Comparing yolov3, yolov4 and yolov5 for autonomous landing spot detection in faulty uavs10.3390/s22020464 ↗
12. A. Paszke, S. Gross, F. Massa, A. Lerer, J. Bradbury et al., “Pytorch: An imperative style, high-performance deep learning library,” arXiv:1912.01703, pp. 1–12, 2019.
13. N. Ofir and J. -C. Nebel, “Classic versus deep learning approaches to address computer vision challenges,” arXiv:2101.09744, pp. 1–6, 2021.
14. A computational approach to edge detection10.1109/TPAMI.1986.4767851 ↗
15. Vehicle detection and classification system for traffic video surveillance
16. Vehicle classification with deep learning
17. Automatic vehicle type classification with convolutional neural networks
18. Atrip: Architecture for traffic classification based on image processing10.3390/vehicles2020017 ↗
19. Tuning of classifiers to speed-up detection of pedestrians in infrared images10.3390/s20164363 ↗
20. Tree-cnn: A hierarchical deep convolutional neural network for incremental learning10.1016/j.neunet.2019.09.010 ↗
21. Vehicle detection using deep learning technique in tunnel road environments10.3390/sym12122012 ↗
22. Moving object detection based on background compensation and deep learning10.3390/sym13010001 ↗
23. Native vehicles classification on Bangladeshi roads using cnn with transfer learning
24. WZMIAOMIAO, “Yolov5 (6.0/6.1) brief summary #6998,” Github. https://github.com/ultralytics/yolov5/issues/6998 (accessed on 03 March 2022).
25. J. Redmon, S. Divvala, R. Girshick and A. Farhadi, “You only look once: Unified, real-time object detection,” arXiv:1506.02640, pp. 1–10, 2015.10.1109/CVPR.2016.91 ↗
26. Batch normalization accelerating deep network training by reducing internal covariate shift
27. J. Redmon and A. Farhadi, “Yolo9000: Better, faster, stronger,” arXiv:1612.08242, pp. 1–9, 2016.10.1109/CVPR.2017.690 ↗
28. J. Redmon and A. Farhadi, “Yolov3: An incremental improvement,” arXiv:1804.02767, pp. 1–6, 2018.
29. A. Bochkovskiy, C. -Y. Wang and H. -Y. M. Liao, “Yolov4: Optimal speed and accuracy of object detection,” arXiv:2004.10934, pp. 1–17, 2020.
30. G. Jocher. “V4.0-nn.Silu() activations, weights & biases logging, pytorch hub integration.” https://github.com/ultralytics/yolov5/releases/tag/v4.0 (accessed on 07 Jan 2022).
31. B. Xu, N. Wang, T. Chen and M. Li, “Empirical evaluation of rectified activations in convolutional network,” arXiv:1505.00853, pp. 1–5, 2015.
32. A. Howard, M. Sandler, G. Chu, L. -C. Chen, B. Chen et al., “Searching for mobilenetv3,” arXiv:1905.02244, pp. 1–11, 2019.10.1109/ICCV.2019.00140 ↗
33. S. Elfwing, E. Uchibe and K. Doya, “Sigmoid-weighted linear units for neural network function approximation in reinforcement learning,” arXiv:1702.03118, pp. 1–18, 2017.10.1016/j.neunet.2017.12.012 ↗
34. WZMIAOMIAO, “V6.1-tensorrt, tensorflow edge tpu and openvino export and inference,” Github. https://github.com/ultralytics/yolov5/releases (accessed on 11 Aug 2022).10.26507/paper.2300 ↗
35. Thairath Online. Arrest of a minibus driving across a traffic lane in nakhon ratchasima claiming to hurry (in thai), Youtube. https://youtu.be/KZSGL1kDedE, September 22, 2019.
36. Thairath Online. Establishment of an ad hoc working group to arrest song-taews equipped with audio equipment (in thai), Youtube. https://youtu.be/ouJskQP6bDw, October 11, 2016.