Multi-Camera Machine Vision for Detecting and Analyzing Vehicle–Pedestrian Conflicts at Signalized Intersections: Deep Neural-Based Pose Estimation Algorithms
Source abstract
Abstract
Over the past decade, researchers have advanced traffic monitoring using surveillance cameras, unmanned aerial vehicles (UAVs), loop detectors, LiDAR, microwave sensors, and sensor fusion. These technologies effectively detect and track vehicles, enabling robust safety assessments. However, pedestrian detection remains challenging due to diverse motion patterns, varying clothing colors, occlusions, and positional differences. This study introduces an innovative approach that integrates multiple surveillance cameras at signalized intersections, regardless of their types or resolutions. Two distinct convolutional neural network (CNN)-based detection algorithms accurately track road users across multiple views. The resulting trajectories undergo analysis, smoothing, and integration, enabling detailed traffic scene reconstruction and precise identification of vehicle–pedestrian conflicts. The proposed framework achieved 97.73% detection precision and an average intersection over union (IoU) of 0.912 for pedestrians, compared to 68.36% and 0.743 with a single camera. For vehicles, it achieved 98.2% detection precision and an average IoU of 0.955, versus 58.78% and 0.516 with a single camera. These findings highlight significant improvements in detecting and analyzing traffic conflicts, enhancing the identification and mitigation of potential hazards.
Source: crossref · Quality: baseline
Research context
OpenAlex topics: Autonomous Vehicle Technology and Safety · Traffic and Road Safety
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
Affiliations
Department of Civil and Architectural Engineering and Construction Management, University of Cincinnati, 2600 Clifton Ave., Cincinnati, OH 45221, USA
Funding
Wyoming Department of Transportation · Federal Highway Administration · University of Cincinnati’s Center
References (48)
Show source-provided references
1. Federal Highway Administration, U.S. Department of Transportation (2025, June 14). Traffic Safety Facts, Available online: https://highways.dot.gov/research/research-programs/safety/intersection-safety.
2. Modeling Crash Types: New Insights into the Effects of Covariates on Crashes at Rural Intersections10.1061/(ASCE)0733-947X(2006)132:4(282) ↗
3. Effects of Automatic Emergency Braking Systems on Pedestrian Crash Risk10.1016/j.aap.2022.106686 ↗
4. Factors Propelling Fatalities during Road Crashes: A Detailed Investigation and Modelling of Historical Crash Data with Field Studies10.1016/j.heliyon.2022.e11531 ↗
5. Assessment of Crash Occurrence Using Historical Crash Data and a Random Effect Negative Binomial Model: A Case Study for a Rural State10.1177/03611981211027569 ↗
6. Analysis of Crash Data Using Quantile Regression for Counts10.1061/(ASCE)TE.1943-5436.0000650 ↗
7. Simulation of traffic conflicts at unsignalized intersections with TSC-Sim10.1016/0001-4575(94)90021-3 ↗
8. Traffic conflict standards for intersections10.1080/03081069908717634 ↗
9. Otković, I.I., Deluka-Tibljaš, A., Zečević, Đ., and Šimunović, M. (2024). Reconstructing Intersection Conflict Zones: Microsimulation-Based Analysis of Traffic Safety for Pedestrians. Infrastructures, 9.10.3390/infrastructures9120215 ↗
10. Enhancing Urban Traffic Management through YOLOv5 and DeepSORT Algorithms within Digital Twin Frameworks
11. Enhancing Occluded Pedestrian Re-Identification with the MotionBlur Data Augmentation Module
12. Amundsen, F.H., and Hydén, C. (1977). The Swedish Traffic Conflicts Technique. International Calibration Study of Traffic Conflict Techniques, Institute of Transport Economics.
13. Federal Highway Administration (FHWA) (2019). Traffic Conflict Technique for Safety and Operations—Observers Manual, U.S. Department of Transportation. Report No. FHWA-IP-88-027.
14. A MAS-Based Hierarchical Architecture for the Cooperation Control of Connected and Automated Vehicles10.1109/TVT.2022.3211733 ↗
15. Enhancing High-Speed Cruising Performance of Autonomous Vehicles through Integrated Deep Reinforcement Learning Framework10.1109/TITS.2024.3488519 ↗
16. Ismail, K.A. (2010). Application of Computer Vision Techniques for Automated Road Safety Analysis and Traffic Data Collection. [Ph.D. Thesis, University of British Columbia].
17. Simulated Traffic Conflicts: Do They Accurately Represent Field-Measured Conflicts?10.3141/2514-06 ↗
18. New Algorithms for Computing the Time-to-Collision in Freeway Traffic Simulation Models10.1155/2014/761047 ↗
19. Tracking Multiple Vehicles Using Foreground, Background and Motion Models10.1016/S0262-8856(03)00145-8 ↗
20. Tracking All Traffic—Computer Vision Algorithms for Monitoring Vehicles, Individuals, and Crowds10.1109/MRA.2005.1411416 ↗
21. Learning Patterns of Activity Using Real-Time Tracking10.1109/34.868677 ↗
22. Computer Vision Algorithms for Intersection Monitoring10.1109/TITS.2003.821212 ↗
23. Dahlkamp, H., Pece, A.E.C., Ottlik, A., and Nagel, H.-H. (September, January 30). Differential Analysis of Two Model-Based Vehicle Tracking Approaches. Proceedings of the Pattern Recognition, 26th DAGM Symposium, Tübingen, Germany.
24. Koler, D., Weber, J., and Malik, J. (2025, June 14). Robust Multiple Car Tracking with Occlusion Reasoning. UC Berkeley Working Paper No. UCB/CSD-93-780, 1993. Available online: https://escholarship.org/uc/item/49c0g7p8.
25. Tracking Video Objects in Cluttered Background10.1109/TCSVT.2005.844447 ↗
26. Saunier, N., and Sayed, T. (2006, January 7–9). A Feature-Based Tracking Algorithm for Vehicles in Intersections. Proceedings of the 3rd Canadian Conference on Computer and Robot Vision (CRV’06), Quebec, QC, Canada.
27. Monocular Pedestrian Detection: Survey and Experiments10.1109/TPAMI.2008.260 ↗
28. Pedestrian Detection: An Evaluation of the State of the Art10.1109/TPAMI.2011.155 ↗
29. Zhang, S., Benenson, R., and Schiele, B. (2017, January 21–26). CityPersons: A Diverse Dataset for Pedestrian Detection. Proceedings of the 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Honolulu, HI, USA.10.1109/CVPR.2017.474 ↗
30. Robust Real-Time Pedestrians Detection in Urban Environments with Low-Resolution Cameras10.1016/j.trc.2013.11.019 ↗
31. Antonio, J.A., and Romero, M. (2018, January 12–14). Pedestrians’ Detection Methods in Video Images: A Literature Review. Proceedings of the 2018 International Conference on Computational Science and Computational Intelligence (CSCI), Las Vegas, NV, USA.10.1109/CSCI46756.2018.00074 ↗
32. Computer Vision and Deep Learning Techniques for Pedestrian Detection and Tracking: A Survey10.1016/j.neucom.2018.01.092 ↗
33. Fully Convolutional Neural Networks for LIDAR–Camera Fusion for Pedestrian Detection in Autonomous vehicle10.1007/s11042-023-14417-x ↗
34. Beymer, D., McLauchlan, P., Coifman, B., and Malik, J. (1997, January 17–19). A real-time computer vision system for measuring traffic parameters. Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition, San Juan, PR, USA.
35. Traffic flow theory10.1109/PROC.1968.6336 ↗
36. Stauffer, C., and Grimson, W. (1999, January 23–25). Adaptive background mixture models for real-time tracking. Proceedings of the 1999 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, Fort Collins, CO, USA.
37. CitySim: A Drone-Based Vehicle Trajectory Dataset for Safety-Oriented Research and Digital Twins10.1177/03611981231185768 ↗
38. Automated Safety Diagnosis Based on Unmanned Aerial Vehicle Video and Deep Learning Algorithm10.1177/0361198120925808 ↗
39. Using Closed-Circuit Television Cameras to Analyze Traffic Safety at Intersections Based on Vehicle Key Points Detection10.1016/j.aap.2022.106794 ↗
40. Automated Vehicle to Vehicle Conflict Analysis at Signalized Intersections by Camera and LiDAR Sensor Fusion10.1177/03611981221128806 ↗
41. Parker, M.R., and Zegeer, C.V. (1989). Traffic Conflict Techniques for Safety and Operations: Observers Manual, United States Federal Highway Administration. No. FHWA-IP-88-027, NCP 3A9C0093.
42. Mohamed, A., and Ahmed, M.M. (2024, January 15–18). Pedestrian Tracking at Signalized Intersections Leveraging Multi-Camera Field of Views Using Convolutional Neural Network-Based Pose Estimation Algorithm. Proceedings of the International Conference on Transportation and Development (ICTD), Atlanta, Georgia.10.1061/9780784485514.043 ↗
43. Wang, C.-Y., Bochkovskiy, A., and Liao, H.-Y.M. (2022). YOLOv7: Trainable Bag-of-Freebies Sets New State-of-the-Art for Real-Time Object Detectors. arXiv.10.1109/CVPR52729.2023.00721 ↗
44. Zhou, X., Wang, D., and Krähenbühl, P. (2019). Objects as Points. arXiv.
45. Kreiss, S., Bertoni, L., and Alahi, A. (2019). PifPaf: Composite Fields for Human Pose Estimation. arXiv.10.1109/CVPR.2019.01225 ↗
46. Kreiss, S., Bertoni, L., and Alahi, A. (2021). OpenPifPaf: Composite Fields for Semantic Keypoint Detection and Spatio-Temporal Association. arXiv.10.1109/TITS.2021.3124981 ↗
47. Mohamed, A., Li, L., and Ahmed, M.M. (2024, January 15–18). Automated Traffic Safety Assessment Tool Utilizing Monocular 3D Convolutional Neural Network Based Detection Algorithm at Signalized Intersections. Proceedings of the International Conference on Transportation and Development (ICTD), Atlanta, GA, USA.10.1061/9780784485514.040 ↗
48. Towards rapid safety assessment of signalized intersections: An in-depth comparison of computer vision algorithms