Deep Learning-Based Consistent Object Detection in Distance on Highly Perspective Region
Source abstract
Abstract
CCTVs are commonly used for traffic monitoring and accident detection, but their images suffer from severe perspective distortion causing object size reduction with distance. This issue is exacerbated in tunnel CCTVs, positioned low due to space constraints, leading to challenging object detection, especially for distant small objects, due to perspective effects. To address this, this study proposes a solution involving a region of interest setup and an inverse perspective transformation technique. The transformed images, achieved through this technique, enlarge distant objects, maintaining object detection performance and appearance velocity across distances. To validate this, artificial CCTV images were generated in a virtual tunnel environment, creating original and transformed image datasets under identical conditions. Comparisons were made between the appearance velocity and object size of individual vehicles and for deep learning model performance with multiple moving vehicles. The evaluation was conducted across four distance intervals (50 m to 200 m) from the tunnel CCTV location. The results reveal that the model using original images experiences a significant decline in object detection performance beyond 100 m, while the transformed image-based model maintains a consistent performance up to the distance of 200 m.
Source: crossref · Quality: baseline
Research context
OpenAlex topics: Advanced Neural Network Applications · Infrastructure Maintenance and Monitoring · Video Surveillance and Tracking Methods
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
Affiliations
Department of Smart City and Construction Convergence, KICT School, University of Science & Technology, Goyang 10223, Gyeonggi, Republic of Korea
Department of Future & Smart Construction Research, Korea Institute of Civil Engineering and Building Technology (KICT), Goyang 10223, Gyeonggi, Republic of Korea
Funding
Department of Future & Smart Construction Research of the Korea Institute of Civil Engineering and Building Technology
References (52)
Show source-provided references
1. (2023, July 14). Guideline of Installation and Management of Disaster Prevention Facilities on Road Tunnels. Available online: https://www.law.go.kr/%ED%96%89%EC%A0%95%EA%B7%9C%EC%B9%99/%EB%8F%84%EB%A1%9C%ED%84%B0%EB%84%90%EB%B0%A9%EC%9E%AC%EC%8B%9C%EC%84%A4%EC%84%A4%EC%B9%98%EB%B0%8F%EA%B4%80%EB%A6%AC%EC%A7%80%EC%B9%A8/%28308%2C20200831%29.
2. Lönnermark, A., Ingason, H., and Kim, H.K. (2007). Comparison and Review of Safety Design Guidelines for Road Tunnels, SP Technical Research Institute of Sweden.
3. Use of CCTV to Determine Road Accident Factors in Urban Areas10.1016/j.aap.2006.05.008 ↗
4. Trinishia, A.J., and Asha, S. (2022). Intelligent Computing and Applications: Proceedings of ICDIC 2020, Springer.
5. Amala Ruby Florence, J., and Kirubasri, G. (2019, January 1–2). Accident Detection System Using Deep Learning. Proceedings of the International Conference on Computational Intelligence in Data Science, Bangalore, India.
6. Artificial Intelligence-Based Surveillance System for Railway Crossing Traffic10.1109/JSEN.2020.3031861 ↗
7. A Deep-Learning-Based Computer Vision Solution for Construction Vehicle Detection10.1111/mice.12530 ↗
8. Guo, Y., Xu, Y., and Li, S. (2020). Dense Construction Vehicle Detection Based on Orientation-Aware Feature Fusion Convolutional Neural Network. Autom. Constr., 112.10.1016/j.autcon.2020.103124 ↗
9. Road Traffic Accidents in Singapore Expressway Tunnels10.1016/j.tust.2013.09.002 ↗
10. Studies on Traffic Accidents in Norwegian Road Tunnels10.1016/S0886-7798(00)00024-9 ↗
11. Risk Factors Affecting the Severity of Traffic Accidents at Shanghai River-Crossing Tunnel10.1080/15389588.2015.1051222 ↗
12. Sun, H., Wang, Q., Zhang, P., Zhong, Y., and Yue, X. (2019). Spatialtemporal Characteristics of Tunnel Traffic Accidents in China from 2001 to Present. Adv. Civ. Eng., 2019.10.1155/2019/4536414 ↗
13. Pflugfelder, R., Bischof, H., Dominguez, G.F., Nolle, M., and Schwabach, H. (2005, January 16). Influence of Camera Properties on Image Analysis in Visual Tunnel Surveillance. Proceedings of the 2005 IEEE Intelligent Transportation Systems, Vienna, Austria.
14. Tong, K., Wu, Y., and Zhou, F. (2020). Recent Advances in Small Object Detection Based on Deep Learning: A Review. Image Vis. Comput., 97.10.1016/j.imavis.2020.103910 ↗
15. (2023, July 14). Road Structure and Facility Standards Rules. Available online: https://www.law.go.kr/%EB%B2%95%EB%A0%B9/%EB%8F%84%EB%A1%9C%EC%9D%98%EA%B5%AC%EC%A1%B0%E3%86%8D%EC%8B%9C%EC%84%A4%EA%B8%B0%EC%A4%80%EC%97%90%EA%B4%80%ED%95%9C%EA%B7%9C%EC%B9%99.
16. (2023, July 09). ROAD PLUS. Available online: http://www.roadplus.co.kr/.
17. Min, Z., Ying, M., and Dihua, S. (2019, January 3–5). Tunnel Pedestrian Detection Based on Super Resolution and Convolutional Neural Network. Proceedings of the 2019 Chinese Control and Decision Conference (CCDC), Nanchang, China.10.1109/CCDC.2019.8833181 ↗
18. Geometry constrained correlation adjustment for stereo reconstruction in 3D optical deformation measurements10.1364/OE.392248 ↗
19. Inverse Perspective Mapping Simplifies Optical Flow Computation and Obstacle Detection10.1007/BF00201978 ↗
20. Muad, A.M., Hussain, A., Samad, S.A., Mustaffa, M.M., and Majlis, B.Y. (2004, January 24). Implementation of inverse perspective mapping algorithm for the development of an automatic lane tracking system. Proceedings of the 2004 IEEE Region 10 Conference TENCON, Chiang Mai, Thailand.10.1109/TENCON.2004.1414393 ↗
21. Nieto, M., Salgado, L., Jaureguizar, F., and Cabrera, J. (2007, January 13–15). Stabilization of inverse perspective mapping images based on robust vanishing point estimation. Proceedings of the 2007 IEEE Intelligent Vehicles Symposium, Istanbul, Turkey.10.1109/IVS.2007.4290133 ↗
22. Bruls, T., Porav, H., Kunze, L., and Newman, P. (2019, January 9–12). The right (angled) perspective: Improving the understanding of road scenes using boosted inverse perspective mapping. Proceedings of the 2019 IEEE Intelligent Vehicles Symposium (IV), Paris, France.10.1109/IVS.2019.8814056 ↗
23. Bird’s Eye View Localization of Surrounding Vehicles: Longitudinal and Lateral Distance Estimation with Partial Appearance10.1016/j.robot.2018.11.008 ↗
24. Stereo Inverse Perspective Mapping: Theory and Applications10.1016/S0262-8856(97)00093-0 ↗
25. Liu, Z., Wang, S., and Ding, X. (2012, January 16–18). ROI Perspective Transform Based Road Marking Detection and Recognition. Proceedings of the 2012 International Conference on Audio, Language and Image Processing, Shanghai, China.10.1109/ICALIP.2012.6376731 ↗
26. Precise Top View Image Generation without Global Metric Information10.1093/ietisy/e91-d.7.1893 ↗
27. A New Approach to High-Accuracy Road Orthophoto Mapping Based on Wavelet Transform
28. Real-Time Lane Violation Detection System Using Feature Tracking10.3745/KIPSTB.2011.18B.4.201 ↗
29. Luo, L.-B., Koh, I.-S., Min, K.-Y., Wang, J., and Chong, J.-W. (2010, January 9–13). Low-Cost Implementation of Bird’s-Eye View System for Camera-on-Vehicle. Proceedings of the 2010 Digest of Technical Papers International Conference on Consumer Electronics (ICCE), Las Vegas, NV, USA.
30. Galeano, D.A.B., Devy, M., Boizard, J.-L., and Filali, W. (2011, January 11–14). Real-Time Architecture on FPGA for Obstacle Detection Using Inverse Perspective Mapping. Proceedings of the 2011 18th IEEE International Conference on Electronics, Circuits, and Systems, Beirut, Lebanon.10.1109/ICECS.2011.6122392 ↗
31. Dubrofsky, E. (2009). Homography Estimation, Diplomová Práce; Univerzita Britské Kolumbie.
32. Juliani, A., Berges, V.-P., Teng, E., Cohen, A., Harper, J., Elion, C., Goy, C., Gao, Y., Henry, H., and Mattar, M. (2018). Unity: A General Platform for Intelligent Agents. arXiv.
33. (2023, November 18). Low Poly Road Pack. Available online: https://assetstore.unity.com/packages/3d/environments/roadways/low-poly-road-pack-67288.
34. (2023, November 18). Low Poly Cars. Available online: https://assetstore.unity.com/packages/3d/vehicles/land/low-poly-cars-101798.
35. Deep Learning10.1038/nature14539 ↗
36. Handwritten Digit Recognition with a Back-Propagation Network
37. Object Detection in 20 Years: A Survey10.1109/JPROC.2023.3238524 ↗
38. Wang, Z., Li, L., Zeng, C., and Yao, J. (2023). Student Learning Behavior Recognition Incorporating Data Augmentation with Learning Feature Representation in Smart Classrooms. Sensors, 23.10.3390/s23198190 ↗
39. Li, L., Wang, Z., and Zhang, T. (2023). GBH-YOLOv5: Ghost Convolution with BottleneckCSP and Tiny Target Prediction Head Incorporating YOLOv5 for PV Panel Defect Detection. Electronics, 12.10.3390/electronics12030561 ↗
40. Eggert, C., Brehm, S., Winschel, A., Zecha, D., and Lienhart, R. (2017, January 10). A Closer Look: Small Object Detection in Faster R-CNN. Proceedings of the 2017 IEEE International Conference on Multimedia and Expo (ICME), Hong Kong, China.10.1109/ICME.2017.8019550 ↗
41. Padilla, R., Passos, W.L., Dias, T.L.B., Netto, S.L., and Da Silva, E.A.B. (2021). A Comparative Analysis of Object Detection Metrics with a Companion Open-Source Toolkit. Electronics, 10.10.3390/electronics10030279 ↗
42. A Survey of Deep Learning-Based Object Detection10.1109/ACCESS.2019.2939201 ↗
43. Faster R-Cnn: Towards Real-Time Object Detection with Region Proposal Networks
44. Girshick, R. (2015, January 7–13). Fast R-Cnn. Proceedings of the IEEE International Conference on Computer Vision, Washington, DC, USA.10.1109/ICCV.2015.169 ↗
45. Neubeck, A., and Van Gool, L. (2006, January 20–24). Efficient Non-Maximum Suppression. Proceedings of the 18th International Conference on Pattern Recognition (ICPR’06), Hong Kong, China.10.1109/ICPR.2006.479 ↗
46. Brownlee, J. (2023, July 14). Difference Between a Batch and an Epoch in a Neural Network. Available online: https://machinelearningmastery.com/difference-between-a-batch-and-an-epoch/.
47. Kingma, D.P., and Ba, J. (2014). Adam: A Method for Stochastic Optimization. arXiv.
48. He, K., Zhang, X., Ren, S., and Sun, J. (2016, January 27–30). Deep Residual Learning for Image Recognition. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Las Vegas, NV, USA.10.1109/CVPR.2016.90 ↗
49. Chen, K., Wang, J., Pang, J., Cao, Y., Xiong, Y., Li, X., Sun, S., Feng, W., Liu, Z., and Xu, J. (2019). MMDetection: Open Mmlab Detection Toolbox and Benchmark. arXiv.
50. He, K., Gkioxari, G., Dollár, P., and Girshick, R. (2017, January 22–29). Mask R-Cnn. Proceedings of the IEEE International Conference on Computer Vision, Venice, Italy.10.1109/ICCV.2017.322 ↗
51. Zhu, M. (2004). Recall, Precision and Average Precision, Department of Statistics and Actuarial Science, University of Waterloo.
52. Kinematic target surface sensing based on improved deep optical flow tracking10.1364/OE.505993 ↗