Development and Optimization of Deep Learning Models for Weapon Detection in Surveillance Videos
Source abstract
Abstract
Weapon detection in CCTV camera surveillance videos is a challenging task and its importance is increasing because of the availability and easy access of weapons in the market. This becomes a big problem when weapons go into the wrong hands and are often misused. Advances in computer vision and object detection are enabling us to detect weapons in live videos without human intervention and, in turn, intelligent decisions can be made to protect people from dangerous situations. In this article, we have developed and presented an improved real-time weapon detection system that shows a higher mean average precision (mAP) score and better inference time performance compared to the previously proposed approaches in the literature. Using a custom weapons dataset, we implemented a state-of-the-art Scaled-YOLOv4 model that resulted in a 92.1 mAP score and frames per second (FPS) of 85.7 on a high-performance GPU (RTX 2080TI). Furthermore, to achieve the benefits of lower latency, higher throughput, and improved privacy, we optimized our model for implementation on a popular edge-computing device (Jetson Nano GPU) with the TensorRT network optimizer. We have also performed a comparative analysis of the previous weapon detector with our presented model using different CPU and GPU machines that fulfill the purpose of this work, making the selection of model and computing device easier for the users for deployment in a real-time scenario. The analysis shows that our presented models result in improved mAP scores on high-performance GPUs (such as RTX 2080TI), as well as on low-cost edge computing GPUs (such as Jetson Nano) for weapon detection in live CCTV camera surveillance videos.
Source: crossref · Quality: baseline
Research context
OpenAlex topics: Advanced Neural Network Applications · Adversarial Robustness in Machine Learning · Anomaly Detection Techniques and Applications
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
Affiliations
Department of Electrical Engineering, National University of Computer and Emerging Sciences, Islamabad 44000, Pakistan
Department of Mathematics and Natural Sciences, Blekinge Institute of Technology, 371 41 Karlskrona, Sweden
References (31)
Show source-provided references
1. (2019, July 10). Christchurch Mosque Shootings. Available online: https://en.wikipedia.org/wiki/Christchurch_mosque_shootings.
2. (2019, July 10). Global Study on Homicide. Available online: https://www.unodc.org/unodc/en/data-and-analysis/global-study-on-homicide.html.
3. Deisman, W. (2022, March 10). A Report on Camera Surveillance in Canada: Part One. Surveillance Camera Awareness Network (SCAN). Available online: https://qspace.library.queensu.ca/handle/1974/1906.
4. Ratcliffe, J. (2022, March 13). Video Surveillance of Public Places, Available online: https://www.ojp.gov/ncjrs/virtual-library/abstracts/video-surveillance-public-places.
5. Cohen, N., Gattuso, J., and MacLennan-Brown, K. (2022, March 14). CCTV Operational Requirements Manual 2009, Available online: http://designforsecurity.org/downloads/CCTV_Requirements.pdf.
6. Murthy, C.B., Hashmi, M.F., Bokde, N.D., and Geem, Z.W. (2020). Investigations of Object Detection in Images/Videos Using Various Deep Learning Techniques and Embedded Platforms—A Comprehensive Review. Appl. Sci., 10.10.3390/app10093280 ↗
7. Weapon Detection in Real-Time CCTV Videos Using Deep Learning10.1109/ACCESS.2021.3059170 ↗
8. Darker, I., Gale, A., Ward, L., and Blechko, A. (2007, January 8–11). Can CCTV reliably detect gun crime?. Proceedings of the International Carnahan Conference on Security Technology, Ottawa, ON, Canada.10.1109/CCST.2007.4373499 ↗
9. CCTV as an automated sensor for firearms detection: Human-derived performance as a precursor to automatic recognition10.1117/12.800264 ↗
10. Dalal, N., and Triggs, B. (2005, January 20–25). Histograms of oriented gradients for human detection. Proceedings of the 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, CVPR, San Diego, CA, USA.
11. He, K., Zhang, X., Ren, S., and Sun, J. (2016, January 27–30). Deep residual learning for image recognition. Proceedings of the of the IEEE Conference on Computer Vision and Pattern Recognition, Las Vegas, NV, USA.10.1109/CVPR.2016.90 ↗
12. Vajhala, R., Maddineni, R., and Yeruva, P.R. (2016). Weapon Detection in Surveillance Camera Images. [Dissertation]. Available online: http://urn.kb.se/resolve?urn=urn:nbn:se:bth-13565.
13. Nakib, M., Khan, R.T., Hasan, M.S., and Uddin, J. (2018, January 8–9). Crime Scene Prediction by Detecting Threatening Objects Using Convolutional Neural Network. Proceedings of the International Conference on Computer, Communication, Chemical, Material and Electronic Engineering, IC4ME2 2018, Rajshahi, Bangladesh.10.1109/IC4ME2.2018.8465583 ↗
14. Verma, G.K., and Dhillon, A. (2017, January 24–26). A Handheld Gun Detection using Faster R-CNN Deep Learning. Proceedings of the 7th International Conference on Computer and Communication Technology, Allahabad, India.10.1145/3154979.3154988 ↗
15. Automatic handgun detection alarm in videos using deep learning10.1016/j.neucom.2017.05.012 ↗
16. Real-time gun detection in CCTV: An open problem10.1016/j.neunet.2020.09.013 ↗
17. Weapon Detection Using YOLO V3 for Smart Surveillance System10.1155/2021/9975700 ↗
18. Using human pose information for handgun detection10.1007/s00521-021-06317-8 ↗
19. Ma, Y., Chen, H., and Huo, J. (2021, January 18–20). Assault Rifle Detection and Identification Based on Convolutional Neural Network YOLOv3. Proceedings of the 2021 3rd World Symposium on Artificial Intelligence, WSAI 2021, Guangzhou, China.10.1109/WSAI51899.2021.9486333 ↗
20. Salido, J., Lomas, V., Ruiz-Santaquiteria, J., and Deniz, O. (2021). Automatic Handgun Detection with Deep Learning in Video Surveillance Images. Appl. Sci., 11.10.3390/app11136085 ↗
21. Deep Neural Networks Based on Transfer Learning Approaches to Classification of Gun and Knife Images
22. Real-Time Video Surveillance System for Detecting Malicious Actions and Weapons in Public Spaces10.1007/978-981-15-9647-6_12 ↗
23. Martín, C., and José, J. (2022, March 18). Weapon Detection with Deep Learning and Computer Graphics. Available online: http://hdl.handle.net/10578/27818.
24. Reddy, R., Vallabh, K.G., and Sharan, S. (2021, January 21–23). Multiclass weapon detection using multi contrast convolutional neural networks and faster region-based convolutional neural networks. Proceedings of the 2021 2nd International Conference for Emerging Technology, INCET 2021, Belagavi, India.10.1109/INCET51464.2021.9456407 ↗
25. Handgun Detection Using Combined Human Pose and Weapon Appearance10.1109/ACCESS.2021.3110335 ↗
26. Singh, A., Anand, T., Sharma, S., and Singh, P. (2021, January 8–10). IoT Based Weapons Detection System for Surveillance and Security Using YOLOV4. Proceedings of the 6th International Conference on Communication and Electronics Systems, ICCES 2021, Coimbatre, India.10.1109/ICCES51350.2021.9489224 ↗
27. Hashmi TS, S., Haq, N.U., Fraz, M.M., and Shahzad, M. (2021, January 20–21). Application of Deep Learning for Weapons Detection in Surveillance Videos. Proceedings of the 2021 International Conference on Digital Futures and Transformative Technologies, ICoDT2 2021, Islamabad, Pakistan.10.1109/ICoDT252288.2021.9441523 ↗
28. Madhushree, B., Sowmya, K.N., and Chennamma, H.R. (2021). Automatic weapon detection in video using deep learning. Data Engineering and Intelligent Computing, Springer.10.1007/978-981-16-0171-2_47 ↗
29. Sistem Deteksi Senjata Otomatis Menggunakan Deep Learning Berbasis CCTV Cerdas10.37396/jsc.v4i2.172 ↗
30. Kaya, V., Tuncer, S., and Baran, A. (2021). Detection and Classification of Different Weapon Types Using Deep Learning. Appl. Sci., 11.10.3390/app11167535 ↗
31. Ingle, P.Y., and Kim, Y.-G. (2022). Real-Time Abnormal Object Detection for Video Surveillance in Smart Cities. Sensors, 22.10.3390/s22103862 ↗