journal article·2025-01-12Open access

BWFER-YOLOv8: An Enhanced Cascaded Framework for Concealed Object Detection

Khalid Ijaz, Ikramullah Khosa, Ejaz A. Ansari, Syed Farooq Ali, Asif Hussain, Faran Awais Butt

Applied Sciences· Volume 15· Issue 2

Abstract

Contact-free concealed object detection using passive millimeter-wave imaging (PMMWI) sensors is a challenging task due to a low signal-to-noise ratio (SNR) and nonuniform illumination affecting the captured image’s quality. The nonuniform illumination also generates a higher false positive rate due to the limited ability to differentiate small hidden objects from the background of images. Several concealed object detection models have demonstrated outstanding performance but failed to combat the above-mentioned challenges concurrently. This paper proposes a novel three-stage cascaded framework named BWFER-YOLOv8, which implements a new alpha-reshuffled bootstrap random sampling method in the first stage, followed by image reconstruction using an adaptive Wiener filter in the second stage. The third stage uses a novel FER-YOLOv8 architecture with a custom-designed feature extraction and regularization (FER) module and multiple regularized convolution (Conv_Reg) modules for better generalization capability. The comprehensive quantitative and qualitative analysis reveals that the proposed framework outperforms the state-of-the-art tiny YOLOv3 and YOLOv8 models by achieving 98.1% precision and recall in detecting concealed weapons. The proposed framework significantly reduces the false positive rate, by up to 1.8%, in the detection of hidden small guns.
Source: crossref · Quality: baseline

Research context

OpenAlex topics: Microwave Imaging and Scattering Analysis · Terahertz technology and applications · Geophysical Methods and Applications

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

Department of Electrical and Computer Engineering, COMSATS University Islamabad, Lahore 54000, Pakistan

Department of Computer Science, School of Systems and Technology, University of Management and Technology, Lahore 54770, Pakistan

Department of Electrical Engineering, School of Engineering, University of Management and Technology, Lahore 54770, Pakistan

Center for Communication Systems and Sensing, King Fahd University of Petroleum and Minerals, Dhahran 31261, Saudi Arabia

References (72)

Show source-provided references
1. Huang, P., Wei, R., Su, Y., and Tan, W. (2023). Swin-YOLO for concealed object detection in millimeter wave images. Appl. Sci., 13.10.3390/app13179793 ↗
2. Radiation exposure and privacy concerns surrounding full-body scanners in airports
3. A novel deformable body partition model for MMW suspicious object detection and dynamic tracking10.1016/j.sigpro.2020.107627 ↗
4. THz linear array scanner in application to the real-time imaging and convolutional neural network recognition10.15407/spqeo24.01.090 ↗
5. (2024, February 29). Global Terrorism Index 2024 Key Findings. Institute for Economics and Peace. Available online: https://www.visionofhumanity.org/7-key-findings-from-the-global-terrorism-index-2024.
6. Imaging for concealed weapon detection: A tutorial overview of development in imaging sensors and processing10.1109/MSP.2005.1406480 ↗
7. Agurto, A., Li, Y., Tian, G.Y., Bowring, N., and Lockwood, S. (2007, January 15–17). A review of concealed weapon detection and research in perspective. Proceedings of the 2007 IEEE International Conference on Networking, Sensing and Control, London, UK.10.1109/ICNSC.2007.372819 ↗
8. Wang, L.M., Li, N., Ren, C.P., Peng, Z.Y., Lu, H.Z., Li, D., Wu, X.Y., Zhou, Z.X., Deng, J.Y., and Zheng, Z.H. (2023). Sterility of Aedes albopictus by X-ray Irradiation as an Alternative to γ-ray Irradiation for the Sterile Insect Technique. Pathogens, 12.10.3390/pathogens12010102 ↗
9. Riz à Porta, R., Sterchi, Y., and Schwaninger, A. (2022). How realistic is threat image projection for x-ray baggage screening?. Sensors, 22.10.3390/s22062220 ↗
10. Velayudhan, D., Hassan, T., Ahmed, A.H., Damiani, E., and Werghi, N. (2022, January 14–16). Baggage threat recognition using deep low-rank broad learning detector. Proceedings of the 2022 IEEE 21st Mediterranean Electrotechnical Conference (MELECON), Palermo, Italy.10.1109/MELECON53508.2022.9842976 ↗
11. Kovbasa, M., Golenkov, A., and Sizov, F. (2020, January 21–25). Neural network application to the postal terahertz scanner for automated detection of concealed items. Proceedings of the 2020 IEEE Ukrainian Microwave Week (UkrMW), Kharkiv, Ukraine.10.1109/UkrMW49653.2020.9252706 ↗
12. Deep learning for generic object detection: A survey10.1007/s11263-019-01247-4 ↗
13. Solid-state diode technology for millimeter and submillimeter-wave remote sensing applications: Current status and future trends10.1109/MMM.2022.3155031 ↗
14. Passive polarimetric imaging of millimeter and terahertz waves for personnel
15. Owda, A.Y. (2022). Passive millimeter-wave imaging for burns diagnostics under dressing materials. Sensors, 22.10.3390/s22072428 ↗
16. Self-paced feature attention fusion network for concealed object detection in millimeter-wave image10.1109/TCSVT.2021.3058246 ↗
17. AC-SDBSCAN: Toward concealed object detection of passive terahertz images10.1049/ipr2.12390 ↗
18. Optimizing YOLOv3 detection model using terahertz active security scanned low-resolution images10.15863/TAS.2021.03.95.39 ↗
19. Study of object detection in linear terahertz imaging systems10.1117/1.OE.62.8.083104 ↗
20. An optimal defect recognition security-based terahertz low resolution image system using deep learning network10.1016/j.eij.2023.05.009 ↗
21. Image analysis for object detection in millimetre-wave images10.1117/12.580475 ↗
22. Image processing techniques for metallic object detection with millimetre-wave images10.1016/j.patrec.2006.02.003 ↗
23. Martínez, O., Ferraz, L., Binefa, X., Gómez, I., and Dorronsoro, C. (2010, January 13–18). Concealed object detection and segmentation over millimetric waves images. Proceedings of the 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition-Workshops, San Francisco, CA, USA.10.1109/CVPRW.2010.5543714 ↗
24. Zhu, S., and Li, Y. (2018, January 7–11). A multi-class classification system for passive millimeter-wave image. Proceedings of the 2018 International Conference on Microwave and Millimeter Wave Technology (ICMMT), Chengdu, China.10.1109/ICMMT.2018.8563597 ↗
25. Real-time concealed object detection and recognition in passive imaging at 250 GHz10.1364/AO.58.003134 ↗
26. Maqueda, I.G., De La Blanca, N.P., Molina, R., and Katsaggelos, A.K. (September, January 31). Fast millimeter wave threat detection algorithm. Proceedings of the 2015 23rd European Signal Processing Conference (EUSIPCO), Nice, France.10.1109/EUSIPCO.2015.7362453 ↗
27. Segmentation of concealed objects in passive millimeter-wave images based on the Gaussian mixture model10.1007/s10762-015-0146-8 ↗
28. Shape feature analysis of concealed objects with passive millimeter wave imaging10.2528/PIERL15081007 ↗
29. Wang, X., Gou, S., Wang, X., Zhao, Y., and Zhang, L. (2018, January 28–31). Patch-Based Gaussian Mixture Model for Concealed Object Detection in Millimeter-Wave images. Proceedings of the TENCON 2018—2018 IEEE Region 10 Conference, Jeju, Republic of Korea.10.1109/TENCON.2018.8650148 ↗
30. Wavelet fusion for concealed object detection using passive millimeter wave sequence images10.5194/isprs-archives-XLII-3-193-2018 ↗
31. A Visible and Passive Millimeter Wave Image Fusion Algorithm Based on Pulse-Coupled Neural Network in Tetrolet Domain for Early Risk Warning
32. A Multi-Thresholding Method Based on Otsu’s Algorithm for the Detection of Concealed Threats in Passive Millimeter-Wave Images10.1515/freq-2018-0255 ↗
33. Concealed object enhancement using multi-polarization information for passive millimeter and terahertz wave security screening10.1364/OE.384029 ↗
34. Using machine learning to detect and localize concealed objects in passive millimeter-wave images10.1016/j.engappai.2017.09.005 ↗
35. Concealed Object Detection10.1109/TPAMI.2021.3085766 ↗
36. A low-complexity method for concealed object detection in active millimeter-wave images
37. Understanding the effective receptive field in semantic image segmentation10.1007/s11042-018-5704-3 ↗
38. Deep CNNs for object detection using passive millimeter sensors
39. Hidden object detection and recognition in passive terahertz and mid-wavelength infrared10.1007/s10762-019-00628-7 ↗
40. Jiang, Y., Cui, J., Chen, Z., and Wen, X. (2019, January 11–13). Concealed threat detection based on multi-view millimeter wave imaging for human body. Proceedings of the 2019 IEEE International Conference on Signal, Information and Data Processing (ICSIDP), Chongqing, China.10.1109/ICSIDP47821.2019.9173419 ↗
41. A review of terahertz detectors10.1088/1361-6463/ab31d5 ↗
42. Precise localization of concealed objects in millimeter-wave images via semantic segmentation10.1109/ACCESS.2020.3007256 ↗
43. High-quality R-CNN object detection using multi-path detection calibration network10.1109/TCSVT.2020.2987465 ↗
44. Weapon detection in real-time cctv videos using deep learning10.1109/ACCESS.2021.3059170 ↗
45. Ramp-cnn: A novel neural network for enhanced automotive radar object recognition10.1109/JSEN.2020.3036047 ↗
46. Joint anchor-feature refinement for real-time accurate object detection in images and videos10.1109/TCSVT.2020.2980876 ↗
47. Multi-source aggregation transformer for concealed object detection in millimeter-wave images10.1109/TCSVT.2022.3161815 ↗
48. Liu, J., Zhang, K., Sun, Z., Wu, Q., He, W., and Wang, H. (2021). Concealed object detection and recognition system based on millimeter wave FMCW radar. Appl. Sci., 11.10.3390/app11198926 ↗
49. Learning to detect open carry and concealed object with 77 GHz radar10.1109/JSTSP.2022.3171168 ↗
50. Microwave imaging of concealed objects with linear antenna array and optical tracking of the target for high-performance security screening systems10.1109/TMTT.2022.3217593 ↗
51. YOLO-MSFG: Toward real-time detection of concealed objects in passive terahertz images10.1109/JSEN.2021.3127686 ↗
52. Unifying convolution and transformer for efficient concealed object detection in passive millimeter-wave images10.1109/TCSVT.2023.3234311 ↗
53. TCU-Net: Transformer and Convolutional Neural Network-Based Advanced U-Net for Concealed Object Detection10.1109/ACCESS.2022.3223424 ↗
54. Concealed object detection for passive millimeter-wave security imaging based on task-aligned detection transformer
55. Amadi, L., and Agam, G. (2023). Weakly supervised 2D pose adaptation and body part segmentation for concealed object detection. Sensors, 23.10.3390/s23042005 ↗
56. Multitype label noise modeling and uncertainty-weighted label correction for concealed object detection
57. Source-free domain adaptive detection of concealed objects in passive millimeter-wave images
58. Concealed pistol detection from thermal images with deep neural networks10.1007/s11042-023-15358-1 ↗
59. Saliency and superpixel improved detection and segmentation of concealed objects for passive terahertz images10.1117/1.OE.62.2.023101 ↗
60. Sardar, S., Assi, S., Zolkifly, I.A., Jayabalan, M., Alsaleem, M., Mohammed, A.H., and Al-Jumeily OBE, D. (2023). Application of Deep Learning Algorithms to Terahertz Images for Detection of Concealed Objects. Data Science and Emerging Technologies, Springer.10.1007/978-981-97-0293-0_21 ↗
61. Tran, X.T., Do, T.T.T., and Lin, C.T. (2023, January 24–27). Early Detection of Human Decision-Making in Concealed Object Visual Searching Tasks: An EEG-BiLSTM Study. Proceedings of the 2023 45th Annual International Conference of the IEEE Engineering in Medicine & Biology Society (EMBC), Sydney, Australia.10.1109/EMBC40787.2023.10340547 ↗
62. Khor, W., Chen, Y.K., Roberts, M., and Ciampa, F. (2024, March 01). Infrared Thermography as a Non-Invasive Scanner for Concealed Weapon Detection. Cranfield Online Research Data (CORD) 2024. Available online: https://dspace.lib.cranfield.ac.uk/handle/1826/21320.
63. Weakly-supervised concealed object segmentation with sam-based pseudo labeling and multi-scale feature grouping
64. Enhancing concealed object detection in Active Millimeter Wave Images using wavelet transform10.1016/j.sigpro.2023.109303 ↗
65. Cheng, R., and Lucyszyn, S. (2024). Few-shot concealed object detection in sub-THz security images using improved pseudo-annotations. Sci. Rep., 14.10.1038/s41598-024-53045-9 ↗
66. Becker, K., Benecchi, A., and Bourlai, T. (2024, January 15–24). Passive Millimeter Wave Concealed Object Detection Using YOLOv8. Proceedings of the SoutheastCon 2024, Atlanta, GA, USA.10.1109/SoutheastCon52093.2024.10500198 ↗
67. Deep-learning-based method for concealed object detection in terahertz (THz) images
68. Design of a low-cost cross-correlation system for aperture synthesis passive millimeter wave imager
69. Ansel, J., Yang, E., He, H., Gimelshein, N., Jain, A., Voznesensky, M., Bao, B., Bell, P., Berard, D., and Burovski, E. (May, January 27). PyTorch 2: Faster Machine Learning Through Dynamic Python Bytecode Transformation and Graph Compilation. Proceedings of the 29th ACM International Conference on Architectural Support for Programming Languages and Operating Systems, ASPLOS ’24, New York, NY, USA.
70. Ultralytics (2024, October 15). YOLOv3 in PyTorch. Available online: https://github.com/ultralytics/yolov3.
71. Koech, K.E. (2024, October 15). On Object Detection Metrics with Worked Example. Available online: https://towardsdatascience.com/on-object-detectionmetrics-with-worked-example-216f173ed31e.
72. Three-Dimensional Millimeter-Wave Object Detector Based on the Enhancement of Local-Global Contextual Information10.1109/ACCESS.2024.3458979 ↗