An Automated Real-Time Face Mask Detection System Using Transfer Learning with Faster-RCNN in the Era of the COVID-19 Pandemic
Source abstract
Abstract
Today, due to the pandemic of COVID-19 the entire world is facing a serious health crisis. According to the World Health Organization (WHO), people in public places should wear a face mask to control the rapid transmission of COVID-19. The governmental bodies of different countries imposed that wearing a face mask is compulsory in public places. Therefore, it is very difficult to manually monitor people in overcrowded areas. This research focuses on providing a solution to enforce one of the important preventative measures of COVID-19 in public places, by presenting an automated system that automatically localizes masked and unmasked human faces within an image or video of an area which assist in this outbreak of COVID-19. This paper demonstrates a transfer learning approach with the Faster-RCNN model to detect faces that are masked or unmasked. The proposed framework is built by fine-tuning the state-of-the-art deep learning model, Faster-RCNN, and has been validated on a publicly available dataset named Face Mask Dataset (FMD) and achieving the highest average precision (AP) of 81% and highest average Recall (AR) of 84%. This shows the strong robustness and capabilities of the Faster-RCNN model to detect individuals with masked and un-masked faces. Moreover, this work applies to real-time and can be implemented in any public service area.
Source: openalex_inverted_index · Quality: baseline
Research context
OpenAlex topics: Face recognition and analysis · COVID-19 diagnosis using AI · Face and Expression Recognition
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
References (70)
Show source-provided references
1. Time series forecasting of COVID-19 transmission in Asia pacific countries using deep neural networks
2. Deploying machine and deep learning models for efficient data-augmented detection of COVID-19 infections10.3390/v12070769 ↗
3. A novel framework for rapid diagnosis of COVID-19 on computed tomography scans
4. Winning together: Novel coronavirus (COVID-19) infographic10.4103/0974-2700.281047 ↗
5. Efficient deep learning approach for augmented detection of coronavirus disease
6. Coronavirus disease (COVID-19) prevention and treatment methods and effective parameters: A systematic literature review10.1016/j.scs.2020.102568 ↗
7. Multi-grade brain tumor classification using deep CNN with extensive data augmentation10.1016/j.jocs.2018.12.003 ↗
8. Deep residual learning for image recognition
9. Characterization of a novel coronavirus associated with severe acute respiratory syndrome10.1126/science.1085952 ↗
10. Family cluster of Middle East respiratory syndrome coronavirus infections10.1056/NEJMoa1303729 ↗
11. The reproductive number of COVID-19 is higher compared to SARS coronavirus10.1093/jtm/taaa021 ↗
12. Transmission dynamics of the COVID-19 outbreak and effectiveness of government interventions: A data-driven analysis10.1002/jmv.25750 ↗
13. Rational use of face masks in the COVID-19 pandemic10.1016/S2213-2600(20)30134-X ↗
14. Facemasks and hand hygiene to prevent influenza transmission in households: A cluster randomized trial10.7326/0003-4819-151-7-200910060-00142 ↗
15. Mathematical modeling of the effectiveness of facemasks in reducing the spread of novel influenza a (h1n1)10.1371/journal.pone.0009018 ↗
16. Physical interventions to interrupt or reduce the spread of respiratory viruses
17. Respiratory virus shedding in exhaled breath and efficacy of face masks10.1038/s41591-020-0843-2 ↗
18. The use of facemasks to prevent respiratory infection: A literature review in the context of the health belief model10.11622/smedj.2014037 ↗
19. Detection of myocardial infarction based on novel deep transfer learning methods for urban healthcare in smart cities
20. What policy makers need to know about COVID-19 protective immunity
21. Delving deep into rectifiers: Surpassing human-level performance on imagenet classification
22. Dual-branch residual network for lung nodule segmentation10.1016/j.asoc.2019.105934 ↗
23. A framework of human action recognition using length control features fusion and weighted entropy-variances based feature selection10.1016/j.imavis.2020.104090 ↗
24. Human gait analysis for osteoarthritis prediction: A framework of deep learning and kernel extreme learning machine
25. An efficient DA-net architecture for lung nodule segmentation10.3390/math9131457 ↗
26. An efficient gait recognition method for known and unknown covariate conditions10.1109/ACCESS.2020.3047266 ↗
27. A residual-learning-based multi-scale parallel-convolutions-assisted efficient CAD system for liver tumor detection10.3390/math9101133 ↗
28. An efficient U-net framework for lung nodule detection using densely connected dilated convolutions
29. Prediction of COVID-19-pneumonia based on selected deep features and one class kernel extreme learning machine10.1016/j.compeleceng.2020.106960 ↗
30. Unleashing the power of disruptive and emerging technologies amid COVID 2019: A detailed review
31. Digital technology and COVID-1910.1038/s41591-020-0824-5 ↗
32. Sonbhadra · Solitons & Fractals · 2020 · 140 · 11015510.1016/j.chaos.2020.110155 ↗
33. Monitoring COVID-19 social distancing with person detection and tracking via fine-tuned YOLO v3 and deepsort techniques
34. Deploying machine and deep learning models for efficient data-augmented detection of COVID-19 infections10.3390/v12070769 ↗
35. Crowd analysis for congestion control early warning system on foot over bridge
36. Digital technology and COVID-1910.1038/s41591-020-0824-5 ↗
37. Deep learning approaches for COVID-19 detection based on chest X-ray images10.1016/j.eswa.2020.114054 ↗
38. How's the turnout to the class? A face detection system for universities
39. Deep learning and control algorithms of direct perception for autonomous driving
40. Object detection with deep learning: A review10.1109/TNNLS.2018.2876865 ↗
41. A sustainable deep learning framework for object recognition using multi-layers deep features fusion and selection10.3390/su12125037 ↗
42. Automated diagnosis of COVID-19 with limited posteroanterior chest X-ray images using fine-tuned deep neural networks
43. Identifying facemask-wearing condition using image super-resolution with classification network to prevent COVID-1910.3390/s20185236 ↗
44. Implementation of principal component analysis on masked and non-masked face recognition
45. Glasses removal from facial image using recursive error compensation10.1109/TPAMI.2005.103 ↗
46. An enhanced thermal face recognition method based on multiscale complex fusion for Gabor coefficients10.1007/s11042-013-1551-4 ↗
47. A novel GAN-based network for unmasking of masked face10.1109/ACCESS.2020.2977386 ↗
48. System for medical mask detection in the operating room through facial attributes
49. Interactive removal of microphone object in facial images10.3390/electronics8101115 ↗
50. A real time face emotion classification and recognition using deep learning model
51. A hybrid deep transfer learning model with machine learning methods for face mask detection in the era of the COVID-19 pandemic10.1016/j.measurement.2020.108288 ↗
52. Detecting masked faces in the wild with lle-cnns
53. Glasses detection and extraction by deformable contour
54. A real-time big data architecture for glasses detection using computer vision techniques
55. Glasses detection on real images based on robust alignment10.1007/s00138-015-0674-1 ↗
56. Precise glasses detection algorithm for face with in-plane rotation10.1007/s00530-015-0483-4 ↗
57. Glasses detection using convolutional neural networks
58. A convolutional neural network based approach towards real-time hard hat detection
59. CMNet: A connect-and-merge convolutional neural network for fast vehicle detection in urban traffic surveillance10.1109/ACCESS.2019.2919103 ↗
60. A deep network architecture for super-resolution-aided hyperspectral image classification with classwise loss10.1109/TGRS.2018.2832228 ↗
61. Highly accurate facial nerve segmentation refinement from CBCT/CT imaging using a super-resolution classification approach10.1109/TBME.2017.2697916 ↗
62. Object detection by a super-resolution method and a convolutional neural networks
63. Convolutional low-resolution fine-grained classification10.1016/j.patrec.2017.10.020 ↗
64. Facial image super resolution using sparse representation for improving face recognition in surveillance monitoring
65. Very low resolution face recognition problem10.1109/TIP.2011.2162423 ↗
66. Attention-based models for speech recognition
67. Visualizing and understanding convolutional networks
68. Rectified linear units improve restricted boltzmann machines
69. Fast r-cnn
70. Prosperous human gait recognition: An end-to-end system based on pre-trained CNN features selection