journal article·2022Open access

A Deep Learning Approach for Crowd Counting in Highly Congested Scene

Akbar Khan, Kushsairy Abdul Kadir, Jawad Ali Shah, Waleed Albattah, Muhammad Saeed, Haidawati Nasir, Megat Norulazmi Megat Mohamed Noor, Muhammad Haris Kaka Khel

Computers, Materials & Continua· Volume 73· Issue 3

Abstract

With the rapid progress of deep convolutional neural networks, several applications of crowd counting have been proposed and explored in the literature. In congested scene monitoring, a variety of crowd density estimating approaches has been developed. The understanding of highly congested scenes for crowd counting during Muslim gatherings of Hajj and Umrah is a challenging task, as a large number of individuals stand nearby and, it is hard for detection techniques to recognize them, as the crowd can vary from low density to high density. To deal with such highly congested scenes, we have proposed the Congested Scene Crowd Counting Network (CSCC-Net) using VGG-16 as a core network with its first ten layers due to its strong and robust transfer learning rate. A hole dilated convolutional neural network is used at the back end to widen the relevant field to extract a large range of information from the image without losing its original resolution. The dilated convolution neural network is mainly chosen to expand the kernel size without changing other parameters. Moreover, several loss functions have been applied to strengthen the evaluation accuracy of the model. Finally, the entire experiments have been evaluated using prominent data sets namely, ShanghaiTech parts A, B, UCF_CC_50, and UCF_QNRF. Our model has achieved remarkable results i.e., 68.0 and 9.0 MAE on ShanghaiTech parts A, B, 199.1 MAE on UCF_CC_50, and 99.8 on UCF_QNRF data sets respectively.
Source: openalex_inverted_index · Quality: baseline

Research context

OpenAlex topics: Video Surveillance and Tracking Methods · Anomaly Detection Techniques and Applications · Fire Detection and Safety Systems

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

References (78)

Show source-provided references
1. Dense crowds detection and surveillance with drones using density maps
2. Csrnet: Dilated convolutional neural networks for understanding the highly congested scenes
3. Crowded scene analysis: A survey10.1109/TCSVT.2014.2358029 ↗
4. Switching convolutional neural network for crowd counting
5. Cross-scene crowd counting via deep convolutional neural networks
6. Crowd scene analysis encounters high density and scale variation10.1109/TIP.2021.3049963 ↗
7. Data-driven crowd understanding: A baseline for a large-scale crowd dataset10.1109/TMM.2016.2542585 ↗
8. Soft-csrnet: Real-time dilated convolutional neural networks for crowd counting with drones
9. Fully convolutional networks for semantic segmentation
10. Xception: Deep learning with depth wise separable convolutions
11. Imagenet classification with deep convolutional neural networks
12. Crowd monitoring and localization using deep convolutional neural network: A review10.3390/app10144781 ↗
13. Generating high-quality crowd density maps using contextual pyramid cnns
14. Adcrowdnet: An attention-injective deformable convolutional network for crowd understanding
15. Single-image crowd counting via multi-column convolutional neural network
16. Crowdnet: A deep convolutional network for dense crowd counting
17. Towards perspective-free object counting with deep learning
18. Scale driven convolutional neural network model for people counting and localization in crowd scenes10.1109/ACCESS.2019.2918650 ↗
19. Loy · Modeling, Simulation, and Visual Analysis of Crowds · 2013 · 34710.1007/978-1-4614-8483-7_14 ↗
20. Pedestrian detection: An evaluation of the state of the art10.1109/TPAMI.2011.155 ↗
21. Estimating the number of people in crowded scenes by mid based foreground segmentation and head-shoulder detection
22. Tomasi · Computer Vision Sampler · 2012 · 1
23. Pedestrian detection in crowded scenes
24. Pedestrian detection via classification on riemannian manifolds10.1109/TPAMI.2008.75 ↗
25. Monocular pedestrian detection: Survey and experiments10.1109/TPAMI.2008.260 ↗
26. Robust real-time face detection10.1023/B:VISI.0000013087.49260.fb ↗
27. Detection of multiple, partially occluded humans in a single image by Bayesian combination of edgelet part detectors
28. Detecting pedestrians by learning shapelet features
29. Detecting pedestrians using patterns of motion and appearance10.1007/s11263-005-6644-8 ↗
30. Hough forests for object detection, tracking, and action recognition10.1109/TPAMI.2011.70 ↗
31. Repulsion loss: Detecting pedestrians in a crowd
32. Object detection with discriminatively trained part-based models10.1109/MC.2014.42 ↗
33. Object detection with discriminatively trained part-based models10.1109/TPAMI.2009.167 ↗
34. Estimation of number of people in crowded scenes using perspective transformation10.1109/3468.983420 ↗
35. Detection and tracking of multiple, partially occluded humans by Bayesian combination of edgelet based part detectors10.1007/s11263-006-0027-7 ↗
36. Bayesian poisson regression for crowd counting
37. Crowd counting using multiple local features
38. Feature mining for localised crowd counting
39. Decidenet: Counting varying density crowds through attention guided detection and density estimation
40. Crowd density estimation based on classification activation map and patch density level10.1007/s00521-018-3954-7 ↗
41. A survey of recent advances in cnn-based single image crowd counting and density estimation10.1016/j.patrec.2017.07.007 ↗
42. Learning to recognize objects in images
43. Count forest: Co-voting uncertain number of targets using random forest for crowd density estimation
44. K. Simonyan and A. Zisserman, “Very deep convolutional networks for large-scale image recognition,” arXiv preprint arXiv:1409.1556, 2014.
45. M. Marsden, K. McGuinness, S. Little and N. E. O'Connor, “Fully convolutional crowd counting on highly congested scenes,” arXiv preprint arXiv:1612.00220, 2016.10.5220/0006097300270033 ↗
46. Relevant region prediction for crowd counting10.1016/j.neucom.2020.04.117 ↗
47. Crowd counting in low-resolution crowded scenes using region-based deep convolutional neural networks10.1109/ACCESS.2019.2904712 ↗
48. Locate, size and count: Accurately resolving people in dense crowds via detection
49. A texture based mani-fold approach for crowd density estimation using Gaussian markov random field10.1007/s11042-017-5554-4 ↗
50. A framework for designing the architectures of deep convolutional neural networks10.3390/e19060242 ↗
51. From open set to closed set: Counting objects by spatial divide-and-conquer
52. H. Xiong, H. Lu, C. Liu, L. Liu, C. Shen et al., “From open set to closed set: Supervised spatial divide-and-conquer for object counting,” arXiv preprint arXiv:2001.01886, 2020.10.1109/ICCV.2019.00845 ↗
53. F. Yu and V. Koltun, “Multi-scale context aggregation by dilated convolutions,” arXiv preprint arXiv:1511.07122, 2016.
54. L. -C. Chen, G. Papandreou, I. Kokkinos, K. Murphy and A. L. Yuille, “Semantic image segmentation with deep convolutional nets and fully connected crfs,” arXiv preprint arXiv:1412.7062, 2014.
55. L. -C. Chen, G. Papandreou, F. Schroff and H. Adam, “Rethinking atrous convolution for semantic image segmentation,” arXiv preprint arXiv:1706.05587, 2017.
56. Decoupled two-stage crowd counting and beyond10.1109/TIP.2021.3055631 ↗
57. Indices matter: Learning to index for deep image matting
58. Zero-shot video object segmentation with co-attention siamese networks
59. Critical aspects of person counting and density estimation10.3390/jimaging7020021 ↗
60. A comparative study of filters for denoising mammograms
61. A comprehensive survey of loss functions in machine learning
62. Multi-source multi-scale counting in extremely dense crowd images
63. Composition loss for counting, density map estimation and localization in dense crowds
64. Learning from synthetic data for crowd counting in the wild
65. Focus on semantic consistency for cross-domain crowd understanding
66. J. Gao, T. Han, Q. Wang and Y. Yuan, “Domain-adaptive crowd counting via inter-domain features segregation and Gaussian-prior reconstruction,” arXiv preprint arXiv:1912.03677, 2019.
67. Neuron linear transformation: Modeling the domain shift for crowd counting
68. Multi-level features extraction network with gating mechanism for crowd counting10.1049/ipr2.12304 ↗
69. Cnn-based cascaded multi-task learning of high-level prior and density estimation for crowd counting
70. A deep-fusion network for crowd counting in high-density crowded scenes
71. Learning to count with cnn boosting
72. Embedding perspective analysis into multi-column convolutional neural network for crowd counting10.1109/TIP.2020.3043122 ↗
73. U-ASD net: Supervised crowd counting based on semantic segmentation and adaptive scenario discovery10.1109/ACCESS.2021.3112174 ↗
74. Bayesian loss for crowd count estimation with point supervision
75. Padnet: Pan-density crowd counting10.1109/TIP.2019.2952083 ↗
76. Attention scaling for crowd counting
77. Adaptive dilated network with self-correction supervision for counting
78. Weighing counts: Sequential crowd counting by reinforcement learning