journal article·2022-05-20Open access

Scene Adaptive Segmentation for Crowd Counting in Population Heterogeneous Distribution

Hui Gao, Miaolei Deng, Wenjun Zhao, Dexian Zhang

Applied Sciences· Volume 12· Issue 10

Abstract

Crowd counting is an important part of crowd analysis and has been widely applied in the field of public safety and commercial management. Although researchers have proposed many crowd counting methods, there is little research on non-uniform population distribution. In this research, a new scene adaptive segmentation network (SASNet) is proposed that can focus on crowd area to estimate accurately crowd density in population heterogeneous distribution. First, an image segmentation module is designed that can adaptive horizontal segment an image according to different density levels, and then obtains a close-up view image and a distant view image. Second, a dual branches network based on convolution neural network (CNN) is exploited that contains a distant view network (DVNet) and a close-up view network (CVNet), so as to extract different scales of image features and then generate density maps by each branch, respectively, so that the crowd counting module has robustness on different scales of target. Finally, a comparative experiment on three well-known crowd counting datasets shows that SASNet achieved stabilized performance and robustness in population heterogeneous distribution.
Source: crossref · Quality: baseline

Research context

OpenAlex topics: Video Surveillance and Tracking Methods · Anomaly Detection Techniques and Applications · Fire Detection and Safety Systems

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

School of Mechanical and Electrical Engineering, Henan University of Technology, Zhengzhou 450001, China

Henan International Joint Laboratory of Grain Information Processing, Zhengzhou 450001, China

College of Information Science and Engineering, Henan University of Technology, Zhengzhou 450001, China

Funding

National Key R&D Program of China · Major Public Welfare Project of Henan Province

References (35)

Show source-provided references
1. Approaches on crowd counting and density estimation: A review10.1007/s10044-021-00959-z ↗
2. Gavrila, D.M., and Philomin, V. (1999, January 20–27). Real-time object detection for “smart” vehicles. Proceedings of the Seventh IEEE International Conference on Computer Vision, Corfu, Greece.10.1109/ICCV.1999.791202 ↗
3. Chan, A.B., and Vasconcelos, N. (October, January 29). Bayesian Poisson regression for crowd counting. Proceedings of the IEEE 12th International Conference on Computer Vision, Kyoto, Japan.
4. Zhang, C., Li, H., Wang, X., and Yang, X. (2015, January 7–12). Cross-scene crowd counting via deep convolutional neural networks. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Boston, MA, USA.
5. Zhang, Y., Zhou, D., Chen, S., Gao, S., and Ma, Y. (2016, January 27–30). Single-Image Crowd Counting via Multi-Column Convolutional Neural Network. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Las Vegas, NV, USA.10.1109/CVPR.2016.70 ↗
6. Chen, S., Fern, A., and Todorovic, S. (2015, January 7–12). Person count localization in videos from noisy foreground and detections. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Boston, MA, USA.
7. Image quality assessment: From error visibility to structural similarity10.1109/TIP.2003.819861 ↗
8. Idrees, H., Saleemi, I., Seibert, C., and Shah, M. (2013, January 23–28). Multi-source Multi-Scale Counting in Extremely Dense Crowd Images. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Portland, OR, USA.10.1109/CVPR.2013.329 ↗
9. Pedestrian Detection: An Evaluation of the State of the Art10.1109/TPAMI.2011.155 ↗
10. Lowe, D.G. (1999, January 20–27). Object recognition from local scale-invariant features. Proceedings of the Seventh IEEE International Conference on Computer Vision, Corfu, Greece.10.1109/ICCV.1999.790410 ↗
11. Learning to Count Objects in Images
12. Chen, K., Gong, S., Xiang, T., and Loy, C.C. (2013, January 23–28). Cumulative Attribute Space for Age and Crowd Density Estimation. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Portland, OR, USA.10.1109/CVPR.2013.319 ↗
13. Shang, C., Ai, H., and Bai, B. (2016, January 25–28). End-to-end crowd counting via joint learning local and global count. Proceedings of the IEEE International Conference on Image Processing (ICIP), Phoenix, AZ, USA.10.1109/ICIP.2016.7532551 ↗
14. Boominathan, L., Kruthiventi, S.S.S., and Babu, R.V. (2016, January 15–19). CrowdNet: A Deep Convolutional Network for Dense Crowd Counting. Proceedings of the 24th ACM International Conference on Multimedia, Amsterdam, The Netherlands.10.1145/2964284.2967300 ↗
15. Marsden, M., McGuinness, K., Little, S., and O’Connor, N.E. (2017). Fully Convolutional Crowd Counting on Highly Congested Scenes. arXiv.10.5220/0006097300270033 ↗
16. Sindagi, V.A., and Patel, V.M. (2017, January 22–29). Generating High-Quality Crowd Density Maps Using Contextual Pyramid CNNs. Proceedings of the IEEE International Conference on Computer Vision (ICCV), Venice, Italy.10.1109/ICCV.2017.206 ↗
17. Oñoro-Rubio, D., and López-Sastre, R.J. (2016, January 8–16). Towards Perspective-Free Object Counting with Deep Learning. Proceedings of the European Conference on Computer Vision, Amsterdam, The Netherlands.10.1007/978-3-319-46478-7_38 ↗
18. Sindagi, V.A., and Patel, V.M. (September, January 29). CNN-Based cascaded multi-task learning of high-level prior and density estimation for crowd counting. Proceedings of the 14th IEEE International Conference on Advanced Video and Signal Based Surveillance (AVSS), Lecce, Italy.
19. Li, Y., Zhang, X., and Chen, D. (2018, January 18–23). CSRNet: Dilated Convolutional Neural Networks for Understanding the Highly Congested Scenes. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, Salt Lake City, UT, USA.10.1109/CVPR.2018.00120 ↗
20. Zhang, A., Shen, J., Xiao, Z., Zhu, F., and Shao, L. (November, January 27). Relational Attention Network for Crowd Counting. Proceedings of the IEEE/CVF International Conference on Computer Vision (ICCV), Seoul, Korea.
21. Cao, X., Wang, Z., Zhao, Y., and Su, F. (2018, January 8–14). Scale Aggregation Network for Accurate and Efficient Crowd Counting. Proceedings of the European Conference on Computer Vision (ECCV), Munich, Germany.10.1007/978-3-030-01228-1_45 ↗
22. Zhao, S., Jia, Z., Chen, H., and Li, L. (2019, January 21–25). PDANet: Polarity-Consistent Deep Attention Network for Fine-Grained Visual Emotion Regression. Proceedings of the 27th ACM International Conference on Multimedia, Nice, France.10.1145/3343031.3351062 ↗
23. Scale Driven Convolutional Neural Network Model for People Counting and Localization in Crowd Scenes10.1109/ACCESS.2019.2918650 ↗
24. Interlayer and Intralayer Scale Aggregation for Scale-Invariant Crowd Counting10.1016/j.neucom.2021.01.112 ↗
25. Adaptive estimator design for unstable output error systems: A test problem and traditional system identification based analysis
26. Design and Comparison Base Analysis of Adaptive Estimator for Completely Unknown Linear Systems in the Presence of OE Noise and Constant Input Time Delay10.1002/asjc.1184 ↗
27. Dense crowd counting based on adaptive scene division10.1007/s13042-020-01212-5 ↗
28. Sam, D.B., Surya, S., and Babu, R.V. (2017, January 21–26). Switching Convolutional Neural Network for Crowd Counting. Proceedings of the 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Honolulu, HI, USA.10.1109/CVPR.2017.429 ↗
29. PCC Net: Perspective Crowd Counting via Spatial Convolutional Network10.1109/TCSVT.2019.2919139 ↗
30. Jiang, X., Xiao, Z., Zhang, B., Zhen, X., Cao, X., Doermann, D.S., and Shao, L. (2019, January 15–20). Crowd Counting and Density Estimation by Trellis Encoder-Decoder Networks. Proceedings of the 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), Long Beach, CA, USA.10.1109/CVPR.2019.00629 ↗
31. Liu, L., Qiu, Z., Li, G., Liu, S., Ouyang, W., and Lin, L. (November, January 27). Crowd Counting with Deep Structured Scale Integration Network. Proceedings of the 2019 IEEE/CVF International Conference on Computer Vision (ICCV), Seoul, Korea.10.1109/ICCV.2019.00186 ↗
32. Crowd counting by using multi-level density-based spatial information: A Multi-scale CNN framework10.1016/j.ins.2020.04.001 ↗
33. Luo, A., Yang, F., Li, X., Nie, D., Jiao, Z., Zhou, S., and Cheng, H. (2020). Hybrid Graph Neural Networks for Crowd Counting. arXiv.10.1609/aaai.v34i07.6839 ↗
34. Crowd counting based on attention-guided multi-scale fusion networks10.1016/j.neucom.2021.04.045 ↗
35. Zhou, F., Zhao, H., Zhang, Y., Zhang, Q., Liang, L., Li, Y., and Duan, Z. (2022). COMAL: Compositional multi-scale feature enhanced learning for crowd counting. Multimed. Tools Appl.10.1007/s11042-022-12249-9 ↗