Learning to Count Crowds from Low-Altitude Aerial Views via Point-Level Supervision and Feature-Adaptive Fusion
Source abstract
Abstract
Counting small, densely clustered objects from low-altitude aerial views is challenging due to large scale variations, complex backgrounds, and severe occlusion, which often degrade the performance of fully supervised or density-regression methods. To address these issues, we propose a weakly supervised crowd counting framework that leverages point-level supervision and a feature-adaptive fusion strategy to enhance perception under low-altitude aerial views. The network comprises a front-end feature extractor and a back-end fusion module. The front-end adopts the first 13 convolutional layers of VGG16-BN to capture multi-scale semantic features while preserving crucial spatial details. The back-end integrates a Feature-Adaptive Fusion module and a Multi-Scale Feature Aggregation module: the former dynamically adjusts fusion weights across scales to improve robustness to scale variation, and the latter aggregates multi-scale representations to better capture targets in dense, complex scenes. Point-level annotations serve as weak supervision to substantially reduce labeling cost while enabling accurate localization of small individual instances. Experiments on several public datasets, including ShanghaiTech Part A, ShanghaiTech Part B, and UCF_CC_50, demonstrate that our method surpasses existing mainstream approaches, effectively mitigating scale variation, background clutter, and occlusion, and providing an efficient and scalable weakly supervised solution for small-object counting.
Source: crossref · Quality: baseline
Research context
OpenAlex topics: Video Surveillance and Tracking Methods · Advanced Neural Network Applications · UAV Applications and Optimization
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
Affiliations
College of Computer Science, Beijing Information Science and Technology University, Beijing 100192, China
State Post Bureau Safety Supervision Center, Beijing 100091, China
Funding
Beijing Information Science and Technology University
References (35)
Show source-provided references
1. Zhang, Y., Zhou, D., Chen, S., Gao, S., and Ma, Y. (2016, January 27–30). Single-image crowd counting via multi-column convolutional neural network. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Las Vegas, NV, USA.10.1109/CVPR.2016.70 ↗
2. Wu, B., and Nevatia, R. (2005, January 17–20). Detection of multiple, partially occluded humans in a single image by bayesian combination of edgelet part detectors. Proceedings of the Tenth IEEE International Conference on Computer Vision (ICCV’05), Beijing, China.
3. Jones, M.J., and Snow, D. (2008, January 8–11). Pedestrian detection using boosted features over many frames. Proceedings of the 2008 19th International Conference on Pattern Recognition, Tampa, FL, USA.10.1109/ICPR.2008.4761703 ↗
4. Dalal, N., and Triggs, B. (2005, January 20–26). Histograms of oriented gradients for human detection. Proceedings of the 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR’05), San Diego, CA, USA.
5. People-flow counting in complex environments by combining depth and color information10.1007/s11042-016-3344-z ↗
6. Pham, V.Q., Kozakaya, T., Yamaguchi, O., and Okada, R. (2015, January 7–13). Count forest: Co-voting uncertain number of targets using random forest for crowd density estimation. Proceedings of the IEEE International Conference on Computer Vision, Santiago, Chile.10.1109/ICCV.2015.372 ↗
7. Viola, V., and Snow, D. (2003, January 13–16). Detecting pedestrians using patterns of motion and appearance. Proceedings of the Ninth IEEE International Conference on Computer Vision, Nice, France.10.1109/ICCV.2003.1238422 ↗
8. Li, M., Zhang, Z., Huang, K., and Tan, T. (2008, January 8–11). Estimating the number of people in crowded scenes by mid based foreground segmentation and head-shoulder detection. Proceedings of the 2008 19th International Conference on Pattern Recognition, Tampa, FL, USA.10.1109/ICPR.2008.4761705 ↗
9. Segmentation and tracking of multiple humans in crowded environments10.1109/TPAMI.2007.70770 ↗
10. An evaluation of crowd counting methods, features and regression models10.1016/j.cviu.2014.07.008 ↗
11. Paragios, N., and Ramesh, V. (2001, January 8–14). A MRF-based approach for real-time subway monitoring. Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition CVPR 2001, Kauai, HI, USA.
12. Chan, A.B., Liang, Z.-S.J., and Vasconcelos, N. (2008, January 23–28). Privacy preserving crowd monitoring: Counting people without people models or tracking. Proceedings of the 2008 IEEE Conference on Computer Vision and Pattern Recognition, Anchorage, AK, USA.10.1109/CVPR.2008.4587569 ↗
13. Lempitsky, V., and Zisserman, A. (2010). Learning to count objects in images. Adv. Neural Inf. Process. Syst., 23.
14. Gradient-based learning applied to document recognition10.1109/5.726791 ↗
15. Fast crowd density estimation with convolutional neural networks10.1016/j.engappai.2015.04.006 ↗
16. Wang, C., Zhang, H., Yang, L., Liu, S., and Cao, X. (2015, January 26–30). Deep people counting in extremely dense crowds. Proceedings of the 23rd ACM International Conference on Multimedia, Brisbane, Australia.10.1145/2733373.2806337 ↗
17. Walach, E., and Wolf, L. (2016, January 11–14). Learning to count with cnn boosting. Proceedings of the Computer Vision–ECCV 2016: 14th European Conference, Amsterdam, The Netherlands. Proceedings, Part II 14.
18. Babu Sam, D., Surya, S., and Venkatesh Babu, R. (2017, January 21–26). Switching convolutional neural network for crowd counting. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Honolulu, HI, USA.10.1109/CVPR.2017.429 ↗
19. Sindagi, V.A., and Patel, V.M. (2017, January 22–29). Generating high-quality crowd density maps using contextual pyramid cnns. Proceedings of the IEEE International Conference on Computer Vision, Venice, Italy.10.1109/ICCV.2017.206 ↗
20. Guo, D., Li, K., Zha, Z.-J., and Wang, M. (2019, January 21–25). Dadnet: Dilated-attention-deformable convnet for crowd counting. Proceedings of the 27th ACM International Conference on Multimedia, Nice, France.10.1145/3343031.3350881 ↗
21. Li, Y., Zhang, X., and Chen, D. (2018, January 18–22). Csrnet: Dilated convolutional neural networks for understanding the highly congested scenes. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Salt Lake City, UT, USA.10.1109/CVPR.2018.00120 ↗
22. Cao, X., Wang, Z., Zhao, Y., and Su, F. (2018, January 8–14). Scale aggregation network for accurate and efficient crowd counting. Proceedings of the European Conference on Computer Vision (ECCV), Munich, Germany.10.1007/978-3-030-01228-1_45 ↗
23. Liu, N., Long, Y., Zou, C., Niu, Q., Pan, L., and Wu, H. (2019, January 16–20). Adcrowdnet: An attention-injective deformable convolutional network for crowd understanding. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, Long Beach, CA, USA.10.1109/CVPR.2019.00334 ↗
24. Song, Q., Wang, C., Jiang, Z., Wang, Y., Tai, Y., Wang, C., Li, J., Huang, F., and Wu, Y. (2021, January 11–17). Rethinking counting and localization in crowds: A purely point-based framework. Proceedings of the IEEE/CVF International Conference on Computer Vision, Montreal, BC, Canada.10.1109/ICCV48922.2021.00335 ↗
25. Distribution matching for crowd counting
26. Liu, H., Zhao, Q., Ma, Y., Chong, M.O., and Zhang, Y. (2021, January 19–27). Bipartite Matching for Crowd Counting with Point Supervision. Proceedings of the 30th International Joint Conference on Artificial Intelligence (IJCAI), Virtual.10.24963/ijcai.2021/119 ↗
27. Chen, L., Yang, T., Zhang, X., Zhang, W., and Sun, J. (2021, January 19–25). Points as queries: Weakly semi-supervised object detection by points. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, Virtual.10.1109/CVPR46437.2021.00871 ↗
28. Zhu, X., Su, W., Lu, L., Li, B., Wang, X., and Dai, J. (2020). Deformable detr: Deformable transformers for end-to-end object detection. arXiv.
29. Idrees, H., Saleemi, I., Seibert, C., and Shah, M. (2013, January 23–28). Multi-source multi-scale counting in extremely dense crowd images. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Portland, OR, USA.10.1109/CVPR.2013.329 ↗
30. Simonyan, K., and Zisserman, A. (2014). Very deep convolutional networks for large-scale image recognition. arXiv.
31. Liu, W., Salzmann, M., and Fua, P. (2019, January 16–20). Context-aware crowd counting. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, Long Beach, CA, USA.10.1109/CVPR.2019.00524 ↗
32. Cheng, Z.-Q., Dai, Q., Li, H., Song, J., Wu, X., and Hauptmann, A.G. (2022, January 18–24). Rethinking spatial invariance of convolutional networks for object counting. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, New Orleans, LA, USA.10.1109/CVPR52688.2022.01902 ↗
33. Liang, D., Xu, W., and Bai, X. (2022, January 23–27). An end-to-end transformer model for crowd localization. Proceedings of the European Conference on Computer Vision (ECCV), Tel Aviv, Israel.10.1007/978-3-031-19769-7_3 ↗
34. Ma, H.-Y., Zhang, L., and Wei, X.-Y. (February, January 29). Fgenet: Fine-grained extraction network for congested crowd counting. Proceedings of the International Conference on Multimedia Modeling (MMM), Amsterdam, The Netherlands.
35. Ma, H.-Y., Zhang, L., and Shi, S. (2024). VMambaCC: A Visual State Space Model for Crowd Counting. arXiv.