Spatial and Channel Similarity-Aware Attention-Enhanced Network for Object Counting
Source abstract
Abstract
Precise object counting is crucial in practical applications, finding extensive utility across numerous societal domains. In the context of few-shot object counting, variations in object angles can significantly alter the distribution and distinguishability of object feature points, thereby increasing the difficulty of feature extraction. To address these challenges, a spatial and channel similarity-aware attention-enhancement network for few-shot scenarios is introduced. The network employs slice convolution and attention mechanisms within the spatial and channel dimensions, respectively. Through such means, it effectively extracts object features from diverse angles, adeptly surmounting the challenges in feature extraction engendered by angular diversity. Specifically, the network introduces a spatial similarity-aware module, which performs multi-angle matching of support and query features in the spatial dimension to enhance the model’s feature extraction capabilities. Additionally, a channel attention enhancement module is incorporated to weight and enhance critical channel features, improving the network’s ability to handle diverse object angles. Comprehensive experiments carried out on TRANCOS, CARPK, PUCPR+ and UCSD datasets demonstrate that the proposed network exhibits excellent counting performance and robust generalization capabilities. It offers an effective approach for precise object counting tasks.
Source: crossref · Quality: baseline
Research context
OpenAlex topics: Video Surveillance and Tracking Methods · Visual Attention and Saliency Detection · Image Enhancement Techniques
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
Affiliations
Qingdao Institute of Software, College of Computer Science and Technology, China University of Petroleum (East China), Qingdao 266580, China
Funding
Natural Science Foundation of Shandong Province · Qingdao Natural Science Foundation · the First Karamay City Science and Technology Innovation Talent-Core Science and Technology Innovation Talent, and the National Natural Science Foundation of China
References (37)
Show source-provided references
1. Zang, H., Peng, Y., Zhou, M., Li, G., Zheng, G., and Shen, H. (2024). Automatic detection and counting of wheat spike based on DMseg-Count. Sci. Rep., 14.10.1038/s41598-024-80244-1 ↗
2. SS-YOLOv8: Small-size object detection algorithm based on improved YOLOv8 for UAV imagery10.1007/s00530-024-01622-3 ↗
3. Study on deep learning-based detection of viable cell count in dialysis fluid images10.1186/s41100-024-00521-7 ↗
4. Fu, Q., Min, W., Li, C., Zhao, H., and Zhu, M. (2022, January 15–18). Dense Vehicle Counting Method Based on Deep Spatio-Temporal Network. Proceedings of the 2022 IEEE Smartworld, Ubiquitous Intelligence & Computing, Scalable Computing & Communications, Digital Twin, Privacy Computing, Metaverse, Autonomous & Trusted Vehicles (SmartWorld/UIC/ScalCom/DigitalTwin/PriComp/Meta), Haikou, China.10.1109/SmartWorld-UIC-ATC-ScalCom-DigitalTwin-PriComp-Metaverse56740.2022.00127 ↗
5. Deng, Z., and Yang, C. (2021, January 10–15). Multiple-step sampling for dense object detection and counting. Proceedings of the 2020 25th International Conference on Pattern Recognition (ICPR), Milan, Italy.10.1109/ICPR48806.2021.9412449 ↗
6. Wang, C., Zhang, H., Yang, L., Liu, S., and Cao, X. (2015, January 26–30). Deep people counting in extremely dense crowds. Proceedings of the 23rd ACM international conference on Multimedia, Brisbane, Australia.10.1145/2733373.2806337 ↗
7. Gao, G., Liu, Q., and Wang, Y. (2020, January 4–9). Counting dense objects in remote sensing images. Proceedings of the ICASSP 2020-2020 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), Virtual.10.1109/ICASSP40776.2020.9053690 ↗
8. Three-dimensional counting: An accurate and direct method to estimate numbers of cells in sectioned material10.1002/cne.902780305 ↗
9. Ge, W., and Collins, R.T. (2009, January 20–25). Marked point processes for crowd counting. Proceedings of the 2009 IEEE Conference on Computer Vision and Pattern Recognition, Miami, FL, USA.10.1109/CVPRW.2009.5206621 ↗
10. Monocular pedestrian detection: Survey and experiments10.1109/TPAMI.2008.260 ↗
11. Fast crowd density estimation with convolutional neural networks10.1016/j.engappai.2015.04.006 ↗
12. Li, Y., Zhang, X., and Chen, D. (2018, January 18–23). Csrnet: Dilated convolutional neural networks for understanding the highly congested scenes. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Salt Lake City, UT, USA.10.1109/CVPR.2018.00120 ↗
13. Zhang, Y., Zhou, D., Chen, S., Gao, S., and Ma, Y. (2016, January 27–30). Single-image crowd counting via multi-column convolutional neural network. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Las Vegas, NV, USA.10.1109/CVPR.2016.70 ↗
14. Pan, X., Shi, J., Luo, P., Wang, X., and Tang, X. (2018, January 2–7). Spatial as deep: Spatial cnn for traffic scene understanding. Proceedings of the AAAI Conference on Artificial Intelligence, New Orleans, LO, USA.10.1609/aaai.v32i1.12301 ↗
15. A survey of recent advances in cnn-based single image crowd counting and density estimation10.1016/j.patrec.2017.07.007 ↗
16. Chatterjee, S., Saha, S., and Mahapatra, P.R.S. (2024, January 20–22). A Two-Stage CNN Based Satellite Image Analysis Framework for Estimating Building-Count in Residential Built-Up Area. Proceedings of the International Conference on Data Management, Analytics & Innovation, Pune, India.10.1007/978-981-97-3245-6_2 ↗
17. Vehicle object counting network based on feature pyramid split attention mechanism10.1007/s00371-023-02808-y ↗
18. Fu, J., Yang, H., Liu, P., and Hu, Y. (2018, January 16–18). A CNN-RNN neural network join long short-term memory for crowd counting and density estimation. Proceedings of the 2018 IEEE International Conference on Advanced Manufacturing (ICAM), Yunlin, Taiwan.10.1109/AMCON.2018.8614939 ↗
19. Faster R-CNN: Towards real-time object detection with region proposal networks10.1109/TPAMI.2016.2577031 ↗
20. Ciregan, D., Meier, U., and Schmidhuber, J. (2012, January 16–21). Multi-column deep neural networks for image classification. Proceedings of the 2012 IEEE Conference on Computer Vision and Pattern Recognition, Providence, RI, USA.10.1109/CVPR.2012.6248110 ↗
21. Sermanet, P., Chintala, S., and LeCun, Y. (2012, January 11–15). Convolutional neural networks applied to house numbers digit classification. Proceedings of the 21st International Conference on Pattern Recognition (ICPR2012), Tsukuba, Japan.
22. DASECount: Domain-agnostic sample-efficient wireless indoor crowd counting via few-shot learning10.1109/JIOT.2022.3228557 ↗
23. Automatic plant counting and location based on a few-shot learning technique10.1109/JSTARS.2020.3025790 ↗
24. Kang, B., Liu, Z., Wang, X., Yu, F., Feng, J., and Darrell, T. (November, January 27). Few-shot object detection via feature reweighting. Proceedings of the IEEE/CVF International Conference on Computer Vision, Seoul, Republic of Korea.
25. Han, T., Bai, L., Liu, L., and Ouyang, W. (2023, January 2–6). Steerer: Resolving scale variations for counting and localization via selective inheritance learning. Proceedings of the IEEE/CVF International Conference on Computer Vision, Paris, France.10.1109/ICCV51070.2023.01997 ↗
26. Feng, X., Han, L., Tao, P., and Jiang, Y. (2023, January 25–27). Attention Enhanced Multi-Scale Feature Map Fusion Few Shot Learning. Proceedings of the 2023 3rd Asia-Pacific Conference on Communications Technology and Computer Science (ACCTCS), Shenyang, China.10.1109/ACCTCS58815.2023.00096 ↗
27. Pedestrian detection via classification on riemannian manifolds10.1109/TPAMI.2008.75 ↗
28. Ranjan, V., Sharma, U., Nguyen, T., and Hoai, M. (2021, January 20–25). Learning to count everything. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, Nashville, TN, USA.10.1109/CVPR46437.2021.00340 ↗
29. You, Z., Yang, K., Luo, W., Lu, X., Cui, L., and Le, X. (2023, January 2–7). Few-shot object counting with similarity-aware feature enhancement. Proceedings of the IEEE/CVF Winter Conference on Applications of Computer Vision, Waikoloa, HI, USA.10.1109/WACV56688.2023.00625 ↗
30. Quan, K.A.C., Vuong, H.G., and Tran, M.T. (2023, January 5–6). ViT-FFrCnt: A Few-shot Fruit Counting Approach with Multiscale Vision Transformer. Proceedings of the 2023 International Conference on Multimedia Analysis and Pattern Recognition (MAPR), Quy Nhon, Vietnam.10.1109/MAPR59823.2023.10289072 ↗
31. Parameter-free similarity-aware attention module for medical image classification and segmentation10.1109/TETCI.2022.3199733 ↗
32. Hu, J., Shen, L., and Sun, G. (2018, January 18–22). Squeeze-and-excitation networks. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Salt Lake City, UT, USA.10.1109/CVPR.2018.00745 ↗
33. Guerrero-Gómez-Olmedo, R., Torre-Jiménez, B., López-Sastre, R., Maldonado-Bascón, S., and Onoro-Rubio, D. (2015, January 17–19). Extremely overlapping vehicle counting. Proceedings of the Pattern Recognition and Image Analysis: 7th Iberian Conference, IbPRIA 2015, Santiago de Compostela, Spain. Proceedings 7.10.1007/978-3-319-19390-8_48 ↗
34. Hsieh, M.R., Lin, Y.L., and Hsu, W.H. (2017, January 22–29). Drone-based object counting by spatially regularized regional proposal network. Proceedings of the IEEE International Conference on Computer Vision, Venice, Italy.10.1109/ICCV.2017.446 ↗
35. Chan, A.B., Liang, Z.S.J., and Vasconcelos, N. (2008, January 23–28). Privacy preserving crowd monitoring: Counting people without people models or tracking. Proceedings of the 2008 IEEE Conference on Computer Vision and Pattern Recognition, Anchorage, AK, USA.10.1109/CVPR.2008.4587569 ↗
36. Kingma, D.P., and Ba, J. (2014). Adam: A method for stochastic optimization. arXiv.
37. Kang, S., Moon, W., Kim, E., and Heo, J.P. (2024, January 20–27). VLCounter: Text-Aware Visual Representation for Zero-Shot Object Counting. Proceedings of the AAAI Conference on Artificial Intelligence, Vancouver, BC, Canada.10.1609/aaai.v38i3.28050 ↗