A Novel Dual Mixing Attention Network for UAV-Based Vehicle Re-Identification
Source abstract
Abstract
Vehicle re-identification research under surveillance cameras has yielded impressive results. However, the challenge of unmanned aerial vehicle (UAV)-based vehicle re-identification (ReID) presents a high degree of flexibility, mainly due to complicated shooting angles, occlusions, low discrimination of top–down features, and significant changes in vehicle scales. To address this, we propose a novel dual mixing attention network (DMANet) to extract discriminative features robust to variations in viewpoint. Specifically, we first present a plug-and-play dual mixing attention module (DMAM) to capture pixel-level pairwise relationships and channel dependencies, where DMAM is composed of spatial mixing attention (SMA) and channel mixing attention (CMA). First, the original feature is divided according to the spatial and channel dimensions to obtain multiple subspaces. Then, a learnable weight is applied to capture the dependencies between local features in the mixture space. Finally, the features extracted from all subspaces are aggregated to promote their comprehensive feature interaction. In addition, DMAM can be easily plugged into any depth of the backbone network to improve vehicle recognition. The experimental results show that the proposed structure performs better than the representative method in the UAV-based vehicle ReID. Our code and models will be published publicly.
Source: crossref · Quality: baseline
Research context
OpenAlex topics: Video Surveillance and Tracking Methods · Advanced Neural Network Applications · Autonomous Vehicle Technology and Safety
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
Affiliations
PAP Engineering University, Xi’an 710086, China
Funding
military equipment comprehensive research project · PAP independently selected projects · PAP Engineering University research innovation team project
References (51)
Show source-provided references
1. Li, M., Wei, M., He, X., and Shen, F. (2022, January 16–19). Enhancing Part Features via Contrastive Attention Module for Vehicle Re-identification. Proceedings of the 2022 IEEE International Conference on Image Processing (ICIP), Bordeaux, France.10.1109/ICIP46576.2022.9897943 ↗
2. Shen, F., Peng, X., Wang, L., Zhang, X., Shu, M., and Wang, Y. (2022, January 18–22). HSGM: A Hierarchical Similarity Graph Module for Object Re-identification. Proceedings of the 2022 IEEE International Conference on Multimedia and Expo (ICME), Taipei, Taiwan.10.1109/ICME52920.2022.9859883 ↗
3. Han, K., Wang, Q., Zhu, M., and Zhang, X. (2023). PVTReID: A Quick Person Re-Identification Based Pyramid Vision Transformer. Appl. Sci., 13.10.20944/preprints202308.0373.v1 ↗
4. Qiao, W., Ren, W., and Zhao, L. (2022). Vehicle re-identification in aerial imagery based on normalized virtual Softmax loss. Appl. Sci., 12.10.3390/app12094731 ↗
5. Attributes guided feature learning for vehicle re-identification10.1109/TETCI.2021.3127906 ↗
6. Shen, F., Wei, M., and Ren, J. (2022). HSGNet: Object Re-identification with Hierarchical Similarity Graph Network. arXiv.
7. Shen, F., Shu, X., Du, X., and Tang, J. (November, January 29). Pedestrian-specific Bipartite-aware Similarity Learning for Text-based Person Retrieval. Proceedings of the 31th ACM International Conference on Multimedia, Ottawa, ON, Canada.
8. Group-wise learning for weakly supervised semantic segmentation10.1109/TIP.2021.3132834 ↗
9. Cascaded parsing of human-object interaction recognition10.1109/TPAMI.2021.3049156 ↗
10. A sample-proxy dual triplet loss function for object re-identification10.1049/ipr2.12593 ↗
11. Viewpoint robust knowledge distillation for accelerating vehicle re-identification10.1186/s13634-021-00767-x ↗
12. Dual modal meta metric learning for attribute-image person re-identification
13. Fu, X., Shen, F., Du, X., and Li, Z. (2022, January 22–25). Bag of Tricks for “Vision Meet Alage” Object Detection Challenge. Proceedings of the 2022 6th International Conference on Universal Village (UV), Boston, MA, USA.10.1109/UV56588.2022.10185500 ↗
14. Shen, F., Wang, Z., Wang, Z., Fu, X., Chen, J., Du, X., and Tang, J. (2022). A Competitive Method for Dog Nose-print Re-identification. arXiv.
15. Qiao, C., Shen, F., Wang, X., Wang, R., Cao, F., Zhao, S., and Li, C. (November, January 31). A Novel Multi-Frequency Coordinated Module for SAR Ship Detection. Proceedings of the 2022 IEEE 34th International Conference on Tools with Artificial Intelligence (ICTAI), Macao, China.10.1109/ICTAI56018.2022.00124 ↗
16. Hu, J., Shen, L., and Sun, G. (2018, January 18–23). Squeeze-and-excitation networks. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Salt Lake City, UT, USA.10.1109/CVPR.2018.00745 ↗
17. Li, X., Wang, W., Hu, X., and Yang, J. (2019, January 15–20). Selective kernel networks. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, Long Beach, CA, USA.10.1109/CVPR.2019.00060 ↗
18. Wang, Q., Wu, B., Zhu, P., Li, P., Zuo, W., and Hu, Q. (2020, January 13–19). ECA-Net: Efficient channel attention for deep convolutional neural networks. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, Seattle, WA, USA.10.1109/CVPR42600.2020.01155 ↗
19. Zhang, Q.L., and Yang, Y.B. (2021, January 6–11). Sa-net: Shuffle attention for deep convolutional neural networks. Proceedings of the ICASSP 2021–2021 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), Toronto, ON, Canada.10.1109/ICASSP39728.2021.9414568 ↗
20. Park, J., Woo, S., Lee, J.Y., and Kweon, I.S. (2018). Bam: Bottleneck attention module. arXiv.
21. Fu, J., Liu, J., Tian, H., Li, Y., Bao, Y., Fang, Z., and Lu, H. (2019, January 15–20). Dual attention network for scene segmentation. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, Long Beach, CA, USA.10.1109/CVPR.2019.00326 ↗
22. Shen, F., Du, X., Zhang, L., and Tang, J. (2023). Triplet Contrastive Learning for Unsupervised Vehicle Re-identification. arXiv.
23. Vehicle re-identification with dynamic time windows for vehicle passage time estimation10.1109/TITS.2011.2140318 ↗
24. Arterial travel time estimation based on vehicle re-identification using wireless magnetic sensors10.1016/j.trc.2009.04.003 ↗
25. Silva, S.M., and Jung, C.R. (2018, January 8–14). License plate detection and recognition in unconstrained scenarios. Proceedings of the European Conference on Computer Vision (ECCV), Munich, Germany.10.1007/978-3-030-01258-8_36 ↗
26. Watcharapinchai, N., and Rujikietgumjorn, S. (September, January 29). Approximate license plate string matching for vehicle re-identification. Proceedings of the 2017 14th IEEE International Conference on Advanced Video and Signal Based Surveillance (AVSS), Lecce, Italy.10.1109/AVSS.2017.8078538 ↗
27. Large-scale vehicle detection, indexing, and search in urban surveillance videos10.1109/TMM.2011.2170666 ↗
28. Matei, B.C., Sawhney, H.S., and Samarasekera, S. (2011, January 20–25). Vehicle tracking across nonoverlapping cameras using joint kinematic and appearance features. Proceedings of the CVPR 2011, Colorado Springs, CO, USA.10.1109/CVPR.2011.5995575 ↗
29. Huang, P., Huang, R., Huang, J., Yangchen, R., He, Z., Li, X., and Chen, J. (2019, January 16–20). Deep Feature Fusion with Multiple Granularity for Vehicle Re-identification. Proceedings of the CVPR Workshops, Long Beach, CA, USA.
30. Exploring spatial significance via hybrid pyramidal graph network for vehicle re-identification10.1109/TITS.2021.3086142 ↗
31. Git: Graph interactive transformer for vehicle re-identification10.1109/TIP.2023.3238642 ↗
32. An Efficient Multiresolution Network for Vehicle Reidentification10.1109/JIOT.2021.3119525 ↗
33. Matnet: Motion-attentive transition network for zero-shot video object segmentation10.1109/TIP.2020.3013162 ↗
34. Khorramshahi, P., Kumar, A., Peri, N., Rambhatla, S.S., Chen, J.C., and Chellappa, R. (November, January 27). A dual-path model with adaptive attention for vehicle re-identification. Proceedings of the IEEE/CVF International Conference on Computer Vision, Seoul, Republic of Korea.
35. Teng, S., Liu, X., Zhang, S., and Huang, Q. (2018, January 21–22). Scan: Spatial and channel attention network for vehicle re-identification. Proceedings of the Advances in Multimedia Information Processing—PCM 2018: 19th Pacific-Rim Conference on Multimedia, Hefei, China. Proceedings, Part III 19.10.1007/978-3-030-00764-5_32 ↗
36. Viewpoint and scale consistency reinforcement for UAV vehicle re-identification10.1007/s11263-020-01402-2 ↗
37. Song, Y., Liu, C., Zhang, W., Nie, Z., and Chen, L. (2020, January 27–30). View-Decision Based Compound Match Learning for Vehicle Re-identification in UAV Surveillance. Proceedings of the 2020 39th Chinese Control Conference (CCC), Shenyang, China.10.23919/CCC50068.2020.9189528 ↗
38. Shen, F., He, X., Wei, M., and Xie, Y. (2021). A competitive method to vipriors object detection challenge. arXiv.
39. Shen, Y., Xiao, T., Li, H., Yi, S., and Wang, X. (2017, January 22–29). Learning deep neural networks for vehicle re-id with visual-spatio-temporal path proposals. Proceedings of the IEEE International Conference on Computer Vision, Venice, Italy.10.1109/ICCV.2017.210 ↗
40. Chatfield, K., Simonyan, K., Vedaldi, A., and Zisserman, A. (2014). Return of the devil in the details: Delving deep into convolutional nets. arXiv.10.5244/C.28.6 ↗
41. Szegedy, C., Liu, W., Jia, Y., Sermanet, P., Reed, S., Anguelov, D., Erhan, D., Vanhoucke, V., and Rabinovich, A. (2015, January 7–12). Going deeper with convolutions. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Boston, MA, USA.10.1109/CVPR.2015.7298594 ↗
42. Liu, X., Zhang, S., Huang, Q., and Gao, W. (2018, January 23–27). Ram: A region-aware deep model for vehicle re-identification. Proceedings of the 2018 IEEE International Conference on Multimedia and Expo (ICME), San Diego, CA, USA.10.1109/ICME.2018.8486589 ↗
43. Yao, H., Zhang, S., Zhang, Y., Li, J., and Tian, Q. (2017, January 23–27). One-shot fine-grained instance retrieval. Proceedings of the 25th ACM International Conference on Multimedia, Mountain View, CA, USA.10.1145/3123266.3123278 ↗
44. Attention mask-based network with simple color annotation for UAV vehicle re-identification
45. Bromley, J., Guyon, I., LeCun, Y., Säckinger, E., and Shah, R. (1993). Signature verification using a “siamese” time delay neural network. Adv. Neural Inf. Process. Syst., 6.10.1142/9789812797926_0003 ↗
46. Liao, S., Hu, Y., Zhu, X., and Li, S.Z. (2015, January 7–12). Person re-identification by local maximal occurrence representation and metric learning. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Boston, MA, USA.10.1109/CVPR.2015.7298832 ↗
47. Simonyan, K., and Zisserman, A. (2014). Very deep convolutional networks for large-scale image recognition. arXiv.
48. He, K., Zhang, X., Ren, S., and Sun, J. (2016, January 27–30). Deep residual learning for image recognition. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Las Vegas, NV, USA.10.1109/CVPR.2016.90 ↗
49. Pan, X., Ge, C., Lu, R., Song, S., Chen, G., Huang, Z., and Huang, G. (2022, January 18–24). On the integration of self-attention and convolution. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, New Orleans, LA, USA.10.1109/CVPR52688.2022.00089 ↗
50. Contextual transformer networks for visual recognition10.1109/TPAMI.2022.3164083 ↗
51. Liu, H., Liu, F., Fan, X., and Huang, D. (2021). Polarized self-attention: Towards high-quality pixel-wise regression. arXiv.10.1016/j.neucom.2022.07.054 ↗