journal article·2025-01-26Open access

Pedestrian Re-Identification Algorithm Based on Unmanned Aerial Vehicle Imagery

Lili Song, Xin Jin, Jianfeng Han, Jie Yao

Applied Sciences· Volume 15· Issue 3

Abstract

Pedestrian re-identification in complex scenarios is often hindered by challenges such as viewpoint diversity, background interference, and behavioral complexity, which traditional methods struggle to address effectively in wide-area surveillance. Unmanned Aerial Vehicles (UAVs) offer a promising solution to this problem due to their flexibility and extensive coverage capabilities. However, UAV aerial images introduce additional challenges, including significant viewpoint variations and the complexity of pedestrian behaviors. To address these issues, this paper proposes a Transformer-based model that integrates a multi-scale graph convolution network (MU-GCN) with a non-local attention mechanism to address these challenges. A MU-GCN enhances feature extraction by employing graph convolutional networks to improve feature representation after extracting detailed features at various scales through multi-scale convolution kernels. This strengthens the model’s focus on local information. Meanwhile, the non-local attention mechanism enhances the model’s capacity to capture global contextual information by modeling dependencies between distant regions in the image. This approach is better suited for the unique characteristics of UAV aerial imagery. Experimental results demonstrate that, compared to the baseline model, the proposed method achieves improvements of 9.5% in mean average precision (mAP) and 4.9% in Rank-1 accuracy, validating the effectiveness of the model.
Source: crossref · Quality: baseline

Research context

OpenAlex topics: Video Surveillance and Tracking Methods · Remote Sensing and Land Use · Advanced Measurement and Detection Methods

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

School of Information Engineering, Inner Mongolia University of Technology, Hohhot 010080, China

Inner Mongolia Autonomous Region Key Laboratory of Intelligent Perception and System Engineering, Hohhot 010080, China

References (40)

Show source-provided references
1. Deep learning for person re-identification: A survey and outlook10.1109/TPAMI.2021.3054775 ↗
2. Rybak, Ł., and Dudczyk, J. (2020). A geometrical divide of data particle in gravitational classification of moons and circles data sets. Entropy, 22.10.3390/e22101088 ↗
3. Rybak, Ł., and Dudczyk, J. (2021). Variant of data particle geometrical divide for imbalanced data sets classification by the example of occupancy detection. Appl. Sci., 11.10.3390/app11114970 ↗
4. Multi-object detection and tracking, based on DNN, for autonomous vehicles: A review10.1109/JSEN.2020.3041615 ↗
5. Radar/visual fusion with fuse-before-track strategy for low altitude non-cooperative sense and avoid10.1016/j.ast.2024.108946 ↗
6. Applying deep learning to real-time UAV-based forest monitoring: Leveraging multi-sensor imagery for improved results10.1016/j.eswa.2023.123107 ↗
7. Illumination-aware image fusion for around-the-clock human detection in adverse environments from unmanned aerial vehicle10.1016/j.eswa.2022.117413 ↗
8. Liu, F., Shan, J.Y., Xiong, B.Y., and Fang, Z. (2022). A real-time and multi-sensor-based landing area recognition system for UAVs. Drones, 6.10.3390/drones6050118 ↗
9. Cross-layer triple-branch parallel fusion network for small object detection in uav images10.1109/ACCESS.2023.3269290 ↗
10. Li, Y., Li, Q., Pan, J., Zhou, Y., Zhu, H., Wei, H., and Liu, C. (2024). Sod-yolo: Small-object-detection algorithm based on improved yolov8 for UAV images. Remote Sens., 16.10.3390/rs16163057 ↗
11. Yue, M., Zhang, L., Huang, J., and Zhang, H. (2024). Lightweight and efficient tiny-object detection based on improved YOLOv8n for UAV aerial images. Drones, 8.10.3390/drones8070276 ↗
12. Sun, Y., Zheng, L., Deng, W., and Wang, S. (2017, January 22–29). Svdnet for pedestrian retrieval. Proceedings of the IEEE International Conference on Computer Vision, Venice, Italy.10.1109/ICCV.2017.410 ↗
13. Zhang, X., Luo, H., Fan, X., Xiang, W., Sun, Y., Xiao, Q., Jiang, W., Zhang, C., and Sun, J. (2017). Alignedreid: Surpassing human-level performance in person re-identification. arXiv.
14. Zhou, K., Yang, Y., Cavallaro, A., and Xiang, T. (November, January 27). Omni-scale feature learning for person re-identification. Proceedings of the IEEE/CVF International Conference on Computer Vision, Seoul, Republic of Korea.
15. Chen, T., Ding, S., Xie, J., Yuan, Y., Chen, W., Yang, Y., Ren, Z., and Wang, Z. (November, January 27). Abd-net: Attentive but diverse person re-identification. Proceedings of the IEEE/CVF International Conference on Computer Vision, Seoul, Republic of Korea.
16. Zhu, C., Zhou, W., and Ma, J. (2024). Person Re-Identification Network Based on Edge-Enhanced Feature Extraction and Inter-Part Relationship Modeling. Appl. Sci., 14.10.3390/app14188244 ↗
17. Pedestrian Re-Identification Algorithm Based on Attention Pooling Saliency Region Detection and Matching10.1109/TCSS.2022.3233864 ↗
18. Margin CosReid Network for Pedestrian Re-Identification10.3390/app11041775 ↗
19. Khaldi, K., Mantini, P., and Shah, S.K. (2022, January 6–10). Unsupervised person re-identification based on skeleton joints using graph convolutional networks. Proceedings of the International Conference on Image Analysis and Processing, Bologna, Italy.10.1007/978-3-031-06433-3_12 ↗
20. Dai, Z., Wang, G., Yuan, W., Zhu, S., and Tan, P. (2022, January 4–8). Cluster contrast for unsupervised person re-identification. Proceedings of the Asian Conference on Computer Vision, Macau, China.10.1007/978-3-031-26351-4_20 ↗
21. Margin CosReid Network for Pedestrian Re-Identification10.1016/j.patcog.2023.110045 ↗
22. Improving unsupervised pedestrian re-identification with enhanced feature representation and robust clustering10.1049/cvi2.12309 ↗
23. Lin, Y., Dong, X., Zheng, L., Yan, Y., and Yang, Y. (February, January 27). A bottom-up clustering approach to unsupervised person re-identification. Proceedings of the AAAI Conference on Artificial Intelligence, Honolulu, HI, USA.
24. Zeng, K., Ning, M., Wang, Y., and Guo, Y. (2020, January 13–19). Hierarchical clustering with hard-batch triplet loss for person re-identification. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, Seattle, WA, USA.10.1109/CVPR42600.2020.01367 ↗
25. Bai, Z., Wang, Z., Wang, J., Hu, D., and Ding, E. (2020, January 13–19). Unsupervised multi-source domain adaptation for person re-identification. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, Washington, DC, USA.
26. Pedestrian re-identification algorithm based on visual attention-positive sample generation network deep learning model10.1016/j.inffus.2022.07.002 ↗
27. Alexey, D. (2020). An image is worth 16 × 16 words: Transformers for image recognition at scale. arXiv.
28. He, S., Luo, H., Wang, P., Wang, F., Li, H., and Jiang, W. (2021, January 10–17). Transreid: Transformer-based object re-identification. Proceedings of the IEEE/CVF International Conference on Computer Cision, Montreal, BC, Canada.10.1109/ICCV48922.2021.01474 ↗
29. Xu, L., Peng, H., Lu, X., and Xia, D. (2022, January 23–25). Meta-transfer learning for person re-identification in aerial imagery. Proceedings of the CCF Conference on Computer Supported Cooperative Work and Social Computing, Taiyuan, China.10.1007/978-981-99-2385-4_48 ↗
30. Learning to generalize aerial person re-identification using the meta-transfer method10.1002/cpe.7687 ↗
31. Person re-identification in aerial imagery10.1109/TMM.2020.2977528 ↗
32. Lu, Z., Chen, H., Lai, J.H., Jiao, B., and Zhang, Y. (2024, January 18–20). Region Aware Transformer with Intra-Class Compact for Unsupervised Aerial Person Re-identification. Proceedings of the Chinese Conference on Pattern Recognition and Computer Vision (PRCV), Wulumuqi, China.10.1007/978-981-97-8858-3_17 ↗
33. Khaldi, K., Nguyen, V.D., and Mantini, P. (2024, January 3–8). Unsupervised person re-identification in aerial imagery. Proceedings of the IEEE/CVF Winter Conference on Applications of Computer Vision, Waikoloa, HI, USA.10.1109/WACVW60836.2024.00034 ↗
34. Khaldi, K., Nguyen, V.D., Mantini, P., and Shah, S. (2018). Adapted deep feature fusion for person re-identification in aerial images. Autonomous Systems: Sensors, Vehicles, Security, and the Internet of Everything, SPIE.
35. Multi-resolution feature perception network for UAV person re-identification10.1007/s11042-023-17937-8 ↗
36. Deep person re-identification in UAV images10.1186/s13634-019-0647-z ↗
37. Zhang, S., Li, Y., Wu, X., Chu, Z., and Li, L. (2024). MRG-T: Mask-Relation-Guided Transformer for Remote Vision-Based Pedestrian Attribute Recognition in Aerial Imagery. Remote Sens., 16.10.3390/rs16071216 ↗
38. Transformer based light weight person re-identification in unmanned aerial vehicle images
39. Parameter instance learning with enhanced vision transformers for aerial person re-identification10.1002/cpe.8045 ↗
40. Multi-granularity attention in attention for person re-identification in aerial images10.1007/s00371-023-03074-8 ↗