journal article·2023-03-23Open access

Research on Vehicle Re-Identification Algorithm Based on Fusion Attention Method

Peng Chen, Shuang Liu, Simon Kolmanič

Applied Sciences· Volume 13· Issue 7

Abstract

The specific task of vehicle re-identification is how to quickly and correctly match the same vehicle in different scenarios. In order to solve the problem of inter-class similarity and environmental interference in vehicle images in complex scenes, one fusion attention method is put forward based on the idea of obtaining the distinguishing features of details—the mechanism for the vehicle re-identification method. First, the vehicle image is preprocessed to restore the image’s attributes better. Then, the processed image is sent to ResNet50 to extract the features of the second and third layers, respectively. Then, the feature fusion is carried out through the two-layer attention mechanism for a network model. This model can better focus on local detail features, and global features are constructed and named SDLAU-Reid. In the training process, a data augmentation strategy of random erasure is adopted to improve the robustness. The experimental results show that the mAP and rank-k indicators of the model on VeRi-776 and the VehicleID are better than the results of the existing vehicle re-identification algorithms, which verifies the algorithm’s effectiveness.
Source: crossref · Quality: baseline

Research context

OpenAlex topics: Video Surveillance and Tracking Methods · Advanced Neural Network Applications · Industrial Vision Systems and Defect Detection

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

School of Software, Dalian Neusoft University of Information, Dalian 116023, China

School of Computer Science and Engineering, Dalian Minzu University, Dalian 116600, China

Faculty of Electrical Engineering and Computer Science, University of Maribor, Koroska cesta 46, 2000 Maribor, Slovenia

Funding

Chinese-Slovenian Scientific and Technological 2021 Cooperation Project of the Ministry of Science and Technology · Liaoning Province Economic and Social Development Research Project 2023 of Provincial Social Science Association

References (32)

Show source-provided references
1. Liu, X., Liu, W., Ma, H., and Fu, H. (2016, January 11). Large-Scale Vehicle Re-Identification in Urban Surveillance Videos. Proceedings of the 2016 IEEE International Conference on Multimedia and Expo (ICME), Seattle, WA, USA.10.1109/ICME.2016.7553002 ↗
2. Liu, H., Tian, Y., Yang, Y., Pang, L., and Huang, T. (2016, January 30). Deep Relative Distance Learning: Tell the Difference between Similar Vehicles. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Las Vegas, NV, USA.10.1109/CVPR.2016.238 ↗
3. Vehicle re-identification by deep hidden multi-view inference10.1109/TIP.2018.2819820 ↗
4. Kanacı, A., Zhu, X., and Gong, S. (2018). Pattern Recognition, Proceedings of the German Conference on Pattern Recognition, Stuttgart, Germany, 9–12 October 2018, Springer.
5. Yan, K., Tian, Y., Wang, Y., Zeng, W., and Huang, T. (2017, January 27–29). Exploiting Multi-Grain Ranking Constraints for Precisely Searching Visually-Similar Vehicles. Proceedings of the IEEE International Conference on Computer Vision, Venice, Italy.10.1109/ICCV.2017.68 ↗
6. Liu, X., Liu, W., Mei, T., and Ma, H. (2016). Computer Vision–ECCV 2016, Proceedings of the European Conference on Computer Vision, Amsterdam, The Netherlands, 11–14 October 2016, Springer.
7. Tang, Z. (November, January 27). Pamtri: Pose-aware multi-task learning for vehicle re-identification using highly randomized synthetic data. Proceedings of the IEEE/CVF International Conference on Computer Vision, Seoul, Republic of Korea.
8. Meng, D. (2020, January 19–23). Parsing-based view-aware embedding network for vehicle re-identification. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, Seattle, WA, USA.10.1109/CVPR42600.2020.00713 ↗
9. Zhou, Y., and Shao, L. (2018, January 18–23). Aware attentive multi-view inference for vehicle re-identification. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Salt Lake City, UT, USA.10.1109/CVPR.2018.00679 ↗
10. Vehicle re-identification using quadruple directional deep learning features10.1109/TITS.2019.2901312 ↗
11. Multi-view spatial attention embedding for vehicle re-identification10.1109/TCSVT.2020.2980283 ↗
12. Structural analysis of attributes for vehicle re-identification and retrieval10.1109/TITS.2019.2896273 ↗
13. Woo, S., Park, J., Lee, J., and Kweon, I.S. (2018, January 8–24). Cbam: Convolutional block attention module. Proceedings of the European Conference on Computer Vision (ECCV), Munich, Germany.10.1007/978-3-030-01234-2_1 ↗
14. Zheng, L., Yang, Y., and Hauptmann, A.G. (2016). Person re-identification: Past, present and future. arXiv.
15. Zheng, H., Fu, J., Mei, T., and Luo, J. (2017, January 22–29). Learning multi-attention convolutional neural network for fine-grained image recognition. Proceedings of the IEEE International Conference on Computer Vision, Venice, Italy.10.1109/ICCV.2017.557 ↗
16. Hu, J., Shen, L., and Sun, G. (2018, January 19–23). Squeeze-and-excitation networks. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Salt Lake City, UT, USA.10.1109/CVPR.2018.00745 ↗
17. Star: A structure and texture aware retinex model10.1109/TIP.2020.2974060 ↗
18. Fine-grained image classification using modified DCNNs trained by cascaded softmax and generalized large-margin losses10.1109/TNNLS.2018.2852721 ↗
19. Shen, Y., Xiao, T., Li, H., Yi, S., and Wang, X. (2017, January 22–29). Learning deep neural networks for vehicle re-id with visual-spatio-temporal path proposals. Proceedings of the IEEE International Conference on Computer Vision, Venice, Italy.10.1109/ICCV.2017.210 ↗
20. Liu, X., Zhang, S., Huang, Q., and Gao, W. (2018, January 23–27). Ram: A region-aware deep model for vehicle re-identification. Proceedings of the 2018 IEEE International Conference on Multimedia and Expo (ICME), San Diego, CA, USA.10.1109/ICME.2018.8486589 ↗
21. Wang, Z. (2017, January 22–29). Orientation invariant feature embedding and spatial temporal regularization for vehicle re-identification. Proceedings of the IEEE International Conference on Computer Vision, Venice, Italy.10.1109/ICCV.2017.49 ↗
22. Khorramshahi, P., Kumar, A., Peri, N., Rambhatla, S., Chen, J., and Chellappa, R. (November, January 27). A dual-path model with adaptive attention for vehicle re-identification. Proceedings of the IEEE/CVF International Conference on Computer Vision, Seoul, Republic of Korea.
23. Chu, R., Sun, Y., Li, Y., Liu, Z., Zhang, C., and Wei, Y. (November, January 27). Vehicle re-identification with viewpoint-aware metric learning. Proceedings of the IEEE/CVF International Conference on Computer Vision, Seoul, Republic of Korea.
24. He, B., Li, J., Zhao, Y., and Tian, Y. (2019, January 16–17). Part-regularized near-duplicate vehicle re-identification. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, Long Beach, CA, USA.10.1109/CVPR.2019.00412 ↗
25. Liao, S., Hu, Y., Zhu, X., and Li, S.Z. (2015, January 12). Person re-identification by local maximal occurrence representation and metric learning. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Boston, MA, USA.10.1109/CVPR.2015.7298832 ↗
26. Yang, L., Luo, P., Loy, C.C., and Tang, X. (2015, January 7–12). A large-scale car dataset for fine-grained categorization and verification. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Boston, MA, USA.10.1109/CVPR.2015.7299023 ↗
27. Provid: Progressive and multimodal vehicle reidentification for large-scale urban surveillance10.1109/TMM.2017.2751966 ↗
28. Zhu, J., Zeng, H., Lei, Z., Liao, S., Zheng, L., and Cai, C. (2018, January 20–24). A shortly and densely connected convolutional neural network for vehicle re-identification. Proceedings of the 2018 24th International Conference on Pattern Recognition (ICPR), Beijing, China.10.1109/ICPR.2018.8545514 ↗
29. Lee, S., Park, E., Yi, H., and Lee, S.H. (2020, January 14–19). Strdan: Synthetic-to-real domain adaptation network for vehicle re-identification. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops, Seattle, WA, USA.10.1109/CVPRW50498.2020.00312 ↗
30. Stripe-based and attribute-aware network: A two-branch deep model for vehicle re-identification10.1088/1361-6501/ab8b81 ↗
31. VehicleNet: Learning Robust Feature Representation for Vehicle Re-identification
32. Zhou, Y., Wang, Y., and Chau, L. (2022). Moving Towards Centers: Re-ranking with Attention and Memory for Re-identification. IEEE Trans. Multimed., 99.10.1109/TMM.2022.3161189 ↗