Vehicle Re-Identification in Aerial Imagery Based on Normalized Virtual Softmax Loss
Source abstract
Abstract
With the development and popularization of unmanned aerial vehicles (UAVs) and surveillance cameras, vehicle re-identification (ReID) task plays an important role in the field of urban safety. The biggest challenge in the field of vehicle ReID is how to robustly learn the common visual representation of vehicle from different viewpoints while discriminate different vehicles with similar visual appearance. In order to solve this problem, this paper designs the normalized virtual softmax loss to enlarge the inter-class distance and decrease the intra-class distance, and a vehicle ReID model is proposed by jointly training the network with the proposed loss and triplet loss. In addition, we contribute a novel UAV vehicle ReID dataset from multiple viewpoint images to verify the robustness of methods. The experimental results show that comparing with the other softmax-based losses, our method achieves better performance and gets 76.70% and 98.95% in Rank-1 on VRAI and VRAI_AIR dataset, respectively.
Source: crossref · Quality: baseline
Research context
OpenAlex topics: Video Surveillance and Tracking Methods · Advanced Neural Network Applications · Advanced Image and Video Retrieval Techniques
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
Affiliations
Aerospace Information Research Institute, Chinese Academy of Sciences, Beijing 100094, China
Key Laboratory of Network Information System Technology (NIST), Aerospace Information Research Institute, Chinese Academy of Sciences, Beijing 100190, China
University of Chinese Academy of Sciences, Beijing 100049, China
School of Electronic, Electrical and Communication Engineering, University of Chinese Academy of Sciences, Beijing 101499, China
References (39)
Show source-provided references
1. Urban computing: Concepts, methodologies, and applications
2. Simulation of Multi-Camera Indoor and Outdoor 3D Scanner10.26666/rmp.jesr.2018.3.6 ↗
3. Autonomous Intelligent UAV System for Criminal Pursuit—A Proof of Concept
4. Wang, P., Jiao, B., Yang, L., Yang, Y., Zhang, S., Wei, W., and Zhang, Y. (2019, January 27–28). Vehicle re-identification in aerial imagery: Dataset and approach. Proceedings of the IEEE/CVF International Conference on Computer Vision, Seoul, Korea.10.1109/ICCV.2019.00055 ↗
5. Lin, T.Y., Maire, M., Belongie, S., Hays, J., Perona, P., Ramanan, D., Dollár, P., and Zitnick, C.L. (2014, January 8–14). Microsoft coco: Common objects in context. Proceedings of the European Conference on Computer Vision, Munich, Germany.10.1007/978-3-319-10602-1_48 ↗
6. Ye, M., Shen, J., Lin, G., Xiang, T., Shao, L., and Hoi, S.C. (2021). Deep learning for person re-identification: A survey and outlook. IEEE Trans. Pattern Anal. Mach. Intell., 1–20.10.1109/TPAMI.2021.3054384 ↗
7. Teng, S., Liu, X., Zhang, S., and Huang, Q. (2018, January 21–22). Scan: Spatial and channel attention network for vehicle re-identification. Proceedings of the 19th Pacific-Rim Conference on Multimedia, Hefei, China.10.1007/978-3-030-00764-5_32 ↗
8. Chu, R., Sun, Y., Li, Y., Liu, Z., Zhang, C., and Wei, Y. (November, January 27). Vehicle re-identification with viewpoint-aware metric learning. Proceedings of the IEEE/CVF International Conference on Computer Vision, Seoul, Korea.
9. Liu, X., Liu, W., Mei, T., and Ma, H. (2016, January 11–14). A deep learning-based approach to progressive vehicle re-identification for urban surveillance. Proceedings of the 14th European Conference on Computer Vision, Amsterdam, The Netherlands.10.1007/978-3-319-46475-6_53 ↗
10. Liu, H., Tian, Y., Yang, Y., Pang, L., and Huang, T. (2016, January 27–30). Deep relative distance learning: Tell the difference between similar vehicles. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Las Vegas, NV, USA.10.1109/CVPR.2016.238 ↗
11. Xia, G.S., Bai, X., Ding, J., Zhu, Z., Belongie, S., Luo, J., Datcu, M., Pelillo, M., and Zhang, L. (2018, January 18–22). DOTA: A large-scale dataset for object detection in aerial images. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Salt Lake City, UT, USA.10.1109/CVPR.2018.00418 ↗
12. Zhu, P., Wen, L., Du, D., Bian, X., Fan, H., Hu, Q., and Ling, H. (2020). Detection and Tracking Meet Drones Challenge. arXiv.
13. He, K., Zhang, X., Ren, S., and Sun, J. (2016, January 27–30). Deep residual learning for image recognition. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Las Vegas, NV, USA.10.1109/CVPR.2016.90 ↗
14. Zeiler, M.D., and Fergus, R. (2014, January 6–12). Visualizing and understanding convolutional networks. Proceedings of the 13th European Conference on Computer Vision, Zurich, Switzerland.10.1007/978-3-319-10590-1_53 ↗
15. Deng, J., Dong, W., Socher, R., Li, L.J., Li, K., and Fei-Fei, L. (2009, January 20–25). Imagenet: A large-scale hierarchical image database. Proceedings of the 2009 IEEE Conference on Computer Vision and Pattern Recognition, Miami, FL, USA.10.1109/CVPR.2009.5206848 ↗
16. Dosovitskiy, A., Beyer, L., Kolesnikov, A., Weissenborn, D., Zhai, X., Unterthiner, T., Dehghani, M., Minderer, M., Heigold, G., and Gelly, S. (2020). An Image is Worth 16×16 Words: Transformers for Image Recognition at Scale. arXiv.
17. He, S., Luo, H., Wang, P., Wang, F., Li, H., and Jiang, W. (2021, January 11–17). Transreid: Transformer-based object re-identification. Proceedings of the IEEE/CVF International Conference on Computer Vision, Montreal, BC, Canada.10.1109/ICCV48922.2021.01474 ↗
18. Studien uber das Gleichgewicht der lebenden Kraft
19. Gibbs, J.W. (1902). Elementary Principles in Statistical Mechanics: Developed with Especial Reference to the Rational Foundations of Thermodynamics, C. Scribner’s Sons.10.5962/bhl.title.32624 ↗
20. Bridle, J.S. (1990). Probabilistic interpretation of feedforward classification network outputs, with relationships to statistical pattern recognition. Neurocomputing, Springer.10.1007/978-3-642-76153-9_28 ↗
21. Shannon equations reform and applications
22. Optimization of computer simulation models with rare events10.1016/S0377-2217(96)00385-2 ↗
23. Zheng, L., Zhang, H., Sun, S., Chandraker, M., Yang, Y., and Tian, Q. (2017, January 21–26). Person re-identification in the wild. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Honolulu, HI, USA.10.1109/CVPR.2017.357 ↗
24. Liu, W., Wen, Y., Yu, Z., and Yang, M. (2016). Large-margin softmax loss for convolutional neural networks. arXiv.
25. Liu, W., Wen, Y., Yu, Z., Li, M., Raj, B., and Song, L. (2017, January 21–26). Sphereface: Deep hypersphere embedding for face recognition. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Honolulu, HI, USA.10.1109/CVPR.2017.713 ↗
26. Chen, B., Deng, W., and Shen, H. (2018). Virtual class enhanced discriminative embedding learning. Adv. Neural Inf. Process. Syst., 31.
27. VehicleNet: Learning robust visual representation for vehicle re-identification10.1109/TMM.2020.3014488 ↗
28. Hermans, A., Beyer, L., and Leibe, B. (2017). In defense of the triplet loss for person re-identification. arXiv.
29. Wang, C., Zhang, Q., Huang, C., Liu, W., and Wang, X. (2018, January 8–14). Mancs: A multi-task attentional network with curriculum sampling for person re-identification. Proceedings of the European Conference on Computer Vision (ECCV), Munich, Germany.10.1007/978-3-030-01225-0_23 ↗
30. Luo, H., Gu, Y., Liao, X., Lai, S., and Jiang, W. (2019, January 16–20). Bag of tricks and a strong baseline for deep person re-identification. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops, Long Beach, CA, USA.10.1109/CVPRW.2019.00190 ↗
31. Zhong, Z., Zheng, L., Cao, D., and Li, S. (2017, January 21–26). Re-ranking person re-identification with k-reciprocal encoding. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Honolulu, HI, USA.10.1109/CVPR.2017.389 ↗
32. LabelMe: A database and web-based tool for image annotation10.1007/s11263-007-0090-8 ↗
33. Song, J., Yang, Y., Song, Y.Z., Xiang, T., and Hospedales, T.M. (2019, January 16–20). Generalizable person re-identification by domain-invariant mapping network. Proceedings of the IEEE/CVF conference on Computer Vision and Pattern Recognition, Long Beach, CA, USA.10.1109/CVPR.2019.00081 ↗
34. Wang, X., Doretto, G., Sebastian, T., Rittscher, J., and Tu, P. (2007, January 14–20). Shape and appearance context modeling. Proceedings of the 2007 IEEE 11th International Conference on Computer Vision, Rio de Janeiro, Brazil.10.1109/ICCV.2007.4409019 ↗
35. Zheng, L., Shen, L., Tian, L., Wang, S., Wang, J., and Tian, Q. (2015, January 7–13). Scalable person re-identification: A benchmark. Proceedings of the IEEE International Conference on Computer Vision, Santiago, Chile.10.1109/ICCV.2015.133 ↗
36. Glorot, X., and Bengio, Y. (2010, January 13–15). Understanding the difficulty of training deep feedforward neural networks. Proceedings of the Thirteenth International Conference on Artificial Intelligence and Statistics. JMLR Workshop and Conference Proceedings, Sardinia, Italy.
37. Wang, G., Yuan, Y., Chen, X., Li, J., and Zhou, X. (2018, January 22–26). Learning discriminative features with multiple granularities for person re-identification. Proceedings of the 26th ACM International Conference on Multimedia, Seoul, Korea.10.1145/3240508.3240552 ↗
38. Wei, X.S., Zhang, C.L., Liu, L., Shen, C., and Wu, J. (2018, January 2–6). Coarse-to-fine: A RNN-based hierarchical attention model for vehicle re-identification. Proceedings of the 14th Asian Conference on Computer Vision, Perth, Australia.
39. Liu, X., Zhang, S., Huang, Q., and Gao, W. (2018, January 23–27). Ram: A region-aware deep model for vehicle re-identification. Proceedings of the 2018 IEEE International Conference on Multimedia and Expo (ICME), San Diego, CA, USA.10.1109/ICME.2018.8486589 ↗