journal article·2025-12-11Open access

SwinMR: A Mutual Refinement Enhanced SwinTrack Framework

Shifeng Zhao, Chuanyuan Yang, Yanfang Fu

Applied Sciences· Volume 15· Issue 24

Abstract

The task of tracking weak targets in low-altitude UAV scenarios requires high robustness and generalization ability of the model. Against this backdrop, this paper proposes a novel annotation and training mechanism based on SwinTrack. To improve the model’s tracking ability for weak targets, this paper proposes a pseudo-label consistency screening and background enhancement annotation strategy. This strategy enlarges the target box proportionally before training to obtain more effective background information. Furthermore, pseudo-labels are screened using a hybrid gating system of geometric overlap and confidence consistency to reduce the negative transfer interference of noise generated in different domains on the model. Since the data feature distribution varies significantly in tracking tasks, this paper introduces a mutual-teaching pseudo-label iterative training method into the field of weak target tracking. This aims to continuously transfer the model from the source domain to the target domain during iteration, thereby improving the model’s generalization ability. Experiments have shown that, when faced with a completely new dataset of weak target tracking, the proposed method improves upon recent strong baselines in single-target tracking by 0.05 in both P@20 and NP-AUC, and by 0.04 in SUS, demonstrating the enhanced tracking performance and generalization ability of the proposed method in the field of weak target tracking.
Source: crossref · Quality: baseline

Research context

OpenAlex topics: Video Surveillance and Tracking Methods · Target Tracking and Data Fusion in Sensor Networks · Infrared Target Detection Methodologies

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

School of Computer Science and Engineering, Xi’an Technological University, Weiyang Campus, Xi’an 710021, China

References (49)

Show source-provided references
1. Tian, X., Jia, Y., Luo, X., and Yin, J. (2022). Small target recognition and tracking based on UAV platform. Sensors, 22.10.3390/s22176579 ↗
2. Improved SwinTrack single target tracking algorithm based on spatio-temporal feature fusion10.1049/ipr2.12803 ↗
3. Attentional local contrast networks for infrared small target detection10.1109/TGRS.2020.3044958 ↗
4. SwinEFT: A robust and powerful Swin transformer based event frame tracker10.1007/s10489-023-04763-6 ↗
5. Mu, Q., He, Z., Wang, X., and Li, Z. (2024). SSTrack: An Object Tracking Algorithm Based on Spatial Scale Attention. Appl. Sci., 14.10.3390/app14062476 ↗
6. Small target recognition method on weak features10.1007/s11042-020-09926-y ↗
7. Infrared small target tracking algorithm via segmentation network and multistrategy fusion
8. Mirzaei, B., Nezamabadi-Pour, H., Raoof, A., and Derakhshani, R. (2023). Small object detection and tracking: A comprehensive review. Sensors, 23.10.3390/s23156887 ↗
9. Single-frame infrared small-target detection: A survey10.1109/MGRS.2022.3145502 ↗
10. Receptive-field and direction induced attention network for infrared dim small target detection with a large-scale dataset IRDST10.1109/TGRS.2023.3335418 ↗
11. Bolme, D.S., Beveridge, J.R., Draper, B.A., and Lui, Y.M. (2010, January 13–18). Visual object tracking using adaptive correlation filters. Proceedings of the 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, San Francisco, CA, USA.10.1109/CVPR.2010.5539960 ↗
12. High-speed tracking with kernelized correlation filters10.1109/TPAMI.2014.2345390 ↗
13. Hare, S., Saffari, A., Torr, P., and Struck, S. (2011, January 6–13). Structured output tracking with kernels. Proceedings of the IEEE International Conference on Computer Vision, Barcelona, Spain.10.1109/ICCV.2011.6126251 ↗
14. Possibilistic classification by support vector networks10.1016/j.neunet.2022.02.007 ↗
15. Bertinetto, L., Valmadre, J., Henriques, J.F., Vedaldi, A., and Torr, P.H.S. (2016, January 11–14). Fully-convolutional siamese networks for object tracking. Proceedings of the European Conference on Computer Vision, Amsterdam, The Netherlands.10.1007/978-3-319-48881-3_56 ↗
16. Cao, D., Dai, R., Zhao, T., Alqahtani, F., Tolba, A., Sherratt, R.S., and Zhu, M. (2023, January 23–25). SiamIRPN: Siamese visual tracking with improved region proposal networks. Proceedings of the 2023 International Conference on Frontiers of Robotics and Software Engineering (FRSE), Nanjing, China.10.1109/FRSE58934.2023.00030 ↗
17. Li, B., Wu, W., Wang, Q., Zhang, F., Xing, J., and Yan, J. (2019, January 15–20). Siamrpn++: Evolution of siamese visual tracking with very deep networks. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, Long Beach, CA, USA.10.1109/CVPR.2019.00441 ↗
18. Wang, Q., Zhang, L., Bertinetto, L., Hu, W., and Torr, P.H.S. (2019, January 15–20). Fast online object tracking and segmentation: A unifying approach. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, Long Beach, CA, USA.10.1109/CVPR.2019.00142 ↗
19. Danelljan, M., Bhat, G., Khan, F.S., and Felsberg, M. (2019, January 15–20). Atom: Accurate tracking by overlap maximization. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, Long Beach, CA, USA.10.1109/CVPR.2019.00479 ↗
20. Bhat, G., Danelljan, M., Gool, L.V., and Timofte, R. (November, January 27). Learning discriminative model prediction for tracking. Proceedings of the IEEE/CVF International Conference on Computer Vision, Seoul, Republic of Korea.
21. Chen, X., Yan, B., Zhu, J., Wang, D., Yang, X., and Lu, H. (2021, January 20–25). Transformer tracking. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, Nashville, TN, USA.10.1109/CVPR46437.2021.00803 ↗
22. Yan, B., Peng, H., Fu, J., Wang, D., and Lu, H. (2021, January 10–17). Learning spatio-temporal transformer for visual tracking. Proceedings of the IEEE/CVF International Conference on Computer Vision, Montreal, QC, Canada.10.1109/ICCV48922.2021.01028 ↗
23. Cui, Y., Jiang, C., Wang, L., and Wu, G. (2022, January 18–24). Mixformer: End-to-end tracking with iterative mixed attention. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, New Orleans, LA, USA.10.1109/CVPR52688.2022.01324 ↗
24. Wang, Z., Zhou, W., Xia, Z., and Fan, B. (2023, January 17–19). Easy One-Stream Transformer Tracker. Proceedings of the 2023 China Automation Congress (CAC), Chongqing, China.10.1109/CAC59555.2023.10451713 ↗
25. Swintrack: A simple and strong baseline for transformer tracking
26. Zhu, Z., Wang, Q., Li, B., Wu, W., Yan, J., and Hu, W. (2018, January 8–14). Distractor-aware siamese networks for visual object tracking. Proceedings of the European Conference on Computer Vision (ECCV), Munich, Germany.10.1007/978-3-030-01240-3_7 ↗
27. Danelljan, M., Hager, G., Shahbaz Khan, F., and Felsberg, M. (2015, January 7–13). Learning spatially regularized correlation filters for visual tracking. Proceedings of the IEEE International Conference on Computer Vision, Santiago, Chile.10.1109/ICCV.2015.490 ↗
28. Danelljan, M., Bhat, G., Khan, F.S., and FelsBerg, M. (2017, January 21–26). Efficient convolution operators for tracking. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Honolulu, HI, USA.10.1109/CVPR.2017.733 ↗
29. Xu, Y., Wang, Z., Li, Z., Yuan, Y., and Yu, G.S.F.C. (2020). Towards robust and accurate visual tracking with target estimation guidelines. arXiv.10.1609/aaai.v34i07.6944 ↗
30. Chen, Z., Zhong, B., Li, G., Zhang, S., and Ji, R. (2020, January 13–19). Siamese box adaptive network for visual tracking. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, Seattle, WA, USA.10.1109/CVPR42600.2020.00670 ↗
31. Improved SiamCAR with ranking-based pruning and optimization for efficient UAV tracking10.1016/j.imavis.2023.104886 ↗
32. Zhang, Z., Peng, H., Fu, J., Li, B., and Hu, W. (2020, January 23–28). Ocean: Object-aware anchor-free tracking. Proceedings of the 2020 European Conference on Computer Vision, Glasgow, UK.10.1007/978-3-030-58589-1_46 ↗
33. Cao, Z., Fu, C., Ye, J., Li, B., and Li, Y.H.F.T. (2021, January 10–17). Hierarchical feature transformer for aerial tracking. Proceedings of the IEEE/CVF International Conference on Computer Vision, Montreal, QC, Canada.10.1109/ICCV48922.2021.01517 ↗
34. Yan, B., Zhang, X., Wang, D., Lu, H., and Yang, X. (2021, January 20–25). Alpha-refine: Boosting tracking performance by precise bounding box estimation. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, Nashville, TN, USA.10.1109/CVPR46437.2021.00525 ↗
35. Deep unsupervised domain adaptation: A review of recent advances and perspectives10.1561/116.00000192 ↗
36. Fu, Y., Wei, Y., Wang, G., Zhou, Y., Shi, H., and Huang, T.S. (November, January 27). Self-similarity grou: A simple unsupervised cross domain adaptation approach for person re-identification. Proceedings of the IEEE/CVF International Conference on Computer Vision, Seoul, Republic of Korea.
37. Lu, Y., Shen, M., Ma, A.J., Xie, X., and Lai, J.H. (2024, January 20–27). Mlnet: Mutual learning network with neighborhood invariance for universal domain adaptation. Proceedings of the AAAI Conference on Artificial Intelligence, Vancouver, BC, Canada.10.1609/aaai.v38i4.28182 ↗
38. Dual-refinement: Joint label and feature refinement for unsupervised domain adaptive person re-identification10.1109/TIP.2021.3104169 ↗
39. Zhai, Y., Lu, S., Ye, Q., Shan, X., Chen, J., Ji, R., and Tian, Y. (2020, January 13–19). Ad-cluster: Augmented discriminative clustering for domain adaptive person re-identification. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, Seattle, WA, USA.10.1109/CVPR42600.2020.00904 ↗
40. Liu, Y., Yang, X., Zhou, S., Liu, X., Wang, Z., Liang, K., Tu, W., Li, L., Duan, J., and Chen, C. (2023, January 7–14). Hard sample aware network for contrastive deep graph clustering. Proceedings of the AAAI Conference on Artificial Intelligence, Washington, DC, USA.10.1609/aaai.v37i7.26071 ↗
41. Ge, Y., Chen, D., and Li, H. (2020). Mutual mean-teaching: Pseudo label refinery for unsupervised domain adaptation on person re-identification. arXiv.
42. Self-paced contrastive learning with hybrid memory for domain adaptive object re-id
43. Unsupervised domain adaptation of object detectors: A survey10.1109/TPAMI.2022.3217046 ↗
44. Liu, Y.C., Ma, C.Y., He, Z., Kuo, C.W., Chen, K., Zhang, P., Wu, B., Kira, Z., and Vajda, P. (2021). Unbiased teacher for semi-supervised object detection. arXiv.
45. Xu, M., Zhang, Z., Hu, H., Wang, J., Wei, F., Bai, X., and Liu, Z. (2021, January 10–17). End-to-end semi-supervised object detection with soft teacher. Proceedings of the IEEE/CVF International Conference on Computer Vision, Montreal, QC, Canada.10.1109/ICCV48922.2021.00305 ↗
46. Lu, Z., Shuai, B., Chen, Y., Xu, Z., and Modolo, D. (2024). Self-supervised multi-object tracking with path consistency. arXiv.10.1109/CVPR52733.2024.01799 ↗
47. Panagiotakopoulos, T., Dovesi, P.L., Härenstam-Nielsen, L., and Poggi, M. (2022, January 23–27). Online domain adaptation for semantic segmentation in ever-changing conditions. Proceedings of the 2020 European Conference on Computer Vision, Tel Aviv, Israel.10.1007/978-3-031-19830-4_8 ↗
48. Cai, B., Ma, L., and Sun, Y. (2023). Dual consistent pseudo label generation for multi-source domain adaptation without source data for medical image segmentation. Front. Neurosci., 17.10.3389/fnins.2023.1209132 ↗
49. He, T., Shen, L., Guo, Y., Ding, G., and Guo, Z. (March, January 22). Secret: Self-consistent pseudo label refinement for unsupervised domain adaptive person re-identification. Proceedings of the AAAI Conference on Artificial Intelligence, Virtual.