journal article·2022Open access

Criss-Cross Attentional Siamese Networks for Object Tracking

Zhangdong Wang, Jiaohua Qin, Xuyu Xiang, Yun Tan, Neal N. Xiong

Computers, Materials & Continua· Volume 73· Issue 2

Abstract

Visual object tracking is a hot topic in recent years. In the meanwhile, Siamese networks have attracted extensive attention in this field because of its balanced precision and speed. However, most of the Siamese network methods can only distinguish foreground from the non-semantic background. The fine-tuning and retraining of fully-convolutional Siamese networks for object tracking(SiamFC) can achieve higher precision under interferences, but the tracking accuracy is still not ideal, especially in the environment with more target interferences, dim light, and shadows. In this paper, we propose criss-cross attentional Siamese networks for object tracking (SiamCC). To solve the imbalance between foreground and non-semantic background, we use the feature enhancement module of criss-cross attention to greatly improve the accuracy of video object tracking in dim light and shadow environments. Experimental results show that the maximum running speed of SiamCC in the object tracking benchmark dataset is 90 frames/second. In terms of detection accuracy, the accuracy of shadow sequences is greatly improved, especially the accuracy score of sequence HUMAN8 is improved from 0.09 to 0.89 compared with the original SiamFC, and the success rate score is improved from 0.07 to 0.55.
Source: openalex_inverted_index · Quality: baseline

Research context

OpenAlex topics: Video Surveillance and Tracking Methods · Impact of Light on Environment and Health · Visual Attention and Saliency Detection

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

References (38)

Show source-provided references
1. Joint-attention feature fusion network and dual-adaptive NMS for object detection10.1016/j.knosys.2022.108213 ↗
2. A privacy-preserving and traitor tracking content-based image retrieval scheme in cloud computing10.1007/s00530-020-00734-w ↗
3. GAN-GLS: Generative lyric steganography based on generative adversarial networks10.32604/cmc.2021.017950 ↗
4. A robust text coverless information hiding based on multi-index method10.32604/iasc.2021.017720 ↗
5. ImageNet large scale visual recognition challenge10.1007/s11263-015-0816-y ↗
6. Discrete multi-graph hashing for large-scale visual search10.1007/s11063-018-9892-7 ↗
7. Dual model learning combined with multiple feature selection for accurate visual tracking10.1109/ACCESS.2019.2908668 ↗
8. Coverless steganography based on image retrieval of DenseNet features and DWT sequence mapping10.1016/j.knosys.2019.105375 ↗
9. MOLS-Net: Multi-organ and lesion segmentation network based on sequence feature pyramid and attention mechanism for aortic dissection diagnosis10.1016/j.knosys.2021.107853 ↗
10. Coverless image steganography based on multi-object recognition10.1109/TCSVT.2020.3033945 ↗
11. Learning multi-domain convolutional neural networks for visual tracking
12. Siamese instance search for tracking
13. Fully-convolutional Siamese networks for object tracking
14. Learning attentions: Residual attentional Siamese network for high performance online visual tracking
15. End-to-end representation learning for correlation filter based tracking
16. Learning dynamic Siamese network for visual object tracking
17. High performance visual tracking with Siamese region proposal network
18. Distractor-aware Siamese networks for visual object tracking
19. Siamese cascaded region proposal networks for real-time visual tracking
20. Fast online object tracking and segmentation: A unifying approach
21. SiamRPN++: Evolution of Siamese visual tracking with very deep networks
22. CAPTCHA recognition based on deep convolutional neural network10.3934/mbe.2019292 ↗
23. Dynamic modeling cross-modal interactions in two-phase prediction for entity-relation extraction
24. GOT-10k: A large high-diversity benchmark for generic object tracking in the Wild10.1109/TPAMI.2019.2957464 ↗
25. Image piece learning for weakly supervised semantic segmentation10.1109/TSMC.2016.2623683 ↗
26. Enhancing chinese character representation with lattice-aligned attention
27. Squeeze-and-excitation networks
28. Attention to scale: Scale-aware semantic image segmentation
29. A smart mobile diagnosis system for citrus diseases based on densely connected convolutional networks10.1109/ACCESS.2019.2924973 ↗
30. Non-local neural networks
31. Dual attention network for scene segmentation
32. PSANet: Point-wise spatial attention network for scene parsing
33. CCNet: Criss-cross attention for semantic segmentation
34. A full convolutional network based on DenseNet for remote sensing scene classification10.3934/mbe.2019167 ↗
35. Object tracking benchmark10.1109/TPAMI.2014.2388226 ↗
36. Towards differential access control and privacy-preserving for secure media data sharing in the cloud10.1016/j.cose.2021.102553 ↗
37. News text topic clustering optimized method based on TF-IDF algorithm on spark10.32604/cmc.2020.06431 ↗
38. Concrete cracks detection based on FCN with dilated convolution10.3390/app9132686 ↗