Minimum Barrier Distance-Based Object Descriptor for Visual Tracking
Source abstract
Abstract
In most visual tracking tasks, the target is tracked by a bounding box given in the first frame. The complexity and redundancy of background information in the bounding box inevitably exist and affect tracking performance. To alleviate the influence of background, we propose a robust object descriptor for visual tracking in this paper. First, we decompose the bounding box into non-overlapping patches and extract the color and gradient histograms features for each patch. Second, we adopt the minimum barrier distance (MBD) to calculate patch weights. Specifically, we consider the boundary patches as the background seeds and calculate the MBD from each patch to the seed set as the weight of each patch since the weight calculated by MBD can represent the difference between each patch and the background more effectively. Finally, we impose the weight on the extracted feature to get the descriptor of each patch and then incorporate our MBD-based descriptor into the structured support vector machine algorithm for tracking. Experiments on two benchmark datasets demonstrate the effectiveness of the proposed approach.
Source: crossref · Quality: baseline
Research context
OpenAlex topics: Video Surveillance and Tracking Methods · Advanced Image and Video Retrieval Techniques · IoT-based Smart Home Systems
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
Affiliations
School of Computer Science and Technology, Anhui University, Hefei 230601, China
Funding
National Natural Science Foundation of China
References (57)
Show source-provided references
1. Wu, Y., Lim, J., and Yang, M.H. (2013, January 23–28). Online Object Tracking: A Benchmark. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Portland, OR, USA.10.1109/CVPR.2013.312 ↗
2. Wang, X., Li, C., Luo, B., and Tang, J. (2018, January 12–15). SINT++: Robust Visual Tracking via Adversarial Positive Instance Generation. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Lake Tahoe, NV, USA.10.1109/CVPR.2018.00511 ↗
3. Li, X., Shen, C., Dick, A., and van den Hengel, A. (2013, January 23–28). Learning Compact Binary Codes for Visual Tracking. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Portland, OR, USA.10.1109/CVPR.2013.313 ↗
4. Torr, P.H., Hare, S., and Saffari, A. (2011, January 6–13). Struck: Structured output tracking with kernels. Proceedings of the IEEE International Conference on Computer Vision, Barcelona, Spain.
5. High-Speed Tracking with Kernelized Correlation Filters10.1109/TPAMI.2014.2345390 ↗
6. Visual Tracking via Random Walks on Graph Model10.1109/TCYB.2015.2466437 ↗
7. Nam, H., and Han, B. (2016, January 27–30). Learning Multi-domain Convolutional Neural Networks for Visual Tracking. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Las Vegas, NV, USA.10.1109/CVPR.2016.465 ↗
8. Hong, S., You, T., Kwak, S., and Han, B. (2015, January 9–11). Online tracking by learning discriminative saliency map with convolutional neural network. Proceedings of the IEEE International Conference on Machine Learning, Miami, FL, USA.
9. Li, C., Lin, L., Zuo, W., and Tang, J. (2017, January 4–9). Learning Patch-Based Dynamic Graph for Visual Tracking. Proceedings of the AAAI Conference on Artificial Intelligence, San Francisco, CA, USA.10.1609/aaai.v31i1.11200 ↗
10. Kim, H.U., Lee, D.Y., Sim, J.Y., and Kim, C.S. (2016, January 25–28). SOWP: Spatially Ordered and Weighted Patch Descriptor for Visual Tracking. Proceedings of the IEEE International Conference on Computer Vision, Stanford, CA, USA.10.1109/ICCV.2015.345 ↗
11. Vehicle Tracking using Euclidean Distance
12. Li, Y., Zhu, J., and Hoi, S.C.H. (2015, January 7–12). Reliable Patch Trackers: Robust visual tracking by exploiting reliable patches. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Boston, MA, USA.10.1109/CVPR.2015.7298632 ↗
13. Li, C., Zhu, C., Huang, Y., Tang, J., and Wang, L. (2018, January 8–14). Cross-modal ranking with soft consistency and noisy labels for RGB-T object tracking. Proceedings of the European Conference on Computer Vision, Munich, Germany.10.1007/978-3-030-01261-8_49 ↗
14. The minimum barrier distance10.1016/j.cviu.2012.10.011 ↗
15. Jiang, H., Wang, J., Yuan, Z., Wu, Y., Zheng, N., and Li, S. (2013, January 23–28). Salient Object Detection: A Discriminative Regional Feature Integration Approach. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Portland, OR, USA.10.1109/CVPR.2013.271 ↗
16. Wei, Y., Wen, F., Zhu, W., and Sun, J. (2012, January 7–13). Geodesic Saliency Using Background Priors. Proceedings of the European Conference on Computer Vision, Florence, Italy.10.1007/978-3-642-33712-3_3 ↗
17. Object Tracking Benchmark10.1109/TPAMI.2014.2388226 ↗
18. Choi, J., Chang, H.J., Yun, S., Fischer, T., Demiris, Y., and Jin, Y.C. (2017, January 21–26). Attentional Correlation Filter Network for Adaptive Visual Tracking. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Honolulu, HI, USA.10.1109/CVPR.2017.513 ↗
19. Zhang, J., Ma, S., and Sclaroff, S. (2014, January 6–12). MEEM: Robust Tracking via Multiple Experts Using Entropy Minimization. Proceedings of the European Conference on Computer Vision, Zurich, Switzerland.10.1007/978-3-319-10599-4_13 ↗
20. Hong, Z., Chen, Z., Wang, C., Mei, X., Prokhorov, D., and Tao, D. (2015, January 7–12). MUlti-Store Tracker (MUSTer): A cognitive psychology inspired approach to object tracking. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Boston, MA, USA.10.1109/CVPR.2015.7298675 ↗
21. Tracking-Learning-Detection10.1109/TPAMI.2011.239 ↗
22. Kwon, J., and Lee, K.M. (2010, January 13–18). Visual tracking decomposition. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, San Francisco, CA, USA.10.1109/CVPR.2010.5539821 ↗
23. Robust Visual Tracking and Vehicle Classification via Sparse Representation10.1109/TPAMI.2011.66 ↗
24. Fernando, T., Denman, S., Sridharan, S., and Fookes, C. (2018, January 12–15). Tracking by Prediction: A Deep Generative Model for Mutli-person Localisation and Tracking. Proceedings of the IEEE Winter Conference on Applications of Computer Vision, Lake Tahoe, NV, USA.10.1109/WACV.2018.00128 ↗
25. A deep features based generative model for visual tracking10.1016/j.neucom.2018.05.007 ↗
26. Avidan, S. (2003, January 16-22). Support Vector Tracking. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Madison, WI, USA.
27. Matas, J., Mikolajczyk, K., and Kalal, Z. (2010, January 13–18). P-N learning: Bootstrapping binary classifiers by structural constraints. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, San Francisco, CA, USA.
28. Robust Object Tracking with Online Multiple Instance Learning10.1109/TPAMI.2010.226 ↗
29. Ning, J., Yang, J., Jiang, S., Zhang, L., and Yang, M.H. (2016, January 27–30). Object Tracking via Dual Linear Structured SVM and Explicit Feature Map. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Las Vegas, NV, USA.10.1109/CVPR.2016.462 ↗
30. Learning Collaborative Sparse Representation for Grayscale-thermal Tracking10.1109/TIP.2016.2614135 ↗
31. Fusing two-stream neural networks for RGB-T object tracking10.1016/j.neucom.2017.11.068 ↗
32. Robust Online Learned Spatio-Temporal Context Model for Visual Tracking10.1109/TIP.2013.2293430 ↗
33. Struck: Structured Output Tracking with Kernels10.1109/TPAMI.2015.2509974 ↗
34. Pixel-Wise Spatial Pyramid-Based Hybrid Tracking10.1109/TCSVT.2012.2201794 ↗
35. He, S., Yang, Q., Lau, R.W.H., Wang, J., and Yang, M.H. (2013, January 23–28). Visual Tracking via Locality Sensitive Histograms. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Portland, OR, USA.10.1109/CVPR.2013.314 ↗
36. Constrained Superpixel Tracking10.1109/TCYB.2017.2675910 ↗
37. Robust Superpixel Tracking via Depth Fusion10.1109/TCSVT.2013.2273631 ↗
38. Yeo, D., Son, J., Han, B., and Han, J.H. (2017, January 21–26). Superpixel-Based Tracking-by-Segmentation Using Markov Chains. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Honolulu, HI, USA.10.1109/CVPR.2017.62 ↗
39. Robust superpixel tracking10.1109/TIP.2014.2300823 ↗
40. Li, C., Lin, L., Zuo, W., Tang, J., and Yang, M.H. (2018). Visual Tracking via Dynamic Graph Learning. IEEE Trans. Pattern Anal. Mach. Intell.10.1109/TPAMI.2018.2864965 ↗
41. Meshgi, K., Maeda, S.I., Oba, S., and Ishii, S. (2016, January 1–3). Data-Driven Probabilistic Occlusion Mask to Promote Visual Tracking. Proceedings of the IEEE Conference on Computer and Robot Vision, Victoria, BC, Canada.10.1109/CRV.2016.19 ↗
42. Kwak, S., Nam, W., Han, B., and Han, J.H. (2011, January 6–13). Learning occlusion with likelihoods for visual tracking. Proceedings of the IEEE International Conference on Computer Vision, Barcelona, Spain.
43. Liu, T., Wang, G., and Yang, Q. (2015, January 7–12). Real-time part-based visual tracking via adaptive correlation filters. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Boston, MA, USA.10.1109/CVPR.2015.7299124 ↗
44. Strand, R., Ciesielski, K.C., Malmberg, F., and Saha, P.K. (2017, January 19–21). The Minimum Barrier Distance: A Summary of Recent Advances. Proceedings of the International Conference on Discrete Geometry for Computer Imagery, Vienna, Austria.10.1007/978-3-319-66272-5_6 ↗
45. Efficient algorithm for finding the exact minimum barrier distance10.1016/j.cviu.2014.03.007 ↗
46. Zhang, J., Sclaroff, S., Lin, Z., Shen, X., Price, B., and Mech, R. (2015, January 19–22). Minimum Barrier Salient Object Detection at 80 FPS. Proceedings of the IEEE International Conference on Computer Vision, Lyon, France.10.1109/ICCV.2015.165 ↗
47. Wang, Q., Zhang, L., and Kpalma, K. (2017, January 10–14). Fast filtering-based temporal saliency detection using Minimum Barrier Distance. Proceedings of the IEEE International Conference on Multimedia Expo Workshops, Hong Kong, China.
48. Danelljan, M., Häger, G., Khan, F.S., and Felsberg, M. (2014, January 1–5). Accurate Scale Estimation for Robust Visual Tracking. Proceedings of the British Machine Vision Conference, Nottingham, UK.10.5244/C.28.65 ↗
49. Encoding Color Information for Visual Tracking: Algorithms and Benchmark10.1109/TIP.2015.2482905 ↗
50. Ma, C., Yang, X., Zhang, C., and Yang, M.H. (2015, January 7–12). Long-term correlation tracking. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Boston, MA, USA.10.1109/CVPR.2015.7299177 ↗
51. Yang, T., and Chan, A.B. (arXiv, 2018). Learning Dynamic Memory Networks for Object Tracking, arXiv.10.1007/978-3-030-01240-3_10 ↗
52. Wang, Q., Gao, J., Xing, J., Zhang, M., and Hu, W. (arXiv, 2017). DCFNet: Discriminant Correlation Filters Network for Visual Tracking, arXiv.
53. Bertinetto, L., Valmadre, J., Henriques, J.F., Vedaldi, A., and Torr, P.H.S. (2016, January 8–16). Fully-Convolutional Siamese Networks for Object Tracking. Proceedings of the European Conference on Computer Vision, Amsterdam, The Netherlands.10.1007/978-3-319-48881-3_56 ↗
54. Bertinetto, L., Valmadre, J., Golodetz, S., Miksik, O., and Torr, P.H. (2016, January 27–30). Staple: Complementary learners for real-time tracking. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Las Vegas, NV, USA.10.1109/CVPR.2016.156 ↗
55. Jia, X., Lu, H., and Yang, M.H. (2012, January 16–21). Visual tracking via adaptive structural local sparse appearance model. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Providence, RI, USA.
56. A survey of datasets for visual tracking10.1007/s00138-015-0713-y ↗
57. Li, C., Liang, X., Lu, Y., Zhao, N., and Tang, J. (arXiv, 2018). RGB-T Object Tracking: Benchmark and Baseline, arXiv.10.1016/j.patcog.2019.106977 ↗