Robust Long-Term Visual Object Tracking via Low-Rank Sparse Learning for Re-Detection
Source abstract
Abstract
The Discriminative Correlation Filter (DCF) has been universally recognized in visual object tracking, thanks to its excellent accuracy and high speed. Nevertheless, these DCF-based trackers perform poorly in long-term tracking. The reasons include the following aspects—first, they have low adaptability to significant appearance changes in long-term tracking and are prone to tracking failure; second, these trackers lack a practical re-detection module to find the target again after tracking failure. In our work, we propose a new long-term tracking strategy to solve these issues. First, we make the best of the static and dynamic information of the target by introducing the motion features to our long-term tracker and obtain a more robust tracker. Second, we introduce a low-rank sparse dictionary learning method for re-detection. This re-detection module can exploit a correlation among these training samples and alleviate the impact of occlusion and noise. Third, we propose a new reliability evaluation method to model an adaptive update, which can switch expediently between the tracking module and the re-detection module. Massive experiments demonstrate that our proposed approach has an obvious improvement in precision and success rate over these state-of-the-art trackers.
Source: crossref · Quality: baseline
Research context
OpenAlex topics: Video Surveillance and Tracking Methods · Infrared Target Detection Methodologies · Fire Detection and Safety Systems
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
Affiliations
Science and Technology on Micro-System Laboratory, Shanghai Institute of Microsystem and Information Technology, Chinese Academy of Sciences, Shanghai 201800, China
University of Chinese Academy of Sciences, Beijing 100049, China
References (56)
Show source-provided references
1. Visual tracking: An experimental survey
2. Visual object tracking: A survey
3. Intelligent Visual Surveillance—A Survey10.1007/s12555-010-0501-4 ↗
4. Reddy, K.R., Priya, K.H., and Neelima, N. (2015, January 12–14). Object Detection and Tracking—A Survey. Proceedings of the 2015 International Conference on Computational Intelligence and Communication Networks (CICN), Jabalpur, India.10.1109/CICN.2015.317 ↗
5. A Survey On Moving Object Tracking in Video
6. A Review of Visual Moving Target Tracking10.1007/s11042-016-3647-0 ↗
7. Lucas-Kanade 20 Years on: A Unifying Framework10.1023/B:VISI.0000011205.11775.fd ↗
8. Locally Orderless Tracking10.1007/s11263-014-0740-6 ↗
9. Incremental Learning for Robust Visual Tracking10.1007/s11263-007-0075-7 ↗
10. Danelljan, M., Shahbaz Khan, F., Felsberg, M., and Van de Weijer, J. (2014, January 24–27). Adaptive Color Attributes for Real-time Visual Tracking. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Columbus, OH, USA.10.1109/CVPR.2014.143 ↗
11. Bolme, D.S., Beveridge, J.R., Draper, B.A., and Lui, Y.M. (2010, January 13–18). Visual Object Tracking Using Adaptive Correlation Filters. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, San Francisco, CA, USA.10.1109/CVPR.2010.5539960 ↗
12. High-speed tracking with kernelized correlation filters10.1109/TPAMI.2014.2345390 ↗
13. Discriminative Scale Space Tracking10.1109/TPAMI.2016.2609928 ↗
14. Li, Y., and Zhu, J. (2014, January 5–12). A Scale Adaptive Kernel Correlation Filter Tracker with Feature Integration. Proceedings of the European Conference on Computer Vision, Zurich, Switzerland.10.1007/978-3-319-16181-5_18 ↗
15. Bertinetto, L., Valmadre, J., Golodetz, S., Miksik, O., and Torr, P.H. (July, January 26). Staple: Complementary Learners for Real-time Tracking. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Las Vegas, NV, USA.
16. Danelljan, M., Hager, G., Shahbaz, K.F., and Felsberg, M. (2015, January 11–18). Convolutional Features for Correlation Filter based Visual Tracking. Proceedings of the IEEE International Conference on Computer Vision, Santiago, Chile.10.1109/ICCVW.2015.84 ↗
17. Danelljan, M., Hager, G., Shahbaz, K.F., and Felsberg, M. (2015, January 11–18). Learning Spatially Regularized Correlation Filters for Visual Tracking. Proceedings of the IEEE International Conference on Computer Vision, Santiago, Chile.10.1109/ICCV.2015.490 ↗
18. Danelljan, M., Bhat, G., Shahbaz Khan, F., and Felsberg, M. (2017, January 22–25). Eco: Efficient Convolution Operators for Tracking. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Honolulu, HI, USA.10.1109/CVPR.2017.733 ↗
19. Danelljan, M., Robinson, A., Khan, F.S., and Felsberg, M. (2016, January 8–16). Beyond Correlation Filters: Learning Continuous Convolution Operators for Visual Tracking. Proceedings of the European Conference on Computer Vision, Amsterdam, The Netherlands.10.1007/978-3-319-46454-1_29 ↗
20. Dai, K., Wang, D., Lu, H., Sun, C., and Li, J. (2019, January 16–20). Visual Tracking via Adaptive Spatially-regularized Correlation Filters. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Beach, CA, USA.10.1109/CVPR.2019.00480 ↗
21. Li, F., Tian, C., Zuo, W., Zhang, L., and Yang, M.H. (2018, January 19–21). Learning Spatial-temporal Regularized Correlation Filters for Visual Tracking. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Salt Lake City, UT, USA.10.1109/CVPR.2018.00515 ↗
22. Learning Adaptive Discriminative Correlation Filters via Temporal Consistency Preserving Spatial Feature Selection for Robust Visual Object Tracking10.1109/TIP.2019.2919201 ↗
23. Kiani Galoogahi, H., Fagg, A., and Lucey, S. (2017, January 19–22). Learning Background-aware Correlation Filters for Visual Tracking. Proceedings of the IEEE International Conference on Computer Vision, Venice, Italy.10.1109/ICCV.2017.129 ↗
24. An Anti-Drift Background-aware Correlation Filter for Visual Tracking in Complex Scenes10.1109/ACCESS.2019.2959406 ↗
25. Xue, X., Li, Y., and Shen, Q. (2018). Unmanned Aerial Vehicle Object Tracking by Correlation Filter with Adaptive Appearance Model. Sensors, 18.10.3390/s18092751 ↗
26. Yang, Y., Zhang, Y., Li, D., and Wang, Z. (2019). Parallel Correlation Filters for Real-time Visual Tracking. Sensors, 19.10.3390/s19102362 ↗
27. Shin, J., Kim, H., Kim, D., and Paik, J. (2020). Fast and Robust Object Tracking Using Tracking Failure Detection in Kernelized Correlation Filter. Appl. Sci., 10.10.3390/app10020713 ↗
28. He, W., Li, H., Liu, W., Li, C., and Guo, B. (2020). rStaple: A Robust Complementary Learning Method for Real-Time Object Tracking. Appl. Sci., 10.10.3390/app10093021 ↗
29. Wang, W., Liu, C., Xu, B., Li, L., Chen, W., and Tian, Y. (2020). Robust Visual Tracking Based on Fusional Multi-Correlation-Filters with a High-Confidence Judgement Mechanism. Appl. Sci., 10.10.3390/app10062151 ↗
30. Wu, Y., Lim, J., and Yang, M.H. (2013, January 25–27). Online Object Tracking: A benchmark. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Portland, OR, USA.10.1109/CVPR.2013.312 ↗
31. Encoding Color Information for Visual Tracking: Algorithms and Benchmark10.1109/TIP.2015.2482905 ↗
32. Kristan, M., Leonardis, A., Matas, J., Felsberg, M., Pflugfelder, R., Čehovin Zajc, L., Vojir, T., Bhat, G., Lukezic, A., and Eldesokey, A. (2018, January 8–14). The sixth Visual Object Tracking VOT2018 Challenge Results. Proceedings of the European Conference on Computer Vision (ECCV), Munich, Germany.
33. Ma, C., Yang, X., Zhang, C., and Yang, M.H. (2015, January 8–10). Long-term Correlation Tracking. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Boston, MA, USA.10.1109/CVPR.2015.7299177 ↗
34. Lebeda, K., Hadfield, S., Matas, J., and Bowden, R. (2013, January 1–8). Long-term Tracking through Failure Cases. Proceedings of the IEEE International Conference on Computer Vision Workshops, Sydney, Australia.10.1109/ICCVW.2013.26 ↗
35. Hong, Z., Chen, Z., Wang, C., Mei, X., Prokhorov, D., and Tao, D. (2015, January 8–10). Multi-store Tracker (muster): A Cognitive Psychology Inspired Approach to Object Tracking. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Boston, MA, USA.10.1109/CVPR.2015.7298675 ↗
36. Reliable Re-detection for Long-term Tracking10.1109/TCSVT.2018.2816570 ↗
37. Long-term Correlation Tracking via Spatial-temporal Context10.1007/s00371-019-01631-8 ↗
38. Tang, M., and Feng, J. (2015, January 11–18). Multi-kernel Correlation Filter for Visual Tracking. Proceedings of the IEEE International Conference on Computer Vision, Santiago, Chile.10.1109/ICCV.2015.348 ↗
39. Lukezic, A., Vojir, T., Čehovin Zajc, L., Matas, J., and Kristan, M. (2017, January 21–26). Discriminative Correlation Filter with Channel and Spatial Reliability. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Honolulu, HI, USA.10.1109/CVPR.2017.515 ↗
40. Mueller, M., Smith, N., and Ghanem, B. (2017, January 21–26). Context-aware Correlation Filter Tracking. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Honolulu, HI, USA.10.1109/CVPR.2017.152 ↗
41. Deformable Parts Correlation Filters for Robust Visual Tracking
42. Tracking-learning-detection10.1109/TPAMI.2011.239 ↗
43. Object Detection with Discriminatively Trained Part-based Models10.1109/TPAMI.2009.167 ↗
44. Context Constraint and Pattern Memory for Long-term Correlation Tracking10.1016/j.neucom.2019.10.021 ↗
45. Long-term Correlation Tracking using Multi-layer Hybrid Features in Sparse and Dense Environments10.1016/j.jvcir.2018.06.027 ↗
46. Dalal, N., Triggs, B., and Schmid, C. (2006, January 7–13). Human Detection Using Oriented Histograms of Flow and Appearance. Proceedings of the European Conference on Computer Vision, Graz, Austria.10.1007/11744047_33 ↗
47. Video Fire Smoke Detection Using Motion and Color Features10.1007/s10694-009-0110-z ↗
48. Robust Visual Tracking via Collaborative Motion and Appearance Model10.1109/TII.2017.2700943 ↗
49. Wang, M., Liu, Y., and Huang, Z. (2017, January 21–26). Large Margin Object Tracking with Circulant Feature Maps. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Honolulu, HI, USA.10.1109/CVPR.2017.510 ↗
50. Zeng, H., Peng, N., Yu, Z., Gu, Z., Liu, H., and Zhang, K. (2015, January 21–24). Visual Tracking using Multi-channel Correlation Filters. Proceedings of the 2015 IEEE International Conference on Digital Signal Processing (DSP), Singapore.10.1109/ICDSP.2015.7251861 ↗
51. Determining Optical Flow
52. Lin, Z., Liu, R., and Su, Z. (2011). Linearized Alternating Direction Method with Adaptive Penalty for Low-rank Representation. arXiv, preprint.
53. Robust Face Recognition via Low-rank Sparse Representation-based Classification10.1007/s11633-015-0901-2 ↗
54. Sparse and Low-rank Representation with Key Connectivity for Hyperspectral Image Classification10.1109/JSTARS.2020.3023483 ↗
55. Liu, J., Ji, S., and Ye, J. (2012). Multi-task Feature Learning via Efficient L2, 1-norm Minimization. arXiv, preprint.
56. Zitnick, C.L., and Dollár, P. (2014, January 6–12). Edge boxes: Locating Object Proposals from Edges. Proceedings of the European Conference on Computer Vision, Zurich, Switzerland.10.1007/978-3-319-10602-1_26 ↗