AR Long-Term Tracking Combining Multi-Attention and Template Updating
Source abstract
Abstract
Aiming at the problem that the augmented reality system is susceptible to complex scenes and easily leads to the failure of tracking registration, a long-term augmented reality tracking algorithm combining multi-attention and template updating is proposed. Firstly, we improved the ResNet-50 network to extract richer semantic features instead of AlexNet. Secondly, the attention-based feature fusion network effectively fuses the template and search area features through a combination of dual self-attention and cross attention. Dual self-attention effectively enhances the information in the context, whereas cross attention adaptively enhanced the features of both self-attention branches. Thirdly, the ORB feature-matching algorithm is utilized to match the template and search image features, with the template updated if more than 150 matching feature points are found. Lastly, the anchor frameless mechanism is adopted in the classification and regression network, resulting in a significant reduction in the number of parameters. The results of experiments conducted on various public datasets demonstrate the algorithm’s high success rate and accuracy, as well as its robustness in complex environments.
Source: crossref · Quality: baseline
Research context
OpenAlex topics: Video Surveillance and Tracking Methods · Visual Attention and Saliency Detection · Advanced Image and Video Retrieval Techniques
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
Affiliations
School of Electronic and Electrical Engineering, Shanghai University of Engineering Science, Shanghai 201620, China
References (44)
Show source-provided references
1. Thomas, P.C., and David, W.M. (1992, January 7–10). Augmented reality: An application of heads-up display technology to manual manufacturing processes. Proceedings of the Hawaii International Conference on System Sciences, Kauai, HI, USA.
2. Distinctive image features from scale-invariant keypoints10.1023/B:VISI.0000029664.99615.94 ↗
3. Surf: Speeded up robust features10.1007/11744023_32 ↗
4. Rublee, E., Rabaud, V., Konolige, K., and Bradski, G. (2011, January 6–13). ORB: An efficient alternative to SIFT or SURF. Proceedings of the International Conference on Computer Vision, Barcelona, Spain.10.1109/ICCV.2011.6126544 ↗
5. Bolme, D.S., Beveridge, J.R., Draper, B.A., and Lui, Y.M. (2010, January 13–18). Visual object tracking using adaptive correlation filters. Proceedings of the 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, San Francisco, CA, USA.10.1109/CVPR.2010.5539960 ↗
6. High-Speed Tracking with Kernelized Correlation Filters10.1109/TPAMI.2014.2345390 ↗
7. Danelljan, M., Häger, G., Khan, F., and Felsberg, M. (2014). British Machine Vision Conference, Nottingham, UK, 1–5 September 2014, BMVA Press.
8. Henriques, J.F., Caseiro, R., Martins, P., and Batista, J. (2012). Computer Vision–ECCV 2012: 12th European Conference on Computer Vision, Florence, Italy, 7–13 October 2012, Springer.
9. Long-term Visual Tracking: Review and Experimental Comparison10.1007/s11633-022-1344-1 ↗
10. A survey of appearance models in visual object tracking
11. Siamese visual object tracking: A survey10.1109/ACCESS.2021.3101988 ↗
12. Bertinetto, L., Valmadre, J., Henriques, J.F., Vedaldi, A., and Torr, P.H.S. (2016). Computer Vision–ECCV 2016 Workshops, Amsterdam, The Netherlands, 8–10 and 15–16 October 2016, Springer.
13. Li, B., Yan, J., Wu, W., Zhu, Z., and Hu, X. (1997, January 17–19). High performance visual tracking with siamese region proposal network. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, San Juan, PR, USA.
14. Guo, D., Wang, J., Cui, Y., Wang, Z., and Chen, S. (2020, January 13–19). SiamCAR: Siamese fully convolutional classification and regression for visual tracking. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, Seattle, WA, USA.10.1109/CVPR42600.2020.00630 ↗
15. Yu, Y., Xiong, Y., Huang, W., and Scott, M.R. (2020, January 13–19). Deformable siamese attention networks for visual object tracking. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, Seattle, WA, USA.10.1109/CVPR42600.2020.00676 ↗
16. Wang, Q., Zhang, L., Bertinetto, L., Hu, W., and Torr, P.H. (2019, January 15–20). Fast online object tracking and segmentation: A unifying approach. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, Long Beach, CA, USA.10.1109/CVPR.2019.00142 ↗
17. Li, B., Wu, W., Wang, Q., Zhang, F., Xing, J., and Yan, J. (2019, January 15–20). Siamrpn++: Evolution of siamese visual tracking with very deep networks. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, Long Beach, CA, USA.10.1109/CVPR.2019.00441 ↗
18. Zhu, Z., Wang, Q., Li, B., Wu, W., Yan, J., and Hu, W. (2018, January 8–14). Distractor-aware siamese networks for visual object tracking. Proceedings of the European Conference on Computer Vision (ECCV), Munich, Germany.10.1007/978-3-030-01240-3_7 ↗
19. Imagenet classification with deep convolutional neural networks10.1145/3065386 ↗
20. Tao, R., Gavves, E., and Smeulders, A.W.M. (2016, January 27–30). Siamese instance search for tracking. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Las Vegas, NV, USA.10.1109/CVPR.2016.158 ↗
21. Zhang, Z., and Peng, H. (2019, January 15–20). Deeper and wider siamese networks for real-time visual tracking. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, Long Beach, CA, USA.10.1109/CVPR.2019.00472 ↗
22. He, K., Zhang, X., Ren, S., and Sun, J. (2016, January 27–30). Deep residual learning for image recognition. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Las Vegas, NV, USA.10.1109/CVPR.2016.90 ↗
23. Vaswani, A., Shazeer, N., Parmar, N., Uszkoreit, J., Jones, L., Gomez, A.N., Kaiser, Ł., and Polosukhin, I. (2017, January 4–9). Attention is all you need. Proceedings of the Annual Conference on Neural Information Processing Systems, Long Beach, CN, USA.
24. Hu, J., Shen, L., and Sun, G. (2018, January 18–23). Squeeze-and-excitation networks. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Salt Lake City, UT, USA.10.1109/CVPR.2018.00745 ↗
25. Wang, X., Girshick, R., Gupta, A., and He, K. (2018, January 18–23). Non-local neural networks. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Salt Lake City, UT, USA.10.1109/CVPR.2018.00813 ↗
26. Woo, S., Park, J., Lee, J.Y., and Kweon, I.S. (2018, January 8–14). Cbam: Convolutional block attention module. Proceedings of the European Conference on Computer Vision, Munich, Germany.10.1007/978-3-030-01234-2_1 ↗
27. Lin, T.Y., Maire, M., Belongie, S., Hays, J., Perona, P., Ramanan, D., Dollár, P., and Zitnick, C.L. (2014). Computer Vision–ECCV 2014: 13th European Conference, Zurich, Switzerland, 6–12 September 2014, Springer.
28. Muller, M., Bibi, A., Giancola, S., Alsubaihi, S., and Ghanem, B. (2018, January 8–14). Trackingnet: A large-scale dataset and benchmark for object tracking in the wild. Proceedings of the European Conference on Computer Vision, Munich, Germany.10.1007/978-3-030-01246-5_19 ↗
29. Lasot: A high-quality large-scale single object tracking benchmark10.1007/s11263-020-01387-y ↗
30. Got-10k: A large high-diversity benchmark for generic object tracking in the wild10.1109/TPAMI.2019.2957464 ↗
31. Object Tracking Benchmark10.1109/TPAMI.2014.2388226 ↗
32. Valmadre, J., Bertinetto, L., Henriques, J., Vedaldi, A., and Torr, P.H. (2017, January 21–26). End-to-end representation learning for correlation filter based tracking. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Honolulu, HI, USA.10.1109/CVPR.2017.531 ↗
33. Li, P., Chen, B., Ouyang, W., Wang, D., Yang, X., and Lu, H. (November, January 27). Gradnet: Gradient-guided network for visual object tracking. Proceedings of the IEEE/CVF International Conference on Computer Vision, Seoul, Republic of Korea.
34. Bertinetto, L., Valmadre, J., Golodetz, S., Miksik, O., and Torr, P.H. (2016, January 27–30). Staple: Complementary learners for real-time tracking. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Las Vegas, NV, USA.10.1109/CVPR.2016.156 ↗
35. Yan, B., Peng, H., Fu, J., Wang, D., and Lu, H. (2021, January 11–17). Learning spatio-temporal transformer for visual tracking. Proceedings of the IEEE/CVF International Conference on Computer Vision, Montreal, BC, Canada.10.1109/ICCV48922.2021.01028 ↗
36. Danelljan, M., Bhat, G., Khan, F.S., and Felsberg, M. (2019, January 15–20). Atom: Accurate tracking by overlap maximization. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, Long Beach, CA, USA.10.1109/CVPR.2019.00479 ↗
37. Yan, B., Zhao, H., Wang, D., Lu, H., and Yang, X. (November, January 27). ‘Skimming-Perusal’ Tracking: A framework for real-time and robust long-term tracking. Proceedings of the IEEE/CVF International Conference on Computer Vision, Seoul, Republic of Korea.
38. Dai, K., Zhang, Y., Wang, D., Li, J., Lu, H., and Yang, X. (2020, January 13–19). High-performance long-term tracking with meta-updater. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), Seattle, WA, USA.10.1109/CVPR42600.2020.00633 ↗
39. Kiani Galoogahi, H., Fagg, A., and Lucey, S. (2017, January 22–29). Learning background-aware correlation filters for visual tracking. Proceedings of the IEEE International Conference on Computer Vision, Venice, Italy.10.1109/ICCV.2017.129 ↗
40. Zhu, G., Porikli, F., and Li, H. (2016, January 27–30). Beyond local search: Tracking objects everywhere with instance-specific proposals. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Las Vegas, NV, USA.10.1109/CVPR.2016.108 ↗
41. Ma, C., Yang, X., Zhang, C., Qi, J., and Lu, H. (2015, January 7–12). Long-term correlation tracking. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Boston, MA, USA.10.1109/CVPR.2015.7299177 ↗
42. Tracking-learning-detection10.1109/TPAMI.2011.239 ↗
43. Learning regression and verification networks for robust long-term tracking10.1007/s11263-021-01487-3 ↗
44. Huang, L., Zhao, X., and Huang, K. (2020, January 7–12). Globaltrack: A simple and strong baseline for long-term tracking. Proceedings of the AAAI Conference on Artificial Intelligence, New York, NY, USA.10.1609/aaai.v34i07.6758 ↗