Comparison of Tracking Techniques on 360-Degree Videos
Source abstract
Abstract
With the availability of 360-degree cameras, 360-degree videos have become popular recently. To attach a virtual tag on a physical object in 360-degree videos for augmented reality applications, automatic object tracking is required so the virtual tag can follow its corresponding physical object in 360-degree videos. Relative to ordinary videos, 360-degree videos in an equirectangular format have special characteristics such as viewpoint change, occlusion, deformation, lighting change, scale change, and camera shakiness. Tracking algorithms designed for ordinary videos may not work well on 360-degree videos. Therefore, we thoroughly evaluate the performance of eight modern trackers in terms of accuracy and speed on 360-degree videos. The pros and cons of these trackers on 360-degree videos are discussed. Possible improvements to adapt these trackers to 360-degree videos are also suggested. Finally, we provide a dataset containing nine 360-degree videos with ground truth of target positions as a benchmark for future research.
Source: crossref · Quality: baseline
Research context
OpenAlex topics: Video Surveillance and Tracking Methods · Advanced Vision and Imaging · Visual Attention and Saliency Detection
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
Affiliations
Department of Computer Science & Information Engineering, National Dong Hwa University, Hualien 974, Taiwan
Funding
Ministry of Science and Technology, Taiwan
References (22)
Show source-provided references
1. Zia, O., Kim, J., Han, K., and Lee, J.W. (2019, January 11–13). 360° Panorama Generation using Drone Mounted Fisheye Cameras. Proceedings of the IEEE International Conference on Consumer Electronics, Las Vegas, NV, USA.10.1109/ICCE.2019.8661954 ↗
2. Kelling, C., Väätäjä, H., and Kauhanen, O. (2017, January 26–29). Impact of device, context of use, and content on viewing experience of 360-degree tourism video. Proceedings of the International Conference on Mobile and Ubiquitous Multimedia, New York, NY, USA.10.1145/3152832.3152872 ↗
3. Afzal, S., Chen, J., and Ramakrishnan, K.K. (2017, January 25). Characterization of 360-degree Videos. Proceedings of the ACM SIGCOMM 2017 Workshop on Virtual Reality and Augmented Reality Network, Los Angeles, CA, USA.10.1145/3097895.3097896 ↗
4. Boonsuk, W. (2011). Evaluation of Desktop Interface Displays for 360-Degree Video. [Master’s Thesis, Iowa State University].
5. Cai, C., Liang, X., Wang, B., Cui, Y., and Yan, Y. (2018, January 25–27). A Target Tracking Method Based on KCF for Omnidirectional Vision. Proceedings of the 37th Chinese Control Conference, Wuhan, China.10.23919/ChiCC.2018.8483083 ↗
6. Delforouzi, A., Tabatabaei, S., Shirahama, K., and Grzegorzek, M. (2016, January 4–8). Unknown object tracking in 360-degree camera images. Proceedings of the International Conference on Pattern Recognition, Cancun, Mexico.10.1109/ISM.2016.0077 ↗
7. Get around 360 hypervideo: Its design and evaluation10.4018/jaci.2012100103 ↗
8. Berning, M., Yonezawa, T., Riedel, T., Nakazawa, J., Beigl, M., and Tokuda, H. (2013, January 8–12). pARnorama: 360 degree interactive video for augmented reality prototyping. Proceedings of the ACM International Joint Conference on Pervasive and Ubiquitous Computing, Zurich, Switzerland.10.1145/2494091.2499570 ↗
9. Rupp, M., Kozachuk, J., Michaelis, J., Odette, K., Smither, J., and McConnell, D. (2016, January 19–23). The effects of immersiveness and future VR expectations on subjec-tive-experiences during an educational 360 video. Proceedings of the International Annual Meeting of the Human Factors and Ergonomics Society, Washington, DC, USA.10.1177/1541931213601477 ↗
10. Pakkanen, T., Hakulinen, J., Jokela, T., Rakkolainen, I., Kangas, J., Piippo, P., Raisamo, R., and Salmimaa, M. (2017, January 18–22). Interaction with WebVR 360 video player: Comparing three interaction paradigms. Proceedings of the IEEE Virtual Reality, Los Angeles, CA, USA.10.1109/VR.2017.7892285 ↗
11. Huang, H., Solah, M., Li, D., and Yu, L. (2019, January 4–9). Audible Panorama: Automatic Spatial Audio Generation for Panorama Imagery. Proceedings of the CHI Conference on Human Factors in Computing Systems, Glasgow, UK.10.1145/3290605.3300851 ↗
12. Mousas, C. (2018, January 18–22). Performance-driven dance motion control of a virtual partner character. Proceedings of the IEEE Conference on Virtual Reality and 3D User Interfaces, Reutlingen, Germany.10.1109/VR.2018.8446498 ↗
13. Grabner, H., Grabner, M., and Bischof, H. (2006, January 4–7). Real-Time Tracking via On-line Boosting. Proceedings of the British Machine Vision Conference, Edinburgh, UK.10.5244/C.20.6 ↗
14. Babenko, B., Yang, M., and Belongie, S.J. (2009, January 20–25). Visual tracking with online Multiple Instance Learning. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Miami, FL, USA.10.1109/CVPR.2009.5206737 ↗
15. Kalal, Z., Mikolajczyk, K., and Matas, J. (2010, January 23–26). Forward-Backward Error: Automatic Detection of Tracking Failures. Proceedings of the International Conference on Pattern Recognition, Istanbul, Turkey.10.1109/ICPR.2010.675 ↗
16. Bolme, D.S., Beveridge, J.R., Draper, B.A., and Lui, Y.M. (2010, January 13–18). Visual object tracking using adaptive correlation filters. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, San Francisco, CA, USA.10.1109/CVPR.2010.5539960 ↗
17. Tracking-learning-detection10.1109/TPAMI.2011.239 ↗
18. High-Speed Tracking with Kernelized Correlation Filters10.1109/TPAMI.2014.2345390 ↗
19. Held, D., Thrun, S., and Savarese, S. (2016, January 11–14). Learning to Track at 100 FPS with Deep Regression Networks. Proceedings of the European Conference on Computer Vision, Amsterdam, The Netherlands.10.1007/978-3-319-46448-0_45 ↗
20. Lukezic, A., Vojír, T., Zajc, L.C., Matas, J., and Kristan, M. (2017, January 21–26). Discriminative Correlation Filter Tracker with Channel and Spatial Reliability. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Honolulu, HI, USA.10.1109/CVPR.2017.515 ↗
21. Wang, P., Zhang, L., Wu, Z., and Xu, R. (2015, January 15–17). Research on video coding parameters affecting object tracking. Proceedings of the International Conference on Wireless Communications & Signal Processing, Nanjing, China.10.1109/WCSP.2015.7341293 ↗
22. Sacht, L., Carvalho, P., Velho, L., and Gattass, M. (2010, January 4–7). Face and Straight Line Detection in Equirectangular Images. Proceedings of the Workshop de Visão Computacional, São Paulo, Brzail.