journal article·2022Open access

Enhancing the Robustness of Visual Object Tracking via Style Transfer

Abdollah Amirkhani, Amir Hossein Barshooi, Amir Ebrahimi

Computers, Materials & Continua· Volume 70· Issue 1

Abstract

The performance and accuracy of computer vision systems are affected by noise in different forms. Although numerous solutions and algorithms have been presented for dealing with every type of noise, a comprehensive technique that can cover all the diverse noises and mitigate their damaging effects on the performance and precision of various systems is still missing. In this paper, we have focused on the stability and robustness of one computer vision branch (i.e., visual object tracking). We have demonstrated that, without imposing a heavy computational load on a model or changing its algorithms, the drop in the performance and accuracy of a system when it is exposed to an unseen noise-laden test dataset can be prevented by simply applying the style transfer technique on the train dataset and training the model with a combination of these and the original untrained data. To verify our proposed approach, it is applied on a generic object tracker by using regression networks. This method’s validity is confirmed by testing it on an exclusive benchmark comprising 50 image sequences, with each sequence containing 15 types of noise at five different intensity levels. The OPE curves obtained show a 40% increase in the robustness of the proposed object tracker against noise, compared to the other trackers considered.
Source: openalex_inverted_index · Quality: baseline

Research context

OpenAlex topics: Video Surveillance and Tracking Methods · Advanced Vision and Imaging · Image Enhancement Techniques

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

References (57)

Show source-provided references
1. Visual object tracking using adaptive correlation filters
2. The pascal visual object classes (VOC) challenge10.1007/s11263-009-0275-4 ↗
3. Textural features for image classification10.1109/TSMC.1973.4309314 ↗
4. Determining optical flow10.1016/0004-3702(81)90024-2 ↗
5. Image segmentation by probabilistic bottom-up aggregation and cue integration10.1109/TPAMI.2011.130 ↗
6. The visual object tracking vot2015 challenge results
7. A survey on machine learning techniques for cyber security in the last decade10.1109/ACCESS.2020.3041951 ↗
8. Performance comparison and current challenges of using machine learning techniques in cybersecurity10.3390/en13102509 ↗
9. Computer vision for autonomous vehicles: Problems, datasets and state of the art10.1561/0600000079 ↗
10. Dix · Human-Computer Interaction · 2000
11. Training and tracking in robotics
12. Vehicle detection and tracking for traffic monitoring system
13. Content based video indexing and retrieval10.1109/93.311653 ↗
14. Object detection and tracking–a survey
15. Handcrafted and deep trackers: Recent visual object tracking approaches and trends10.1145/3309665 ↗
16. A survey of appearance models in visual object tracking
17. Multi scale feature point tracking
18. Globally-optimal greedy algorithms for tracking a variable number of objects
19. Optimal predictive model selection10.1214/009053604000000238 ↗
20. ReViewNet: A fast and resource optimized network for enabling safe autonomous driving in hazy weather conditions
21. Robust intensity-based localization method for autonomous driving on snow-wet road surface10.1109/TII.2017.2713836 ↗
22. Occlusion handling in videos object tracking: A survey
23. Occlusion-robust traffic sign detection via cascaded colour cubic feature10.1049/iet-its.2015.0099 ↗
24. Robust multiple human tracking using particle swarm optimization and the Kalman filter on full occlusion conditions
25. Yu · Computer Vision: A Reference Guide · 2019 · 1
26. Deeptrack: Learning discriminative feature representations online for robust visual tracking10.1109/TIP.2015.2510583 ↗
27. Markov random field models in computer vision
28. Image denoising by sparse 3-D transform-domain collaborative filtering10.1109/TIP.2007.901238 ↗
29. Decision-based median filter using local signal statistics
30. Incremental kernel principal component analysis10.1109/TIP.2007.896668 ↗
31. Histograms of oriented gradients for human detection
32. Gradient local binary patterns for human detection
33. On-line ensemble SVM for robust object tracking
34. Group sparsity residual constraint for image denoising with external nonlocal self-similarity prior10.1016/j.neucom.2017.11.004 ↗
35. A new fuzzy logic filter for image enhancement10.1109/3477.826951 ↗
36. Adaptive fuzzy multilevel median filter10.1109/83.382502 ↗
37. Image denoising by various filters for different noise10.5120/1370-1846 ↗
38. Natural image denoising: Optimality and inherent bounds
39. Gradient-based learning applied to document recognition10.1109/5.726791 ↗
40. Natural image denoising with convolutional networks
41. A cascaded noise-robust deep CNN for face recognition
42. Learning discriminative model prediction for tracking
43. Vehicle detection and tracking in adverse weather using a deep learning framework
44. Robust object tracking via sparsity-based collaborative model
45. Enhancing diversity of defocus blur detectors via cross-ensemble network
46. Learning to track at 100 fps with deep regression networks
47. Fast online object tracking and segmentation: A unifying approach
48. Visual tracking: An experimental survey
49. Microsoft coco: Common objects in context
50. Benchmarking neural network robustness to common corruptions and perturbations
51. Consistent linear-elastic transformations for image matching
52. Online object tracking: A benchmark
53. A. Mordvintsev, C. Olah and M. Tyka, “Inceptionism: Going deeper into neural networks,” 2015. [Online]. Available: http://googleresearch.blogspot.com/2015/06/inceptionism-going-deeper-into-neural.html.
54. Image style transfer using convolutional neural networks
55. Arbitrary style transfer in real-time with adaptive instance normalization
56. Henstock · The General Theory of Integration · 199110.1093/oso/9780198535669.001.0001 ↗
57. Chimp optimization algorithm10.1016/j.eswa.2020.113338 ↗