Few-Shot Object Detection Based on the Transformer and High-Resolution Network
Source abstract
Abstract
Now object detection based on deep learning tries different strategies. It uses fewer data training networks to achieve the effect of large dataset training. However, the existing methods usually do not achieve the balance between network parameters and training data. It makes the information provided by a small amount of picture data insufficient to optimize model parameters, resulting in unsatisfactory detection results. To improve the accuracy of few shot object detection, this paper proposes a network based on the transformer and high-resolution feature extraction (THR). High-resolution feature extraction maintains the resolution representation of the image. Channels and spatial attention are used to make the network focus on features that are more useful to the object. In addition, the recently popular transformer is used to fuse the features of the existing object. This compensates for the previous network failure by making full use of existing object features. Experiments on the Pascal VOC and MS-COCO datasets prove that the THR network has achieved better results than previous mainstream few shot object detection.
Source: openalex_inverted_index · Quality: baseline
Research context
OpenAlex topics: Advanced Neural Network Applications · Industrial Vision Systems and Defect Detection · Domain Adaptation and Few-Shot Learning
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
References (38)
Show source-provided references
1. Rich feature hierarchies for accurate object detection and semantic segmentation
2. You only look once: Unified, real-time object detection
3. Few-shot object detection via feature reweighting
4. Meta-learning to detect rare objects
5. Meta R-CNN: Towards general solver for instance-level low-shot learning
6. YOLO9000: Better, faster, stronger
7. Imagenet classification with deep convolutional neural networks
8. M. Lin, Q. Chen and S. C. Yan, “Network in network,” in arXiv preprint arXiv:1312.4400, pp. 1–10, 2013.
9. K. Simonyan and A. Zisserman, “Very deep convolutional networks for large-scale image recognition,” in arXiv preprint arXiv:1409.1556, pp. 1–14, 2014.
10. Batch normalization: Accelerating deep network training by reducing internal covariate shift
11. Going deeper with convolutions
12. Deep residual learning for image recognition
13. Rethinking the inception architecture for computer vision
14. Inception-v4, inception-resnet and the impact of residual connections on learning
15. Yolov3: An incremental improvement
16. Yolov4: Optimal speed and accuracy of object detection
17. Fast R-CNN
18. Faster R-CNN: Towards real-time object detection with region proposal networks10.1109/TPAMI.2016.2577031 ↗
19. Small object detection via precise region-based fully convolutional networks10.32604/cmc.2021.017089 ↗
20. Spatial-resolution independent object detection framework for aerial imagery10.32604/cmc.2021.014406 ↗
21. A new meta-baseline for few-shot learning
22. Multi-head attention graph network for few shot learning10.32604/cmc.2021.016851 ↗
23. J. Lu, P. H. Gong, J. P. Ye and C. S. Zhang, “Learning from very few samples: A survey,” in arXiv preprint arXiv:2009.02653, pp. 1–30, 2020.
24. An analysis of scale invariance in object detection snip
25. LSTD: A low-shot transfer detector for object detection
26. Generalizing from a few examples: A survey on few-shot learning
27. Meta-SSD: Towards fast adaptation for few-shot object detection with meta-learning10.1109/ACCESS.2019.2922438 ↗
28. Tracking by instance detection: A meta-learning approach
29. Incremental few-shot object detection
30. Attention is all you need
31. J. Devlin, M. -W. Chang, K. Lee and K. Toutanova, “Bert: Pre-training of deep bidirectional transformers for language understanding,” in arXiv preprint arXiv:1810.04805, pp. 1–16, 2018.
32. Review of text classification methods on deep learning10.32604/cmc.2020.010172 ↗
33. End-to-end object detection with transformers
34. A. Dosovitskiy, L. Beyer, A. Kolesnikov, D. Weissenborn, X. H. Zhai et al., “An image is worth 16x16 words: Transformers for image recognition at scale,” in arXiv preprint arXiv:2010.11929, pp. 1–22, 2020.
35. Deep high-resolution representation learning for human pose estimation
36. J. Park, S. Woo, J. -Y. Lee and I. S. Kweon, “Bam: Bottleneck attention module,” in arXiv preprint arXiv:1807.06514, pp. 1–14, 2018.
37. CBAM: Convolutional block attention module
38. Deep co-image-label hashing for multi-label image retrieval10.1109/TMM.2021.3119868 ↗