A Sentence Retrieval Generation Network Guided Video Captioning
Source abstract
Abstract
Currently, the video captioning models based on an encoder-decoder mainly rely on a single video input source. The contents of video captioning are limited since few studies employed external corpus information to guide the g... | Find, read and cite all the research you need on Tech Science Press
Source: openalex_inverted_index · Quality: baseline
Research context
OpenAlex topics: Multimodal Machine Learning Applications · Video Analysis and Summarization · Human Pose and Action Recognition
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
References (53)
Show source-provided references
1. Automatic image and video caption generation with deep learning: A concise review and algorithmic overlap10.1109/ACCESS.2020.3042484 ↗
2. Current research status and prospects on multimedia content understanding
3. Capturing temporal structures for video captioning by spatio-temporal contexts and channel attention mechanism10.1007/s11063-017-9591-9 ↗
4. Spatio-temporal dynamics and semantic attribute enriched visual encoding for video captioning
5. Refocused attention: Long short-term rewards guided video captioning10.1007/s11063-019-10030-y ↗
6. Adaptively converting auxiliary attributes and textual embedding for video captioning based on BiLSTM10.1007/s11063-020-10352-2 ↗
7. Jointly cross-and self-modal graph attention network for query-based moment localization
8. Context-aware biaffine localizing network for temporal sentence grounding
9. Task-driven dynamic fusion: Reducing ambiguity in video description
10. Babytalk: Understanding and generating simple image descriptions
11. Youtube2text: Recognizing and describing arbitrary activities using semantic hierarchies and zero-shot recognition
12. Learning explicit video attributes from mid-level representation for video captioning10.1016/j.cviu.2017.06.012 ↗
13. Multimodal architecture for video captioning with memory networks and an attention mechanism10.1016/j.patrec.2017.10.012 ↗
14. Attention is all you need
15. Videobert: A joint model for video and language representation learning
16. Sketch, ground, and refine: Top-down dense video captioning
17. Inter-media hashing for large-scale retrieval from heterogeneous data sources
18. Generating natural-language video descriptions using text-mined knowledge
19. Open-book video captioning with retrieve-copy-generate network
20. Im2text: Describing images using 1 million captioned photographs
21. Understanding videos, constructing plots learning a visually grounded storyline model from annotated videos
22. End-to-end generative pretraining for multimodal video captioning
23. Variational stacked local attention networks for diverse video captioning
24. SibNet: Sibling convolutional encoder for video captioning10.1109/TPAMI.2019.2940007 ↗
25. MemCap: Memorizing style knowledge for image captioning
26. Effective video summarization approach based on visual attention10.32604/cmc.2022.021158 ↗
27. Spatio-temporal ranked-attention networks for video captioning
28. Object-aware aggregation with bidirectional temporal graph for video captioning
29. Joint common sense and relation reasoning for dense relational captioning
30. Joint syntax representation learning and visual cue translation for video captioning
31. Research on video captioning method based on semantic key frame
32. Aligning source visual and target language domains for unpaired video captioning
33. Video captioning using global-local representation10.1109/TCSVT.2022.3177320 ↗
34. Using neural encoder-decoder models with continuous outputs for remote sensing image captioning10.1109/ACCESS.2022.3151874 ↗
35. Image understanding using vision and reasoning through scene description graph10.1016/j.cviu.2017.12.004 ↗
36. Improving image captioning by leveraging knowledge graphs
37. Joint commonsense and relation reasoning for image and video captioning
38. Topic-based image caption generation10.1007/s13369-019-04262-2 ↗
39. Aggregated residual transformations for deep neural networks
40. Eco: Efficient convolutional network for online video understanding
41. Temporal rules discovery for web data cleaning10.14778/2856318.2856328 ↗
42. Adapting GPT, GPT-2 and BERT language models for speech recognition
43. A lightweight convolution neural network for automatic disasters recognition
44. Bleu: A method for automatic evaluation of machine translation
45. METEOR: An automatic metric for MT evaluation with improved correlation with human judgments
46. Rouge: A package for automatic evaluation of summaries
47. Cider: Consensus-based image description evaluation
48. Temporal deformable convolutional encoder-decoder networks for video captioning
49. Video captioning with object-aware spatio-temporal correlation and aggregation10.1109/TIP.2020.2988435 ↗
50. Video captioning based on channel soft attention and semantic reconstructor10.3390/fi13020055 ↗
51. Syntax-aware action targeting for video captioning
52. Object relational graph with teacher-recommended learning for video captioning
53. Co-segmentation aided two-stream architecture for video captioning