Image Captioning Using Multimodal Deep Learning Approach
Source abstract
Abstract
The process of generating descriptive captions for images has witnessed significant advancements in last years, owing to the progress in deep learning techniques. Despite significant advancements, the task of thoroughly grasp... | Find, read and cite all the research you need on Tech Science Press
Source: openalex_inverted_index · Quality: baseline
Research context
OpenAlex topics: Multimodal Machine Learning Applications · Video Analysis and Summarization · Human Pose and Action Recognition
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
References (52)
Show source-provided references
1. Multimodal machine learning: A survey and taxonomy10.1109/TPAMI.2018.2798607 ↗
2. Explainable vision transformers for vein biometric recognition10.1109/ACCESS.2024.3393558 ↗
3. Research on image tibetan caption generation method fusion attention mechanism
4. Moving target detection algorithm based on SIFT feature matching
5. Feature extraction method based on improved linear LBP operator
6. A SAR remote sensing image change detection method based on DR-UNet-CRF model
7. Image captioning techniques: A review
8. Image caption generation using deep neural networks
9. Image captioning using VGG-16 deep learning model
10. A new CNN-RNN framework for remote sensing image captioning
11. Combination of DenseNet and BiLSTM model for Indonesian image captioning
12. Image caption generation using ResNET-50 and LSTM
13. Vision 360: Image caption generation using encoder-decoder model
14. Using neural encoder-decoder models with continuous outputs for remote sensing image captioning10.1109/ACCESS.2022.3151874 ↗
15. Improved multi-stage training of online attention-based encoder-decoder models
16. A comparative study of attention-based encoder-decoder approaches to natural scene text recognition
17. Video summarization with self-attention based encoder-decoder framework
18. Attention is all you need
19. Deep vision transformer and T5-based for image captioning
20. Remote sensing image change captioning with dual-branch transformers: A new method and a large scale dataset
21. Exploring transformer and multilabel classification for remote sensing image captioning10.1109/LGRS.2022.3198234 ↗
22. Attention on attention for image captioning
23. Image captioning with semantic attention
24. Improving robustness for vision transformer with a simple dynamic scanning augmentation
25. Deep multimodal representation learning: A survey10.1109/ACCESS.2019.2916887 ↗
26. Scaling up vision-language pretraining for image captioning
27. Enhanced soft attention mechanism with an inception-like module for image captioning
28. Near-optimal glimpse sequences for improved hard attention neural network training
29. Auto-encoding and distilling scene graphs for image captioning
30. A multimodal fusion approach for image captioning
31. Multimodal fusion methods with vision transformers for remote sensing semantic segmentation
32. EfficientNet: Rethinking model scaling for convolutional neural networks
33. GUI-based YOLOv8 license plate detection system design
34. A comprehensive review of YOLO architectures in computer vision: From YOLOv1 to YOLOv8 and YOLO-NAS10.3390/make5040083 ↗
35. Kaggle, “Flickr 8k dataset,” Apr. 1, 2024. Accessed: Jul. 31, 2024. [Online]. Available: https://www.kaggle.com/datasets/adityajn105/flickr8k
36. Show and tell: A neural image caption generator
37. Attend and tell: Neural image caption generation with visual attention
38. Bottom-up and top-down attention for image captioning and visual question answering
39. B. Alexey et al., “YOLOv4: Optimal speed and accuracy of object detection,” 2020, arXiv:2004.10934.
40. Improved small-object detection using YOLOv8: A comparative study10.54254/2755-2721/41/20230714 ↗
41. Keras, “YOLOV8 backbones,” Apr. 1, 2024. Accessed: Jul. 31, 2024. [Online]. Available: https://keras.io/api/keras_cv/models/backbones/yolo_v8/
42. Practical analysis on architecture of EfficientNet
43. Recognizing the style of a fine-art painting with EfficientNet and transfer learning
44. Multi-label classification of fundus images with EfficientNet10.1109/ACCESS.2020.3040275 ↗
45. Classification of remote sensing images using EfficientNet-B3 CNN model with attention10.1109/ACCESS.2021.3051085 ↗
46. TransRNAm: Identifying twelve types of RNA modifications by an interpretable multi-label deep learning model based on transformer10.1109/TCBB.2023.3307419 ↗
47. Transformer-based feature compensation and aggregation for DeepFake detection10.1109/LSP.2022.3214768 ↗
48. Comparison of various CNN encoders for image captioning
49. RBBA: ResNet-BERT-Bahdanau attention for image caption generator
50. Image captioning using DenseNet network and adaptive attention
51. Guiding the long-short term memory model for image caption generation
52. X-linear attention networks for image captioning