journal article·2025Open access

A Novelty Framework in Image-Captioning with Visual Attention-Based Refined Visual Features

Alaa Thobhani, Beiji Zou, Xiaoyan Kui, Amr Abdussalam, Muhammad Asim, Mohammed ELAffendi, Sajid Shah

Computers, Materials & Continua· Volume 82· Issue 3

Abstract

Image captioning, the task of generating descriptive sentences for images, has advanced significantly with the integration of semantic information. However, traditional models still rely on static visual features that do not ... | Find, read and cite all the research you need on Tech Science Press
Source: openalex_inverted_index · Quality: baseline

Research context

OpenAlex topics: Multimodal Machine Learning Applications · Advanced Image and Video Retrieval Techniques · Video Analysis and Summarization

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

References (52)

Show source-provided references
1. Bashir · Neural Comput Appl · 2024 · 1
2. Efficient color image enhancement using piecewise linear transformation and gamma correction10.1007/s12596-023-01171-4 ↗
3. Synergistic integration of transfer learning and deep learning for enhanced object detection in digital images10.1109/ACCESS.2024.3354706 ↗
4. Image captioning with semantic attention
5. Bi-directional co-attention network for image captioning10.1145/3460474 ↗
6. Show, attend and tell: neural image caption generation with visual attention
7. Knowing when to look: adaptive attention via a visual sentinel for image captioning
8. Bottom-up and top-down attention for image captioning and visual question answering
9. Spatio-temporal memory attention for image captioning10.1109/TIP.2020.3004729 ↗
10. Dual attention on pyramid feature maps for image captioning10.1109/TMM.2021.3072479 ↗
11. Visual cluster grounding for image captioning10.1109/TIP.2022.3177318 ↗
12. Multimodal transformer with multi-view visual representation for image captioning10.1109/TCSVT.2019.2947482 ↗
13. Region-aware image captioning via interaction learning10.1109/TCSVT.2021.3107035 ↗
14. Visual attention network10.1007/s41095-023-0364-2 ↗
15. Learning joint relationship attention network for image captioning10.1016/j.eswa.2022.118474 ↗
16. GVA: guided visual attention approach for automatic image caption generation10.1007/s00530-023-01249-w ↗
17. More is better: precise and detailed image captioning using online positive recall and missing concepts mining10.1109/TIP.2018.2855415 ↗
18. Image captioning with end-to-end attribute detection and subsequent attributes prediction10.1109/TIP.2020.2969330 ↗
19. Image captioning model using part-of-speech guidance module for description with diverse vocabulary10.1109/ACCESS.2022.3169781 ↗
20. Integrating part of speech guidance for image captioning10.1109/TMM.2020.2976552 ↗
21. Topic-oriented image captioning based on order-embedding10.1109/TIP.2018.2889922 ↗
22. Integrating scene semantic knowledge into image captioning10.1145/3439734 ↗
23. Chinese image caption generation via visual attention and topic modeling10.1109/TCYB.2020.2997034 ↗
24. Image captioning with novel topics guidance and retrieval-based topics re-weighting10.1109/TMM.2022.3202690 ↗
25. Re-caption: saliency-enhanced image captioning through two-phase learning10.1109/TIP.2019.2928144 ↗
26. Vision-to-language tasks based on attributes and attention mechanism10.1109/TCYB.2019.2914351 ↗
27. Stack-VS: stacked visual-semantic attention for image caption generation10.1109/ACCESS.2020.3018752 ↗
28. Rotstein N, Bensaid D, Brody S, Ganz R, Kimmel R. FuseCap: leveraging large language models to fuse visual data into enriched image captions. arXiv:2305.17718. 2023.10.1109/WACV57701.2024.00559 ↗
29. Haque N, Labiba I, Akter S. FaceAtt: enhancing image captioning with facial attributes for portrait images. arXiv:2309.13601. 2023.
30. ICEAP: an advanced fine-grained image captioning network with enhanced attribute predictor10.1016/j.displa.2024.102798 ↗
31. Attribute guided fusion network for obtaining fine-grained image captions
32. Towards diverse and natural image descriptions via a conditional GAN
33. Show and tell more: topic-oriented multi-sentence image captioning
34. NumCap: a number-controlled multi-caption image captioning network10.1145/3576927 ↗
35. Image captioning by diffusion models: a survey10.1016/j.engappai.2024.109288 ↗
36. Microsoft coco: common objects in context
37. Deep visual-semantic alignments for generating image descriptions
38. CIDEr: consensus-based image description evaluation
39. BLEU: a method for automatic evaluation of machine translation
40. Lin · Text summarization branches out · 2004 · 74
41. METEOR: an automatic metric for MT evaluation with improved correlation with human judgments
42. SPICE: semantic propositional image caption evaluation
43. Recurrent fusion network for image captioning
44. Recall what you see continually using gridlstm in image captioning10.1109/TMM.2019.2931815 ↗
45. Self-critical sequence training for image captioning
46. Hierarchical attention-based fusion for image caption with multi-grained rewards10.1109/ACCESS.2020.2981513 ↗
47. MRRC: multiple role representation crossover interpretation for image captioning with R-CNN feature distribution composition (FDC)10.1007/s11042-021-10578-9 ↗
48. Task-adaptive attention for image captioning10.1109/TCSVT.2021.3067449 ↗
49. A cooperative approach based on self-attention with interactive attribute for image caption10.1007/s11042-022-13279-z ↗
50. A reference-based model using deep learning for image captioning10.1007/s00530-022-00937-3 ↗
51. A concise and varied visual features-based image captioning model with visual selection
52. Fine-grained image captioning with global-local discriminative objective10.1109/TMM.2020.3011317 ↗