Effective Video Summarization Approach Based on Visual Attention
Source abstract
Abstract
Video summarization is applied to reduce redundancy and develop a concise representation of key frames in the video, more recently, video summaries have been used through visual attention modeling. In these schemes, the frames that stand out visually are extracted as key frames based on human attention modeling theories. The schemes for modeling visual attention have proven to be effective for video summaries. Nevertheless, the high cost of computing in such techniques restricts their usability in everyday situations. In this context, we propose a method based on KFE (key frame extraction) technique, which is recommended based on an efficient and accurate visual attention model. The calculation effort is minimized by utilizing dynamic visual highlighting based on the temporal gradient instead of the traditional optical flow techniques. In addition, an efficient technique using a discrete cosine transformation is utilized for the static visual salience. The dynamic and static visual attention metrics are merged by means of a non-linear weighted fusion technique. Results of the system are compared with some existing state-of-the-art techniques for the betterment of accuracy. The experimental results of our proposed model indicate the efficiency and high standard in terms of the key frames extraction as output.
Source: openalex_inverted_index · Quality: baseline
Research context
OpenAlex topics: Video Analysis and Summarization · Image Retrieval and Classification Techniques · Advanced Image and Video Retrieval Techniques
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
References (38)
Show source-provided references
1. Video abstraction: A systematic review and classification
2. Keyframe-based user interfaces for digital video
3. Video manga: Generating semantically meaningful video summaries
4. Video summarisation: A conceptual framework and survey of the state of the art10.1016/j.jvcir.2007.04.002 ↗
5. An autonomous framework to produce and distribute personalized team-sport video summaries: A basketball case study10.1109/TMM.2011.2166379 ↗
6. Spatial analysis in key-frame extraction using video segmentation
7. A model of motion attention for video skimming
8. Key frame extraction based on visual attention model10.1016/j.jvcir.2011.08.005 ↗
9. Image signature: Highlighting sparse salient regions10.1109/TPAMI.2011.146 ↗
10. Keyframe-based video summarization using delaunay clustering10.1007/s00799-005-0129-9 ↗
11. VSUMM: A mechanism designed to produce static video summaries and a novel evaluation method10.1016/j.patrec.2010.08.004 ↗
12. Video summarization by curve simplification
13. Keyframe-based video summary using visual attention clues
14. A novel framework for semantic annotation and personalized retrieval of sports video10.1109/TMM.2008.917346 ↗
15. Combined key-frame extraction and object-based video segmentation10.1109/TCSVT.2005.848347 ↗
16. A long video caption generation algorithm for big video data retrieval10.1016/j.future.2018.10.054 ↗
17. An integrated system for content-based video retrieval and browsing10.1016/S0031-3203(96)00109-4 ↗
18. Video retrieval based on scene change detection in compressed streams10.1109/30.793648 ↗
19. Adaptive key frame extraction for video summarization using an aggregation mechanism10.1016/j.jvcir.2012.06.013 ↗
20. Dynamic selection and effective compression of key frames for video abstraction10.1016/S0167-8655(02)00391-4 ↗
21. Hierarchical video summarization in reference subspace10.1109/TCE.2009.5278026 ↗
22. Automatic video summarizing tool using MPEG-7 descriptors for personal video recorder10.1109/TCE.2003.1233813 ↗
23. A video summarization tool using two-level redundancy detection for personal video recorders10.1109/TCE.2008.4560124 ↗
24. A generic framework of user attention model and its application in video summarization10.1109/TMM.2005.854410 ↗
25. Styles · The Psychology of Attention · 200610.4324/9780203968215 ↗
26. Computational versus psychophysical bottom-up image saliency: A comparative evaluation study10.1109/TPAMI.2011.53 ↗
27. Fast human detection using a novel boosted cascading structure with meta stages10.1109/TIP.2008.926152 ↗
28. An attention-based decision fusion scheme for multimedia information retrieval
29. On the plausibility of the discriminant center-surround hypothesis for visual saliency10.1167/8.7.13 ↗
30. STIMO: STIll and MOving video storyboard for the web scenario10.1007/s11042-009-0307-7 ↗
31. Visual saliency models for summarization of diagnostic hysteroscopy videos in healthcare systems10.1186/s40064-016-3171-8 ↗
32. VSCAN: An enhanced video summarization using density-based spatial clustering
33. Memorable and rich video summarization10.1016/j.jvcir.2016.12.001 ↗
34. Efficient visual attention driven framework for key frames extraction from hysteroscopy videos10.1016/j.bspc.2016.11.011 ↗
35. Efficient visual attention based framework for extracting key frames from videos
36. Context-aware surveillance video summarization10.1109/TIP.2016.2601493 ↗
37. Cost-effective video summarization using deep CNN with hierarchical weighted fusion for IoT surveillance networks
38. Motion-state-adaptive video summarization via spatiotemporal analysis10.1109/TCSVT.2016.2539638 ↗