Video Summarization Approach Based on Binary Robust Invariant Scalable Keypoints and Bisecting K-Means
Source abstract
Abstract
Due to the exponential growth of video data, aided by rapid advancements in multimedia technologies. It became difficult for the user to obtain information from a large video series. The process of providing an abstract of the entire video that includes the most representative frames is known as static video summarization. This method resulted in rapid exploration, indexing, and retrieval of massive video libraries. We propose a framework for static video summary based on a Binary Robust Invariant Scalable Keypoint (BRISK) and bisecting K-means clustering algorithm. The current method effectively recognizes relevant frames using BRISK by extracting keypoints and the descriptors from video sequences. The video frames’ BRISK features are clustered using a bisecting K-means, and the keyframe is determined by selecting the frame that is most near the cluster center. Without applying any clustering parameters, the appropriate clusters number is determined using the silhouette coefficient. Experiments were carried out on a publicly available open video project (OVP) dataset that contained videos of different genres. The proposed method’s effectiveness is compared to existing methods using a variety of evaluation metrics, and the proposed method achieves a trade-off between computational cost and quality.
Source: openalex_inverted_index · Quality: baseline
Research context
OpenAlex topics: Video Analysis and Summarization · Advanced Image and Video Retrieval Techniques · Image Retrieval and Classification Techniques
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
References (30)
Show source-provided references
1. Fast temporal video segmentation based on Krawtchouk-Tchebichef moments10.1109/ACCESS.2020.2987870 ↗
2. Keypoints-based keyframe selection10.1109/TCSVT.2012.2214871 ↗
3. Key moment extraction for designing an agglomerative clustering algorithm-based video summarization framework10.1007/s00521-021-06132-1 ↗
4. A gradient based dual detection model for shot boundary detection10.1007/s11042-022-13547-y ↗
5. K-means clustering algorithms: A comprehensive review, variants analysis, and advances in the era of big data10.1016/j.ins.2022.11.139 ↗
6. BRISK: Binary robust invariant scalable keypoints
7. A review of principal component analysis algorithm for dimensionality reduction
8. Silhouettes: A graphical aid to the interpretation and validation of cluster analysis10.1016/0377-0427(87)90125-7 ↗
9. Evaluation of image feature detection and matching algorithms
10. Performance comparison and analysis between keypoints extraction algorithms using drone images
11. The Open Video Project 2016. Accessed: Sep. 01, 2023. [Online]. Available: http://www.open-video.org.
12. Szeliski · Computer Vision: Algorithms and Applications · 202210.1007/978-3-030-34372-9 ↗
13. Automatic video temporal segmentation based on multiple features10.1007/s00500-009-0527-9 ↗
14. Summarization of videos by image quality assessment
15. VISCOM: A robust video summarization approach using color co-occurrence matrices10.1007/s11042-016-4300-7 ↗
16. Network video summarization based on key frame extraction via superpixel segmentation
17. Keyframe-based video summarization using delaunay clustering10.1007/s00799-005-0129-9 ↗
18. STIMO: STIll and MOving video storyboard for the web scenario10.1007/s11042-009-0307-7 ↗
19. VSUMM: A mechanism designed to produce static video summaries and a novel evaluation method10.1016/j.patrec.2010.08.004 ↗
20. Vison: Video summarization for online applications10.1016/j.patrec.2011.08.007 ↗
21. Vscan: An enhanced video summarization using density-based spatial clustering
22. Towards scalable summarization of consumer videos via sparse dictionary selection
23. Key-frame extraction based on HSV histogram and adaptive clustering10.1155/2019/5217961 ↗
24. Multi-featured cluster based keyframe extraction for efficient video processing and management
25. Distinctive image features from scale-invariant keypoints10.1023/B:VISI.0000029664.99615.94 ↗
26. Speeded-up robust features (SURF)10.1016/j.cviu.2007.09.014 ↗
27. ORB: An efficient alternative to SIFT or SURF
28. Key frames extraction based on local features for efficient video summarization
29. Key frame extraction for video summarization using local description and repeatability graph clustering10.1007/s11760-018-1376-8 ↗
30. M. Massaoudi, S. Bahroun, and E. Zagrouba, “Video summarization based on local features,” 2017. doi: 10.4018/ijmdem.2014040103.10.4018/ijmdem.2014040103 ↗