FSpot: Fast and Efficient Video Encoding Workloads Over Amazon Spot Instances
Source abstract
Abstract
HTTP Adaptive Streaming (HAS) of video content is becoming an undivided part of the Internet and accounts for most of today's network traffic. Video compression technology plays a vital role in efficiently utilizing network channels, but encoding videos into multiple representations with selected encoding parameters is a significant challenge. However, video encoding is a computationally intensive and time-consuming operation that requires high-performance resources provided by on-premise infrastructures or public clouds. In turn, the public clouds, such as Amazon elastic compute cloud (EC2), provide hundreds of computing instances optimized for different purposes and clients’ budgets. Thus, there is a need for algorithms and methods for optimized computing instance selection for specific tasks such as video encoding and transcoding operations. Additionally, the encoding speed directly depends on the selected encoding parameters and the complexity characteristics of video content. In this paper, we first benchmarked the video encoding performance of Amazon EC2 spot instances using multiple ×264 codec encoding parameters and video sequences of varying complexity. Then, we proposed a novel fast approach to optimize Amazon EC2 spot instances and minimize video encoding costs. Furthermore, we evaluated how the optimized selection of EC2 spot instances can affect the encoding cost. The results show that our approach, on average, can reduce the encoding costs by at least 15.8% and up to 47.8% when compared to a random selection of EC2 spot instances.
Source: openalex_inverted_index · Quality: baseline
Research context
OpenAlex topics: Video Coding and Compression Technologies · Image and Video Quality Assessment · Advanced Data Compression Techniques
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
References (47)
Show source-provided references
1. Robbins · Cisco Annual Internet Report (2018–2023). Cisco · 2020
2. Continuous one-way detection of available bandwidth changes for video streaming over best effort networks10.1109/TIM.2014.2331423 ↗
3. The MPEG-DASH standard for multimedia streaming over the internet10.1109/MMUL.2011.71 ↗
4. A survey on bitrate adaptation schemes for streaming media over HTTP10.1109/COMST.2018.2862938 ↗
5. Evaluation of the performance of adaptive HTTP streaming systems
6. AdViSE: Adaptive video streaming evaluation framework for the automated testing of media players
7. Overview of the H.264/AVC video coding standard10.1109/TCSVT.2003.815165 ↗
8. Overview of the high-efficiency video coding (HEVC) standard10.1109/TCSVT.2012.2221191 ↗
9. A technical overview of VP9: The latest open-source video codec
10. Optimized transcoding for large scale adaptive streaming using playback statistics
11. B. Bross, J. Chen and S. Liu, “Versatile video coding (Draft 7),” JVET-P2001, Geneva, CH, 2019.
12. Multi-codec DASH dataset
13. Video transcoding clouds comparison 2019
14. Efficient cloud provisioning for video transcoding: Review, open challenges and future opportunities10.1109/MIC.2017.3301630 ↗
15. Performance and behavior characterization of Amazon EC2 spot instances
16. Performance analysis and modeling of video transcoding using heterogeneous cloud services10.1109/TPDS.2018.2870651 ↗
17. Where to encode: A performance analysis of x86 and arm-based Amazon EC2 instances
18. Stride: Distributed video transcoding in spark
19. Towards microservices architecture to transcode videos in the large at low costs
20. FastTTPS: Fast approach for video transcoding time prediction and scheduling for HTTP adaptive streaming videos10.1007/s10586-020-03207-x ↗
21. Firmament: Fast, centralized cluster scheduling at scale
22. Quincy: Fair scheduling for distributed computing clusters
23. Tetrisched: Global rescheduling with adaptive plan-ahead in dynamic heterogeneous clusters
24. Algorithms for cost-and deadline-constrained provisioning for scientific workflow ensembles in iaas clouds10.1016/j.future.2015.01.004 ↗
25. A Moth-flame optimization algorithm for web service composition in cloud computing: Simulation and verification
26. Budget-driven scheduling of scientific workflows in iaas clouds with fine-grained billing periods10.1145/3041036 ↗
27. Cost minimization for computational applications on hybrid cloud infrastructures10.1016/j.future.2013.01.004 ↗
28. Enhancing the power of two choices load balancing algorithm using round-robin policy
29. Multi-criteria HPC task scheduling on IaaS cloud infrastructures using metaheuristics
30. Autonomic task scheduling algorithm for dynamic workloads through a load balancing technique for the cloud-computing environment
31. An empirical analysis of Amazon EC2 spot instance features affecting cost-effective resource procurement10.1145/3233180 ↗
32. Transcoding live adaptive video streams at a massive scale in the cloud
33. Scheduling video transcoding jobs in the cloud
34. QoS-Aware resource allocation for video transcoding in clouds10.1109/TCSVT.2016.2589621 ↗
35. MCCA scheduling for enhancing QoS based video streaming for video surveillance applications10.1007/s10586-018-2150-y ↗
36. Bitrate reduction video transcoding with distributed computing
37. Cost-efficient and robust on-demand video transcoding using heterogeneous cloud services10.1109/TPDS.2017.2766069 ↗
38. Contrast: Container-based transcoding for interactive video streaming
39. Energy-efficient proactive caching for adaptive video streaming via data-driven optimization10.1109/JIOT.2020.2981250 ↗
40. An efficient scheduling multimedia transcoding method for DASH streaming in cloud environment
41. “Use Spot Instance Pricing for Your Video Encoding Workflows with Bitmovin,” https://aws.amazon.com/blogs/startups/use-spot-instance-pricing-for-your-video-encoding-workflow/-with-bitmovin-containerized-encoding/. [Online; accessed 14-Jan-2021], 2017.
42. “FFprobe Documentation,” https://ffmpeg.org/ffprobe.html. [Online; accessed 25-July-2020], 2020.
43. Dynamic adaptive streaming over HTTP dataset
44. ComplexCTTP: Complexity class-based transcoding time prediction for video sequences using artificial neural network
45. “H.264 Video Encoding Guide,” https://trac.ffmpeg.org/wiki/Encode/H.264. [Online; accessed 10-September-2020], 2020.
46. Amazon, “Amazon EC2 spot instances pricing,” https://aws.amazon.com/ec2/spot/pricing. [Online; accessed 14-Jan-2021], 2021.
47. “Spot Instance Advisor,” https://aws.amazon.com/ru/ec2/spot/instance-advisor. [Online; accessed 14-Jan-2021], 2021.