Region-of-Interest Based Coding Scheme for Live Videos
Source abstract
Abstract
In this paper, we introduce a novel rate control scheme specifically tailored for live broadcasting scenarios. Notably, in high-definition live transmissions of sports events and video game competitions that typically exceed 1080 p resolution and run at frame rates of 60 fps or higher, the transcoding speed of encoders often becomes a limiting factor, leading to streams with substantial bitrates but unsatisfactory quality metrics. To enhance the overall Quality of Service (QoS) without increasing the bitrate, it is essential to improve the quality of Regions of Interest (ROI).Our proposed solution presents an ROI-based rate reservoir model that ingeniously leverages Convolutional Neural Networks (CNNs) to predict rate control parameters. This approach aims to optimize the bitrate allocation within high bitrate live broadcasts, thus enhancing the image quality within ROIs. Experimental outcomes demonstrate that this algorithm manages to increase the bitrate by no more than 5%, effectively redistributing the reduced bitrate across the entire Group of Pictures (GOP). As a result, it ensures a gradual decrease in the quality of Regions of Uninterest (ROU), thereby maintaining a balanced quality experience throughout the broadcasted content.
Source: crossref · Quality: baseline
Research context
OpenAlex topics: Video Coding and Compression Technologies · Advanced Data Compression Techniques · Advanced Vision and Imaging
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
Affiliations
School of Software and Microelectronics, Peking University, Beijing 100871, China
Shannon Lab, Cloud Architecture and Platform Department, Technology and Engineering Group, Tencent, Shenzhen 518054, China
References (25)
Show source-provided references
1. (2013). Intelligent Multimedia Technologies for Networking Applications: Techniques and Tools: Techniques and Tools, IGI Global.
2. Region-of-interest based resource allocation for conversational video communication of H. 264/AVC10.1109/TCSVT.2007.913754 ↗
3. Region-based rate control and bit allocation for wireless video transmission10.1109/TMM.2005.861296 ↗
4. Region-of-interest video coding based on rate and distortion variations for H. 263+10.1016/j.image.2007.12.001 ↗
5. A region-based H. 263+ codec and its rate control for low VBR video10.1109/TMM.2004.827488 ↗
6. Meuel, H., Kluger, F., and Ostermann, J. (2018). Region of interest (roi) coding for aerial surveillance video using avc & hevc. arXiv.
7. Yang, L., Zhang, L., Ma, S., and Zhao, D. (2009, January 6–8). A ROI quality adjustable rate control scheme for low bitrate video coding. Proceedings of the 2009 Picture Coding Symposium, Chicago, IL, USA.
8. Chiang, J.C., Hsieh, C.S., Chang, G., Jou, F.D., and Lie, W.N. (2010, January 19–23). Region-of-interest based rate control scheme with flexible quality on demand. Proceedings of the 2010 IEEE International Conference on Multimedia and Expo, Singapore.10.1109/ICME.2010.5583354 ↗
9. Low bit-rate coding of image sequences using adaptive regions of interest10.1109/76.736718 ↗
10. Wu, C.Y., and Su, P.C. (2009, January 12–14). A region of interest rate-control scheme for encoding traffic surveillance videos. Proceedings of the 2009 5th International Conference on Intelligent Information Hiding and Multimedia Signal Processing, Kyoto, Japan.10.1109/IIH-MSP.2009.114 ↗
11. Region-of-interest-based rate control scheme for high-efficiency video coding10.1017/ATSIP.2014.15 ↗
12. Frame-layer constant-quality rate control of regions of interest for multiple encoders with single video source10.1109/TCSVT.2007.899605 ↗
13. Paudel, B., Vafi, S., and Bhattarai, P. (2019, January 15–18). An adaptive ROI based UEP scheme for HEVC compressed video bitstreams. Proceedings of the 2019 IEEE 8th Global Conference on Consumer Electronics (GCCE), Osaka, Japan.10.1109/GCCE46687.2019.9015248 ↗
14. Zhao, W., Fu, J., Lu, Y., Li, S., and Zhao, D. (2015, January 13–16). Region-of-interest based coding scheme for synthesized video. Proceedings of the 2015 Visual Communications and Image Processing (VCIP), Singapore.10.1109/VCIP.2015.7457879 ↗
15. Chen, M., Lin, W., and Zheng, X. (2014, January 14–18). An efficient coding method for coding region-of-interest locations in avs2. Proceedings of the 2014 IEEE International Conference on Multimedia and Expo Workshops (ICMEW), Chengdu, China.10.1109/ICMEW.2014.6890688 ↗
16. Ahonen, J.I., Le, N., Zhang, H., Cricri, F., and Rahtu, E. (2023, January 27–29). Region of Interest Enabled Learned Image Coding for Machines. Proceedings of the 2023 IEEE 25th International Workshop on Multimedia Signal Processing (MMSP), Poitiers, France.10.1109/MMSP59012.2023.10337731 ↗
17. Kao, C.H., Weng, Y.C., Chen, Y.H., Chiu, W.C., and Peng, W.H. (2023, January 8–11). Transformer-Based Variable-Rate Image Compression with Region-of-Interest Control. Proceedings of the 2023 IEEE International Conference on Image Processing (ICIP), Kuala Lumpur, Malaysia.10.1109/ICIP49359.2023.10222853 ↗
18. Lin, P. (2023, January 21–23). Video Bitrate Allocation Algorithm Based on Regions of Interest. Proceedings of the 2023 8th International Conference on Intelligent Computing and Signal Processing (ICSP), Xi’an, China.10.1109/ICSP58490.2023.10248607 ↗
19. Chen, K., Wang, J., Pang, J., Cao, Y., Xiong, Y., Li, X., Sun, S., Feng, W., Liu, Z., and Xu, J. (2019). mm-detection: Open mmlab detection toolbox and benchmark. arXiv.
20. Ma, S., Si, J., and Wang, S. (October, January 30). A study on the rate distortion modeling for high efficiency video coding. Proceedings of the 2012 19th IEEE International Conference on Image Processing, Orlando, FL, USA.10.1109/ICIP.2012.6466825 ↗
21. Yu, S., and Ahmad, I. (2002, January 19). New rate control algorithm for MPEG-4 video coding. Proceedings of the Visual Communications and Image Processing 2002, SPIE, San Jose, CA, USA.10.1117/12.453113 ↗
22. Adaptive rate control for H. 26410.1016/j.jvcir.2005.04.004 ↗
23. Naccari, M., and Pereira, F. (2012, January 7–9). Quadratic modeling rate control in the emerging HEVC standard. Proceedings of the 2012 Picture Coding Symposium, Krakow, Poland.10.1109/PCS.2012.6213374 ↗
24. MulticoreWare Inc. (2020, January 01). x265 HEVC Encoder/H.265 Video Codec. Available online: http://x265.org.
25. λ Domain Rate Control Algorithm for High Efficiency Video Coding10.1109/TIP.2014.2336550 ↗