journal article·2019-05-16Open access

Object-Based Approach for Adaptive Source Coding of Surveillance Video

Tung-Ming Pan, Kuo-Chin Fan, Yuan-Kai Wang

Applied Sciences· Volume 9· Issue 10

Abstract

Intelligent analysis of surveillance videos over networks requires high recognition accuracy by analyzing good-quality videos that however introduce significant bandwidth requirement. Degraded video quality because of high object dynamics under wireless video transmission induces more critical issues to the success of smart video surveillance. In this paper, an object-based source coding method is proposed to preserve constant quality of video streaming over wireless networks. The inverse relationship between video quality and object dynamics (i.e., decreasing video quality due to the occurrence of large and fast-moving objects) is characterized statistically as a linear model. A regression algorithm that uses robust M-estimator statistics is proposed to construct the linear model with respect to different bitrates. The linear model is applied to predict the bitrate increment required to enhance video quality. A simulated wireless environment is set up to verify the proposed method under different wireless situations. Experiments with real surveillance videos of a variety of object dynamics are conducted to evaluate the performance of the method. Experimental results demonstrate significant improvement of streaming videos relative to both visual and quantitative aspects.
Source: crossref · Quality: baseline

Research context

OpenAlex topics: Advanced Data Compression Techniques · Video Coding and Compression Technologies · Video Surveillance and Tracking Methods

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

Department of Computer Science & Information Engineering, National Central University, Chung-Li 320, Taiwan

Holistic Education Center, Fu Jen Catholic University, New Taipei 242, Taiwan

Department of Electrical Engineering, Fu Jen Catholic University, New Taipei 242, Taiwan

References (38)

Show source-provided references
1. Intelligent Mobile Video Surveillance System with Multilevel Distillation
2. Heterogeneous information fusion and visualization for a large-scale intelligent video surveillance system10.1109/TSMC.2016.2531671 ↗
3. Fast reference frame selection based on content similarity for low complexity HEVC encoder10.1016/j.jvcir.2016.07.018 ↗
4. Enhanced Macroblock Features for Dynamic Background Modeling in H.264/AVC Video Encoded at Low Bitrate10.1109/TCSVT.2016.2614984 ↗
5. Real-Time Frame-Layer H.264 Rate Control for Scene-Transition Video at Low Bit Rate10.1109/TCE.2007.4341589 ↗
6. A reformative frame layer rate control algorithm for H.26410.1109/TCE.2010.5681172 ↗
7. (2019, January 11). Network Simulator-2. Available online: http://www.isi.edu/nsnam/ns/.
8. Burst-aware dynamic rate control for H.264/AVC video streaming10.1109/TBC.2010.2079690 ↗
9. Pixel-wise unified rate-quantization model for multi-level rate control10.1109/JSTSP.2013.2272241 ↗
10. Khan, M.U.K., Shafique, M., and Henkel, J. (2013, January 15–18). An adaptive complexity reduction scheme with fast prediction unit decision for HEVC intra encoding. Proceedings of the 2013 IEEE International Conference on Image Processing, Melbourne, Australia.10.1109/ICIP.2013.6738325 ↗
11. The design of a wireless real-time visual surveillance system10.1007/s11042-006-0056-9 ↗
12. Content-adaptive traffic prioritization of spatio-temporal scalable video for robust communications over QoS-provisioned 802.11e networks10.1016/j.image.2010.04.006 ↗
13. VBR rate control for perceptually consistent video quality10.1109/TCE.2008.4711253 ↗
14. Incremental rate control for H.264/AVC video compression10.1049/iet-ipr.2009.0037 ↗
15. SSIM-motivated two-pass VBR coding for HEVC10.1109/TCSVT.2016.2580398 ↗
16. A testbed and methodology for comparing live video frame rate control methods10.1109/LSP.2010.2090869 ↗
17. Rate-distortion analysis for H.264/AVC video coding and its application to rate control10.1109/TCSVT.2005.857300 ↗
18. A rate perceptual-distortion optimized video coding HEVC10.1587/transinf.2018EDP7164 ↗
19. Zhong, H., Shen, S., Fan, Y., and Zeng, X. (2012, January 4–6). A Low Complexity Macroblock Layer Rate Control Scheme Base on Weighted-Window for H.264 Encoder. Proceedings of the International Conference on Multimedia Modeling, Klagenfurt, Austria.10.1007/978-3-642-27355-1_52 ↗
20. A Context-Adaptive Prediction Scheme for Parameter Estimation in H.264/AVC Macroblock Layer Rate Control10.1109/TCSVT.2009.2020338 ↗
21. λ Domain Rate Control Algorithm for High Efficiency Video Coding10.1109/TIP.2014.2336550 ↗
22. Low-Complexity Joint Temporal-Quality Scalability Rate Control for H.264/SVC10.1109/TCSVT.2017.2702648 ↗
23. Geng, M., Zhang, X., Tian, Y., Liang, L., and Huang, T. (2012, January 9–13). A fast and performance-maintained transcoding method based on background modeling for surveillance video. Proceedings of the IEEE International Conference on Multimedia and Expo, Melbourne, Australia.10.1109/ICME.2012.65 ↗
24. Meuel, H., Reso, M., Jachalsky, J., and Ostermann, J. (2013, January 27–30). Superpixel-based segmentation of moving objects for low bitrate ROI coding systems. Proceedings of the 2013 10th IEEE International Conference on Advanced Video and Signal Based Surveillance, Krakow, Poland.10.1109/AVSS.2013.6636672 ↗
25. Situation control of unmanned aerial vehicles for road traffic monitoring
26. Region-of-interest-based rate control scheme for high-efficiency video coding10.1017/ATSIP.2014.15 ↗
27. Chen, X., Wu, Z., Zhang, X., Xiang, Y., and Xie, S. (2016, January 2–5). One Novel Rate Control Scheme for Region of Interest Coding. Proceedings of the International Conference on Intelligent Computing Methodologies, Lanzhou, China.
28. Wu, C.Y., and Su, P.C. (2009, January 12–14). A Region of Interest Rate-Control Scheme for Encoding Traffic Surveillance Videos. Proceedings of the 2009 Fifth International Conference on Intelligent Information Hiding and Multimedia Signal Processing, Kyoto, Japan.10.1109/IIH-MSP.2009.114 ↗
29. M-Estimators in Regression Models
30. Robust Estimation of Location Parameter10.1214/aoms/1177703732 ↗
31. Tukey, J.W. (1977). Exploratory Data Analysis, Addison-Wesley Publishers.
32. Godbehere, A.B., Matsukawa, A., and Goldberg, K. (2012, January 27–29). Visual tracking of human visitors under variable-lighting conditions for a responsive audio art installation. Proceedings of the 2012 American Control Conference (ACC), Montreal, QC, Canada.10.1109/ACC.2012.6315174 ↗
33. An Evaluation Framework for More Realistic Simulations of MPEG Video Transmission
34. Klaue, J., Rathke, B., and Wolisz, A. (2003, January 2–5). EvalVid—A Framework for Video Transmission and Quality Evaluation. Proceedings of the 13th International Conference on Modelling Techniques and Tools for Computer Performance Evaluation, Urbana, IL, USA.10.1007/978-3-540-45232-4_16 ↗
35. Kahaki, S.M.M., Nordin, M.J., Ashtari, A.H., and Zahra, S.J. (2016). Invariant feature matching for image registration application based on new dissimilarity of spatial features. PLoS ONE, 11.10.1371/journal.pone.0149710 ↗
36. Kahaki, S.M., Arshad, H., Nordin, M.J., and Ismail, W. (2018). Geometric feature descriptor and dissimilarity-based registration of remotely sensed imagery. PLoS ONE, 13.10.1371/journal.pone.0200676 ↗
37. Performance of peak signal-to-noise ratio quality assessment in video streaming with packet losses10.1049/el.2015.3784 ↗
38. Overview of H.264/MPEG-4 part 1010.1016/j.jvcir.2005.05.010 ↗