Optical Flow-Based Fast Motion Parameters Estimation for Affine Motion Compensation
Source abstract
Abstract
This study proposes a lightweight solution to estimate affine parameters in affine motion compensation. Most of the current approaches start with an initial approximation based on the standard motion estimation, which only estimates the translation parameters. From there, iterative methods are used to find the best parameters, but they require a significant amount of time. The proposed method aims to speed up the process in two ways, first, skip evaluating affine prediction when it is likely to bring no encoding efficiency benefit, and second, by estimating better initial values for the iteration process. We use the optical flow between the reference picture and the current picture to estimate quickly the best encoding mode and get a better initial estimation. We achieve a reduction in encoding time over the reference of half when compared to the state of the art, with a loss in efficiency below 1%.
Source: crossref · Quality: baseline
Research context
OpenAlex topics: Advanced Vision and Imaging · Video Coding and Compression Technologies · Advanced Image Processing Techniques
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
Affiliations
Graduate School of Engineering, Tohoku University, Sendai, Miyagi 980-8579, Japan
Funding
Japan Society for the Promotion of Science · Ministry of Education, Culture, Sports, Science and Technology
References (19)
Show source-provided references
1. Overview of the High Efficiency Video Coding (HEVC) Standard10.1109/TCSVT.2012.2221191 ↗
2. Overview of the H.264/AVC video coding standard10.1109/TCSVT.2003.815165 ↗
3. Narroschke, M., and Swoboda, R. (2013, January 8–11). Extending HEVC by an affine motion model. Proceedings of the 2013 Picture Coding Symposium (PCS), San Jose, CA, USA.10.1109/PCS.2013.6737748 ↗
4. Lin, S., Chen, H., Zhang, H., Maxim, S., Yang, H., and Zhou, J. (2015). Affine Transform Prediction for Next Generation Video Coding, ITU. Technical report; Document ITU-T SG 16.
5. An Improved Framework of Affine Motion Compensation in Video Coding10.1109/TIP.2018.2877355 ↗
6. Fast rate estimation for RDO mode decision in HEVC10.3390/e16126667 ↗
7. An Efficient Four-Parameter Affine Motion Model for Video Coding10.1109/TCSVT.2017.2699919 ↗
8. Heithausen, C., and Vorwerk, J.H. (2015, January 19–24). Motion compensation with higher order motion models for HEVC. Proceedings of the 2015 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), Brisbane, QLD, Australia.10.1109/ICASSP.2015.7178208 ↗
9. Heithausen, C., Bläser, M., Wien, M., and Ohm, J. (2016, January 25–28). Improved higher order motion compensation in HEVC with block-to-block translational shift compensation. Proceedings of the 2016 IEEE International Conference on Image Processing (ICIP), Phoenix, AZ, USA.10.1109/ICIP.2016.7532710 ↗
10. Block-Matching-Based Implementation of Affine Motion Estimation for HEVC10.1587/transinf.2017EDP7201 ↗
11. Heithausen, C., Bläser, M., and Wien, M. (2016, January 4–7). Distance scaling of higher order motion parameters in an extension of HEVC. Proceedings of the 2016 Picture Coding Symposium (PCS), Nuremberg, Germany.10.1109/PCS.2016.7906343 ↗
12. An Iterative Image Registration Technique with an Application to Stereo Vision
13. Revaud, J., Weinzaepfel, P., Harchaoui, Z., and Schmid, C. (2015, January 7–12). EpicFlow: Edge-Preserving Interpolation of Correspondences for Optical Flow. Proceedings of the IEEE Conference on Computer Vision & Pattern Recognition (CVPR), Boston, MA, USA.10.1109/CVPR.2015.7298720 ↗
14. HEVC-EPIC: Fast Optical Flow Estimation From Coded Video via Edge-Preserving Interpolation10.1109/TIP.2018.2813090 ↗
15. Liu, C. (2009). Beyond Pixels: Exploring New Representations and Applications for Motion Analysis. [Ph.D. Thesis, Massachusetts Institute of Technology].
16. JCT-VC (2014). High Efficiency Video Coding (HEVC) Test Model 14 (HM 14.0), Fraunhofer Heinrich Hertz Institute.
17. Bjøntegaard, G. (2001, January 2–4). Calculation of Average PSNR Differences between RD-curves. Proceedings of the ITU—Telecommunications Standardization Sector STUDY GROUP 16 Video Coding Experts Group (VCEG), 13th Meeting, Austin, TX, USA.
18. Institute of Image Information and Television Engineers (2009). ITE/ARIB Hi-Vision Test Sequence, NHK Engineering Services, Inc.. [2nd ed.].
19. Derf (2018, October 10). Xiph.org Video Test Media [Derf’s Collection]. Available online: https://media.xiph.org/video/derf/.