An Analytic Transform Kernel Derivation Method for Video Codecs
Source abstract
Abstract
In the standardization of versatile video coding (VVC), discrete cosine transform (DCT)-2, discrete sine transform (DST)-7, and DCT-8 are regarded as the primary transform kernels. However, DST-4 and DCT-4 can also be considered as the transform kernels instead of using DST-7 and DCT-8 owing to their effectiveness in smaller resolution test sequences. To implement these different block size transform kernels, a considerable amount of memory has to be allocated. Moreover, memory consumption to store different block size transform kernels is regarded as a major issue in video coding standardization. To address this problem, a common sparse unified matrix concept is introduced in this study, where any block size transform kernel matrix can be obtained after some mathematical operations. The proposed common sparse unified matrix saves approximately 80% of the static memory by storing only a few transform kernel elements for DCT-2, DST-7, and DCT-8. Full-required transform kernels are derived using the stored transform kernels and generated unit-element matrices and a permutation matrix. The static memory required is only for 1648 elements instead of 8180 elements, each with 8-bit precision. The defined common sparse unified matrix is composed of two parts: a unified DST-3 matrix and a grouped DST-7 matrix. The unified DST-3 matrix is used to derive different points of DCT-2 transform kernels, and the grouped DST-7 matrix is used to derive different points of DST-7 and DCT-8 transform kernels. The new technique of grouping concept is introduced, which shows the relationship between different rows of DST-7 transform kernels with various block sizes. The proposed grouping concept supports the fast algorithm of DST-7 by implementing the proposed method of the “one group one feature” principle. The simulation was conducted using the VTM-3.0 reference software under common test conditions. The simulation result of the all intra (AI) configuration is Y = 0.00%, U = −0.02%, V = 0.00% with an encoding time of 100%, and a decoding time of 100%. Similarly, the simulation results of random access (RA) configuration are Y = −0.01%, U = 0.09%, V = 0.06%, and the encoding and decoding times are 101% and 100%, respectively. The simulation result of the low delay B (LDB) configuration is Y = 0.01%, U = 0.08%, and V = −0.27%, for encoding and decoding times of 101% and 100%, respectively.
Source: crossref · Quality: baseline
Research context
OpenAlex topics: Video Coding and Compression Technologies · Advanced Data Compression Techniques · Advanced Vision and Imaging
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
Affiliations
Department of Information and Communication Engineering, Chosun University, Gwangju 61452, Korea
Funding
Chosun University
References (31)
Show source-provided references
1. An Overview of H.26x Series And its Applications
2. Overview of the H.264/AVC video coding standard10.1109/TCSVT.2003.815165 ↗
3. Sullivan, G.J., Ohm, J., Han, W., and Wiegand, T. (2012). Overview of the High Efficiency Video Coding (HEVC) Standard, IEEE.10.1109/TCSVT.2012.2221191 ↗
4. Chen, J., Ye, Y., and Kim, S.H. (2018, January 3–12). Algorithm description for Versatile Video Coding and Test Model 3 (VTM 3), [JVET-L1002]. Proceedings of the JVET of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, 12th Meeting, Macao, China.
5. Rao, K.R., and Yip, P. (1990). Discrete Cosine Transform. IEEE Transactions on Computers, Academic Press.10.1016/B978-0-08-092534-9.50007-2 ↗
6. Development of Integer Cosine Transforms by the Principle of Dyadic Symmetry
7. The Discrete Cosine Transform10.1137/S0036144598336745 ↗
8. A Sinusoidal-Hyperbolic Family of Transforms with Potential Applications in Compressive Sensing10.1109/TIP.2019.2912355 ↗
9. A Sinusoidal Family of Unitary Transforms10.1109/TPAMI.1979.4766944 ↗
10. Sullivan, G.J., and Ohm, J. (2019, January 9–18). Meeting Report of the 13th Meeting of the Joint Video Experts Team (JVET). Proceedings of the Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, 13th Meeting, Marrakech, MA, USA.
11. Zhao, X., Chen, J., Karczewicz, M., Zhang, L., Li, X., and Jung, W. (April, January 29). Enhanced Multiple Transform for Video Coding. Proceedings of the Data Compression Conference, Snowbird, UT, USA.
12. Philippe, P., Biatek, T., and Lorcy, V. (September, January 28). Improvement of HEVC Inter-coding Mode Using Multiple Transforms. Proceedings of the 25th European Signal Processing Conference (EUSIPCO), Kos Island, Greece.
13. Abe, K., Toma, T., Ikeda, M., Naser, K., Leannec, F.L., and Francois, E. (2019, January 9–18). CE6: JVET-L0262: Replacing all DST-7/DCT-8 by DST-4/DCT-4 used in MTS (test 6.1.1e). Proceedings of the Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, 13th Meeting, Marrakech, MA, USA.
14. Zhao, Z., Kim, S., Zhao, Y., Egilmez, H., Koo, M., Liu, S., Lainema, J., and Karczewicz, M. (2021). Transform coding in VVC standard. IEEE Trans. Circuits Syst. Video Technol., early access.10.1109/TCSVT.2021.3087706 ↗
15. Bross, B., Chen, J., and Liu, S. (2019, January 9–18). Versatile Video Coding (Draft 4) JVET-M1001. Proceedings of the Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, 13th Meeting, Marrakech, MA, USA.
16. (2019, February 01). JVET VTM Software—JVET. Available online: https://vcgit.hhi.fraunhofer.de/jvet/VVCSoftware_VTM/tree/VTM-4.0.
17. Zhao, X., Li, X., Luo, Y., and Liu, S. (2019, January 9–18). CE6: Fast DST-7/DCT-8 with dual implementation support JVET-M0497. Proceedings of the Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, 13th Meeting, Marrakech, MA, USA.
18. Luxán-Hernández, S.D., George, V., Ma, J., Nguyen, T., Schwarz, H., Marpe, D., and Wiegand, T. (2019, January 9–18). CE3: Intra Sub-Partitions Coding Mode (Tests 1.1.1 and 1.1.2). Proceedings of the Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, 13th Meeting, Marrakech, MA, USA.
19. Zhao, Y., Gao, H., Yang, H., and Chen, J. (2019, January 9–18). CE6:Sub-block transform for inter blocks (CE6.4.1). Proceedings of the Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, 13th Meeting, Marrakech, MA, USA.
20. Core Transform Design in the High Efficiency Video Coding (HEVC) Standard10.1109/JSTSP.2013.2270429 ↗
21. Zhao, X., Li, X., and Liu, S. (2019, January 9–18). CE6: Compound Orthonormal Transform JVET-M0200. Proceedings of the Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, 13th Meeting, Marrakech, MA, USA.
22. Fast algorithms for the discrete cosine transform10.1109/78.157218 ↗
23. Choi, K., Park, M., Park, M.W., and Choi, W. (2019, January 9–18). CE6: Unified matrix for transform JVET-M0200. Proceedings of the Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, 13th Meeting, Marrakech, MA, USA.
24. Said, A., Egilmez, H., Seregin, V., and Karczewicz, M. (2018, January 10–20). Complexity Reduction for Adaptive Multiple Transforms (AMTs) using Adjustment Stages JVET-J0066. Proceedings of the Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, 10th Meeting, San Diego, CA, USA.
25. Philippe, P. (2019, January 9–18). CE6: MTS simplification with TAF. Proceedings of the Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, 13th Meeting, Marrakech, MA, USA.
26. Ochoa-Dominguez, H., and Rao, K.R. (2019). Discrete Cosine Transform, CRC Press. [2nd ed.].10.1201/9780203729854 ↗
27. (2018, November 01). JVET VTM Software—JVET. Available online: https://vcgit.hhi.fraunhofer.de/jvet/VVCSoftware_VTM/tree/VTM-3.0.
28. Fast DST-VII/DCT-VIII with Dual Implementation Support for Versatile Video Codec10.1109/TCSVT.2020.2977118 ↗
29. Hanhart, P., Boyce, J., Choi, K., and Lin, J.-L. (2018, January 3–12). JVET common test conditions and evaluation procedures for 360° video. Proceedings of the JVET of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, 12th Meeting, Macao, China.
30. Lu, G., Ouyang, W., Xu, D., Zhang, X., Cai, C., and Gao, Z. (2019, January 16–20). DVC: An End-to-end Deep Video Compression Framework. Proceedings of the CVPR, Long Beach, CA, USA.10.1109/CVPR.2019.01126 ↗
31. Bossen, F., Boyce, J., Li, X., Seregin, V., and Sühring, K. (2019, January 9–18). JVET common test conditions and software reference configurations for SDR video. Proceedings of the Joint Video Exploration Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, 13th Meeting, Marrakech, MA, USA.