Temporally Aware Objective Quality Metric for Immersive Video
Source abstract
Abstract
State-of-the-art objective quality metrics designed for immersive content typically prioritize spatial distortions; therefore, they can omit temporal artifacts introduced by view synthesis and dynamic scene rendering. Consequently, metrics such as the commonly used peak signal-to-noise ratio for immersive video (IV-PSNR) are “temporally blind”, creating a conceptual gap where temporally stable distortions cannot be distinguished from disruptive temporal flickering. To address this limitation, we propose a temporal extension of the IV-PSNR metric that incorporates motion information into the quality assessment process. The method augments the traditional Y, U, and V color components with a fourth channel representing motion vectors (M), enabling the proposed four-component IV-PSNRYUVM metric to account for dynamic distortions introduced by view rendering. To evaluate the effectiveness of the proposed approach, multiple configurations of motion integration were tested, including metrics based solely on motion consistency, metrics combining motion with texture, and several dense optical flow algorithms with different parameter settings. Extensive experiments performed on immersive video sequences demonstrate that the proposed four-component IV-PSNRYUVM achieves the highest correlation with subjectively perceived video quality. These results confirm that combining texture with motion information provides a benefit, making the proposal a valuable addition for real-world immersive video systems.
Source: crossref · Quality: baseline
Research context
OpenAlex topics: Image and Video Quality Assessment · Video Coding and Compression Technologies · Advanced Vision and Imaging
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
Affiliations
Institute of Multimedia Telecommunications, Poznan University of Technology, 60-965 Poznań, Poland
Funding
Ministry of Science and Higher Education of the Republic of Poland
References (32)
Show source-provided references
1. Standardization status of immersive video coding10.1109/JETCAS.2019.2898948 ↗
2. MPEG Immersive Video coding standard10.1109/JPROC.2021.3062590 ↗
3. IV-PSNR—The objective quality metric for immersive video applications10.1109/TCSVT.2022.3179575 ↗
4. Image quality assessment: From error measurement to structural similarity10.1109/TIP.2003.819861 ↗
5. (2025, December 20). The Netflix Tech Blog, June 2016. Available online: https://netflixtechblog.com/toward-a-practical-perceptual-video-quality-metric-653f208b9652.
6. Ghazanfari, S., Garg, S., Krishnamurthy, P., Khorrami, F., and Araujo, A. (2023). R-LPIPS: An Adversarially Robust Perceptual Similarity Metric. arXiv.
7. A new standardized method for objectively measuring video quality10.1109/TBC.2004.834028 ↗
8. Video Quality Assessment by Reduced Reference Spatio-Temporal Entropic Differencing10.1109/TCSVT.2012.2214933 ↗
9. Motion Tuned Spatio-Temporal Quality Assessment of Natural Videos10.1109/TIP.2009.2034992 ↗
10. Moorthy, A.K., and Bovik, A.C. (2009, January 1–4). A motion compensated approach to video quality assessment. Proceedings of the 2009 Conference Record of the Forty-Third Asilomar Conference on Signals, Systems and Computers, Pacific Grove, CA, USA.10.1109/ACSSC.2009.5469994 ↗
11. A free-viewpoint television system for horizontal virtual navigation10.1109/TMM.2018.2790162 ↗
12. Depth map estimation for free-viewpoint television and virtual navigation10.1109/ACCESS.2019.2963487 ↗
13. Weighted-to-Spherically-Uniform Quality Evaluation for Omnidirectional Video
14. Dziembowski, A., Nowak, W., and Stankowski, J. (2024). IV-SSIM—The Structural Similarity Metric for Immersive Video. Appl. Sci., 14.10.3390/app14167090 ↗
15. Large Displacement Optical Flow: Descriptor Matching in Variational Motion Estimation10.1109/TPAMI.2010.143 ↗
16. Hassner, T., and Liu, C. (2016). Introduction to Dense Optical Flow. Dense Image Correspondences for Computer Vision, Springer.10.1007/978-3-319-23048-1 ↗
17. Optical flow modeling and computation: A survey10.1016/j.cviu.2015.02.008 ↗
18. Dosovitskiy, A., Fischer, P., Ilg, E., Hausser, P., Hazirbas, C., Golkov, V., Van Der Smagt, P., Cremers, D., and Brox, T. (2015, January 7–13). FlowNet: Learning optical flow with convolutional networks. Proceedings of the 2015 IEEE International Conference on Computer Vision, Santiago, Chile.10.1109/ICCV.2015.316 ↗
19. Teed, Z., and Deng, J. (2020, January 23–28). RAFT: Recurrent all-pairs field transforms for optical flow. Proceedings of the 16th European Conference on Computer Vision–ECCV, Glasgow, UK.10.1007/978-3-030-58536-5_24 ↗
20. Farnebäck, G. (July, January 29). Two-frame motion estimation based on polynomial expansion. Proceedings of the Scandinavian Conference on Image Analysis, Halmstad, Sweden.
21. Robust Local Optical Flow for Feature Tracking10.1109/TCSVT.2012.2202070 ↗
22. ISO/IEC (2019). Call for proposals on 3DoF+ visual. Document ISO/IEC JTC1/SC29/WG11 MPEG N18145, International Organization for Standardization.
23. Elwardy, M., Zepernick, H.J., Hu, Y., and Chu, T.M.C. (2023, January 6–8). ACR360: A Dataset on Subjective 360° Video Quality Assessment Using ACR Methods. Proceedings of the 16th International Conference on Signal Processing and Communication System, ICSPCS, Bydgoszcz, Poland.10.1109/ICSPCS58109.2023.10261151 ↗
24. Duan, H., Zhai, G., Yang, X., Li, D., and Zhu, W. (2017, January 22–24). IVQAD 2017: An immersive video quality assessment database. Proceedings of the 2017 International Conference on Systems, Signals and Image Processing (IWSSIP), Poznań, Poland.10.1109/IWSSIP.2017.7965610 ↗
25. Full-reference quality assessment of stereopairs accounting for rivalry10.1016/j.image.2013.05.006 ↗
26. Cox, S.R., Lim, M., and Ooi, W.T. (2023, January 7–10). VOLVQAD: An MPEG V-PCC Volumetric Video Quality Assessment Dataset. Proceedings of the 14th ACM Multimedia Systems Conference (MMSys ’23), Vancouver, Canada.10.1145/3587819.3592543 ↗
27. Yang, Z., Pan, S., Wang, S., Wang, H., Lin, L., Li, G., Wen, Z., Lin, B., Tao, J., and Yu, T. (2025, January 11–15). ImViD: Immersive Volumetric Videos for Enhanced VR Engagement. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), Nashville, TN, USA.10.1109/CVPR52734.2025.01543 ↗
28. ISO/IEC (2024). Common test conditions for MPEG immersive video. Document ISO/IEC JTC1/SC29/WG4 MPEG VC N0539, International Organization for Standardization.
29. Baroncini, V., and Baroncini, G. (2019). Evaluation Results of the Call for Proposals on 3DoF+ Visual. Document ISO/IEC JTC1/SC29/WG11 MPEG N18353, International Organization for Standardization.
30. (2025). Information Technology—Coded Representation of Immersive Media. Part 12: MPEG Immersive Video (Standard No. ISO/IEC 23090-12:2025).
31. Objective video quality assessment methods: A classification, review, and performance comparison10.1109/TBC.2011.2104671 ↗
32. (2025, December 20). OpenCV Documentation, 25 August 2025. OpenCV: Optical Flow Algorithms. Available online: https://docs.opencv.org/3.4/d2/d84/group__optflow.html.