Improved Image Quality Assessment by Utilizing Pre-Trained Architecture Features with Unified Learning Mechanism
Source abstract
Abstract
The purpose of the no-reference image quality assessment (NR-IQA) is to measure perceived image quality based on subjective judgments; however, due to the lack of a clean reference image, this is a complicated and unresolved challenge. Massive new IQA datasets have facilitated the creation of deep learning-based image quality measurements. We present a unique model to handle the NR-IQA challenge in this research by employing a hybrid strategy that leverages from pre-trained CNN model and the unified learning mechanism that extracts both local and non-local characteristics from the input patch. The deep analysis of the proposed framework shows that the model uses features and a mechanism that improves the monotonicity relationship between objective and subjective ratings. The intermediary goal was mapped to a quality score using a regression architecture. To extract various feature maps, a deep architecture with an adaptive receptive field was used. Analyses of this biggest NR-IQA benchmark datasets demonstrate that the suggested technique outperforms current state-of-the-art NR-IQA measures.
Source: crossref · Quality: baseline
Research context
OpenAlex topics: Image and Video Quality Assessment · Advanced Image Fusion Techniques · Image Enhancement Techniques
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
Affiliations
Electronics and Telecommunications Research Institute (ETRI), Gwangju 61012, Republic of Korea
References (43)
Show source-provided references
1. Wu, Q., Wang, Z., and Li, H. (2015, January 27–30). A highly efficient method for blind image quality assessment. Proceedings of the 2015 IEEE International Conference on Image Processing (ICIP), Quebec City, QC, Canada.10.1109/ICIP.2015.7350816 ↗
2. Joint foveation-depth just-noticeable-difference model for virtual reality environment10.1016/j.jvcir.2018.07.015 ↗
3. Multi-view point cloud registration based on evolutionary multitasking with bi-channel knowledge sharing mechanism
4. Perceptual image quality assessment: A survey10.1007/s11432-019-2757-1 ↗
5. Comparison of four subjective methods for image quality assessment10.1111/j.1467-8659.2012.03188.x ↗
6. New feature selection algorithms for no-reference image quality assessment10.1007/s10489-018-1151-0 ↗
7. Comparison of full-reference image quality models for optimization of image processing systems10.1007/s11263-020-01419-7 ↗
8. Blind image quality assessment with active inference10.1109/TIP.2021.3064195 ↗
9. An enhanced image quality assessment by synergizing superpixels and visual saliency10.1016/j.jvcir.2022.103610 ↗
10. Chang, H.W., Du, C.Y., Bi, X.D., and Wang, M.H. (2021, January 23–24). Color image quality evaluation based on visual saliency and gradient information. Proceedings of the 2021 7th International Symposium on System and Software Reliability (ISSSR), Chongqing, China.10.1109/ISSSR53171.2021.00030 ↗
11. Image Quality Evaluation Based on Gradient, Visual Saliency, and Color Information
12. No-reference image and video quality assessment: A classification and review of recent approaches10.1186/1687-5281-2014-40 ↗
13. Impact of visual saliency on multi-distorted blind image quality assessment using deep neural architecture10.1007/s11042-022-12060-6 ↗
14. Natural scene statistics model independent no-reference image quality assessment using patch based discrete cosine transform10.1007/s11042-020-09229-2 ↗
15. No-reference image quality assessment using bag-of-features with feature selection10.1007/s11042-019-08465-5 ↗
16. Blind image quality assessment: From natural scene statistics to perceptual quality10.1109/TIP.2011.2147325 ↗
17. RAAGR2-Net: A brain tumor segmentation network using parallel processing of multiple spatial frames
18. Rehman, M.U., Cho, S., Kim, J., and Chong, K.T. (2021). Brainseg-net: Brain tumor mr image segmentation via enhanced encoder–decoder network. Diagnostics, 11.10.3390/diagnostics11020169 ↗
19. Rehman, M.U., Cho, S., Kim, J.H., and Chong, K.T. (2020). Bu-net: Brain tumor segmentation using modified u-net architecture. Electronics, 9.10.3390/electronics9122203 ↗
20. i6mA-Caps: A CapsuleNet-based framework for identifying DNA N6-methyladenine sites10.1093/bioinformatics/btac434 ↗
21. Rehman, M.U., Tayara, H., and Chong, K.T. (2022). DL-m6A: Identification of N6-methyladenosine Sites in Mammals using deep learning based on different encoding schemes. IEEE/ACM Trans. Comput. Biol. Bioinform.10.1109/TCBB.2022.3192572 ↗
22. Wu, Y., Zhang, Y., Fan, X., Gong, M., Miao, Q., and Ma, W. (2022). Inenet: Inliers estimation network with similarity learning for partial overlapping registration. IEEE Trans. Circuits Syst. Video Technol.10.1109/TCSVT.2022.3213592 ↗
23. Blind image quality prediction by exploiting multi-level deep representations10.1016/j.patcog.2018.04.016 ↗
24. Saliency-based deep convolutional neural network for no-reference image quality assessment10.1007/s11042-017-5070-6 ↗
25. KonIQ-10k: An ecologically valid database for deep learning of blind image quality assessment10.1109/TIP.2020.2967829 ↗
26. Precise no-reference image quality evaluation based on distortion identification10.1145/3468872 ↗
27. Lin, H., Hosu, V., and Saupe, D. (2019, January 5–7). KADID-10k: A large-scale artificially distorted IQA database. Proceedings of the 2019 Eleventh International Conference on Quality of Multimedia Experience (QoMEX), Berlin, Germany.10.1109/QoMEX.2019.8743252 ↗
28. Dipu Kabir, H., Abdar, M., Jafar Jalali, S.M., Khosravi, A., Atiya, A.F., Nahavandi, S., and Srinivasan, D. (2020). SpinalNet: Deep Neural Network with Gradual Input. arXiv.
29. Defect classification model for high-speed train wheelset treads based on SimAM and SpinalNet
30. Ahuja, M.K., Sahil, S., and Spieker, H. (2022, November 21). Mistake-driven Image Classification with FastGAN and SpinalNet. Available online: https://openreview.net/forum?id=ChKNCDB0oYj.
31. Spinenet-6ma: A novel deep learning tool for predicting dna n6-methyladenine sites in genomes10.1109/ACCESS.2020.3036090 ↗
32. Shaiakhmetov, D., Mekuria, R.R., Isaev, R., and Unsal, F. (2021, January 25–26). Morphological Classification of Galaxies Using SpinalNet. Proceedings of the 2021 16th International Conference on Electronics Computer and Computation (ICECCO), Kaskelen, Kazakhstan.10.1109/ICECCO53203.2021.9663784 ↗
33. ZayyuNet–A unified deep learning model for the identification of epigenetic modifications using raw genomic sequences10.1109/TCBB.2021.3083789 ↗
34. Varga, D. (2022). A Human Visual System Inspired No-Reference Image Quality Assessment Method Based on Local Feature Descriptors. Sensors, 22.10.3390/s22186775 ↗
35. No-reference image quality assessment based on spatial and spectral entropies10.1016/j.image.2014.06.006 ↗
36. Blind image quality assessment: A natural scene statistics approach in the DCT domain10.1109/TIP.2012.2191563 ↗
37. Blind image quality assessment based on high order statistics aggregation10.1109/TIP.2016.2585880 ↗
38. No-reference image quality assessment in the spatial domain10.1109/TIP.2012.2214050 ↗
39. A two-step framework for constructing blind image quality indices10.1109/LSP.2010.2043888 ↗
40. Zhang, R., Isola, P., Efros, A.A., Shechtman, E., and Wang, O. (2018, January 18–22). The unreasonable effectiveness of deep features as a perceptual metric. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Salt Lake City, UT, USA.10.1109/CVPR.2018.00068 ↗
41. Ye, P., Kumar, J., Kang, L., and Doermann, D. (2012, January 16–21). Unsupervised feature learning framework for no-reference image quality assessment. Proceedings of the 2012 IEEE Conference on Computer Vision and Pattern Recognition, Providence, RI, USA.
42. Kang, L., Ye, P., Li, Y., and Doermann, D. (2014, January 24–27). Convolutional neural networks for no-reference image quality assessment. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Columbus, OH, USA.10.1109/CVPR.2014.224 ↗
43. Bosse, S., Maniry, D., Wiegand, T., and Samek, W. (2016, January 25–28). A deep neural network for image quality assessment. Proceedings of the 2016 IEEE International Conference on Image Processing (ICIP), Phoenix, AZ, USA.10.1109/ICIP.2016.7533065 ↗