Restoration of the JPEG Maximum Lossy Compressed Face Images with Hourglass Block-GAN
Source abstract
Abstract
In the context of high compression rates applied to Joint Photographic Experts Group (JPEG) images through lossy compression techniques, image-blocking artifacts may manifest. This necessitates the restoration of the image to its original quality. The challenge lies in regenerating significantly compressed images into a state in which these become identifiable. Therefore, this study focuses on the restoration of JPEG images subjected to substantial degradation caused by maximum lossy compression using Generative Adversarial Networks (GAN). The generator in this network is based on the U-Net architecture. It features a new hourglass structure that preserves the characteristics of the deep layers. In addition, the network incorporates two loss functions to generate natural and high-quality images: Low Frequency (LF) loss and High Frequency (HF) loss. HF loss uses a pretrained VGG-16 network and is configured using a specific layer that best represents features. This can enhance the performance in the high-frequency region. In contrast, LF loss is used to handle the low-frequency region. The two loss functions facilitate the generation of images by the generator, which can mislead the discriminator while accurately generating high- and low-frequency regions. Consequently, by removing the blocking effects from maximum lossy compressed images, images in which identities could be recognized are generated. This study represents a significant improvement over previous research in terms of the image resolution performance.
Source: openalex_inverted_index · Quality: baseline
Research context
OpenAlex topics: Advanced Image Processing Techniques · Image and Signal Denoising Methods · Digital Media Forensic Detection
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
References (29)
Show source-provided references
1. The JPEG still picture compression standard10.1109/30.125072 ↗
2. Quality analysis of the conversion according to the compression rate from the PNG image to the JPEG image
3. Restoration of JPEG lossy compressed image based on Pix2Pix: A Preliminary Study
4. Learning better lossless compression using lossy compression
5. Flexible lossy compression for selective encrypted image with image inpainting10.1109/TCSVT.2018.2878026 ↗
6. On perceptual lossy compression: The cost of perceptual reconstruction and an optimal training framework
7. Very deep convolutional networks for large-scale image recognition
8. Generative adversarial nets
9. Image-to-image translation with conditional adversarial networks
10. M. Mirza and S. Osindero, “Conditional generative adversarial nets,” arXiv preprint arXiv:1411.1784v1, 2014.
11. Progressive growing of GANs for improved quality, stability, abd variation
12. A style-based generator architecture for generative adversarial networks
13. Arbitrary style transfer in real-time with adaptive instance normalization
14. Analyzing and improving the image quality of StyleGAN
15. Training generative adversarial networks with limited data
16. Deformable GANs for pose-based human image generation
17. Traffic accident detection in first-person videos based on depth and background motion Estimation10.14801/jkiit.2021.19.3.25 ↗
18. Algorithm development of cloud removal from solar images based on Pix2Pix Network10.32604/cmc.2022.022325 ↗
19. Image super-resolution using deep convolutional networks10.1109/TPAMI.2015.2439281 ↗
20. Real-time single image and video super-resolution using an efficient sub-pixel convolutional neural network
21. Accurate image super-resolution using very deep convolutional networks
22. Photo-realistic single image super-resolution using a generative adversarial network
23. Precomputed real-time texture synthesis with markovian generative adversarial networks
24. HiFaceGAN: Face renovation via collaborative suppression and replenishment
25. Towards efficient and scale-robust ultra-high-definition image demoiréing
26. Image quality metrics: PSNR vs. SSIM
27. Image information and visual quality10.1109/TIP.2005.859378 ↗
28. The unreasonable effectiveness of deep features as a perceptual metric
29. waifu2x. 2023. [Online]. Available: http://waifu2x.udp.jp/index.ko.html (accessed on 25/09/2023).