journal article·2019-06-08Open access

Wasserstein Generative Adversarial Network Based De-Blurring Using Perceptual Similarity

Minsoo Hong, Yoonsik Choe

Applied Sciences· Volume 9· Issue 11

Abstract

The de-blurring of blurred images is one of the most important image processing methods and it can be used for the preprocessing step in many multimedia and computer vision applications. Recently, de-blurring methods have been performed by neural network methods, such as the generative adversarial network (GAN), which is a powerful generative network. Among many different types of GAN, the proposed method is performed using the Wasserstein generative adversarial network with gradient penalty (WGANGP). Since edge information is the most important factor in an image, the style loss function is applied to represent the perceptual information of the edge in order to preserve small edge information and capture its perceptual similarity. As a result, the proposed method improves the similarity between sharp and blurred images by minimizing the Wasserstein distance, and it captures well the perceptual similarity using the style loss function, considering the correlation of features in the convolutional neural network (CNN). To confirm the performance of the proposed method, three experiments are conducted using two datasets: the GOPRO Large and Kohler dataset. The optimal solutions are found by changing the parameter values experimentally. Consequently, the experiments depict that the proposed method achieves 0.98 higher performance in structural similarity (SSIM) and outperforms other de-blurring methods in the case of both datasets.
Source: crossref · Quality: baseline

Research context

OpenAlex topics: Advanced Image Processing Techniques · Image and Signal Denoising Methods · Generative Adversarial Networks and Image Synthesis

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

Department of Electrical & Electronic Engineering, Yonsei University, Seoul 03722, Korea

References (21)

Show source-provided references
1. Tomasi, C., and Manduchi, R. (1998, January 7). Bilateral filtering for gray and color images. Proceedings of the Sixth International Conference on Computer Vision, Bombay, India.
2. Brown, R.G., and Hwang, P.Y. (1992). Introduction to Random Signals and Applied Kalman Filtering, Wiley.
3. Nah, S., Kim, T.H., and Lee, K.M. (2017, January 22–25). Deep multi-scale convolutional neural network for dynamic scene deblurring. Proceedings of the CVPR 2017, Honolulu, HI, USA.10.1109/CVPR.2017.35 ↗
4. Xu, L., Zheng, S., and Jia, J. (2013, January 23–28). Unnatural 10 sparse representation for natural image deblurring. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Portland, OR, USA.10.1109/CVPR.2013.147 ↗
5. Kupyn, O., Budzan, V., Mykhailych, M., Mishkin, D., and Matas, J. (2017). DeblurGAN: Blind Motion Deblurring Using Conditional Adversarial Networks. arXiv.
6. Goodfellow, I., Pouget-Abadie, J., Mirza, M., Xu, B., Warde-Farley, D., Ozair, S., Courville, A., and Bengio, Y. (2014). Generative Adversarial Nets, NIPS. Advances in neural information processing systems 27.
7. Mirza, M., and Osindero, S. (2014). Conditional Generative Adversarial Nets. arXiv.
8. Arjovsky, M., Chintala, S., and Bottou, L. (2017). Wasserstein GAN. arXiv.
9. Gulrajani, I., Ahmed, F., Arjovsky, M., Dumoulin, V., and Courville, A.C. (2017). Improved Training of Wasserstein Gans, NIPS. Advances in Neural Information Processing Systems 30.
10. Johnson, J., Alahi, A., and Li, F.-F. (2016). Perceptual losses for real-time style transfer and super-resolution. European Conference on Computer Vision, Springer.10.1007/978-3-319-46475-6_43 ↗
11. Gatys, L.A., Ecker, A.S., and Bethge, M. (2015). A neural algorithm of artistic style. arXiv.
12. Lions, J.L. (1971). Optimal Control of Systems Governed by Partial Differential Equations (Grundlehren der Mathematischen Wissens-chaften), Springer.10.1007/978-3-642-65024-6 ↗
13. Simonyan, K., and Zisserman, A. (2014). Very deep convolutional networks for large-scale image recognition. arXiv.
14. He, K., Zhang, X., Ren, S., and Sun, J. (2016, January 27–30). Deep residual learning for image recognition. Proceedings of the IEEE conference on computer vision and pattern recognition, Las Vegas, NV, USA.10.1109/CVPR.2016.90 ↗
15. Huang, X., and Belongie, S.J. (2017, January 22–29). Arbitrary Style Transfer in Real-Time with Adaptive Instance Normalization. Proceedings of the ICCV 2017, Venice, Italy.10.1109/ICCV.2017.167 ↗
16. Nair, V., and Hinton, G.E. (2010, January 21–24). Rectified Linear Units Improve Restricted Boltzmann Machines. Proceedings of the 27th international conference on machine learning (ICML-10), Haifa, Israel.
17. Dropout: A simple way to prevent neural networks from overfitting
18. Isola, P., Isola, P., Zhu, J.Y., Zhou, T., and Efros, A.A. (2017). Image-to-image translation with conditional adversarial networks. arXiv.10.1109/CVPR.2017.632 ↗
19. Li, C., and Wand, M. (2016). Precomputed Real-Time Texture Synthesis with Markovian Generative Adversarial Networks, Springer. European Conference on Computer Vision.
20. Xu, B., Wang, N., Chen, T., and Li, M. (2015). Empirical evaluation of rectified activations in convolutional network. arXiv.
21. Köhler, R., Hirsch, M., Mohler, B., Schölkopf, B., and Harmeling, S. (2012). Recording and Playback of Camera Shake: Benchmarking Blind Deconvolution with a Real-World Database, Springer. European Conference on Computer Vision.10.1007/978-3-642-33786-4_3 ↗