Image-to-Image Style Transfer Based on the Ghost Module
Source abstract
Abstract
The technology for image-to-image style transfer (a prevalent image processing task) has developed rapidly. The purpose of style transfer is to extract a texture from the source image domain and transfer it to the target image domain using a deep neural network. However, the existing methods typically have a large computational cost. To achieve efficient style transfer, we introduce a novel Ghost module into the GANILLA architecture to produce more feature maps from cheap operations. Then we utilize an attention mechanism to transform images with various styles. We optimize the original generative adversarial network (GAN) by using more efficient calculation methods for image-to-illustration translation. The experimental results show that our proposed method is similar to human vision and still maintains the quality of the image. Moreover, our proposed method overcomes the high computational cost and high computational resource consumption for style transfer. By comparing the results of subjective and objective evaluation indicators, our proposed method has shown superior performance over existing methods.
Source: openalex_inverted_index · Quality: baseline
Research context
OpenAlex topics: Advanced Image Processing Techniques · Image Enhancement Techniques · Image and Signal Denoising Methods
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
References (35)
Show source-provided references
1. Deep learning for distinguishing computer generated images and natural images: A survey10.32604/jihpp.2020.010464 ↗
2. A review of object detectors in deep learning10.32604/jai.2020.010193 ↗
3. Review on video object tracking based on deep learning10.32604/jnm.2019.06253 ↗
4. A review on deep learning approaches to image classification and object segmentation10.32604/cmc.2019.03595 ↗
5. A novel scene text recognition method based on deep learning10.32604/cmc.2019.05595 ↗
6. Unpaired image-to-image translation using cycle-consistent adversarial networks
7. DualGAN: Unsupervised dual learning for image-to-image translation
8. CartoonGAN: Generative adversarial networks for photo cartoonization
9. GANILLA: Generative adversarial networks for image to illustration translation10.1016/j.imavis.2020.103886 ↗
10. Deep residual learning for image recognition
11. GhostNet: More features from cheap operations
12. Generative adversarial nets
13. Generative adversarial networks in computer vision: A survey and taxonomy
14. Deep generative adversarial networks for image-to-image translation: A review10.3390/sym12101705 ↗
15. Image-to-image translation with conditional adversarial networks
16. High-resolution image synthesis and semantic manipulation with conditional GANs
17. Asymmetric GAN for unpaired image-to-image translation10.1109/TIP.2019.2922854 ↗
18. Very deep convolutional networks for large-scale image recognition
19. Quality-aware unpaired image-to-image translation10.1109/TMM.2019.2907052 ↗
20. SPA-GAN: Spatial attention GAN for image-to-image translation10.1109/TMM.2020.2975961 ↗
21. Deep compression: Compressing deep neural networks with pruning, trained quantization and huffman coding
22. ThiNet: A filter level pruning method for deep neural network compression
23. XNOR-Net: ImageNet classification using binary convolutional neural networks
24. Quantization and training of neural networks for efficient integer-arithmetic-only inference
25. Distilling the knowledge in a neural network
26. Learning from multiple teacher networks
27. MobileNets: Efficient convolutional neural networks for mobile vision applications
28. MobileNetV2: Inverted residuals and linear bottlenecks
29. ShuffleNet: An extremely efficient convolutional neural network for mobile devices
30. Instance normalization: The missing ingredient for fast stylization
31. Squeeze-and-excitation networks10.1109/TPAMI.2019.2913372 ↗
32. Recurrent models of visual attention
33. Adam: A method for stochastic optimization
34. Pytorch: An imperative style, high-performance deep learning library
35. Image quality assessment: From error visibility to structural similarity10.1109/TIP.2003.819861 ↗