journal article·2023Open access

Towards Robust Rain Removal with Unet++

Boxia Hu, Yaqi Sun, Yufei Yang, Ze Ouyang, Feng Zhang

Computers, Materials & Continua· Volume 75· Issue 1

Abstract

Image deraining has become a hot topic in the field of computer vision. It is the process of removing rain streaks from an image to reconstruct a high-quality background. This study aims at improving the performance of image rain streak removal and reducing the disruptive effects caused by rain. To better fit the rain removal task, an innovative image deraining method is proposed, where a kernel prediction network with Unet++ is designed and used to filter rainy images, and rainy-day images are used to estimate the pixel-level kernel for rain removal. To minimize the gap between synthetic and real data and improve the performance in real rainy image handling, a loss function and an effective data optimization method are suggested. In contrast with other methods, the loss function consists of Structural Similarity Index loss, edge loss, and L1 loss, and it is adopted to improve performance. The proposed algorithm can improve the Peak Signal-to-Noise ratio by 1.3% when compared to conventional approaches. Experimental results indicate that the proposed method can achieve a better efficiency and preserve more image structure than several classical methods.
Source: openalex_inverted_index · Quality: baseline

Research context

OpenAlex topics: Image Enhancement Techniques · Advanced Image Fusion Techniques · Image and Signal Denoising Methods

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

References (34)

Show source-provided references
1. Single image rain streaks removal: A review and an exploration10.1007/s13042-020-01061-2 ↗
2. Climate change threatens Pakistan’s snow leopards10.1126/science.add9065 ↗
3. Joint rain detection and removal from a single image with contextualized deep networks10.1109/TPAMI.2019.2895793 ↗
4. Robust zero watermarking algorithm for medical images using local binary pattern and discrete cosine transform
5. Rain streak removal using layer priors
6. A robust zero-watermarkinging algorithm based on PHTs-DCT for medical images in the encrypted domain
7. Survey on rain removal from videos or a single image
8. Robust watermarking algorithm for medical images based on log-polar transform
9. Deep joint rain detection and removal from a single image
10. A novel robust watermarking algorithm for encrypted medical image based on bandelet-DCT
11. Removing rain from single images via a deep detail network
12. Multi-watermarking algorithm for medical image based on KAZE-DCT
13. Density-aware single image deraining using a multi-stream dense network
14. Robust multi-watermarking algorithm for medical images using patchwork-DCT
15. Attentive generative adversarial network for raindrop removal from a single image
16. New watermarking algorithm utilizing quaternion Fourier transform with advanced scrambling and secure encryption10.1007/s11042-020-10257-1 ↗
17. Mu-Net: Multi-path upsampling convolution network for medical image segmentation10.32604/cmes.2022.018565 ↗
18. Robust zero watermarking algorithm for encrypted medical images based on DWT-gabor
19. Progressive image deraining networks: A better and simpler baseline
20. A model-driven deep neural network for single image rain removal
21. From rain generation to rain removal
22. Removing raindrops and rain streaks in one go
23. MIA-UNet: Multi-scale iterative aggregation U-network for retinal vessel segmentation10.32604/cmes.2021.017332 ↗
24. Spatial attentive single-image deraining with a high quality real rain dataset
25. Closing the loop: Joint rain generation and removal via disentangled image translation
26. Recurrent squeeze-and-excitation context aggregation net for single image deraining
27. Guo · Proc. AAAI · 2021 · 148710.1609/aaai.v35i2.16239 ↗
28. Single image deraining network with rain embedding consistency and layered LSTM
29. U-Net: Convolutional networks for biomedical image segmentation
30. Fully convolutional networks for semantic segmentation
31. Unet++: A nested u-net architecture for medical image segmentation
32. Multi-scale context aggregation by dilated convolutions
33. Local similarity-based spatial-spectral fusion hyperspectral image classification with deep CNN and gabor filtering10.1109/TGRS.2021.3090410 ↗
34. Semi-supervised video deraining with dynamical rain generator