journal article·2025-04-14Open access

A Semi-Supervised Single-Image Deraining Algorithm Based on the Integration of Wavelet Transform and Swin Transformer

Yu Hao, Xiaoyan Liu

Applied Sciences· Volume 15· Issue 8

Abstract

Rain is a typical meteorological event that affects the visual appeal of outdoor pictures. The presence of rain streaks severely blurs image details, negatively impacting subsequent computer visual tasks. Due to the challenge of acquiring authentic photographs of rainfall, most deraining methods have been developed using generated samples. However, the inherent differences between generated and real data lead to poor generalization performance in practical applications. This study proposes a semi-supervised single-image rain removal approach using Transformer and wavelet transform. It fully utilizes the feature information of rainy images, addressing the issue that current methods focus too much on network structure innovation while neglecting rain streak features. The algorithm leverages the directional properties of wavelet transform to decompose rainy images into multi-scale components, with networks of varying sizes generating rain streak maps across different directions and scales. By combining supervised and unsupervised training in a semi-supervised system, the model improves deraining performance and generalization capability. Additionally, a residual detail recovery network restores fine-grained image details, further enhancing the deraining effect in real-world scenarios. Comprehensive tests on multiple standard datasets show that the proposed approach outperforms current methods, confirming its effectiveness in practical applications. Experimental results on common datasets demonstrate that it performs better than advanced rain removal algorithms. The method’s superiority is further validated by the PSNR and SSIM values of 34.86 dB and 0.961 on the Rain1200 synthetic dataset, and the NIQE and PIQE values of 11.52 and 9.13 on the RealRain dataset.
Source: crossref · Quality: baseline

Research context

OpenAlex topics: Image Enhancement Techniques · Advanced Vision and Imaging · Image and Signal Denoising Methods

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

Faculty of Information Engineering and Automation, Kunming University of Science and Technology, Kunming 650500, China

Yunnan Key Laboratory of Artificial Intelligence, Kunming University of Science and Technology, Kunming 650500, China

Funding

National Natural Science Foundation of China

References (38)

Show source-provided references
1. Ma, L., Liu, R., Zhang, X., Zhong, W., and Fan, X. (2021, January 5–9). Video deraining via temporal aggregation-and-guidance. Proceedings of the 2021 IEEE International Conference on Multimedia and Expo (ICME), Shenzhen, China.10.1109/ICME51207.2021.9428400 ↗
2. Yan, W., Tan, R.T., Yang, W., and Dai, D. (2021, January 20–25). Self-aligned video deraining with transmission-depth consistency. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, Nashville, TN, USA.10.1109/CVPR46437.2021.01179 ↗
3. Progressive subtractive recurrent lightweight network for video deraining10.1109/LSP.2021.3134171 ↗
4. Online rain/snow removal from surveillance videos10.1109/TIP.2021.3050313 ↗
5. Enhanced Spatio-Temporal Interaction Learning for Video Deraining: Faster and Better10.1109/TPAMI.2022.3148707 ↗
6. Yue, Z., Xie, J., Zhao, Q., and Meng, D. (2021, January 20–25). Semi-supervised video deraining with dynamical rain generator. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, Nashville, TN, USA.10.1109/CVPR46437.2021.00070 ↗
7. Single image deraining: From model-based to datadriven and beyond10.1109/TPAMI.2020.2995190 ↗
8. Cherian, A.K., Poovammal, E., Philip, N.S., Ramana, K., Singh, S., and Ra, I.H. (2021). Deep Learning Based Filtering Algorithm for Noise Removal in Underwater Images. Water, 13.10.3390/w13192742 ↗
9. UC-former: A multi-scale image deraining network using enhanced transformer10.1016/j.cviu.2024.104097 ↗
10. Lightweight Pyramid Networks for Image Deraining10.1109/TNNLS.2019.2926481 ↗
11. Chen, X., Pan, J., and Dong, J. (2024, January 16–22). Bidirectional Multi-Scale Implicit Neural Representations for Image Deraining. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, Seattle, WA, USA.10.1109/CVPR52733.2024.02421 ↗
12. Wang, Z., Cun, X., Bao, J., Zhou, W., Liu, J., and Li, H. (2022, January 18–24). Uformer: A general u-shaped transformer for image restoration. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, New Orleans, LA, USA.10.1109/CVPR52688.2022.01716 ↗
13. Datadriven single image deraining: A comprehensive review and new perspectives10.1016/j.patcog.2023.109740 ↗
14. Efficientderain: Learning pixel-wise dilation filtering for high-efficiency single-image deraining
15. Huang, H., Yu, A., and He, R. (2021, January 20–25). Memory Oriented Transfer Learning for Semi-supervised Image Deraining. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, Nashville, TN, USA.10.1109/CVPR46437.2021.00764 ↗
16. Yasarla, R., Sindagi, V.A., and Patel, V.M. (2020, January 13–19). Syn2real transfer learning for image deraining using gaussian processes. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, Seattle, WA, USA.10.1109/CVPR42600.2020.00280 ↗
17. Lightweight Semi-supervised Network for Single Image Rain Removal10.1016/j.patcog.2022.109277 ↗
18. Chen, X., Pan, J., Jiang, K., Li, Y., Huang, Y., and Kong, C. (2022, January 18–24). Unpaired Deep Image Deraining Using Dual Contrastive Learning. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, New Orleans, LA, USA.10.1109/CVPR52688.2022.00206 ↗
19. T-shaped image dehazing network based on wavelet transform and attention mechanism
20. EAGNet: Elementwise Attentive Gating Network-Based Single Image De-Raining with Rain Simplification10.1109/TCSVT.2021.3068985 ↗
21. Rethinking ResNets: Improved stacking strategies with high-order schemes for image classification10.1007/s40747-022-00671-3 ↗
22. Utilizing two-phase processing with FBLS for single image deraining10.1109/TMM.2020.2987703 ↗
23. Hu, J., Shen, L., and Sun, G. (2018, January 18–22). Squeeze-and-Excitation Networks. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Salt Lake City, UT, USA.10.1109/CVPR.2018.00745 ↗
24. A new end-to-end framework based on non-local network structure and spatial attention mechanism for image rain removal
25. Jaderberg, M., Simonyan, K., and Zisserman, A. (2015). Spatial transformer networks. Adv. Neural Inf. Process. Syst., 28.
26. Liu, Z., Lin, Y., Cao, Y., Hu, H., Wei, Y., Zhang, Z., Lin, S., and Guo, B. (2021, January 10–17). Swin transformer: Hierarchical vision transformer using shifted windows. Proceedings of the IEEE/CVF International Conference on Computer Vision, Montreal, QC, Canada.10.1109/ICCV48922.2021.00986 ↗
27. Dosovitskiy, A., Beyer, L., Kolesnikov, A., Weissenborn, D., Zhai, X., Unterthiner, T., Dehghani, M., Minderer, M., Heigold, G., and Gelly, S. (2020). An image is worth 16x16 words: Transformers for image recognition at scale. International Conference on Learning Representations, ICLR.
28. Miclea, A.V., Terebes, R.M., Meza, S., and Cislariu, M. (2022). On Spectral-Spatial Classification of Hyperspectral Images Using Image Denoising and Enhancement Techniques, Wavelet Transforms and Controlled Data Set Partitioning. Remote Sens., 14.10.3390/rs14061475 ↗
29. Xinyi, L. (2023). Deep Learning Based Single Image Deraining: Datasets, Metrics and Methods, Fujian Normal University.
30. Image de-raining using a conditional generative adversarial network10.1109/TCSVT.2019.2920407 ↗
31. Image quality assessment: From error visibility to structural similarity10.1109/TIP.2003.819861 ↗
32. Making a “completely blind“ image quality analyzer10.1109/LSP.2012.2227726 ↗
33. Venkatanath, N., Praneeth, D., Bh, M.C., Channappayya, S.S., and Medasani, S.S. (March, January 27). Blind image quality evaluation using perception based features. Proceedings of the 2015 Twenty-First National Conference on Communications (NCC), Mumbai, India.10.1109/NCC.2015.7084843 ↗
34. Li, P., Jin, J., Jin, G., Fan, L., Gao, X., Song, T., and Chen, X. (2022, January 19–20). Deep Scale-space Mining Network for Single Image Deraining. Proceedings of the 2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops, New Orleans, LA, USA.10.1109/CVPRW56347.2022.00473 ↗
35. Image De-Raining Transformer10.1109/TPAMI.2022.3183612 ↗
36. Li, Y., Lu, J., Chen, H., Wu, X., and Chen, X. (2023, January 17–24). Dilated Convolutional Transformer for High-Quality Image Deraining. Proceedings of the 2023 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops, Vancouver, BC, Canada.10.1109/CVPRW59228.2023.00442 ↗
37. Residual Contextual Hourglass Network for Single-Image Deraining10.1007/s11063-024-11541-z ↗
38. Semi-supervised image deraining using knowledge distillation10.1109/TCSVT.2022.3190516 ↗