An Integrated Framework of Frequency-Domain Denoising with Learnable Parameters in Variational Autoencoders
Source abstract
Abstract
Variational autoencoders (VAEs) are sensitive to spatially heterogeneous noise because corrupted high-frequency components can be propagated into the latent posterior and degrade reconstruction. We propose Learnable Local FFT-VAE, a VAE-oriented localized frequency correction framework that performs windowed Fourier-domain modulation before variational encoding. The proposed Localized Denoising-Correction Module extracts overlapping patches, applies local FFT, predicts patch-conditioned frequency-control parameters (α,σ,m), and reconstructs corrected inputs through inverse FFT and Hann overlap-add. This design preserves spatial locality while remaining differentiable and jointly trainable with the VAE objective. We evaluate the method on FashionMNIST, CIFAR-10, and PneumoniaMNIST under homogeneous and heterogeneous synthetic noise, and compare it with Direct VAE, AE, Local FFT-AE, best-tuned Fixed FFT-VAE, learnable Global FFT-VAE, BM3D, DnCNN, and FFDNet. The revised experiments demonstrate improvements in PSNR, SSIM, SNR, MSE, HFEN, and gradient-error, with statistical tests over random seeds. Parameter heatmaps and spectral visualizations further show that the learned local correction adapts to spatially varying corruption. PneumoniaMNIST is used only as a lightweight biomedical benchmark, and the method is not intended for clinical diagnosis.
Source: crossref · Quality: baseline
Research context
OpenAlex topics: Generative Adversarial Networks and Image Synthesis · AI in cancer detection · Domain Adaptation and Few-Shot Learning
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
Affiliations
College of Mathematics and Systems Science, Xinjiang University, Boda Campus, No. 777 Huarui Road, Shuimogou District, Urumqi 830017, China
Funding
Natural Science Foundation of Xinjiang Uygur Autonomous Region · Xinjiang Tianchi Talent Program · Xinjiang University
References (30)
Show source-provided references
1. Kingma, D.P., and Welling, M. (2014, January 14–16). Auto-Encoding Variational Bayes. Proceedings of the International Conference on Learning Representations (ICLR), Banff, AB, Canada.
2. Rezende, D.J., Mohamed, S., and Wierstra, D. (2014). Stochastic Backpropagation and Approximate Inference in Deep Generative Models. Proceedings of the International Conference on Machine Learning (ICML), Beijing, China, 21–26 June 2014, JMLR.org.
3. Wiener, N. (1949). Extrapolation, Interpolation, and Smoothing of Stationary Time Series, MIT Press.10.7551/mitpress/2946.001.0001 ↗
4. Ideal Spatial Adaptation by Wavelet Shrinkage10.1093/biomet/81.3.425 ↗
5. Xiao, H., Rasul, K., and Vollgraf, R. (2017). Fashion-MNIST: A Novel Image Dataset for Benchmarking Machine Learning Algorithms. arXiv.
6. MedMNIST v2: A Large-Scale Lightweight Benchmark for 2D and 3D Biomedical Image Classification10.1038/s41597-022-01721-8 ↗
7. A Non-Local Algorithm for Image Denoising10.1109/CVPR.2005.38 ↗
8. Image Denoising by Sparse 3-D Transform-Domain Collaborative Filtering10.1109/TIP.2007.901238 ↗
9. Beyond a Gaussian Denoiser: Residual Learning of Deep CNN for Image Denoising10.1109/TIP.2017.2662206 ↗
10. Lehtinen, J., Munkberg, J., Hasselgren, J., Laine, S., Karras, T., Aittala, M., and Aila, T. (2018). Noise2Noise: Learning Image Restoration without Clean Data. Proceedings of the International Conference on Machine Learning (ICML), Stockholm, Sweden, 10–15 July 2018, JMLR.org.
11. Krull, A., Buchholz, T.O., and Jug, F. (2019). Noise2Void—Learning Denoising from Single Noisy Images. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), Long Beach, CA, USA, 15–20 June 2019, IEEE.10.1109/CVPR.2019.00223 ↗
12. Higgins, I., Matthey, L., Pal, A., Burgess, C., Glorot-Xavier, L., Botvinick, M., Mohamed, S., and Lerchner, A. (2017, January 24–26). beta-VAE: Learning Basic Visual Concepts with a Constrained Variational Framework. Proceedings of the International Conference on Learning Representations (ICLR), Toulon, France.
13. Zhao, S., Song, J., and Ermon, S. (2017). InfoVAE: Information Maximizing Variational Autoencoders. arXiv.
14. An Introduction to Variational Autoencoders10.1561/2200000056 ↗
15. Burda, Y., Grosse, R., and Salakhutdinov, R. (2016). Importance Weighted Autoencoders. arXiv.
16. Learning Structured Output Representation using Deep Conditional Generative Models
17. Improved Variational Inference with Inverse Autoregressive Flow
18. Goodfellow, I., Pouget-Abadie, J., Mirza, M., Xu, B., Warde-Farley, D., Ozair, S., Courville, A., and Bengio, Y. (2014). Generative Adversarial Nets. Proceedings of the Advances in Neural Information Processing Systems (NeurIPS), Montreal, QC, Canada, 8–13 December 2014, NeurIPS.
19. Denoising Diffusion Probabilistic Models
20. Song, Y., Sohl-Dickstein, J., Kingma, D.P., Kumar, A., Ermon, S., and Poole, B. (2021, January 4). Score-Based Generative Modeling through Stochastic Differential Equations. Proceedings of the International Conference on Learning Representations (ICLR), Vienna, Austria.
21. Ledig, C., Theis, L., Huszar, F., Caballero, J., Cunningham, A., Acosta, A., Aitken, A., Tejani, A., Totz, J., and Wang, Z. (2017). Photo-Realistic Single Image Super-Resolution Using a Generative Adversarial Network. Proceedings of the 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Honolulu, HI, USA, 21–26 July 2017, IEEE.10.1109/CVPR.2017.19 ↗
22. Kupyn, O., Budzan, V., Mykhailych, M., Mishkin, D., and Matas, J. (2018). DeblurGAN: Blind Motion Deblurring Using Conditional Adversarial Networks. Proceedings of the 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition, Salt Lake City, UT, USA, 18–23 June 2018, IEEE.10.1109/CVPR.2018.00854 ↗
23. Rombach, R., Blattmann, A., Lorenz, D., Esser, P., and Ommer, B. (2022). High-Resolution Image Synthesis with Latent Diffusion Models. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), IEEE.10.1109/CVPR52688.2022.01042 ↗
24. NVAE: A Deep Hierarchical Variational Autoencoder
25. Simple FFT and DCT algorithms with reduced number of operations10.1016/0165-1684(84)90059-8 ↗
26. An FFT-Based Method for Rough Surface Contact10.1115/1.2833523 ↗
27. FFDNet: Toward a Fast and Flexible Solution for CNN-based Image Denoising10.1109/TIP.2018.2839891 ↗
28. Qin, Z., Zhang, P., Wu, F., and Li, X. (2021). FcaNet: Frequency Channel Attention Networks. Proceedings of the IEEE/CVF International Conference on Computer Vision (ICCV), Montreal, QC, Canada, 11–17 October 2021, IEEE.10.1109/ICCV48922.2021.00082 ↗
29. MFNet: Multi-level Frequency Network for Image Restoration
30. Zamir, S.W., Arora, A., Khan, S., Hayat, M., Khan, F.S., and Yang, M.H. (2022). Restormer: Efficient Transformer for High-Resolution Image Restoration. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), IEEE.10.1109/CVPR52688.2022.00564 ↗