journal article·2025-12-05Open access

Noise-Aware Hybrid Compression of Deep Models with Zero-Shot Denoising and Failure Prediction

Lizhe Zhang, Quan Zhou, Ruihua Liu, Lang Huyan, Juanni Liu, Yi Zhang

Applied Sciences· Volume 15· Issue 24

Abstract

Deep learning-based image compression achieves remarkable average rate-distortion performance but is prone to failure on noisy, high-frequency, or high-entropy inputs. This work systematically investigates these failure cases and proposes a noise-aware hybrid compression framework to address them. A High-Frequency Vulnerability Index (HFVI) is proposed, integrating frequency energy, encoder Jacobian sensitivity, and texture entropy into a unified measure of degradation susceptibility. Guided by HFVI, the system incorporates a selective zero-shot denoising module (P2PA) and a lightweight hybrid codec selector that determines, for each image, whether P2PA is necessary and selecting the more reliable codec (a learning-based model or JPEG2000) accordingly, without retraining any compression backbones. Experiments span a 200,000-image cross-domain benchmark incorporating general datasets, synthetic noise (eight levels), and real-noise datasets demonstrate that the proposed pipeline improves PSNR by up to 1.28 dB, raises SSIM by 0.02, reduces LPIPS by roughly 0.05, and decreases the failure-case rate by 6.7% over the best baseline (Joint-IC). Additional intensity-profile and cross-validation analyses further validate the robustness and deployment readiness of the method, showing that the hybrid selector provides a practical path toward reliable, noise-adaptive deep image compression.
Source: crossref · Quality: baseline

Research context

OpenAlex topics: Advanced Data Compression Techniques · Image and Video Quality Assessment · Digital Media Forensic Detection

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

Xi’an Institute of Space Radio Technology, Xi’an 710100, China

References (55)

Show source-provided references
1. Zhou, L., Cai, C., Gao, Y., Su, S., and Wu, J. (2018, January 18–22). Variational autoencoder for low bit-rate image compression. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition Workshops, Salt Lake City, UT, USA.
2. Ballé, J., Minnen, D., Singh, S., Hwang, S.J., and Johnston, N. (May, January 30). Variational image compression with a scale hyperprior. Proceedings of the International Conference on Learning Representations (ICLR), Vancouver, BC, Canada.
3. Cheng, Z., Sun, H., Takeuchi, M., and Katto, J. (2018, January 24–27). Deep convolutional autoencoder-based lossy image compression. Proceedings of the Picture Coding Symposium (PCS), San Francisco, CA, USA.10.1109/PCS.2018.8456308 ↗
4. Choi, Y., El-Khamy, M., and Lee, J. (November, January 27). Variable rate deep image compression with a conditional autoencoder. Proceedings of the IEEE/CVF International Conference on Computer Vision (ICCV), Seoul, Republic of Korea.
5. Liu, J., Sun, H., and Katto, J. (2023, January 17–24). Learned image compression with mixed transformer-CNN architectures. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), Vancouver, QC, Canada.10.1109/CVPR52729.2023.01383 ↗
6. Han, L., Shaohui, L., Wenrui, D., Chenglin, L., Zou, J., and Xiong, H. (2024, January 7–11). Frequency-aware transformer for learned image compression. Proceedings of the Twelfth International Conference on Learning Representations, Vienna, Austria.
7. (1992). Information Technology-Digital Compression and Coding of Continuous-Tone Still Images: Requirements and Guidelines (Standard No. ISO/IEC 10918-1:1992).
8. (2000). Information Technology-JPEG 2000 Image Coding System: Core Coding System (Standard No. ISO/IEC 15444-1:2000).
9. Google Inc. (2025, October 18). WebP Compression Format. Available online: https://developers.google.com/speed/webp/.
10. (2025, October 18). Kodak True-Color Image Suite. Available online: http://r0k.us/graphics/kodak/.
11. (2025, October 18). Challenge on Learned Image Compression (CLIC). Available online: https://archive.compression.cc/2024/tasks/.
12. The open images dataset V4: Unified image classification, object detection, and visual relationship detection at scale10.1007/s11263-020-01316-z ↗
13. JPEG AI: The first international standard for image coding based on an end-to-end learning-based approach10.1109/MMUL.2024.3485255 ↗
14. Brummer, B., and De Vleeschouwer, C. (2019, January 16–17). Natural image noise dataset. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops, Long Beach, CA, USA.10.1109/CVPRW.2019.00228 ↗
15. Duan, Z., Lu, M., Ma, Z., and Zhu, F. (2023, January 2–7). Lossy image compression with quantized hierarchical VAEs. Proceedings of the IEEE/CVF Winter Conference on Applications of Computer Vision (WACV), Waikoloa, HI, USA.10.1109/WACV56688.2023.00028 ↗
16. Lu, J., Zhang, L., Zhou, X., Li, M., Li, W., and Gu, S. (2025, January 13–15). Learned image compression with dictionary-based entropy model. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), Nashville, TN, USA.10.1109/CVPR52734.2025.01199 ↗
17. NLIC: Non-uniform quantization-based learned image compression10.1109/TCSVT.2024.3401872 ↗
18. Cheng, K.L., Xie, Y., and Chen, Q. (2022, January 23–28). Optimizing image compression via joint learning with denoising. Proceedings of the European Conference on Computer Vision (ECCV), Glasgow, UK.10.1007/978-3-031-19800-7_4 ↗
19. Cai, S., Liang, X., Cao, S., Yan, L., Zhong, S., Chen, L., and Ziu, X. (2024, January 15–19). Powerful lossy compression for noisy images. Proceedings of the IEEE International Conference on Multimedia and Expo (ICME), Niagara Falls, ON, Canada.10.1109/ICME57554.2024.10687468 ↗
20. Near lossless data compression onboard a hyperspectral satellite10.1109/TAES.2006.248183 ↗
21. Compressed sensing for high-noise astronomical image recovery10.1117/1.JEI.28.5.053026 ↗
22. The blind spot of deep image compression: Why JPEG2000 still wins in high-entropy high-frequency regions
23. Fabrice, B. (2025, October 18). Better Portable Graphics Image Format. Available online: https://bellard.org/bpg/.
24. Alliance for Open Media (2025, October 18). AV1 Image File Format (AVIF). Available online: https://aomediacodec.github.io/av1-avif/.
25. Developments in international video coding standardization after AVC, with an overview of versatile video coding (VVC)10.1109/JPROC.2020.3043399 ↗
26. Cheng, Z., Zhou, M., Guo, J., Yuan, J., Ji, Y., and Zhang, Y. (2020, January 13–19). Steering one-step diffusion model with fidelity-rich decoder for fast image compression. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), Seattle, WA, USA.
27. International Telecommunication Union (ITU) (2025, October 18). Recommendation ITU-T T.840.1. JPEG AI Learning-Based Image Coding System (JPEG-AI). Available online: https://gitlab.com/wg1/jpeg-ai/jpeg-ai-reference-software.git.
28. A lightweight model for perceptual image compression via implicit priors
29. Zeng, F., Tang, H., Shao, Y., Chen, S., Shao, L., and Wang, Y. (2025). MambaIC: State space models for high-performance learned image compression. arXiv.10.1109/CVPR52734.2025.01681 ↗
30. Lossy compression of noisy images10.1109/83.730376 ↗
31. Adaptive wavelet thresholding for image denoising and compression10.1109/83.862633 ↗
32. Brummer, B., and De Vleeschouwer, C. (2023, January 2–7). On the importance of denoising when learning to compress images. Proceedings of the IEEE/CVF Winter Conference on Applications of Computer Vision (WACV), Waikoloa, HI, USA.10.1109/WACV56688.2023.00247 ↗
33. De-noising by soft-thresholding10.1109/18.382009 ↗
34. A review of image denoising algorithms, with a new one10.1137/040616024 ↗
35. Beyond a gaussian denoiser: Residual learning of deep cnn for image denoising10.1109/TIP.2017.2662206 ↗
36. Ronneberger, O., Fischer, P., and Brox, T. (2015, January 5–9). U-net: Convolutional networks for biomedical image segmentation. Proceedings of the International Conference on Medical Image Computing and Computer-Assisted Intervention, Munich, Germany.10.1007/978-3-319-24574-4_28 ↗
37. Chang, X., Wang, X., Huang, X., Yan, M., and Cheng, L. (2025). Multi-scale differentiated network with spatial-spectral co-operative attention for hyperspectral image denoising. Appl. Sci., 15.10.3390/app15158648 ↗
38. Pixel2pixel: A pixelwise approach for zero-shot single image denoising10.1109/TPAMI.2025.3546870 ↗
39. Huang, T., Li, S., Jia, X., Lu, H., and Lu, J. (2021, January 20–25). Neighbor2neighbor: Self-supervised denoising from single noisy images. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), Nashville, TN, USA.10.1109/CVPR46437.2021.01454 ↗
40. Mansour, Y., and Heckel, R. (2023, January 17–23). Zero-shot noise2noise: Efficient image denoising without any data. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, Vancouver, BC, Canada.10.1109/CVPR52729.2023.01347 ↗
41. Lin, T.Y., Maire, M., Belongie, S., Bourdev, L., Girshick, R., Hays, J., Perona, P., Ramanan, D., Zitnick, C.L., and Dollár, P. (2014, January 6–12). Microsoft COCO: Common objects in context. Proceedings of the European Conference on Computer Vision (ECCV), Zurich, Switzerland.10.1007/978-3-319-10602-1_48 ↗
42. AiRound and CV-BrCT: Novel multiview datasets for scene classification10.1109/JSTARS.2020.3033424 ↗
43. Abdelhamed, A., Lin, S., and Brown, M.S. (2018, January 18–23). A high-quality denoising dataset for smartphone cameras. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), Salt Lake City, UT, USA.10.1109/CVPR.2018.00182 ↗
44. Abdelhamed, A., Afifi, M., Timofte, R., Brown, M.S., Cao, Y., Zhang, Z., Zuo, W., Zhang, X., Liu, J., and Chen, W. (2020, January 14–19). NTIRE 2020 challenge on real image denoising: Dataset, methods and results. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops, Seattle, WA, USA.
45. Ignatov, A., Kobyshev, N., and Timofte, R. (2020, January 14–19). Noise-aware training for deep image compression. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops, Seattle, WA, USA.
46. Mildenhall, B., Barron, J.T., Chen, J., Sharlet, D., Ng, R., and Carroll, R. (2018, January 18–23). Burst denoising with kernel prediction networks. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Salt Lake City, UT, USA.10.1109/CVPR.2018.00265 ↗
47. Finlay, C., Jacobsen, J.H., Nurbekyan, L., and Oberman, A.M. (2020, January 12–18). How to train your neural ODE: The world of Jacobian and kinetic regularization. Proceedings of the International Conference on Machine Learning (ICML), Vienna, Austria.
48. Quantitative measurement of aging using image texture entropy10.1093/bioinformatics/btp571 ↗
49. Chen, T., and Guestrin, C. (2016, January 13–17). XGBoost: A scalable tree boosting system. Proceedings of the 22nd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, San Francisco, CA, USA.10.1145/2939672.2939785 ↗
50. Image quality assessment: From error visibility to structural similarity10.1109/TIP.2003.819861 ↗
51. Zhang, R., Isola, P., Efros, A.A., Shechtman, E., and Wang, O. (2018, January 18–23). The unreasonable effectiveness of deep features as a perceptual metric. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Salt Lake City, UT, USA.10.1109/CVPR.2018.00068 ↗
52. Image quality assessment: Unifying structure and texture similarity
53. A visual information fidelity approach to video quality assessment
54. Perceptual image quality assessment using a normalized Laplacian pyramid10.2352/ISSN.2470-1173.2016.16.HVEI-103 ↗
55. CT image denoising using multivariate model and method noise thresholding in non-subsampled shearlet domain