journal article·2025-02-22Open access

Physics-Based Noise Modeling and Deep Learning for Denoising Permanently Shadowed Lunar Images

Haiyan Pan, Binbin Chen, Ruyan Zhou

Applied Sciences· Volume 15· Issue 5

Abstract

The Narrow-Angle Cameras (NACs) onboard the Lunar Reconnaissance Orbiter Camera (LROC) capture lunar images that play a crucial role in current lunar exploration missions. Among these images, those of the Moon’s permanently shadowed regions (PSRs) are highly noisy, obscuring the lunar topographic features within these areas. While significant advancements have been made in denoising techniques based on deep learning, the direct acquisition of paired clean and noisy images from the PSRs of the Moon is costly, making dataset acquisition expensive and hindering network training. To address this issue, we employ a physical noise model based on the imaging principles of the LROC NACs to generate noisy pairs of images for the Moon’s PSRs, simulating realistic lunar imagery. Furthermore, inspired by the ideas of full-scale skip connections and self-attention models (Transformers), we propose a denoising method based on deep information convolutional neural networks. Using a dataset synthesized through the physical noise model, we conduct a comparative analysis between the proposed method and existing state-of-the-art denoising approaches. The experimental results demonstrate that the proposed method can effectively recover topographic features obscured by noise, achieving the highest quantitative metrics and superior visual results.
Source: crossref · Quality: baseline

Research context

OpenAlex topics: Planetary Science and Exploration

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

College of Information Technology, Shanghai Ocean University, Shanghai 201306, China

Funding

National Natural Science Foundation of China

References (52)

Show source-provided references
1. Lunar reconnaissance orbiter overview: The instrument suite and mission10.1007/s11214-007-9153-y ↗
2. Lunar reconnaissance orbiter camera (LROC) instrument overview10.1007/s11214-010-9634-2 ↗
3. Chromey, F.R. (2016). To Measure the Sky, Cambridge University Press.10.1017/CBO9781316424117 ↗
4. Konnik, M., and Welsh, J. (2014). High-level numerical simulations of noise in CCD and CMOS photosensors: Review and tutorial. arXiv.
5. A review of image denoising algorithms, with a new one10.1137/040616024 ↗
6. Image denoising review: From classical to state-of-the-art approaches10.1016/j.inffus.2019.09.003 ↗
7. Brief review of image denoising techniques10.1186/s42492-019-0016-7 ↗
8. Gu, S., and Timofte, R. (2019). A Brief Review of Image Denoising Algorithms and Beyond. Inpainting and Denoising Challenges, Springer.10.1007/978-3-030-25614-2_1 ↗
9. A comprehensive review of image denoising in deep learning10.1007/s11042-023-17468-2 ↗
10. Buades, A., Coll, B., and Morel, J.M. (2005, January 20–25). A non-local algorithm for image denoising. Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR), San Diego, CA, USA.
11. Nonlinear total variation based noise removal algorithms10.1016/0167-2789(92)90242-F ↗
12. Image denoising using scale mixtures of Gaussians in the wavelet domain10.1109/TIP.2003.818640 ↗
13. Image denoising by sparse 3-D transform-domain collaborative filtering10.1109/TIP.2007.901238 ↗
14. Huang, T., Li, S., Jia, X., Lu, H., and Liu, J. (2021). Neighbor2Neighbor: Self-Supervised Denoising from Single Noisy Images. arXiv.10.1109/CVPR46437.2021.01454 ↗
15. Cheng, S., Wang, Y., Huang, H., Liu, D., Fan, H., and Liu, S. (2021, January 20–25). NBNet: Noise Basis Learning for Image Denoising with Subspace Projection. Proceedings of the 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), Nashville, TN, USA.10.1109/CVPR46437.2021.00486 ↗
16. Liu, Y., Qin, Z., Anwar, S., Ji, P., Kim, D., Caldwell, S., and Gedeon, T. (2021). Invertible Denoising Network: A Light Solution for Real Noise Removal. arXiv.10.1109/CVPR46437.2021.01316 ↗
17. Byun, J., Cha, S., and Moon, T. (2021). FBI-Denoiser: Fast Blind Image Denoiser for Poisson-Gaussian Noise. arXiv.10.1109/CVPR46437.2021.00571 ↗
18. Dual residual attention network for image denoising10.1016/j.patcog.2024.110291 ↗
19. Wang, Z., Cun, X., Bao, J., Zhou, W., Liu, J., and Li, H. (2022, January 18–24). Uformer: A General U-Shaped Transformer for Image Restoration. Proceedings of the 2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), New Orleans, LA, USA.10.1109/CVPR52688.2022.01716 ↗
20. Zhou, S., Chen, D., Pan, J., Shi, J., and Yang, J. (2024, January 16–22). Adapt or Perish: Adaptive Sparse Transformer with Attentive Feature Refinement for Image Restoration. Proceedings of the 2024 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), Seattle, WA, USA.10.1109/CVPR52733.2024.00285 ↗
21. Kong, Z., Deng, F., Zhuang, H., Yu, J., He, L., and Yang, X. (2023). A Comparison of Image Denoising Methods. arXiv.
22. Beyond a Gaussian denoiser: Residual learning of deep CNN for image denoising10.1109/TIP.2017.2662206 ↗
23. Mao, X.J., Shen, C., and Yang, Y.B. (2016, January 5–10). Image restoration using very deep convolutional encoder-decoder networks with symmetric skip connections. Proceedings of the NIPS’16: Proceedings of the 30th International Conference on Neural Information Processing Systems, Barcelona, Spain.
24. Tai, Y., Yang, J., Liu, X., and Xu, C. (2017, January 22–29). MemNet: A Persistent Memory Network for Image Restoration. Proceedings of the IEEE International Conference on Computer Vision, Venice, Italy.10.1109/ICCV.2017.486 ↗
25. Guo, S., Yan, Z., Zhang, K., Zuo, W., and Zhang, L. (2019, January 15–20). Toward convolutional blind denoising of real photographs. Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition, Long Beach, CA, USA.10.1109/CVPR.2019.00181 ↗
26. Lehtinen, J., Munkberg, J., Hasselgren, J., Laine, S., Karras, T., Aittala, M., and Aila, T. (2018, January 10–15). Noise2Noise: Learning image restoration without clean data. Proceedings of the 35th International Conference on Machine Learning, Stockholm, Sweden.
27. Krull, A., Buchholz, T.O., and Jug, F. (2019, January 15–20). Noise2void-Learning denoising from single noisy images. Proceedings of the 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), Long Beach, CA, USA.10.1109/CVPR.2019.00223 ↗
28. Lempitsky, V., Vedaldi, A., and Ulyanov, D. (2018, January 18–23). Deep Image Prior. Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition, Salt Lake City, UT, USA.10.1109/CVPR.2018.00984 ↗
29. Moseley, B., Bickel, V., López-Francos, I.G., and Rana, L. (2021, January 20–25). Extreme Low-Light Environment-Driven Image Denoising over Permanently Shadowed Lunar Regions with a Physical Noise Model. Proceedings of the 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), Nashville, TN, USA.10.1109/CVPR46437.2021.00625 ↗
30. Chen, C., Chen, Q., Xu, J., and Koltun, V. (2018, January 18–23). Learning to See in the Dark. Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition, Salt Lake City, UT, USA.10.1109/CVPR.2018.00347 ↗
31. Wei, K., Fu, Y., Yang, J., and Huang, H. (2020, January 13–19). A Physics-based Noise Formation Model for Extreme Low-light Raw Denoising. Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition, Seattle, WA, USA.10.1109/CVPR42600.2020.00283 ↗
32. Xu, K., Yang, X., Yin, B., and Lau, R.W.H. (2020, January 13–19). Learning to restore low-light images via decomposition-and-enhancement. Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition, Seattle, WA, USA.10.1109/CVPR42600.2020.00235 ↗
33. Maharjan, P., Li, L., Li, Z., Xu, N., Ma, C., and Li, Y. (2019, January 8–12). Improving extreme low-light image denoising via residual learning. Proceedings of the 2019 IEEE International Conference on Multimedia and Expo (ICME), Shanghai, China.10.1109/ICME.2019.00162 ↗
34. Szeliski, R. (2010). Computer Vision: Algorithms and Applications, Springer.10.1007/978-1-84882-935-0 ↗
35. (2023, November 21). Working with Lunar Reconnaissance Orbiter LROC Narrow. Available online: http://www.lroc.asu.edu/data/support/downloads/LROC_NAC_Processing_Guide.pdf.
36. Flight Calibration of the LROC Narrow Angle Camera10.1007/s11214-015-0201-8 ↗
37. Dosovitskiy, A., Beyer, L., Kolesnikov, A., Weissenborn, D., Zhai, X., Unterthiner, T., Dehghani, M., Minderer, M., Heigold, G., and Gelly, S. (2020, January 26–30). An Image is Worth 16x16 Words: Transformers for Image Recognition at Scale. Proceedings of the 8th International Conference on Learning Representations, ICLR, Addis Ababa, Ethiopia.
38. Vaswani, A., Shazeer, N., Parmar, N., Uszkoreit, J., Jones, L., Gomez, A., Kaiser, L., and Polosukhin, I. (2017, January 4–9). Attention Is All You Need. Proceedings of the NeurIPS, Annual Conference on Neural Information Processing Systems, Long Beach, CA, USA.
39. Li, Y., Zhang, K., Cao, J., Timofte, R., and Van Gool, L. (2021). LocalViT: Bringing Locality to Vision Transformers. arXiv.
40. Wu, H., Xiao, B., Codella, N., Liu, M., Dai, X., Yuan, L., and Zhang, L. (2021). CvT: Introducing convolutions to vision transformers. arXiv.10.1109/ICCV48922.2021.00009 ↗
41. Liu, Z., Lin, Y., Cao, Y., Hu, H., Wei, Y., Zhang, Z., Lin, S., and Guo, B. (2021). Swin Transformer: Hierarchical Vision Transformer using Shifted Windows. arXiv.10.1109/ICCV48922.2021.00986 ↗
42. Shaw, P., Uszkoreit, J., and Vaswani, A. (2018). SelfAttention with Relative Position Representations. arXiv.10.18653/v1/N18-2074 ↗
43. Chen, J., Kao, S., He, H., Zhuo, W., Wen, S., Lee, C., and Chan, S.G. (2023, January 17–24). Run, don’t walk: Chasing higher flops for faster neural networks. Proceedings of the 2023 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), Vancouver, BC, Canada.10.1109/CVPR52729.2023.01157 ↗
44. Howard, A.G., Zhu, M., Chen, B., Kalenichenko, D., Wang, W., Weyand, T., Andreetto, M., and Adam, H. (2017). Mobilenets: Efficient convolutional neural networks for mobile vision applications. arXiv.
45. Image quality assessment: From error visibility to structural similarity10.1109/TIP.2003.819861 ↗
46. A Feature-Enriched Completely Blind Image Quality Evaluator10.1109/TIP.2015.2426416 ↗
47. Wang, Z., Sheikh, H., and Bovik, A. (2002, January 22–25). No-reference perceptual quality assessment of JPEG compressed images. Proceedings of the Proceedings. International Conference on Image Processing, Rochester, NY, USA.
48. Ke, J., Wang, Q., Wang, Y., Milanfar, P., and Yang, F. (2021, January 10–17). MUSIQ: Multi-scale Image Quality Transformer. Proceedings of the 2021 IEEE/CVF International Conference on Computer Vision (ICCV), Montreal, QC, Canada.10.1109/ICCV48922.2021.00510 ↗
49. Ronneberger, O., Fischer, P., and Brox, T. (2015). U-Net: Convolutional Networks for Biomedical Image Segmentation. arXiv.10.1007/978-3-319-24574-4_28 ↗
50. Dua, P. (2023, April 15). Image Denoising Using a U-Net. Available online: http://stanford.edu/class/ee367/Winter2019/dua_report.pdf.
51. Huang, H., Lin, L., Tong, R., Hu, H., Zhang, Q., Iwamoto, Y., Han, X., Chen, Y.W., and Wu, J. (2020, January 4–8). UNet 3+: A Full-Scale Connected UNet for Medical Image Segmentation. Proceedings of the ICASSP 2020—2020 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), Barcelona, Spain.10.1109/ICASSP40776.2020.9053405 ↗
52. Direct evidence of surface exposed water ice in the lunar polar regions10.1073/pnas.1802345115 ↗