journal article·2026-04-23Open access

AmpFormer: Amplitude-Aware Spectral Recalibration for Shadow Removal

Lianmeng Wei, Sihui Luo

Applied Sciences· Volume 16· Issue 9

Abstract

Recent years have witnessed significant progress in deep learning-based shadow removal. However, most prior methods operate primarily in the spatial domain or rely on coarse frequency cues, while the informative role of amplitude components in the frequency domain remains largely unexplored. The amplitude spectrum encodes spectral energy that reflects global illumination and fine texture that strongly influence shadow appearance. Motivated by this observation, we propose AmpFormer, a U-shaped transformer architecture that explicitly models amplitude information for robust shadow correction. Central to AmpFormer is a lightweight SFR module inserted at each encoder–decoder stage: SFR extracts multi-scale amplitude cues from compact spectral representations, learns per-channel adaptive gains and subtle phase adjustments, and injects the recalibrated frequency features into the spatial stream. To further encourage amplitude-aware restoration, we introduce an amplitude loss that explicitly regularizes spectral energy with emphasis on global illumination consistency. Extensive experiments on standard benchmarks demonstrate that AmpFormer achieves state-of-the-art restoration quality while offering a favorable computational-efficiency-accuracy trade-off, validating the practical benefit of amplitude-aware frequency modeling for shadow removal.
Source: crossref · Quality: baseline

Research context

OpenAlex topics: Image Enhancement Techniques · Generative Adversarial Networks and Image Synthesis · Computer Graphics and Visualization Techniques

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

Faculty of Electrical Engineering and Computer Science, Ningbo University, Ningbo 315000, China

Funding

the Natural Science Foundation Projects of Zhejiang Province

References (37)

Show source-provided references
1. Image segmentation using deep learning: A survey
2. Physical models for moving shadow and object detection in video10.1109/TPAMI.2004.51 ↗
3. Improving shadow suppression for illumination robust face recognition10.1109/TPAMI.2018.2803179 ↗
4. Guo, L., Huang, S., Liu, D., Cheng, H., and Wen, B. (2023, January 7–14). ShadowFormer: Global context helps shadow removal. Proceedings of the AAAI Conference on Artificial Intelligence, Washington, DC, USA.10.1609/aaai.v37i1.25148 ↗
5. Xiao, J., Fu, X., Zhu, Y., Li, D., Huang, J., Zhu, K., and Zha, Z.J. (2024, January 16–22). Homoformer: Homogenized transformer for image shadow removal. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), Seattle, WA, USA.10.1109/CVPR52733.2024.02420 ↗
6. Xu, J., Li, Z., Zheng, Y., Huang, C., Gu, R., Xu, W., and Xu, G. (March, January 25). Omnisr: Shadow removal under direct and indirect lighting. Proceedings of the AAAI Conference on Artificial Intelligence, Philadelphia, PA, USA.
7. Yu, J., He, P., and Peng, Z. (November, January 29). Fsr-net: Deep fourier network for shadow removal. Proceedings of the ACM International Conference on Multimedia (ACM MM), Ottawa, ON, Canada.
8. Shadow remover: Image shadow removal based on illumination recovering optimization10.1109/TIP.2015.2465159 ↗
9. On the removal of shadows from images10.1109/TPAMI.2006.18 ↗
10. Paired regions for shadow detection and removal10.1109/TPAMI.2012.214 ↗
11. Wang, X., Guo, L., Wang, X., Huang, S., and Wen, B. (2025, January 11–15). SoftShadow: Leveraging Soft Masks for Penumbra-Aware Shadow Removal. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), Nashville, TN, USA.10.1109/CVPR52734.2025.02162 ↗
12. Guo, L., Wang, C., Yang, W., Huang, S., Wang, Y., Pfister, H., and Wen, B. (2023, January 17–24). Shadowdiffusion: When degradation prior meets diffusion model for shadow removal. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), Vancouver, BC, Canada.10.1109/CVPR52729.2023.01350 ↗
13. Jin, Y., Ye, W., Yang, W., Yuan, Y., and Tan, R.T. (2024, January 20–27). Des3: Adaptive attention-driven self and soft shadow removal using vit similarity. Proceedings of the AAAI Conference on Artificial Intelligence, Vancouver, BC, Canada.10.1609/aaai.v38i3.28041 ↗
14. Cao, H., Wang, Y., Chen, J., Jiang, D., Zhang, X., Tian, Q., and Wang, M. (2022, January 23–27). Swin-unet: Unet-like pure transformer for medical image segmentation. Proceedings of the European Conference on Computer Vision (ECCV), Tel Aviv, Israel.10.1007/978-3-031-25066-8_9 ↗
15. Nussbaumer, H.J. (1981). The fast Fourier transform. Fast Fourier Transform and Convolution Algorithms, Springer.10.1007/978-3-662-00551-4 ↗
16. Liu, Z., Lin, Y., Cao, Y., Hu, H., Wei, Y., Zhang, Z., Lin, S., and Guo, B. (2021, January 10–17). Swin transformer: Hierarchical vision transformer using shifted windows. Proceedings of the IEEE/CVF International Conference on Computer Vision (ICCV), Montreal, QC, Canada.10.1109/ICCV48922.2021.00986 ↗
17. The fourier transform10.1038/scientificamerican0689-86 ↗
18. On computing the discrete Fourier transform10.1090/S0025-5718-1978-0468306-4 ↗
19. Charbonnier, P., Blanc-Feraud, L., Aubert, G., and Barlaud, M. (1994, January 13–16). Two Deterministic Half-Quadratic Regularization Algorithms for Computed Imaging. Proceedings of the IEEE International Conference on Image Processing, Austin, TX, USA.
20. Qu, L., Tian, J., He, S., Tang, Y., and Lau, R.W. (2017, January 21–26). Deshadownet: A multi-context embedding deep network for shadow removal. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), Honolulu, HI, USA.10.1109/CVPR.2017.248 ↗
21. Cun, X., Pun, C.M., and Shi, C. (2020, January 7–12). Towards ghost-free shadow removal via dual hierarchical aggregation network and shadow matting gan. Proceedings of the AAAI Conference on Artificial Intelligence, New York, NY, USA.10.1609/aaai.v34i07.6695 ↗
22. Wang, J., Li, X., and Yang, J. (2018, January 18–23). Stacked conditional generative adversarial networks for jointly learning shadow detection and shadow removal. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), Salt Lake City, UT, USA.10.1109/CVPR.2018.00192 ↗
23. Le, H., and Samaras, D. (November, January 27). Shadow removal via shadow image decomposition. Proceedings of the IEEE/CVF International Conference on Computer Vision (ICCV), Seoul, Republic of Korea.
24. Vasluianu, F.A., Seizinger, T., and Timofte, R. (2023, January 17–24). Wsrd: A novel benchmark for high resolution image shadow removal. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPRW), Vancouver, BC, Canada.10.1109/CVPRW59228.2023.00181 ↗
25. Vasluianu, F.A., Seizinger, T., Zhou, Z., Wu, Z., Chen, C., Timofte, R., Dong, W., Zhou, H., Tian, Y., and Chen, J. (2024, January 16–24). NTIRE 2024 image shadow removal challenge report. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPRW), Seattle, WA, USA.
26. Physics-based shadow image decomposition for shadow removal10.1109/TPAMI.2021.3124934 ↗
27. Zhu, J., Samuel, K.G., Masood, S.Z., and Tappen, M.F. (2010). Learning to recognize shadows in monochromatic natural images. Proceedings of the 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, IEEE.10.1109/CVPR.2010.5540209 ↗
28. Loshchilov, I., and Hutter, F. (2019, January 6–9). Decoupled weight decay regularization. Proceedings of the International Conference on Learning Representations (ICLR), New Orleans, LA, USA.
29. Fu, L., Zhou, C., Guo, Q., Juefei-Xu, F., Yu, H., Feng, W., Liu, Y., and Wang, S. (2021, January 20–25). Auto-exposure fusion for single-image shadow removal. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), Nashville, TN, USA.10.1109/CVPR46437.2021.01043 ↗
30. Wang, Z., Cun, X., Bao, J., Zhou, W., Liu, J., and Li, H. (2022, January 18–24). Uformer: A general u-shaped transformer for image restoration. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), New Orleans, LA, USA.10.1109/CVPR52688.2022.01716 ↗
31. Zhu, Y., Huang, J., Fu, X., Zhao, F., Sun, Q., and Zha, Z.J. (2022, January 18–24). Bijective mapping network for shadow removal. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), New Orleans, LA, USA.10.1109/CVPR52688.2022.00554 ↗
32. Liu, Y., Ke, Z., Xu, K., Liu, F., Wang, Z., and Lau, R.W. (2024, January 26–27). Recasting regional lighting for shadow removal. Proceedings of the AAAI Conference on Artificial Intelligence, Vancouver, BC, Canada.10.1609/aaai.v38i4.28172 ↗
33. Liu, H., Li, M., and Guo, X. (November, January 28). Regional Attention for Shadow Removal. Proceedings of the ACM International Conference on Multimedia (ACM MM), Melbourne, VIC, Australia.
34. Luo, Z., Gustafsson, F.K., Zhao, Z., Sjölund, J., and Schön, T.B. (2023, January 17–24). Refusion: Enabling large-size realistic image restoration with latent-space diffusion models. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPRW), Vancouver, BC, Canada.10.1109/CVPRW59228.2023.00169 ↗
35. Deep learning in remote sensing: A comprehensive review and list of resources10.1109/MGRS.2017.2762307 ↗
36. Domain adaptation using transformer models for automated detection of exterior cladding materials in street view images10.1038/s41598-025-32524-7 ↗
37. Domain-adaptive faster R-CNN for non-PPE identification on construction sites from body-worn and general images10.1038/s41598-026-35148-7 ↗