journal article·2025-04-28Open access

A Shadow Detection Method Combining Topography and Spectra for Remote Sensing Images in Mountainous Environments

Huagui Xu, Jingxing Zhu, Feng Wang, Hongjian You, Wenzhi Wang

Applied Sciences· Volume 15· Issue 9

Abstract

Shadow in remote sensing images can obscure important details of land features, making shadow detection crucial for enhancing the accuracy of subsequent analyses and applications. Current shadow detection methods primarily rely on the spectral information of images, which can often result in shadow misdetection due to the phenomenon of spectral confusion of different objects. To mitigate this issue, we propose a method that combines topography and spectra (CTS). Firstly, we introduce a new DEM-based shadow coarse detection method to obtain the DEM rough shadow mask, which uses a relationship between the magnitude of terrain height angle and solar elevation angle to determine shadow properties. Then, we use the MC3 (modified C3 component) index-based shadow fine detection method to obtain an MC3 mean map, which includes image enhancement with a stretching process and multi-scale superpixel segmentation. We then derive the Shadow pixel Proportion Map (SPM) by counting the DEM rough shadow mask in terms of superpixels. The Joint Shadow probability Map (JSM) is obtained by combining the SPM and the MC3 mean map with specific weights. Finally, a multi-level Otsu threshold method is applied to the JSM to generate the shadow mask. We compare the proposed CTS method against several state-of-the-art algorithms through both qualitative assessments and quantitative metrics. The results show that the CTS method demonstrates superior accuracy and consistency in detecting true shadows, achieving an average overall accuracy of 95.81% on mountainous remote sensing images.
Source: crossref · Quality: baseline

Research context

OpenAlex topics: Visual Attention and Saliency Detection · Remote-Sensing Image Classification · Advanced Image Fusion Techniques

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

Key Laboratory of Technology in Geo-Spatial Information Processing and Application System, Aerospace Information Research Institute, Chinese Academy of Sciences, Beijing 100190, China

Aerospace Information Research Institute, Chinese Academy of Sciences, Beijing 100094, China

School of Electronic, Electrical and Communication Engineering, University of Chinese Academy of Sciences, Beijing 101408, China

Funding

Future Star Foundation of Aerospace Information Research Institute, Chinese Academy of Sciences

References (45)

Show source-provided references
1. Development of a multi-scale object-based shadow detection method for high spatial resolution image10.1080/2150704X.2014.1001079 ↗
2. Rendering Synthetic Objects into Legacy Photographs10.1145/2070781.2024191 ↗
3. Estimating the Natural Illumination Conditions from a Single Outdoor Image10.1007/s11263-011-0501-8 ↗
4. Schläpfer, D., Hueni, A., and Richter, R. (2018). Cast Shadow Detection to Quantify the Aerosol Optical Thickness for Atmospheric Correction of High Spatial Resolution Optical Imagery. Remote Sens., 10.10.3390/rs10020200 ↗
5. Zhang, H.Y., Xu, C., Fan, Z.J., Li, W.Z., Sun, K.M., and Li, D.R. (2023). Detection and Classification of Buildings by Height from Single Urban High-Resolution Remote Sensing Images. Appl. Sci., 13.10.3390/app131910729 ↗
6. Tricolor Attenuation Model for Shadow Detection10.1109/TIP.2009.2026682 ↗
7. Adaptive Shadow Detection Using A Blackbody Radiator Model10.1109/TGRS.2010.2096515 ↗
8. Li, J., Hu, Q., and Ai, M. (2016). Joint Model and Observation Cues for Single-image Shadow Detection. Remote Sens., 8.10.3390/rs8060484 ↗
9. Stevens, M.R., Pyeatt, L.D., Houlton, D.J., and Goss, M.E. (1995). Locating Shadows in Aerial Photographs Using Imprecise Elevation Data. Computer Science Technical Report CS-95-105, Colorado State University.
10. Tolt, G., Shimoni, M., and Ahlberg, J. (2011, January 24–29). A Shadow Detection Method for Remote Sensing Images Using VHR Hyperspectral and LIDAR Data. Proceedings of the 2011 IEEE International Geoscience and Remote Sensing Symposium, Vancouver, BC, Canada.10.1109/IGARSS.2011.6050213 ↗
11. Wang, Q., Yan, L., Yuan, Q., and Ma, Z. (2017). An Automatic Shadow Detection Method for VHR Remote Sensing Orthoimagery. Remote Sens., 9.10.3390/rs9050469 ↗
12. Huang, J., Xie, W., and Tang, L. (2004, January 15–19). Detection of and Compensation for Shadows in Colored Urban Aerial Images. Proceedings of the World Congress on Intelligent Control and Automation, Hangzhou, China.
13. A Comparative Study on Shadow Compensation of Color Aerial Images in Invariant Color Models10.1109/TGRS.2006.869980 ↗
14. Ma, H., Qin, Q., and Shen, X. (2008, January 7–11). Shadow Segmentation and Compensation in High Resolution Satellite Images. Proceedings of the International Geoscience and Remote Sensing Symposium, Boston, MA, USA.10.1109/IGARSS.2008.4779175 ↗
15. Modified Invariant Colour Model for Shadow Detection10.1080/01431161.2015.1112930 ↗
16. Han, H., Han, C., Lan, T., Huang, L., Hu, C., and Xue, X. (2020). Automatic Shadow Detection for Multispectral Satellite Remote Sensing Images in Invariant Color Spaces. Appl. Sci., 10.10.3390/app10186467 ↗
17. A Modified Valley-emphasis Method for Automatic Thresholding10.1016/j.patrec.2011.12.009 ↗
18. Zhou, T., Fu, H., Sun, C., and Wang, S. (2021). Shadow Detection and Compensation from Remote Sensing Images under Complex Urban Conditions. Remote Sens., 13.10.3390/rs13040699 ↗
19. A shadow identification method using vegetation indices derived from hyperspectral data10.1080/01431161.2017.1338785 ↗
20. Near Real-Time Shadow Detection and Removal in Aerial Motion Imagery Application10.1016/j.isprsjprs.2017.11.005 ↗
21. Shadow Detection in Remote Sensing Images Based on Spectral Radiance Separability Enhancement10.1109/TPAMI.2023.3343728 ↗
22. Shadow Detection and Reconstruction of High-Resolution Remote Sensing Images in Mountainous and Hilly Environments10.1109/JSTARS.2023.3338976 ↗
23. DTHNet: Dual-Stream Network Based on Transformer and High-Resolution Representation for Shadow Extraction from Remote Sensing Imagery10.1109/LGRS.2023.3329687 ↗
24. A Shadow Detection Algorithm Based on Multiscale Spatial Attention Mechanism for Aerial Remote Sensing Images
25. ESPFNet: An Edge-Aware Spatial Pyramid Fusion Network for Salient Shadow Detection in Aerial Remote Sensing Images10.1109/JSTARS.2021.3066791 ↗
26. Jin, Y., Xu, W., Hu, Z., Jia, H., Luo, X., and Shao, D. (2020). GSCA-UNet: Towards Automatic Shadow Detection in Urban Aerial Imagery with Global-Spatial-Context Attention Module. Remote Sens., 12.10.3390/rs12172864 ↗
27. Valanarasu, J.M.J., and Patel, V.M. (2023, January 3–7). Fine-Context Shadow Detection using Shadow Removal. Proceedings of the 23rd IEEE/CVF Winter Conference on Applications of Computer Vision (WACV), Waikoloa, HI, USA.10.1109/WACV56688.2023.00175 ↗
28. Zheng, Q., Qiao, X., Cao, Y., and Lau, R.W.H. (2019, January 16–20). Distraction-aware Shadow Detection. Proceedings of the 32nd IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), Long Beach, CA, USA.10.1109/CVPR.2019.00531 ↗
29. Qu, L.Q., Tian, J.D., He, S.F., Tang, Y.D., and Lau, R.W.H. (2017, January 21–26). DeshadowNet: A Multi-context Embedding Deep Network for Shadow Removal. Proceedings of the 30th IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), Honolulu, HI, USA.10.1109/CVPR.2017.248 ↗
30. Morales, G., Huamán, S.G., and Telles, J. (2018, January 3–5). Shadow Removal in High-Resolution Satellite Images Using Conditional Generative Adversarial Networks. Proceedings of the 2018 Annual International Symposium on Information Management and Big Data, Lima, Peru.
31. Wang, J.F., Li, X., and Yang, J. (2018, January 18–23). Stacked Conditional Generative Adversarial Networks for Jointly Learning Shadow Detection and Shadow Removal. Proceedings of the 31st IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), Salt Lake City, UT, USA.10.1109/CVPR.2018.00192 ↗
32. A shadow constrained conditional generative adversarial net for SRTM data restoration10.1016/j.rse.2019.111602 ↗
33. Ding, B., Long, C.J., Zhang, L., and Xiao, C.X. (November, January 27). ARGAN: Attentive Recurrent Generative Adversarial Network for Shadow Detection and Removal. Proceedings of the IEEE/CVF International Conference on Computer Vision (ICCV), Seoul, Republic of Korea.
34. Guan, H.K., Xu, K., and Lau, R.W.H. (2024). Delving into Dark Regions for Robust Shadow Detection. arXiv.
35. Fang, X.Y., He, X.H., Wang, L.B., and Shen, J.B. (2021, January 20–24). Robust shadow detection by exploring effective shadow contexts. Proceedings of the 29th ACM International Conference on Multimedia, Virtual Event.10.1145/3474085.3475199 ↗
36. Deeply Supervised Convolutional Neural Network for Shadow Detection Based on A Novel Aerial Shadow Imagery Dataset10.1016/j.isprsjprs.2020.07.016 ↗
37. MRPFA-Net for Shadow Detection in Remote-Sensing Images
38. Wang, H.Q., Wang, W., Zhou, H.P., Xu, H.H., Wu, S.Z., and Zhu, L. (November, January 28). Language-Driven Interactive Shadow Detection. Proceedings of the 32nd ACM International Conference on Multimedia, Melbourne, VIC, Australia.
39. Semantic-aware transformer for shadow detection10.1016/j.cviu.2024.103941 ↗
40. Structure-Aware Transformer for Shadow Detection10.1049/ipr2.70031 ↗
41. A Comprehensive Overview of Image Enhancement Techniques10.1007/s11831-021-09587-6 ↗
42. SLIC Superpixels Compared to State-of-the-Art Superpixel Methods10.1109/TPAMI.2012.120 ↗
43. Strobl, J., Blaschke, T., and Griesebner, G. Multiresolution Segmentation: An Optimization Approach for High Quality Multi-Scale Image Segmentation. Angewandte Geographische Informations-Verarbeitung XII, Wichmann Verlag.
44. Yao, J., and Zhang, Z.F. (2004, January 23–26). Systematic static shadow detection. Proceedings of the 17th International Conference on Pattern Recognition (ICPR), Cambridge, UK.
45. A Review on Various Shadow Detection and Compensation Techniques in Remote Sensing Images10.1080/07038992.2017.1384310 ↗