journal article·2023-08-15Open access

A Neural-Network-Based Landscape Search Engine: LSE Wisconsin

Matthew Haffner, Matthew DeWitte, Papia F. Rozario, Gustavo A. Ovando-Montejo

Applied Sciences· Volume 13· Issue 16

Abstract

The task of image retrieval is common in the world of data science and deep learning, but it has received less attention in the field of remote sensing. The authors seek to fill this gap in research through the presentation of a web-based landscape search engine for the US state of Wisconsin. The application allows users to select a location on the map and to find similar locations based on terrain and vegetation characteristics. It utilizes three neural network models—VGG16, ResNet-50, and NasNet—on digital elevation model data, and uses the NDVI mean and standard deviation for comparing vegetation data. The results indicate that VGG16 and ResNet50 generally return more favorable results, and the tool appears to be an important first step toward building a more robust, multi-input, high resolution landscape search engine in the future. The tool, called LSE Wisconsin, is hosted publicly on ShinyApps.io.
Source: crossref · Quality: baseline

Research context

OpenAlex topics: Remote Sensing in Agriculture · Remote Sensing and LiDAR Applications · Species Distribution and Climate Change

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

Department of Geography and Anthropology, University of Wisconsin–Eau Claire, Eau Claire, WI 54701, USA

Department of Environment and Society, Utah State University, Blanding, UT 84511, USA

Funding

Office of Research and Sponsored Programs at the University of Wisconsin-Eau Claire

References (28)

Show source-provided references
1. Deep learning in remote sensing applications: A meta-analysis and review10.1016/j.isprsjprs.2019.04.015 ↗
2. Pei, H., Owari, T., Tsuyuki, S., and Zhong, Y. (2023). Application of a Novel Multiscale Global Graph Convolutional Neural Network to Improve the Accuracy of Forest Type Classification Using Aerial Photographs. Remote Sens., 15.10.3390/rs15041001 ↗
3. Deep learning in environmental remote sensing: Achievements and challenges10.1016/j.rse.2020.111716 ↗
4. Weed resistance assessment through airborne multimodal data fusion and deep learning: A novel approach towards sustainable agriculture
5. A comprehensive survey of oriented object detection in remote sensing images10.1016/j.eswa.2023.119960 ↗
6. Li, Z., Wang, Y., Zhang, N., Zhang, Y., Zhao, Z., Xu, D., Ben, G., and Gao, Y. (2022). Deep Learning-Based Object Detection Techniques for Remote Sensing Images: A Survey. Remote Sens., 14.10.3390/rs14102385 ↗
7. Deep learning in multimodal remote sensing data fusion: A comprehensive review
8. Chen, J., Hong, H., Song, B., Guo, J., Chen, C., and Xu, J. (2023). MDCT: Multi-Kernel Dilated Convolution and Transformer for One-Stage Object Detection of Remote Sensing Images. Remote Sens., 15.10.3390/rs15020371 ↗
9. Deep learning for remote sensing image classification: A survey10.1002/widm.1264 ↗
10. Landscape similarity, retrieval, and machine mapping of physiographic units10.1016/j.geomorph.2014.06.011 ↗
11. The Landscape Similarity Toolbox: New tools for optimizing the location of control sites in experimental studies10.1111/j.1600-0587.2010.06577.x ↗
12. Pilliod, D.S., Jeffries, M.I., and Welty, J. (2023, August 06). Land Treatment Exploration Tool. Available online: https://susy.mdpi.com/user/assigned/production_form/1c6eec251f1a7967167a5f989ab777ab.
13. Gomes, R., Kamrowski, C., Langlois, J., Rozario, P., Dircks, I., Grottodden, K., Martinez, M., Tee, W.Z., Sargeant, K., and LaFleur, C. (2022). A Comprehensive Review of Machine Learning Used to Combat COVID-19. Diagnostics, 12.10.3390/diagnostics12081853 ↗
14. Simonyan, K., and Zisserman, A. (2015, January 7–9). Very Deep Convolutional Networks for Large-Scale Image Recognition. Proceedings of the International Conference on Learning Representations, San Diego, CA, USA.
15. A Lightweight Model of VGG-16 for Remote Sensing Image Classification10.1109/JSTARS.2021.3090085 ↗
16. Convolutional neural network-VGG16 for road extraction from remotely sensed images10.22214/ijraset.2020.30796 ↗
17. Khaleghian, S., Ullah, H., Kræmer, T., Hughes, N., Eltoft, T., and Marinoni, A. (2021). Sea Ice Classification of SAR Imagery Based on Convolution Neural Networks. Remote Sens., 13.10.3390/rs13091734 ↗
18. UAV remote sensing image stitching via improved VGG16 Siamese feature extraction network10.1016/j.eswa.2023.120525 ↗
19. He, K., Zhang, X., Ren, S., and Sun, J. (2015). Deep Residual Learning for Image Recognition. arXiv.10.1109/CVPR.2016.90 ↗
20. Automatic Building Extraction on Satellite Images Using Unet and ResNet5010.1155/2022/5008854 ↗
21. Jian, X., Yunquan, Z., and Yue, Q. (2021, January 11–13). Remote Sensing Image Classification Based on Different Convolutional Neural Network Models. Proceedings of the 2021 6th International Symposium on Computer and Information Processing Technology (ISCIPT), Changsha, China.10.1109/ISCIPT53667.2021.00069 ↗
22. Firat, H., and Hanbay, D. (2021, January 9–11). Classification of Hyperspectral Images Using 3D CNN Based ResNet50. Proceedings of the 2021 29th Signal Processing and Communications Applications Conference (SIU), Istanbul, Turkey.10.1109/SIU53274.2021.9477899 ↗
23. Remote-Sensing Image Captioning Based on Multilayer Aggregated Transformer
24. Using Classic Networks for Classifying Remote Sensing Images: Comparative Study10.25046/aj050594 ↗
25. Li, L., Tian, T., and Li, H. (2019, January 19–21). Classification of Remote Sensing Scenes Based on Neural Architecture Search Network. Proceedings of the 2019 IEEE 4th International Conference on Signal and Image Processing (ICSIP), Wuxi, China.10.1109/SIPROCESS.2019.8868439 ↗
26. Chang, W., Cheng, J., Allaire, J., Sievert, C., Schloerke, B., Xie, Y., Allen, J., McPherson, J., Dipert, A., and Borges, B. (2021). Shiny: Web Application Framework for R, R package version 1.7.1.
27. Wickham, H., Girlich, M., and Ruiz, E. (2022). Dbplyr: A ’Dplyr’ Back End for Databases, R package version 2.2.0.
28. Image quality assessment: From error visibility to structural similarity10.1109/TIP.2003.819861 ↗