Novel Approach in Vegetation Detection Using Multi-Scale Convolutional Neural Network
Source abstract
Abstract
Vegetation segmentation plays a crucial role in accurately monitoring and analyzing vegetation cover, growth patterns, and changes over time, which in turn contributes to environmental studies, land management, and assessing the impact of climate change. This study explores the potential of a multi-scale convolutional neural network (MSCNN) design for object classification, specifically focusing on vegetation detection. The MSCNN is designed to integrate multi-scale feature extraction and attention mechanisms, enabling the model to capture both fine and coarse vegetation patterns effectively. Moreover, the MSCNN architecture integrates multiple convolutional layers with varying kernel sizes (3 × 3, 5 × 5, and 7 × 7), enabling the model to extract features at different scales, which is vital for identifying diverse vegetation patterns across various landscapes. Vegetation detection is demonstrated using three diverse datasets: the CamVid dataset, the FloodNet dataset, and the multispectral RIT-18 dataset. These datasets present a range of challenges, including variations in illumination, the presence of shadows, occlusion, scale differences, and cluttered backgrounds, which are common in real-world scenarios. The MSCNN architecture allows for the integration of information from multiple scales, facilitating the detection of diverse vegetation types under varying conditions. The performance of the proposed MSCNN method is rigorously evaluated and compared against state-of-the-art techniques in the field. Comprehensive experiments showcase the effectiveness of the approach, highlighting its robustness in accurately segmenting and classifying vegetation even in complex environments. The results indicate that the MSCNN design significantly outperforms traditional methods, achieving a remarkable global accuracy and boundary F1 score (BF score) of up to 98%. This superior performance underscores the MSCNN’s capability to enhance vegetation detection in imagery, making it a promising tool for applications in environmental monitoring and land use management.
Source: crossref · Quality: baseline
Research context
OpenAlex topics: Smart Agriculture and AI · Remote Sensing in Agriculture · Remote-Sensing Image Classification
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
Affiliations
College of Information Technology, University of Bahrain, Sakhir P.O. Box 32038, Bahrain
References (23)
Show source-provided references
1. de Castro, A.I., Shi, Y., Maja, J.M., and Peña, J.M. (2021). UAVs for vegetation monitoring: Overview and recent scientific contributions. Remote Sens., 13.10.3390/rs13112139 ↗
2. Thermal infrared remote sensing of vegetation: Current status and perspectives
3. Ayhan, B., Kwan, C., Budavari, B., Kwan, L., Lu, Y., Perez, D., Li, J., Skarlatos, D., and Vlachos, M. (2020). Vegetation detection using deep learning and conventional methods. Remote Sens., 12.10.3390/rs12152502 ↗
4. Semantic object classes in video: A high-definition ground truth database10.1016/j.patrec.2008.04.005 ↗
5. Higher Order Textural Statistics for Object Segmentation in Unconstrained Environments10.12785/ijcds/140125 ↗
6. Chen, L.C., Papandreou, G., Schroff, F., and Adam, H. (2017). Rethinking Atrous Convolution for Semantic Image Segmentation. arXiv.
7. VegAnn, Vegetation Annotation of multi-crop RGB images acquired under diverse conditions for segmentation10.1038/s41597-023-02098-y ↗
8. Fast and robust object region segmentation with self-organized lattice Boltzmann based active contour method10.1117/1.JEI.33.4.043050 ↗
9. Chen, L., Zhu, Y., Papandreou, G., Schroff, F., and Adam, H. (2018). Encoder-Decoder with Atrous Separable Convolution for Semantic Image Segmentation. arXiv.10.1007/978-3-030-01234-2_49 ↗
10. Ronneberger, O., Fischer, P., and Brox, T. (2015, January 5–9). U-Net: Convolutional Networks for Biomedical Image Segmentation. Proceedings of the Medical Image Computing and Computer-Assisted Intervention—MICCAI 2015, Munich, Germany.10.1007/978-3-319-24574-4_28 ↗
11. Segnet: A deep convolutional encoder-decoder architecture for image segmentation10.1109/TPAMI.2016.2644615 ↗
12. Deep convolutional neural network for damaged vegetation segmentation from RGB images based on virtual NIR-channel estimation
13. A deep neural network combined CNN and GCN for remote sensing scene classification10.1109/JSTARS.2020.3011333 ↗
14. Review on Convolutional Neural Networks (CNN) in vegetation remote sensing10.1016/j.isprsjprs.2020.12.010 ↗
15. Crop classification based on G-CNN using multi-scale remote sensing images10.1080/2150704X.2024.2388848 ↗
16. A modified bidirectional long short-term memory neural network for rail vehicle suspension fault detection10.1080/00423114.2022.2158879 ↗
17. A physical–data-driven combined strategy for load identification of tire type rail transit vehicle10.1016/j.ress.2024.110493 ↗
18. Brostow, G.J., Shotton, J., Fauqueur, J., and Cipolla, R. (2008, January 12–18). Segmentation and Recognition Using Structure from Motion Point Clouds. Proceedings of the ECCV 2008, Marseille, France.10.1007/978-3-540-88682-2_5 ↗
19. Rahnemoonfar, M., Chowdhury, T., Sarkar, A., Varshney, D., Yari, M., and Murphy, R.R. (2020). FloodNet: A High Resolution Aerial Imagery Dataset for Post Flood Scene Understanding. arXiv.10.1109/ACCESS.2021.3090981 ↗
20. Kemker, R., Salvaggio, C., and Kanan, C. (2017). High-resolution multispectral dataset for semantic segmentation. arXiv.
21. Deep learning10.1038/nature14539 ↗
22. Vaswani, A., Shazeer, N., Parmar, N., Uszkoreit, J., Jones, L., Gomez, A.N., Kaiser, L., and Polosukhin, I. (2017). Attention is All You Need. arXiv.
23. Woo, S., Park, J., Lee, J.Y., and Kweon, I.S. (2018, January 8–14). Cbam: Convolutional block attention module. Proceedings of the European Conference on Computer Vision (ECCV), Munich, Germany.10.1007/978-3-030-01234-2_1 ↗