Enhanced Plant Species Identification through Metadata Fusion and Vision Transformer Integration
Source abstract
Abstract
Accurate plant species classification is essential for many applications, such as biodiversity conservation, ecological research, and sustainable agricultural practices. Traditional morphological classification methods are inherently slow, labour-intensive, and prone to inaccuracies, especially when distinguishing between species exhibiting visual similarities or high intra-species variability. To address these limitations and to overcome the constraints of image-only approaches, we introduce a novel Artificial Intelligence-driven framework. This approach integrates robust Vision Transformer (ViT) models for advanced visual analysis with a multi-modal data fusion strategy, incorporating contextual metadata such as precise environmental conditions, geographic location, and phenological traits. This combination of visual and ecological cues significantly enhances classification accuracy and robustness, proving especially vital in complex, heterogeneous real-world environments. The proposed model achieves an impressive 97.27% of test accuracy, and Mean Reciprocal Rank (MRR) of 0.9842 that demonstrates strong generalization capabilities. Furthermore, efficient utilization of high-performance GPU resources (RTX 3090, 18 GB memory) ensures scalable processing of high-dimensional data. Comparative analysis consistently confirms that our metadata fusion approach substantially improves classification performance, particularly for morphologically similar species, and through principled self-supervised and transfer learning from ImageNet, the model adapts efficiently to new species, ensuring enhanced generalization. This comprehensive approach holds profound practical implications for precise conservation initiatives, rigorous ecological monitoring, and advanced agricultural management.
Source: openalex_inverted_index · Quality: baseline
Research context
OpenAlex topics: Smart Agriculture and AI
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
References (33)
Show source-provided references
1. Anderson · Plants, man, and life · 2005
2. The diversity of plant life: a comprehensive exploration of plant classification, taxonomy, and their roles in ecological balance10.25163/ahi.519950 ↗
3. PlantCLEF: a large-scale plant identification dataset for biodiversity research
4. iNaturalist: citizen science and AI for biodiversity research
5. Principles of data quality
6. Automated plant species identification—trends and future directions10.1371/journal.pcbi.1005993 ↗
7. Complex bioindication and environmental stress assessment
8. Future scenarios for plant phenotyping10.1146/annurev-arplant-050312-120137 ↗
9. Assessing the relevance of herbarium collections as tools for conservation biology10.1007/s12229-017-9188-z ↗
10. Haider · Wild plants: identification, uses and conservation · 2011 · 1
11. Simplifying VGG-16 for plant species identification10.1109/TLA.2022.9904757 ↗
12. Using deep learning for image-based plant disease detection10.3389/fpls.2016.01419 ↗
13. Integrated leaf disease recognition across diverse crops through transfer learning10.1016/j.procs.2024.03.192 ↗
14. Machine learning techniques in plant conditions classification and observation
15. Zhang · Genomics · 2024 · 15 · 444
16. Random erasing data augmentation
17. Multi-feature machine learning model for automatic segmentation of green fractional vegetation cover for high-throughput field phenotyping10.1186/s13007-017-0253-8 ↗
18. Deep learning and citizen science enable automated plant trait predictions from photographs10.1038/s41598-021-95616-0 ↗
19. An image is worth 16 × 16 words: transformers for image recognition at scale
20. Deep residual learning for image recognition
21. LeafSnap: a leaf image dataset for automatic plant identification
22. Goëau · LifeCLEF plant identification task 2015 · 2015 · 1391
23. Han · The morgan kaufmann series in data management systems · 2012 · 633
24. Inference and missing data10.1093/biomet/63.3.581 ↗
25. SMOTE: synthetic minority over-sampling technique10.1613/jair.953 ↗
26. Zauner C. Implementation and benchmarking of perceptual image hash functions [master’s thesis]. Austria: Upper Austria University of Applied Sciences, Hagenberg Campus; 2010.
27. ImageNet classification with deep convolutional neural networks
28. A new typology design of performance metrics to measure errors in machine learning regression algorithms
29. Goodfellow · Deep learning · 2016
30. Adam: a method for stochastic optimization
31. A systematic analysis of performance measures for classification tasks10.1016/j.ipm.2009.03.002 ↗
32. Overview of PlantCLEF 2021: cross-domain plant identification
33. The t-SNE algorithm as a tool to improve the quality of reference data used in accurate mapping of heterogeneous non-forest vegetation10.3390/rs12010039 ↗