TSINet: A Semantic and Instance Segmentation Network for 3D Tomato Plant Point Clouds
Source abstract
Abstract
Accurate organ-level segmentation is essential for achieving high-throughput, non-destructive, and automated plant phenotyping. To address the challenge of intelligent acquisition of phenotypic parameters in tomato plants, we propose TSINet, an end-to-end dual-task segmentation network designed for effective and precise semantic labeling and instance recognition of tomato point clouds, based on the Pheno4D dataset. TSINet adopts an encoder–decoder architecture, where a shared encoder incorporates four Geometry-Aware Adaptive Feature Extraction Blocks (GAFEBs) to effectively capture local structures and geometric relationships in raw point clouds. Two parallel decoder branches are employed to independently decode shared high-level features for the respective segmentation tasks. Additionally, a Dual Attention-Based Feature Enhancement Module (DAFEM) is introduced to further enrich feature representations. The experimental results demonstrate that TSINet achieves superior performance in both semantic and instance segmentation, particularly excelling in challenging categories such as stems and large-scale instances. Specifically, TSINet achieves 97.00% mean precision, 96.17% recall, 96.57% F1-score, and 93.43% IoU in semantic segmentation and 81.54% mPrec, 81.69% mRec, 81.60% mCov, and 86.40% mWCov in instance segmentation. Compared with state-of-the-art methods, TSINet achieves balanced improvements across all metrics, significantly reducing false positives and false negatives while enhancing spatial completeness and segmentation accuracy. Furthermore, we conducted ablation studies and generalization tests to systematically validate the effectiveness of each TSINet component and the overall robustness of the model. This study provides an effective technological approach for high-throughput automated phenotyping of tomato plants, contributing to the advancement of intelligent agricultural management.
Source: crossref · Quality: baseline
Research context
OpenAlex topics: Smart Agriculture and AI · Remote Sensing and LiDAR Applications · Remote Sensing in Agriculture
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
Affiliations
College of Information Science and Engineering, Shandong Agricultural University, Taian 271018, China
Funding
National Natural Science Foundation of China · Shandong Province College Student Innovation and Entrepreneurship Training Program
References (30)
Show source-provided references
1. Roohanitaziani, R., De Maagd, R.A., Lammers, M., Molthoff, J., Meijer-Dekens, F., Van Kaauwen, M.P.W., Finkers, R., Tikunov, Y., Visser, R.G.F., and Bovy, A.G. (2020). Exploration of a Resequenced Tomato Core Collection for Phenotypic and Genotypic Variation in Plant Growth and Fruit Quality Traits. Genes, 11.10.3390/genes11111278 ↗
2. Tomato (Solanum lycopersicum L.) Seed: A Review on Bioactives and Biomedical Activities10.1016/j.biopha.2021.112018 ↗
3. Tomato Responses to Salinity Stress: From Morphological Traits to Genetic Changes10.3389/fpls.2023.1118383 ↗
4. Deep Learning in Image-Based Plant Phenotyping10.1146/annurev-arplant-070523-042828 ↗
5. Segmentation of Tomato Leaf Images Based on Adaptive Clustering Number of K-Means Algorithm10.1016/j.compag.2019.104962 ↗
6. Ivanovska, M., Struc, V., and Pers, J. (2023, January 23–25). TomatoDIFF: On-Plant Tomato Segmentation with Denoising Diffusion Models. Proceedings of the 18th International Conference on Machine Vision and Applications (MVA), Hamamatsu, Japan.10.23919/MVA57639.2023.10215774 ↗
7. Niu, Z., Huang, T., Xu, C., Sun, X., Taha, M.F., He, Y., and Qiu, Z. (2025). A Novel Approach to Optimize Key Limitations of Azure Kinect DK for Efficient and Precise Leaf Area Measurement. Agriculture, 15.10.3390/agriculture15020173 ↗
8. Automatic Stem-Leaf Segmentation of Maize Shoots Using Three-Dimensional Point Cloud10.1016/j.compag.2021.106310 ↗
9. Liang, X., Yu, W., Qin, L., Wang, J., Jia, P., Liu, Q., Lei, X., and Yang, M. (2025). Stem and Leaf Segmentation and Phenotypic Parameter Extraction of Tomato Seedlings Based on 3D Point. Agronomy, 15.10.3390/agronomy15010120 ↗
10. Xing, Y., Pham, D., Williams, H., Smith, D., Ahn, H.S., Lim, J., MacDonald, B.A., and Nejati, M. (2023). Look How They Have Grown: Non-Destructive Leaf Detection and Size Estimation of Tomato Plants for 3D Growth Monitoring. arXiv.
11. Plant Stem and Leaf Segmentation and Phenotypic Parameter Extraction Using Neural Radiance Fields and Lightweight Point Cloud Segmentation Networks10.3389/fpls.2025.1491170 ↗
12. Sun, Y., Guo, X., and Yang, H. (2023). Win-Former: Window-Based Transformer for Maize Plant Point Cloud Semantic Segmentation. Agronomy, 13.10.3390/agronomy13112723 ↗
13. Zhang, L., Huang, Z., Yang, Z., Yang, B., Yu, S., Zhao, S., Zhang, X., Li, X., Yang, H., and Lin, Y. (2025). Tomato Stem and Leaf Segmentation and Phenotype Parameter Extraction Based on Improved Red Billed Blue Magpie Optimization Algorithm. Agriculture, 15.10.3390/agriculture15020180 ↗
14. Stem–Leaf Segmentation and Phenotypic Trait Extraction of Individual Plant Using a Precise and Efficient Point Cloud Segmentation Network10.1016/j.compag.2024.108839 ↗
15. Maize Stem–Leaf Segmentation Framework Based on Deformable Point Clouds10.1016/j.isprsjprs.2024.03.025 ↗
16. Automatic Acquisition, Analysis and Wilting Measurement of Cotton 3D Phenotype Based on Point Cloud10.1016/j.biosystemseng.2024.02.010 ↗
17. FACNet: A High-Precision Pumpkin Seedling Point Cloud Organ Segmentation Method10.1016/j.compag.2025.110049 ↗
18. Facility of Tomato Plant Organ Segmentation and Phenotypic Trait Extraction via Deep Learning10.1016/j.compag.2025.109957 ↗
19. Organ Segmentation and Phenotypic Information Extraction of Cotton Point Clouds Based on the CotSegNet Network and Machine Learning10.1016/j.compag.2025.110466 ↗
20. Automated 3D Segmentation of Plant Organs via the Plant-MAE: A Self-Supervised Learning Framework10.1016/j.plaphe.2025.100049 ↗
21. A Cotton Organ Segmentation Method with Phenotypic Measurements from a Point Cloud Using a Transformer10.1186/s13007-025-01357-w ↗
22. Automatic 3D Plant Organ Instance Segmentation Method Based on PointNeXt and Quickshift++10.1016/j.plaphe.2025.100065 ↗
23. Pheno4D: A Spatio-Temporal Dataset of Maize and Tomato Plant Point Clouds for Phenotyping and Advanced Plant Analysis10.1371/journal.pone.0256340 ↗
24. Qi, C.R., Yi, L., Su, H., and Guibas, L.J. (2017). PointNet++: Deep Hierarchical Feature Learning on Point Sets in a Metric Space. arXiv.
25. Mean Shift: A Robust Approach toward Feature Space Analysis10.1109/34.1000236 ↗
26. Wang, Y., Sun, Y., Liu, Z., Sarma, S.E., Bronstein, M.M., and Solomon, J.M. (2019). Dynamic Graph CNN for Learning on Point Clouds, ACM Transactions on Graphics (tog).10.1145/3326362 ↗
27. Xu, M., Ding, R., Zhao, H., and Qi, X. (2021, January 20–25). PAConv: Position Adaptive Convolution with Dynamic Kernel Assembling on Point Clouds. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, Nashville, TN, USA.10.1109/CVPR46437.2021.00319 ↗
28. Qi, C.R., Su, H., Mo, K., and Guibas, L.J. (2017, January 21–26). PointNet: Deep Learning on Point Sets for 3D Classification and Segmentation. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Honolulu, HI, USA.
29. Wang, X., Liu, S., Shen, X., Shen, C., and Jia, J. (2019, January 15–20). Associatively Segmenting Instances and Semantics in Point Clouds. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, Long Beach, CA, USA.10.1109/CVPR.2019.00422 ↗
30. JSNet: Joint Instance and Semantic Segmentation of 3D Point Clouds10.1609/aaai.v34i07.6994 ↗