Diagnosis by SAM Linked to Machine Vision Systems in Olive Pitting Machines
Source abstract
Abstract
Computer Vision (CV) has proven to be a powerful tool for automation in agri-food industrial processes, offering high-precision solutions tailored to specific working conditions. Recent advancements in Artificial Neural Networks (ANNs) have revolutionized CV applications, enabling systems to autonomously learn and optimize tasks. However, ANN-based approaches often require complex development and lengthy training periods, making their implementation a challenge. In this study, we explore the use of the Segment Anything Model (SAM), a pre-trained neural network developed by META AI in 2023, as an alternative for industrial segmentation tasks in the table olive (Olea europaea L.) processing industry. SAM’s ability to segment objects regardless of scene composition makes it a promising tool to improve the efficiency of olive pitting machines (DRRs). These machines, widely employed in industrial processing, frequently experience mechanical inefficiencies, including the “boat error,” which arises when olives are improperly oriented, leading to defective pitting and pit splinter contamination. Our approach integrates SAM into n CV workflow to diagnose and quantify boat errors without designing or training an additional task-specific ANN. By analyzing the segmented images, we can determine both the percentage of boat errors and the size distribution of olives during transport. The results validate SAM as a feasible option for industrial segmentation, offering a simpler and more accessible solution compared to traditional ANN-based methods. Moreover, our statistical analysis reveals that improper calibration—manifested as size deviations from the nominal value—does not significantly increase boat error rates. This finding supports the adoption of complementary CV technologies to enhance olive pitting efficiency. Future work could investigate real-time integration and the combination of CV with electromechanical correction systems to fully automate and optimize the pitting process.
Source: crossref · Quality: baseline
Research context
OpenAlex topics: Industrial Vision Systems and Defect Detection · Image and Object Detection Techniques · Currency Recognition and Detection
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
Affiliations
Department of Aerospace Engineering and Fluid Mechanics, University of Seville, 41013 Seville, Spain
Department of Graphic Engineering, University of Seville, 41013 Seville, Spain
References (44)
Show source-provided references
1. Sun, D.W. (2016). Image Acquisition Systems. Computer Vision Technology for Food Quality Evaluation, Elsevier.
2. A Comprehensive Review of Machine Vision Systems and Artificial Intelligence Algorithms for the Detection and Harvesting of Agricultural Produce
3. Sun, D.W. (2016). Quality Evaluation of Citrus Fruits. Computer Vision Technology for Food Quality Evaluation, Elsevier.
4. González-Merino, R., Hidalgo-Fernández, R.E., Rodero, J., Sola-Guirado, R.R., and Sánchez-López, E. (2022). Postharvest Geometric Characterization of Table Olive Bruising from 3D. Agronomía, 12.10.3390/agronomy12112732 ↗
5. Cano-Marchal, P., Satorres-Martinez, S., Gómez-Ortega, J., and Gámez-García, J. (2021). Automatic System for the Detection of Defects on Olive Fruit in an Oil Mill. Appl. Sci., 11.10.3390/app11178167 ↗
6. Fish Inspection System Using a Parallel Neural Network Chip and the Image Knowledge Builder Application
7. Machine Learning-Based Detection and Sorting of Multiple Vegetables and Fruits10.1007/s12161-021-02086-1 ↗
8. Using Hyperspectral Imaging Technology and Machine Learning Algorithms for Assessing Internal Quality Parameters of Apple Fruits10.1016/j.chemolab.2022.104650 ↗
9. Lucas-Pascual, A., Madueño-Luna, A., Jódar-Lázaro, M., Molina-Martínez, J.M., Ruiz-Canales, A., Madueño-Luna, J.M., and Justicia Segovia, M. (2020). Analysis of the Functionality of the Feed Chain in Olive Pitting, Slicing and Stuffing Machines by IoT, Computer Vision and Neural Network Diagnosis. Sensors, 20.10.3390/s20051541 ↗
10. Deep Learning in Olive Pitting Machines by Computer Vision10.1016/j.compag.2020.105304 ↗
11. He, K., Gkioxari, G., Dollár, P., and Girshick, R. (2017, January 22–29). Mask R-CNN. Proceedings of the IEEE International Conference on Computer Vision (ICCV), Venice, Italy.10.1109/ICCV.2017.322 ↗
12. Xiao, F., Wang, H., Xu, Y., and Zhang, R. (2023). Fruit Recognition Based on Deep Learning for Automatic Harvesting: An Overview and Review. Agronomy, 13.10.3390/agronomy13061625 ↗
13. Ronneberger, O., Fischer, P., and Brox, T. (2015, January 5–9). U-Net: Convolutional Networks for Biomedical Image Segmentation. Proceedings of the Medical Image Computing and Computer-Assisted Intervention–MICCAI 2015: 18th International Conference, Munich, Germany.10.1007/978-3-319-24574-4_28 ↗
14. PSSCL: A Progressive Sample Selection Framework with Contrastive Loss for Noisy Labels10.1016/j.patcog.2024.111284 ↗
15. Zhang, Q., Jin, G., Zhu, Y., Wei, H., and Chen, Q. (2024). BPT-PLR: A Balanced Partitioning and Training Framework with Pseudo-Label Relaxed Contrastive Loss for Noisy Label Learning. Entropy, 26.10.3390/e26070589 ↗
16. (2023, December 16). Segment Anything. Available online: https://segment-anything.com/.
17. Kirillov, A., Mintun, E., Ravi, N., Mao, H., Rolland, C., Gustafson, L., Xiao, T., Whitehead, S., Berg, A.C., and Lo, W.Y. (2023, January 2–6). Segment Anything. Proceedings of the IEEE/CVF International Conference on Computer Vision, Paris, France.10.1109/ICCV51070.2023.00371 ↗
18. Li, Y., Wang, D., Yuan, C., Li, H., and Hu, J. (2023). Enhancing Agricultural Image Segmentation with an Agricultural Segment Anything Model Adapter. Sensors, 23.10.3390/s23187884 ↗
19. Gui, B.L., Bhardwaj, A., and Sam, L. (2024). Evaluating the Efficacy of Segment Anything Model for Delineating Agriculture and Urban Green Spaces in Multiresolution Aerial and Spaceborne Remote Sensing Images. Remote Sens., 16.10.3390/rs16020414 ↗
20. The Segment Anything Model (SAM) for Accelerating the Smart Farming Revolution10.1016/j.atech.2023.100367 ↗
21. Lucas Pascual, A. (2020). Improvements in the Control of Pitting, Slicing, and Stuffing Machines for Table Olives. [PhD Thesis, Universidad Politécnica de Cartagena].
22. Chen, L.-C., Zhu, Y., Papandreou, G., Schroff, F., and Adam, H. (2018, January 8–14). Encoder-Decoder with Atrous Separable Convolution for Semantic Image Segmentation. Proceedings of the ECCV, Munich, Germany.10.1007/978-3-030-01234-2_49 ↗
23. Li, Z., Yan, W., Jiang, Y., Zhang, Y., Wu, Y., Wang, K., and Kuang, Z. (2023). MobileSAM: High-Performance Efficient Segment Anything Model with a Mobile-Friendly Vision Transformer. arXiv.
24. Huang, L., Bozza, A., and Yi, J. (2024). YOLO-Prompt-SAM: Real-Time Detector-Guided Segmentation with the Segment Anything Model. arXiv.
25. Open-Vocabulary Industrial Inspection via Grounding DINO and Segment-Anything
26. Edge-Friendly Fruit Counting with Objectness-Aware CNN and MobileSAM Refinement
27. Li, X., Dong, H., and Chen, S. (2023). FastSAM: Towards Real-Time Segment Anything with 2% of SA-1B. arXiv.
28. Efficient Industrial Defect Segmentation via SAM Proposals and Lightweight CNN Refinement
29. New Technologies Applied to the Fine Manzanilla Olive Sector
30. Estrada-Cabezas, J.M. (2011). The Table Olive: Insights into Its Characteristics, Processing, and Quality, Diputación de Sevilla. Fundación para el Fomento y la Promoción de la Aceituna de Mesa.
31. Elaboration of Table Olives10.3989/gya.2006.v57.i1.24 ↗
32. New Trends on the Alkaline Treatment ‘Cocido’ of Spanish or Sevillian Style Green Table Olives10.3989/gya.2008.v59.i3.509 ↗
33. OFM Food Machinery (2023). PSL-51 Pitting–Slicing Machine, OFM Food Machinery. Available online: https://www.calameo.com/books/00680291585f67faef3b2.
34. The Imaging Source (2024). DFK 33GV024 GigE Color Industrial Camera—Product Page, The Imaging Source Europe GmbH. Available online: https://www.theimagingsource.com/en-us/product/industrial/33g/dfk33gv024/.
35. Toshiba Teli Corporation (2024). SPS02 Smart Photo Sensor. Technical Catalogue, Toshiba Teli Corporation. Available online: https://pdf.directindustry.com/pdf/toshiba-teli-corporation/sps02/194093-734362.html.
36. Sun, D.W. (2016). Quality Evaluation of Strawberry. Computer Vision Technology for Food Quality Evaluation, Elsevier.
37. Sun, D.W. (2016). Classification and Quality Evaluation of Table Olives. Computer Vision Technology for Food Quality Evaluation, Elsevier.
38. Villanueva, L., Madueño-Luna, A., and Madueño-Luna, J.M. (2025). Google Colab_SAM_MATLAB Software, Dropbox. Available online: https://www.dropbox.com/scl/fo/yzemoxh60yvolipkqxz4c/AFplU8x36kgFnsAN4YpCOKA?dl=0.
39. (2015). Statistical Methods for Use in Proficiency Testing by Interlaboratory Comparison (Standard No. ISO 13528:2015).
40. Gandul, L.V., Madueño-Luna, A., Madueño-Luna, J.M., López-Gordillo, M.C., and González-Ortega, M.J. (2025). Development of a Computer Vision-Based Method for Sizing and Boat Error Assessment in Olive Pitting Machines. Appl. Sci., 15.10.3390/app15126648 ↗
41. Ma, L., Sun, K., Tu, K., Pan, L., and Zhang, W. (2017). Identification of Double-Yolked Duck Egg Using Computer Vision. PLoS ONE, 12.10.1371/journal.pone.0190054 ↗
42. Leveraging Deep Learning Techniques to Obtain Efficacious Segmentation Results10.47852/bonviewAAES32021220 ↗
43. A Digital Twin Development Framework for an Electrical Submersible Pump (ESP)10.47852/bonviewAAES42022009 ↗
44. Zhou, S., Ma, S., Zhang, Y., Zhao, S., and Song, S. (2023). FastSAM: Real-time Segment Anything. arXiv.