Contrastive Learning in Stock Keeping Unit Image Recognition
Source abstract
Abstract
Self-supervised contrastive learning has become an effective approach for visual representation learning when large-scale annotation is impractical. In this study, we evaluate three widely used methods—SimCLR, MoCo v2, and BYOL—for large-scale stock keeping unit (SKU) recognition in retail environments. Experiments are conducted on the RP2K benchmark and a domain-specific in-house dataset (InSKU) using both linear probing and full fine-tuning. Under the original RP2K configuration with extended self-supervised pre-training, SimCLR achieves the highest Top-1 accuracy under linear evaluation (94.98%). In contrast, BYOL attains the highest performance under full fine-tuning (99.22% Top-1 accuracy). After filtering and deduplicating the dataset to reduce class imbalance and near-duplicate samples, MoCo v2 achieves competitive, and in some cases superior, linear performance under a reduced training budget. Cross-domain evaluation on InSKU indicates that SimCLR generalises more effectively under frozen-encoder constraints, whereas BYOL and MoCo v2 require full adaptation. These results highlight the sensitivity of contrastive representations to dataset composition, optimisation regime, and domain shift, providing practical guidance for deployment in dynamic retail settings.
Source: crossref · Quality: baseline
Research context
OpenAlex topics: Multimodal Machine Learning Applications · Advanced Image and Video Retrieval Techniques · Advanced Neural Network Applications
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
Affiliations
Faculty of Electrical Engineering, Warsaw University of Technology, Pl. Politechniki 1, 00-661 Warsaw, Poland
Omniaz Sp. z o.o., 90-135 Łódź, Poland
Funding
National Centre for Research and Development
References (28)
Show source-provided references
1. Domain Invariant Hierarchical Embedding for Grocery Products Recognition10.1016/j.cviu.2019.03.005 ↗
2. Shelf Management: A Deep Learning-Based System for Shelf Visual Monitoring10.1016/j.eswa.2024.124635 ↗
3. A Review of Few-Shot Fine-Grained Image Classification10.1016/j.eswa.2025.127054 ↗
4. Kowalczyk, A., and Sarwas, G. (2024). One-Shot Learning from Prototype Stock Keeping Unit Images. Information, 15.10.3390/info15090526 ↗
5. A Simple Framework for Contrastive Learning of Visual Representations
6. He, K., Fan, H., Wu, Y., Xie, S., and Girshick, R. (2020). Momentum Contrast for Unsupervised Visual Representation Learning. arXiv.10.1109/CVPR42600.2020.00975 ↗
7. Bootstrap Your Own Latent—A New Approach to Self-Supervised Learning
8. Deng, J., Dong, W., Socher, R., Li, L.J., Li, K., and Fei-Fei, L. (2009, January 20–25). ImageNet: A Large-Scale Hierarchical Image Database. Proceedings of the Conference on Computer Vision and Pattern Recognition, Miami, FL, USA.10.1109/CVPR.2009.5206848 ↗
9. Chen, X., Fan, H., Girshick, R.B., and He, K. (2020). Improved Baselines with Momentum Contrastive Learning. arXiv.
10. Peng, J., Xiao, C., and Li, Y. (2021). RP2K: A Large-Scale Retail Product Dataset for Fine-Grained Image Classification. arXiv.
11. Distance Metric Learning for Large Margin Nearest Neighbor Classification
12. Signature Verification Using a “Siamese” Time Delay Neural Network
13. van den Oord, A., Li, Y., and Vinyals, O. (2019). Representation Learning with Contrastive Predictive Coding. arXiv.
14. Chen, X., and He, K. (2021, January 20–25). Exploring Simple Siamese Representation Learning. Proceedings of the Conference on Computer Vision and Pattern Recognition, Nashville, TN, USA.10.1109/CVPR46437.2021.01549 ↗
15. Barlow Twins: Self-Supervised Learning via Redundancy Reduction
16. Bardes, A., Ponce, J., and Lecun, Y. (2022, January 25–29). VICReg: Variance-Invariance-Covariance Regularization for Self-Supervised Learning. Proceedings of the International Conference on Learning Representations, Online.
17. A Survey on Self-Supervised Learning: Algorithms, Applications, and Future Trends10.1109/TPAMI.2024.3415112 ↗
18. Kornblith, S., Shlens, J., and Le, Q.V. (2019, January 15–20). Do Better ImageNet Models Transfer Better?. Proceedings of the Conference on Computer Vision and Pattern Recognition, Long Beach, CA, USA.10.1109/CVPR.2019.00277 ↗
19. Understanding Contrastive Representation Learning through Alignment and Uniformity on the Hypersphere
20. Merler, M., Galleguillos, C., and Belongie, S. (2007, January 17–22). Recognizing Groceries in situ Using in vitro Training Data. Proceedings of the Conference on Computer Vision and Pattern Recognition, Minneapolis, MN, USA.10.1109/CVPR.2007.383486 ↗
21. Goldman, E., Herzig, R., Eisenschtat, A., Goldberger, J., and Hassner, T. (2019, January 16–20). Precise Detection in Densely Packed Scenes. Proceedings of the Conference on Computer Vision and Pattern Recognition, Long Beach, CA, USA.10.1109/CVPR.2019.00537 ↗
22. Tonioni, A., Serra, E., and Di Stefano, L. (2018, January 9–11). A Deep Learning Pipeline for Product Recognition on Store Shelves. Proceedings of the International Conference on Image Processing, Applications and Systems, Lyon, France.10.1109/IPAS.2018.8708890 ↗
23. RPC: A large-scale and fine-grained retail product checkout dataset10.1007/s11432-022-3513-y ↗
24. Deep Learning for Retail Product Recognition: Challenges and Techniques10.1155/2020/8875910 ↗
25. Movshovitz-Attias, Y., Toshev, A., Leung, T.K., Ioffe, S., and Singh, S. (2017, January 22–29). No Fuss Distance Metric Learning Using Proxies. Proceedings of the International Conference on Computer Vision, Venice, Italy.10.1109/ICCV.2017.47 ↗
26. A Deep Learning Framework for Grocery Product Detection and Recognition10.1007/s12161-022-02384-2 ↗
27. He, K., Zhang, X., Ren, S., and Sun, J. (2016, January 27–30). Deep Residual Learning for Image Recognition. Proceedings of the Conference on Computer Vision and Pattern Recognition, Las Vegas, NV, USA.10.1109/CVPR.2016.90 ↗
28. Caron, M., Touvron, H., Misra, I., Jegou, H., Mairal, J., Bojanowski, P., and Joulin, A. (2021, January 11–17). Emerging Properties in Self-Supervised Vision Transformers. Proceedings of the International Conference on Computer Vision, Montreal, BC, Canada.10.1109/ICCV48922.2021.00951 ↗