Small-Sample Ctenopharyngodon idella Disease Recognition via Dual-Stream Data Augmentation and Supervised Contrastive Learning
Source abstract
Abstract
Addressing the challenges of extreme sample scarcity, complex underwater optical environments, and significant variations in lesion scales in real-world aquaculture, this paper proposes a small-sample grass carp disease recognition method, namely Swin Transformer with Supervised Contrastive Learning (ST-SCL), integrating dual-stream data augmentation and supervised contrastive learning. First, a frequency-spatial dual-stream augmentation strategy is constructed. In the frequency domain, the Amplitude-Mix technique is introduced to simulate diverse lighting and turbidity styles by mixing background amplitude spectra, thereby enhancing environmental generalization. In the spatial domain, a pathology-mask-guided instance-level Copy-Paste strategy is employed to directionally expand scarce lesion samples and address data imbalance. Second, the Swin Transformer is adopted as the backbone network, leveraging its hierarchical shifted window attention mechanism to effectively capture multi-scale features, balancing the detection of tiny parasites and extensive superficial ulcerations. Finally, supervised contrastive learning is incorporated to maximize intra-class compactness and minimize inter-class separability within the feature space, effectively reducing overfitting inherent to small-sample learning. Experimental results demonstrate that the proposed method achieves a macro-average F1-score of 95.86% across six disease categories. Compared with mainstream models such as ResNet and ConvNeXt, the ST-SCL exhibits notable performance improvements and enhanced robustness in small-sample scenarios, offering a promising technical path for precise fish disease diagnosis in complex aquatic environments.
Source: crossref · Quality: baseline
Research context
OpenAlex topics: Water Quality Monitoring Technologies · Aquaculture disease management and microbiota · Advanced Neural Network Applications
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
Affiliations
School of Information, Shanghai Ocean University, Shanghai 201306, China
Funding
National Natural Science Foundation of China Youth Science Fund Project
References (35)
Show source-provided references
1. Aquaculture Industry in China: Current State, Challenges, and Outlook10.1080/10641262.2011.573597 ↗
2. The state of world fisheries and aquaculture (SOFIA) 2020 report
3. Improvement and Application of Genetic Resources of Grass Carp (Ctenopharyngodon idella)10.1016/j.repbre.2024.04.003 ↗
4. Vibriosis in fish: A review on disease development and prevention10.1002/aah.10045 ↗
5. Intelligent Fish Farm—The Future of Aquaculture10.1007/s10499-021-00773-8 ↗
6. Reliability of self-reported catch and effort data via a smartphone application in a multi-species recreational fishery10.1016/j.fishres.2025.107502 ↗
7. Honarmand Ebrahimi, S., Ossewaarde, M., and Need, A. (2021). Smart fishery: A systematic review and research agenda for sustainable fisheries in the age of AI. Sustainability, 13.10.3390/su13116037 ↗
8. YOLO-Fish: A robust fish detection model to detect fish in realistic underwater environment10.1016/j.ecoinf.2022.101847 ↗
9. Fish Disease Detection Using Image Based Machine Learning Technique in Aquaculture10.1016/j.jksuci.2021.05.003 ↗
10. Fish detection and species classification in underwater environments using deep learning with temporal information10.1016/j.ecoinf.2020.101088 ↗
11. Cubuk, E.D., Zoph, B., Mane, D., Vasudevan, V., and Le, Q.V. (2019, January 15–20). AutoAugment: Learning augmentation policies from data. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), Long Beach, CA, USA.10.1109/CVPR.2019.00020 ↗
12. Plant disease recognition in a low data scenario using few-shot learning10.1016/j.compag.2024.108812 ↗
13. Insights into the antiviral immunity against grass carp (Ctenopharyngodon idella) reovirus (GCRV) in grass carp10.1155/2015/670437 ↗
14. Mishra, S.S., Rakesh, D., Dhiman, M., Choudhary, P., Debbarma, J., Sahoo, S.N., and Mishra, C.K. (2017, January 18). Present status of fish disease management in aquaculture. Proceedings of the National Seminar on Emerging Diseases in Freshwater Aquaculture, Bhubaneswar, India.
15. Artificial intelligence for fish disease diagnosis and management: Innovations, challenges, and One Health implications
16. Carp erythrodermatitis (CE) due to an Aeromonas hydrophila infection. Casuistic and experimental results10.1111/j.1439-0450.1991.tb00860.x ↗
17. A review on pathogenicity of Aeromonas hydrophila and their mitigation through medicinal herbs in aquaculture10.1016/j.heliyon.2023.e14088 ↗
18. Lin, T.Y., Dollár, P., Girshick, R., He, K., Hariharan, B., and Belongie, S. (2017, January 21–26). Feature pyramid networks for object detection. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Honolulu, HI, USA.10.1109/CVPR.2017.106 ↗
19. Cherian, A.K., Venugopal, J., Abishek, R., and Jabbar, F. (2022, January 23–25). Survey on underwater image enhancement using deep learning. Proceedings of the 2022 International Conference on Computing, Communication, Security and Intelligent Systems (IC3SIS), Kochi, India.10.1109/IC3SIS54991.2022.9885529 ↗
20. Yang, Y., and Soatto, S. (2020, January 13–19). FDA: Fourier domain adaptation for semantic segmentation. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), Seattle, WA, USA.10.1109/CVPR42600.2020.00414 ↗
21. A survey on image data augmentation for deep learning10.1186/s40537-019-0197-0 ↗
22. The importance of phase in signals10.1109/PROC.1981.12022 ↗
23. Ghiasi, G., Cui, Y., Srinivas, A., Qian, R., Lin, T.Y., Cubuk, E.D., Le, Q.V., and Zoph, B. (2021, January 20–25). Simple Copy-Paste is a strong data augmentation method for instance segmentation. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), Nashville, TN, USA.10.1109/CVPR46437.2021.00294 ↗
24. Liu, Z., Lin, Y., Cao, Y., Hu, H., Wei, Y., Zhang, Z., Lin, S., and Guo, B. (2021, January 10–17). Swin Transformer: Hierarchical vision transformer using shifted windows. Proceedings of the IEEE/CVF International Conference on Computer Vision (ICCV), Montreal, QC, Canada.10.1109/ICCV48922.2021.00986 ↗
25. Chen, T., Kornblith, S., Norouzi, M., and Hinton, G.E. (2020, January 13–18). A simple framework for contrastive learning of visual representations. Proceedings of the 37th International Conference on Machine Learning (ICML), Virtual.
26. LabelMe: A database and web-based tool for image annotation10.1007/s11263-007-0090-8 ↗
27. Paszke, A., Gross, S., Massa, F., Lerer, A., Bradbury, J., Chanan, G., Killeen, T., Lin, Z., Gimelshein, N., and Antiga, L. (2019, January 8–14). PyTorch: An imperative style, high-performance deep learning library. Proceedings of the Advances in Neural Information Processing Systems 32 (NeurIPS), Vancouver, BC, Canada.
28. Deng, J., Dong, W., Socher, R., Li, L.J., Li, K., and Fei-Fei, L. (2009, January 20–25). ImageNet: A large-scale hierarchical image database. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Miami, FL, USA.10.1109/CVPR.2009.5206848 ↗
29. Loshchilov, I., and Hutter, F. (2019, January 6–9). Decoupled weight decay regularization. Proceedings of the International Conference on Learning Representations (ICLR), New Orleans, LA, USA.
30. He, K., Zhang, X., Ren, S., and Sun, J. (2016, January 27–30). Deep residual learning for image recognition. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Las Vegas, NV, USA.10.1109/CVPR.2016.90 ↗
31. Howard, A., Sandler, M., Chu, G., Chen, L.C., Chen, B., Tan, M., Wang, W., Zhu, Y., Pang, R., and Vasudevan, V. (November, January 27). Searching for MobileNetV3. Proceedings of the IEEE/CVF International Conference on Computer Vision (ICCV), Seoul, Republic of Korea.
32. Liu, Z., Mao, H., Wu, C.Y., Feichtenhofer, C., Darrell, T., and Xie, S. (2022, January 18–24). A ConvNet for the 2020s. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), New Orleans, LA, USA.10.1109/CVPR52688.2022.01167 ↗
33. Dosovitskiy, A., Beyer, L., Kolesnikov, A., Weissenborn, D., Zhai, X., Unterthiner, T., Dehghani, M., Minderer, M., Heigold, G., and Gelly, S. (2021, January 3–7). An image is worth 16 × 16 words: Transformers for image recognition at scale. Proceedings of the International Conference on Learning Representations (ICLR), Virtual.
34. Barman, U., Sarma, P., Rahman, M., Deka, V., Lahkar, S., Sharma, V., and Saikia, M.J. (2024). ViT-SmartAgri: Vision Transformer and smartphone-based plant disease detection for smart agriculture. Agronomy, 14.10.3390/agronomy14020327 ↗
35. Khosla, P., Teterwak, P., Wang, C., Sarna, A., Tian, Y., Isola, P., Maschinot, A., Liu, C., and Krishnan, D. (2020, January 6–12). Supervised contrastive learning. Proceedings of the Advances in Neural Information Processing Systems (NeurIPS), Online.