journal article·2025-06-10Open access

LAAVOS: A DeAOT-Based Approach for Medaka Larval Ventricular Video Segmentation

Kai Rao, Minghao Wang, Shutan Xu

Applied Sciences· Volume 15· Issue 12

Abstract

Accurate segmentation of the ventricular region in embryonic heart videos of medaka fish (Oryzias latipes) holds significant scientific value for research on heart development mechanisms. However, existing medaka ventricular datasets are overly simplistic and fail to meet practical application requirements. And the video frames contain multiple complex interfering factors, including optical interference from the filming environment, dynamic color changes caused by blood flow, significant diversity in ventricular scales, image blurring in certain video frames, high similarity in organ structures, and indistinct boundaries between the ventricles and atria. These challenges mean existing methods still face notable technical difficulties in medaka embryonic ventricular segmentation tasks. To address these challenges, this study first constructs a medaka embryonic ventricular video dataset containing 4200 frames with pixel-level annotations. Building upon this, we propose a semi-supervised video segmentation model based on the hierarchical propagation feature decoupling framework (DeAOT) and innovatively design an architecture that combines the LA-ResNet encoder with the AFPViS decoder, significantly improving the accuracy of medaka ventricular segmentation. Experimental results demonstrate that, compared to the traditional U-Net model, our method achieves a 13.48% improvement in the mean Intersection over Union (mIoU) metric. Additionally, compared to the state-of-the-art DeAOT method, it achieves a notable 4.83% enhancement in the comprehensive evaluation metric Jaccard and F-measure (J&F), providing reliable technical support for research on embryonic heart development.
Source: crossref · Quality: baseline

Research context

OpenAlex topics: Digital Imaging for Blood Diseases · Smart Agriculture and AI · Advanced Neural Network Applications

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

College of Information Technology, Shanghai Ocean University, Hucheng Ring Road 999, Shanghai 201306, China

References (23)

Show source-provided references
1. Medaka—A model organism from the far East10.1038/nrg704 ↗
2. Wang, J., and Cao, H. (2021). Zebrafish and Medaka: Important animal models for human neurodegenerative diseases. Int. J. Mol. Sci., 22.10.3390/ijms221910766 ↗
3. Naderi, A.M., Bu, H., Su, J., Huang, M.H., Vo, K., Torres, R.S.T., Chiao, J.-C., Lee, J., Lau, M.P.H., and Xu, X. (2021). Deep learning-based framework for cardiac function assessment in embryonic zebrafish from heart beating videos. Comput. Biol. Med., 135.10.1016/j.compbiomed.2021.104565 ↗
4. Deep learning enables automated volumetric assessments of cardiac function in zebrafish10.1242/dmm.040188 ↗
5. Ronneberger, O., Fischer, P., and Brox, T. (2015, January 5–9). U-Net: Convolutional Networks for Biomedical Image Segmentation. Proceedings of the Medical Image Computing and Computer-Assisted Intervention–MICCAI 2015: 18th International Conference, Munich, Germany.10.1007/978-3-319-24574-4_28 ↗
6. Machine Learning Methods for Automated Quantification of Ventricular Dimensions10.1089/zeb.2019.1754 ↗
7. Zeng, K., Xu, S., Shu, D., and Chen, M. (2024). STAVOS: A Medaka Larval Cardiac Video Segmentation Method Based on Deep Learning. Appl. Sci., 14.10.3390/app14031239 ↗
8. Deep learning for video object segmentation: A review10.1007/s10462-022-10176-7 ↗
9. Vaswani, A., Shazeer, N., Parmar, N., Uszkoreit, J., Jones, L., Gomez, A.N., Kaiser, L., and Polosukhin, I. (2017). Attention is all you need. NIPS’17, Proceedings of the 31st International Conference on Neural Information Processing Systems, Long Beach, CA, USA, 4–9 December 2017, Curran Associates Inc.. Advances in neural information processing systems 30.
10. He, K., Zhang, X., Ren, S., and Sun, J. (2016, January 27–30). Deep residual learning for image recognition. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Las Vegas, NV, USA.10.1109/CVPR.2016.90 ↗
11. Wang, Y., Li, Y., Wang, G., and Liu, X. (2024, January 8–12). PlainUSR: Chasing faster ConvNet for efficient super-resolution. Proceedings of the 17th Asian Conference on Computer Vision, Hanoi, Vietnam.10.1007/978-981-96-0911-6_15 ↗
12. Liu, J., Zhang, W., Tang, Y., Tang, J., and Wu, G. (2020, January 13–19). Residual feature aggregation network for image super-resolution. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, Seattle, WA, USA.10.1109/CVPR42600.2020.00243 ↗
13. Liang, J., Cao, J., Sun, G., Zhang, K., Gool, L.V., and Timofte, R. (2021, January 10–17). Swinir: Image restoration using swin transformer. Proceedings of the 2021 IEEE/CVF International Conference on Computer Vision Workshops (ICCVW), Montreal, QC, Canada.10.1109/ICCVW54120.2021.00210 ↗
14. Lu, H., Poppe, R., and Salah, A.A. (2023, January 10–14). LA-layer: General local attention layer for full attention networks. Proceedings of the 2023 IEEE International Conference on Multimedia and Expo (ICME), Brisbane, Australia.10.1109/ICME55011.2023.00352 ↗
15. Stergiou, A., Poppe, R., and Kalliatakis, G. (2021, January 10–17). Refining activation downsampling with SoftPool. Proceedings of the IEEE/CVF International Conference on Computer Vision, Montreal, QC, Canada.10.1109/ICCV48922.2021.01019 ↗
16. Dauphin, Y.N., Fan, A., Auli, M., and Grangier, D. (2017., January 6–11). Language modeling with gated convolutional networks. Proceedings of the 34th International Conference on Machine Learning, Sydney, Australia.
17. Wang, Y., Li, Y., Wang, G., and Liu, X. (2024, January 17–18). Multi-Scale attention network for single image super-resolution. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, Seattle, WA, USA.10.1109/CVPRW63382.2024.00602 ↗
18. Lin, T.-Y., Dollár, P., Girshick, R., He, K., Hariharan, B., and Belongie, S. (2017, January 21–26). Feature pyramid networks for object detection. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Honolulu, HI, USA.10.1109/CVPR.2017.106 ↗
19. Yang, G., Lei, J., Zhu, Z., Cheng, S., Feng, Z., and Liang, R. (2023). Afpn: Asymptotic feature pyramid network for object detection. arXiv.10.1109/SMC53992.2023.10394415 ↗
20. Liu, S., Huang, D., and Wang, Y. (2019). Learning spatial fusion for single-shot object detection. arXiv.
21. Cho, S., Lee, H., Lee, M., Park, C., Jang, S., Kim, M., and Lee, S. (2022, January 23–27). Tackling background distraction in video object segmentation. Proceedings of the 17th European Conference, Tel Aviv, Israel.10.1007/978-3-031-20047-2_26 ↗
22. Sandler, M., Howard, A., Zhu, M., Zhmoginov, A., and Chen, L. (2018, January 18–23). MobileNetV2: Inverted Residuals and Linear Bottlenecks. Proceedings of the 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition, Salt Lake City, UT, USA.10.1109/CVPR.2018.00474 ↗
23. Liu, Z., Lin, Y., Cao, Y., Hu, H., Wei, Y., Zhang, Z., Lin, S., and Guo, B. (2021, January 10–17). Swin transformer: Hierarchical vision transformer using shifted windows. Proceedings of the 2021 IEEE/CVF International Conference on Computer Vision (ICCV), Montreal, QC, Canada.10.1109/ICCV48922.2021.00986 ↗