Multi-Scale Localization Grouping Weighted Weakly Supervised Video Instance Segmentation and Air Cruiser Application
Source abstract
Abstract
Implementing video instance segmentation (VIS) to detect, segment, and track targets based on vision system is important research for air cruiser. Large data with high sampling difficulty result in inefficient network training and limit the air cruisers in adapting to natural scenes during mission. A multi-scale localization grouping weighted weakly supervised VIS (MLGW-VIS) is proposed. Firstly, a spatial information refinement module is designed to supplement the multi-scale spatial location information of the high-level features of the feature pyramid. Secondly, feature interaction among the channels in each sub-space of mask features is strengthened by grouping weighting module. Thirdly, projection and color similarity loss are introduced to achieve weak supervised learning. The experimental results on the data from YouTube-VIS 2019 show that MLGW-VIS has increased the average segmentation accuracy by 5.7% and reached 37.9%, and has achieved positive effects on the perception and location accuracy of objects on the air cruiser platform.
Source: crossref · Quality: baseline
Research context
OpenAlex topics: Advanced Neural Network Applications · Advanced Vision and Imaging · Advanced Image Processing Techniques
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
Affiliations
Faculty of Mechanical and Electrical Engineering, Kunming University of Science and Technology, Kunming 650500, China
Funding
National Natural Science Foundation of China · Key Laboratory of Intelligent Application of Equipment of the Ministry of Education for ground time-sensitive target location technology based on multi-cruiser cooperative detection
References (37)
Show source-provided references
1. Liu, X., Liu, W., and Wu, A. (2025). Design of a Lung Lesion Target Detection Algorithm Based on a Domain-Adaptive Neural Network Model. Appl. Sci., 15.10.3390/app15052625 ↗
2. Multi-level similarity transfer and adaptive fusion data augmentation for few-shot object detection10.1016/j.jvcir.2024.104340 ↗
3. M-YOLOv8s: An improved small target detection algorithm for UAV aerial photography10.1016/j.jvcir.2024.104289 ↗
4. Hwang, D., Kim, J.J., Moon, S., and Wang, S. (2025). Image Augmentation Approaches for Building Dimension Estimation in Street View Images Using Object Detection and Instance Segmentation Based on Deep Learning. Appl. Sci., 15.10.3390/app15052525 ↗
5. Fedon Vocaturo, M., Altabella, L., Cardano, G., Montemezzi, S., and Cavedon, C. (2025). Unsupervised Learning Techniques for Breast Lesion Segmentation on MRI Images: Are We Ready for Automation?. Appl. Sci., 15.10.3390/app15052401 ↗
6. Information entropy induced graph convolutional network for semantic segmentation10.1016/j.jvcir.2024.104217 ↗
7. BSNet: A bilateral real-time semantic segmentation network based on multi-scale receptive fields10.1016/j.jvcir.2024.104188 ↗
8. Bayraktar, E. (2025). ReTrackVLM: Transformer-Enhanced Multi-Object Tracking with Cross-Modal Embeddings and Zero-Shot Re-Identification Integration. Appl. Sci., 15.10.3390/app15041907 ↗
9. Cheng, X., Zhao, H., Deng, Y., and Shen, S. (2025). Multi-Object Tracking with Predictive Information Fusion and Adaptive Measurement Noise. Appl. Sci., 15.10.3390/app15020736 ↗
10. UAT:Unsupervised object tracking based on graph attention information embedding10.1016/j.jvcir.2024.104283 ↗
11. He, K., Gkioxari, G., Dollár, P., and Girshick, R. (2017, January 22–29). Mask R-CNN. Proceedings of the 2017 IEEE International Conference on Computer Vision (ICCV), Venice, Italy.10.1109/ICCV.2017.322 ↗
12. Feng, Q., Yang, Z., Li, P., Wei, Y., and Yang, Y. (2019, January 27–28). Dual Embedding Learning for Video Instance Segmentation. Proceedings of the 2019 IEEE/CVF International Conference on Computer Vision Workshop (ICCVW), Seoul, Republic of Korea.10.1109/ICCVW.2019.00090 ↗
13. Wang, Q., He, Y., Yang, X., Yang, Z., and Torr, P. (2019, January 27–28). An Empirical Study of Detection-Based Video Instance Segmentation. Proceedings of the 2019 IEEE/CVF International Conference on Computer Vision Workshop (ICCVW), Seoul, Republic of Korea.10.1109/ICCVW.2019.00089 ↗
14. Liu, X., Ren, H., and Ye, T. (2019, January 27–28). Spatio-Temporal Attention Network for Video Instance Segmentation. Proceedings of the 2019 IEEE/CVF International Conference on Computer Vision Workshop (ICCVW), Seoul, Republic of Korea.10.1109/ICCVW.2019.00092 ↗
15. Dong, M., Wang, J., Huang, Y., Yu, D., Su, K., Zhou, K., Shao, J., Wen, S., and Wang, C. (2019, January 27–28). Temporal Feature Augmented Network for Video Instance Segmentation. Proceedings of the 2019 IEEE/CVF International Conference on Computer Vision Workshop (ICCVW), Seoul, Republic of Korea.10.1109/ICCVW.2019.00091 ↗
16. Cao, J., Anwer, R.M., Cholakkal, H., Khan, F.S., Pang, Y., and Shao, L. (2020, January 23–28). SipMask: Spatial Information Preservation for Fast Image and Video Instance Segmentation. Proceedings of the ECCV, Glasgow, UK.10.1007/978-3-030-58568-6_1 ↗
17. Fu, Y., Yang, L., Liu, D., Huang, T.S., and Shi, H. (2020). CompFeat: Comprehensive Feature Aggregation for Video Instance Segmentation. arXiv.10.1609/aaai.v35i2.16225 ↗
18. Lin, C.C., Hung, Y., Feris, R., and He, L. (2020, January 13–19). Video Instance Segmentation Tracking With a Modified VAE Architecture. Proceedings of the 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), Seattle, WA, USA.10.1109/CVPR42600.2020.01316 ↗
19. Liu, D., Cui, Y., Tan, W., and Chen, Y. (2021). SG-Net: Spatial Granularity Network for One-Stage Video Instance Segmentation. arXiv.10.1109/CVPR46437.2021.00969 ↗
20. Liu, H., Rivera Soto, R.A., Xiao, F., and Lee, Y.J. (June, January 30). YolactEdge: Real-time Instance Segmentation on the Edge. Proceedings of the 2021 IEEE International Conference on Robotics and Automation (ICRA), Xi’an, China.10.1109/ICRA48506.2021.9561858 ↗
21. Carion, N., Massa, F., Synnaeve, G., Usunier, N., Kirillov, A., and Zagoruyko, S. (2020, January 23–28). End-to-End Object Detection with Transformers. Proceedings of the ECCV, Glasgow, UK.10.1007/978-3-030-58452-8_13 ↗
22. Wang, Y., Xu, Z., Wang, X., Shen, C., Cheng, B., Shen, H., and Xia, H. (2021, January 20–25). End-to-End Video Instance Segmentation with Transformers. Proceedings of the 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), Nashville, TN, USA.10.1109/CVPR46437.2021.00863 ↗
23. Wu, J., Jiang, Y., Bai, S., Zhang, W., and Bai, X. (2022, January 23–27). SeqFormer: Sequential Transformer for Video Instance Segmentation. Proceedings of the ECCV, Tel Aviv, Israel.10.1007/978-3-031-19815-1_32 ↗
24. Cheng, B., Misra, I., Schwing, A.G., Kirillov, A., and Girdhar, R. (2022, January 18–24). Masked-attention Mask Transformer for Universal Image Segmentation. Proceedings of the 2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), New Orleans, LA, USA.10.1109/CVPR52688.2022.00135 ↗
25. Vaswani, A., Shazeer, N., Parmar, N., Uszkoreit, J., Jones, L., Gomez, A.N., Kaiser, L., and Polosukhin, I. (2017, January 4–9). Attention is All You Need. Proceedings of the NeurIPS, Long Beach, CA, USA.
26. Yang, S., Fang, Y., Wang, X., Li, Y., Fang, C., Shan, Y., Feng, B., and Liu, W. (2021, January 10–17). Crossover Learning for Fast Online Video Instance Segmentation. Proceedings of the 2021 IEEE/CVF International Conference on Computer Vision (ICCV), Montreal, QC, Canada.10.1109/ICCV48922.2021.00794 ↗
27. Tian, Z., Shen, C., and Chen, H. (2020, January 23–28). Conditional Convolutions for Instance Segmentation. Proceedings of the ECCV, Glasgow, UK.10.1007/978-3-030-58452-8_17 ↗
28. Zhou, B., Khosla, A., Lapedriza, A., Oliva, A., and Torralba, A. (2016, January 27–30). Learning Deep Features for Discriminative Localization. Proceedings of the 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Las Vegas, NV, USA.10.1109/CVPR.2016.319 ↗
29. Ahn, J., Cho, S., and Kwak, S. (2019, January 15–20). Weakly supervised learning of instance segmentation with inter-pixel relations. Proceedings of the 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), Long Beach, CA, USA.10.1109/CVPR.2019.00231 ↗
30. Liu, Q., Ramanathan, V., Mahajan, D., Yuille, A., and Yang, Z. (2021, January 20–25). Weakly Supervised Instance Segmentation for Videos with Temporal Mask Consistency. Proceedings of the 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), Nashville, TN, USA.10.1109/CVPR46437.2021.01375 ↗
31. Solve the Puzzle of Instance Segmentation in Videos: A Weakly Supervised Framework With Spatio-Temporal Collaboration10.1109/TCSVT.2022.3202574 ↗
32. Tian, Z., Shen, C., Wang, X., and Chen, H. (2021, January 20–25). BoxInst: High-Performance Instance Segmentation With Box Annotations. Proceedings of the 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), Nashville, TN, USA.10.1109/CVPR46437.2021.00540 ↗
33. Wang, X., Feng, J., Hu, B., Ding, Q., Ran, L., Chen, X., and Liu, W. (2021, January 20–25). Weakly-supervised Instance Segmentation via Class-agnostic Learning with Salient Images. Proceedings of the CVPR, Nashville, TN, USA.10.1109/CVPR46437.2021.01009 ↗
34. Zhou, Y., Zhu, Y., Ye, Q., Qiu, Q., and Jiao, J. (2018, January 18–23). Weakly Supervised Instance Segmentation Using Class Peak Response. Proceedings of the 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition, Salt Lake City, UT, USA.10.1109/CVPR.2018.00399 ↗
35. Hsu, C.C., Hsu, K.J., Tsai, C.C., Lin, Y.Y., and Chuang, Y.Y. (2019, January 8–14). Weakly supervised instance segmentation using the bounding box tightness prior. Proceedings of the NeurIPS, Vancouver, BC, Canada.
36. He, K., Zhang, X., Ren, S., and Sun, J. (2016, January 27–30). Deep Residual Learning for Image Recognition. Proceedings of the 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Las Vegas, NV, USA.10.1109/CVPR.2016.90 ↗
37. Yu, F., and Koltun, V. (2016). Multi-Scale Context Aggregation by Dilated Convolutions. arXiv.