Joint Adjustment Image Stabilization Method Based on Trajectories of Maritime Multi-Target Detection and Tracking
Source abstract
Abstract
Existing technologies can achieve relative geometric correction and stabilization of geostationary satellite image sequences through fixed land scene matching or homonymous point adjustment. However, these methods heavily rely on fixed land areas, rendering them completely ineffective in vast ocean regions with only ship targets. Additionally, the trajectories of ship targets after processing still exhibit noticeable jitter, hindering motion information analysis. To address these issues, this paper proposes a joint image adjustment and stabilization method based on multi-target trajectories in marine environments: (1) An optimized target detection algorithm based on a multi-scale heterogeneous convolution module is introduced, which extracts background and target features through convolutions of different scales, enabling accurate detection and tracking of weak small targets in the image sequence frame by frame. (2) Curve fitting is performed on the detected positions of the same ship across multiple frames to simulate its motion trajectory under stabilized conditions. Combined with the prior assumption of uniform motion, an equal-division strategy is adopted to determine the corrected positions of the target in the image sequence. (3) The deviation correction values of multiple targets within the same frame are obtained, and based on the principle of intra-frame deviation consistency, precise image stabilization is achieved under multi-target constraints. Experiments based on Gaofen-4 satellite image sequences demonstrate that this method reduces the average position deviation of ship targets in the original images from 8.5 pixels (425 m) to 3.4 pixels (170 m), a decrease of approximately 59.41%, effectively improving the relative geometric accuracy of the image sequence and significantly eliminating target trajectory jitter.
Source: crossref · Quality: baseline
Research context
OpenAlex topics: Image and Video Stabilization · Advanced Control and Stabilization in Aerospace Systems · Infrared Target Detection Methodologies
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
Affiliations
State Key Laboratory of Information Engineering in Surveying, Mapping and Remote Sensing (LIESMARS), Wuhan University, Wuhan 430079, China
Key Laboratory of Technology in Geo-Spatial Information Processing and Application Systems, Chinese Academy of Sciences, Beijing 100190, China
Funding
Hubei Province Strategic Science and Technology Talent Cultivation Special Project
References (50)
Show source-provided references
1. Monitoring waste from unmanned aerial vehicle and satellite imagery using deep learning techniques: A review10.1109/JSTARS.2024.3488056 ↗
2. Zhu, W., Gong, W., Wang, Y., Zhang, Y., and Hu, J. (2026). GMF-Net: A Gaussian-Matched Fusion Network for Weak Small Object Detection in Satellite Laser Ranging Imagery. Sensors, 26.10.3390/s26020407 ↗
3. Aydin, A., and Avaroğlu, E. (2025). AERIS-ED: A Novel Efficient Attention Riser for Multi-Scale Object Detection in Remote Sensing. Appl. Sci., 15.10.3390/app152212223 ↗
4. Wang, P., Qin, P., Chai, R., Zeng, J., Zhao, P., Chen, Z., and Han, B. (2025). End-to-End Online Video Stitching and Stabilization Method Based on Unsupervised Deep Learning. Appl. Sci., 15.10.3390/app15115987 ↗
5. A guide to image-and video-based small object detection using deep learning: Case study of maritime surveillance
6. Development and application of ship detection and classification datasets: A review
7. ST-YOLOv8: Small-Target Ship Detection in SAR Images Targeting Specific Marine Environments
8. Liu, F., Zhang, F., Wang, M., and Xu, Q. (2024). Two-Level Supervised Network for Small Ship Target Detection in Shallow Thin Cloud-Covered Optical Satellite Images. Appl. Sci., 14.10.3390/app142411558 ↗
9. Distinctive Image Features from Scale-Invariant Keypoints10.1023/B:VISI.0000029664.99615.94 ↗
10. Dalal, N., and Triggs, B. (2005). Histograms of Oriented Gradients for Human Detection. 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR), IEEE.10.1109/CVPR.2005.177 ↗
11. Faster R-CNN: Towards real-time object detection with region proposal networks10.1109/TPAMI.2016.2577031 ↗
12. Liu, W., Anguelov, D., Erhan, D., Szegedy, C., Reed, S., Fu, C.-Y., and Berg, A.C. (2016). SSD: Single Shot MultiBox Detector. Computer Vision–ECCV 2016 (ECCV), Springer.10.1007/978-3-319-46448-0_2 ↗
13. Redmon, J., Divvala, S., Girshick, R., and Farhadi, A. (2016). You only look once: Unified, real-time object detection. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), IEEE.10.1109/CVPR.2016.91 ↗
14. Sun, Y., Liu, W., Gao, Y., Hou, X., and Bi, F. (2022). A Dense Feature Pyramid Network for Remote Sensing Object Detection. Appl. Sci., 12.10.3390/app12104997 ↗
15. Yuan, Z., Liu, Z., Zhu, C., Qi, J., and Zhao, D. (2021). Object Detection in Remote Sensing Images via Multi-Feature Pyramid Network with Receptive Field Block. Remote Sens., 13.10.3390/rs13050862 ↗
16. R3Det: Refined Single-Stage Detector with Feature Refinement for Rotating Object Detection
17. Xie, X., Cheng, G., Wang, J., Yao, X., and Han, J. (2021). Oriented R-CNN for Object Detection. Proceedings of the IEEE/CVF International Conference on Computer Vision (ICCV), IEEE.10.1109/ICCV48922.2021.00350 ↗
18. Carion, N., Massa, F., Synnaeve, G., Usunier, N., Kirillov, A., and Zagoruyko, S. (2020). End-to-End Object Detection with Transformers. European Conference on Computer Vision (ECCV), Springer.10.1007/978-3-030-58452-8_13 ↗
19. Wang, X., Wang, A., Yang, J., Chen, A., and Sun, Y. (2023). Small Object Detection Based on Deep Learning for Remote Sensing: A Comprehensive Review. Remote Sens., 15.10.3390/rs15133265 ↗
20. Zhang, Z., Wang, C., Song, J., and Xu, Y. (2022). Object Tracking Based on Satellite Videos: A Literature Review. Remote Sens., 14.10.3390/rs14153674 ↗
21. MULS-Net: A multilevel supervised network for ship tracking from low-resolution remote-sensing image sequences
22. TS-Track: Trajectory self-adjusted ship tracking for GEO satellite image sequences via multilevel supervision paradigm10.1109/TGRS.2024.3438245 ↗
23. Zhao, T., Wang, Y., Li, Z., Gao, Y., Chen, C., Feng, H., and Zhao, Z. (2024). Ship Detection with Deep Learning in Optical Remote-Sensing Images: A Survey of Challenges and Advances. Remote Sens., 16.10.3390/rs16071145 ↗
24. Supervised multi-scale attention-guided ship detection in optical remote sensing images10.1109/TGRS.2022.3206306 ↗
25. Xing, Z., Ren, J., Fan, X., and Zhang, Y. (2023). S-DETR: A Transformer Model for Real-Time Detection of Marine Ships. J. Mar. Sci. Eng., 11.10.3390/jmse11040696 ↗
26. Arbitrary Direction Ship Detection in Remote-Sensing Images Based on Multitask Learning and Multiregion Feature Fusion10.1109/TGRS.2020.3002850 ↗
27. A Novel CNN-Based Method for Accurate Ship Detection in HR Optical Remote Sensing Images via Rotated Bounding Box10.1109/TGRS.2020.2995477 ↗
28. GRS-Det: An Anchor-Free Rotation Ship Detector Based on Gaussian-Mask in Remote Sensing Images10.1109/TGRS.2020.3018106 ↗
29. Yu, W., You, H., Lv, P., Hu, Y., and Han, B. (2021). A Moving Ship Detection and Tracking Method Based on Optical Remote Sensing Images from the Geostationary Satellite. Sensors, 21.10.3390/s21227547 ↗
30. MCTracker: Satellite Video Multi-Object Tracking Considering Inter-Frame Motion Correlation and Multi-Scale Cascaded Feature Enhancement10.1016/j.isprsjprs.2024.06.006 ↗
31. Video Stabilization: A Comprehensive Survey10.1016/j.neucom.2022.10.008 ↗
32. Tang, L., Ma, S., Ma, X., and You, H. (2022). Research on image matching of improved SIFT algorithm based on stability factor and feature descriptor simplification. Appl. Sci., 12.10.3390/app12178448 ↗
33. Multimodality Image Registration by Maximization of Mutual Information10.1109/42.563664 ↗
34. James, J.G., Jain, D., and Rajwade, A. (2023). Globalflownet: Video stabilization using deep distilled global motion estimates. Proceedings of the IEEE/CVF Winter Conference on Applications of Computer Vision, IEEE.
35. Choi, J., Park, J., and Kweon, I.S. (2021, January 22–25). Self-supervised real-time video stabilization. Proceedings of the 32nd British Machine Vision Conference, BMVC 2021, Online.10.5244/C.35.281 ↗
36. A Survey of Vision-Based Trajectory Learning and Analysis for Surveillance10.1109/TCSVT.2008.927109 ↗
37. Deep learning-based activity-aware 3D human motion trajectory prediction in construction10.1016/j.eswa.2023.122423 ↗
38. Predicting vehicle trajectory via combination of model-based and data-driven methods using Kalman filter10.1177/09544070231161846 ↗
39. An intelligent particle filter for infrared dim small target detection and tracking10.1109/TAES.2022.3169447 ↗
40. Multiple Object Tracking: A Literature Review
41. Saliency guided siamese attention network for infrared ship target tracking
42. Learning a robust topological relationship for online multiobject tracking in UAV scenarios10.1109/TGRS.2024.3416326 ↗
43. Billah, M.M., Zhang, J., and Zhang, T. (2022). A method for vessel’s trajectory prediction based on encoder decoder architecture. J. Mar. Sci. Eng., 10.10.3390/jmse10101529 ↗
44. Alcantarilla, P.F., Bartoli, A., and Davison, A.J. (2012). KAZE features. European Conference on Computer Vision (ECCV), Springer.10.1007/978-3-642-33783-3_16 ↗
45. Jocher, G., and Qiu, J. (2026, February 10). Ultralytics YOLO11. GitHub Repository. Available online: https://docs.ultralytics.com/zh/models/yolo11/.
46. Position detection and direction prediction for arbitrary-oriented ships via multitask rotation region convolutional neural network10.1109/ACCESS.2018.2869884 ↗
47. Yuan, X., Wang, T., Liu, J., and Shen, H. (2023). Small object detection via coarse-to-fine proposal generation and imitation learning. Proceedings of the IEEE/CVF International Conference on Computer Vision (ICCV), IEEE.10.1109/ICCV51070.2023.00581 ↗
48. Wojke, N., Bewley, A., and Paulus, D. (2017). Simple online and realtime tracking with a deep association metric. 2017 IEEE International Conference on Image Processing (ICIP), IEEE.10.1109/ICIP.2017.8296962 ↗
49. Zhang, Y., Sun, Y., Wang, Y., and Li, Y. (2022). Bytetrack: Multi-object tracking by associating every detection box. European Conference on Computer Vision, Springer.10.1007/978-3-031-20047-2_1 ↗
50. Meinhardt, T., Kainz, B., and Leal-Taixé, L. (2022). Trackformer: Multi-object tracking with transformers. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, IEEE.10.1109/CVPR52688.2022.00864 ↗