journal article·2023-04-14Open access

SDebrisNet: A Spatial–Temporal Saliency Network for Space Debris Detection

Jiang Tao, Yunfeng Cao, Meng Ding

Applied Sciences· Volume 13· Issue 8

Abstract

The rapidly growing number of space activities is generating numerous space debris, which greatly threatens the safety of space operations. Therefore, space-based space debris surveillance is crucial for the early avoidance of spacecraft emergencies. With the progress in computer vision technology, space debris detection using optical sensors has become a promising solution. However, detecting space debris at far ranges is challenging due to its limited imaging size and unknown movement characteristics. In this paper, we propose a space debris saliency detection algorithm called SDebrisNet. The algorithm utilizes a convolutional neural network (CNN) to take into account both spatial and temporal data from sequential video images, which aim to assist in detecting small and moving space debris. Firstly, taking into account the limited resource of the space-based computational platform, a MobileNet-based space debris feature extraction structure was constructed to make the overall model more lightweight. In particular, an enhanced spatial feature module is introduced to strengthen the spatial details of small objects. Secondly, based on attention mechanisms, a constrained self-attention (CSA) module is applied to learn the spatiotemporal data from the sequential images. Finally, a space debris dataset was constructed for algorithm evaluation. The experimental results demonstrate that the method proposed in this paper is robust for detecting moving space debris with a low signal-to-noise ratio in the video. Compared to the NODAMI method, SDebrisNet shows improvements of 3.5% and 1.7% in terms of detection probability and the false alarm rate, respectively.
Source: crossref · Quality: baseline

Research context

OpenAlex topics: Visual Attention and Saliency Detection · Space Satellite Systems and Control · Ocular and Laser Science Research

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

Department of Aerospace Control, Nanjing University of Aeronautics and Astronautics, Nanjing 211106, China

College of Civil Aviation, Nanjing University of Aeronautics and Astronautics, Nanjing 211106, China

Funding

National Natural Science Foundation of China · Outstanding Doctoral Dissertation in the NUAA

References (62)

Show source-provided references
1. Space-based optical observations on space debris via multipoint of view10.1155/2020/8328405 ↗
2. Dynamics of Tethered-Coulomb Formation for Debris Deorbiting in Geosynchronous Orbit10.1061/(ASCE)AS.1943-5525.0001406 ↗
3. NASA Orbital Debris Program Office (2022). Monthly object type charts by number and mass. Orbital Debris Q. News, 26, 1–10.
4. Effects of deorbit evolution on space-based pulse laser irradiating centimeter-scale space debris in LEO10.1016/j.actaastro.2019.09.010 ↗
5. Method of space object detection by wide field of view telescope based on its following error10.1364/OE.440842 ↗
6. Efficient and automatic image reduction framework for space debris detection based on GPU technology10.1016/j.actaastro.2018.02.009 ↗
7. Detection and correlation of geosynchronous objects in NASA’s Wide-field Infrared Survey Explorer images10.1016/j.actaastro.2021.03.009 ↗
8. Streak detection and analysis pipeline for space-debris optical images10.1016/j.asr.2015.09.024 ↗
9. Robust foreground segmentation and image registration for optical detection of GEO objects10.1016/j.asr.2019.03.008 ↗
10. Automatic extraction channel of space debris based on wide-field surveillance system10.1038/s41526-022-00200-z ↗
11. Multi-stage astrometric image processing using stellar feedback
12. Distinguishing features of CCD astrometry of faint GEO objects10.1016/j.asr.2007.04.033 ↗
13. Sun, Q., Niu, Z., Wang, W., Li, H., Luo, L., and Lin, X. (2019). An adaptive real-time detection algorithm for dim and small photoelectric GSO debris. Sensors, 19.10.3390/s19184026 ↗
14. Algorithms and applications for detecting faint space debris in GEO10.1016/j.actaastro.2015.01.001 ↗
15. Uetsuhara, M., Hanada, T., Yamaoka, H., Fujiwara, T., Yanagisawa, T., Kurosaki, H., and Kitazawa, Y. (2010, January 14–17). Detection of faint GEO objects using population and motion prediction. Proceedings of the 11th Annual Advanced Maui Optical and Space Surveillance Technologies Conference, Maui, HI, USA.
16. Stack-CNN algorithm: A new approach for the detection of space objects10.1016/j.jsse.2022.01.001 ↗
17. Detection of small GEO debris by use of the stacking method10.2322/tjsass.44.190 ↗
18. Yanagisawa, T., Kurosaki, H., Banno, H., Kitazawa, Y., Uetsuhara, M., and Hanada, T. (2012, January 11–14). Comparison between four detection algorithms for GEO objects. Proceedings of the Advanced Maui Optical and Space Surveillance Technologies Conference, Maui, HI, USA.
19. Space debris tracking based on fuzzy running Gaussian average adaptive particle filter track-before-detect algorithm10.1088/1674-4527/17/2/18 ↗
20. Uetsuhara, M., and Ikoma, N. (2014, January 9–12). Faint debris detection by particle based track-before-detect method. Proceedings of the Advanced Maui Optical and Space Surveillance Technologies Conference, Maui, HI, USA.
21. Space target detection in complicated situations for wide-field surveillance10.1109/ACCESS.2019.2938454 ↗
22. Space debris detection in optical image sequences10.1364/AO.55.007929 ↗
23. Detecting small, moving objects in image sequences using sequential hypothesis testing10.1109/78.134399 ↗
24. Rambaux, N., Vaubaillon, J., Lacassagne, L., Galayko, D., Guignan, G., Birlan, M., Boisse, P., Capderou, M., Colas, F., and Deleflie, F. (2019, January 22–24). Meteorix: A cubesat mission dedicated to the detection of meteors and space debris. Proceedings of the 1st ESA NEO and Debris Detection Conference, Darmstadt, Germany.
25. Effective star tracking method based on optical flow analysis for star trackers10.1364/AO.55.010335 ↗
26. A debris image tracking using optical flow algorithm10.1016/j.asr.2011.12.010 ↗
27. Tao, J., Cao, Y., Zhuang, L., Zhang, Z., and Ding, M. (2019, January 5–7). Deep Convolutional Neural Network Based Small Space Debris Saliency Detection. Proceedings of the 2019 25th International Conference on Automation and Computing (ICAC), Lancaster, UK.10.23919/IConAC.2019.8895100 ↗
28. Space Object Detection in Video Satellite Images Using Motion Information10.1155/2017/1024529 ↗
29. Moving Object Detection Method of Video Satellite Based on Tracking Correction Detection10.5194/isprs-annals-V-3-2020-701-2020 ↗
30. DLR-TUBSAT, qualification of high precision attitude control in orbit10.1016/S0094-5765(97)00081-7 ↗
31. Cross-frame keypoint-based and spatial motion information-guided networks for moving vehicle detection and tracking in satellite videos10.1016/j.isprsjprs.2021.05.005 ↗
32. Xiao, A., Wang, Z., Wang, L., and Ren, Y. (2018). Super-resolution for “Jilin-1” satellite video imagery via a convolutional network. Sensors, 18.10.3390/s18041194 ↗
33. Jabir, B., Falih, N., and Rahmani, K. (2021). Accuracy and Efficiency Comparison of Object Detection Open-Source Models. Int. J. Online Biomed. Eng., 17.10.3991/ijoe.v17i05.21833 ↗
34. Chen, Y.W., Jin, X., Shen, X., and Yang, M.H. (2022, January 3–8). Video Salient Object Detection via Contrastive Features and Attention Modules. Proceedings of the IEEE/CVF Winter Conference on Applications of Computer Vision, Waikoloa, HI, USA.10.1109/WACV51458.2022.00061 ↗
35. Xu, B., Liang, H., Ni, W., Gong, W., Liang, R., and Chen, P. (2022). Learning Video Salient Object Detection Progressively from Unlabeled Videos. arXiv.
36. Zhao, W., Zhang, J., Li, L., Barnes, N., Liu, N., and Han, J. (2021, January 20–25). Weakly supervised video salient object detection. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, Nashville, TN, USA.10.1109/CVPR46437.2021.01655 ↗
37. Su, Y., Deng, J., Sun, R., Lin, G., and Wu, Q. (2022). A Unified Transformer Framework for Group-based Segmentation: Co-Segmentation, Co-Saliency Detection and Video Salient Object Detection. arXiv.10.1109/TMM.2023.3264883 ↗
38. Wang, X., Girshick, R., Gupta, A., and He, K. (2018, January 8–22). Non-local neural networks. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Salt Lake City, UT, USA.10.1109/CVPR.2018.00813 ↗
39. Yan, P., Li, G., Xie, Y., Li, Z., Wang, C., Chen, T., and Lin, L. (November, January 27). Semi-supervised video salient object detection using pseudo-labels. Proceedings of the IEEE/CVF International Conference on Computer Vision, Seoul, Republic of Korea.
40. He, K., Zhang, X., Ren, S., and Sun, J. (July, January 26). Deep residual learning for image recognition. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Las Vegas, NV, USA.
41. Chollet, F. (2017, January 21–26). Xception: Deep learning with depthwise separable convolutions. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Honolulu, HI, USA.10.1109/CVPR.2017.195 ↗
42. Blacker, P., Bridges, C.P., and Hadfield, S. (2019, January 22–24). Rapid prototyping of deep learning models on radiation hardened cpus. Proceedings of the 2019 NASA/ESA Conference on Adaptive Hardware and Systems (AHS), Colchester, UK.10.1109/AHS.2019.000-4 ↗
43. Howard, A., Sandler, M., Chu, G., Chen, L.C., Chen, B., Tan, M., Wang, W., Zhu, Y., Pang, R., and Vasudevan, V. (November, January 27). Searching for mobilenetv3. Proceedings of the IEEE/CVF International Conference on Computer Vision, Seoul, Republic of Korea.
44. Hu, J., Shen, L., and Sun, G. (2018, January 18–22). Squeeze-and-excitation networks. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Salt Lake City, UT, USA.10.1109/CVPR.2018.00745 ↗
45. Zhao, X., Liang, H., Li, P., Sun, G., Zhao, D., Liang, R., and He, X. (2022). Motion-aware Memory Network for Fast Video Salient Object Detection. arXiv.
46. Hu, P., and Ramanan, D. (2017, January 21–26). Finding tiny faces. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Honolulu, HI, USA.10.1109/CVPR.2017.166 ↗
47. SSPNet: Scale selection pyramid network for tiny person detection from UAV images
48. Mahadevan, S., Athar, A., Ošep, A., Hennen, S., Leal-Taixé, L., and Leibe, B. (2020). Making a case for 3d convolutions for object segmentation in videos. arXiv.
49. Wang, H., Mu, N., and Zhang, Y. (2021, January 17–20). Video Salient Object Detection Network with Bidirectional Memory and Spatiotemporal Constraints. Proceedings of the 2021 IEEE International Conference on Systems, Man, and Cybernetics (SMC), Melbourne, Australia.10.1109/SMC52423.2021.9658855 ↗
50. DS-Net: Dynamic spatiotemporal network for video salient object detection10.1016/j.dsp.2022.103700 ↗
51. Gu, Y., Wang, L., Wang, Z., Liu, Y., Cheng, M.M., and Lu, S.P. (2020, January 7–12). Pyramid constrained self-attention network for fast video salient object detection. Proceedings of the AAAI Conference on Artificial Intelligence, New York, NY, USA.10.1609/aaai.v34i07.6718 ↗
52. Ji, G.P., Chou, Y.C., Fan, D.P., Chen, G., Fu, H., Jha, D., and Shao, L. (October, January 27). Progressively normalized self-attention network for video polyp segmentation. Proceedings of the International Conference on Medical Image Computing and Computer-Assisted Intervention, Strasbourg, France.
53. A model of saliency-based visual attention for rapid scene analysis10.1109/34.730558 ↗
54. Achanta, R., Hemami, S., Estrada, F., and Susstrunk, S. (2009, January 20–25). Frequency-tuned salient region detection. Proceedings of the 2009 IEEE Conference on Computer Vision and Pattern Recognition, Miami, FL, USA.10.1109/CVPR.2009.5206596 ↗
55. Hou, Q., Cheng, M.M., Hu, X., Borji, A., Tu, Z., and Torr, P.H. (2017, January 21–26). Deeply supervised salient object detection with short connections. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Honolulu, HI, USA.10.1109/CVPR.2017.563 ↗
56. Fan, D.P., Cheng, M.M., Liu, Y., Li, T., and Borji, A. (2017, January 22–29). Structure-measure: A new way to evaluate foreground maps. Proceedings of the IEEE International Conference on Computer Vision, Venice, Italy.10.1109/ICCV.2017.487 ↗
57. Dim Space Target Detection via Convolutional Neural Network in Single Optical Image10.1109/ACCESS.2022.3174054 ↗
58. Topological sweep for multi-target detection of geostationary space objects10.1109/TSP.2020.3021232 ↗
59. Li, H., Chen, G., Li, G., and Yu, Y. (November, January 27). Motion guided attention for video salient object detection. Proceedings of the IEEE/CVF international Conference on Computer Vision, Seoul, Republic of Korea.
60. Zhang, M., Liu, J., Wang, Y., Piao, Y., Yao, S., Ji, W., Li, J., Lu, H., and Luo, Z. (2021, January 11–17). Dynamic context-sensitive filtering network for video salient object detection. Proceedings of the IEEE/CVF International Conference on Computer Vision, Montreal, BC, Canada.10.1109/ICCV48922.2021.00158 ↗
61. Hui, R. (2019). Introduction to Fiber-Optic Communications, Academic Press.10.1016/B978-0-12-805345-4.00001-9 ↗
62. Stray light analysis of high resolution camera for a low-earth-orbit satellite10.3807/JOSK.2011.15.1.052 ↗