journal article·2026-03-11Open access

Spatiotemporal-Aware Multi-Agent Reinforcement Learning for Revisit-Oriented Multi-Satellite Observation Task Scheduling

Wenbo Zhang, Xuanyu Liu, Wei Zhao, Qi He, Chongbin Guo, Binpin Su

Applied Sciences· Volume 16· Issue 6

Abstract

The scheduling of Earth observation satellites presents a formidable multi-objective optimization challenge, characterized by inherent trade-offs among task completion rate, execution timeliness, and the temporal uniformity of revisits. To address this, we introduce the Multi-Satellite Observation Task Scheduling (MSOTS) framework, a novel end-to-end approach based on Multi-Agent Reinforcement Learning (MARL). This framework formulates the scheduling process as a Markov game, employing the Multi-Agent Proximal Policy Optimization (MAPPO) algorithm within a Centralized Training, Decentralized Execution (CTDE) paradigm to effectively navigate these competing objectives. Furthermore, to ensure a balanced evaluation, we propose a Composite Multi-Objective Performance Score grounded in a weighted harmonic mean. Comprehensive empirical evaluations conducted on large-scale, simulated orbital scenarios demonstrate that MSOTS significantly outperforms both traditional heuristics and existing deep reinforcement learning methods in comprehensive performance and robust efficiency. This research provides a highly effective and intelligent approach to modern satellite task scheduling.
Source: crossref · Quality: baseline

Research context

OpenAlex topics: Satellite Communication Systems · Spacecraft Dynamics and Control · Spacecraft Design and Technology

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

College of Information Technology, Shanghai Ocean University, Shanghai 201306, China

Innovation Academy for Microsatellites of Chinese Academy of Sciences, Shanghai 201304, China

University of Chinese Academy of Sciences, Beijing 101408, China

Funding

National Natural Science Foundation of China · the Hong Kong-Macau-Taiwan Science and Technology Cooperation Project of the Science and Technology Innovation Action Plan in Shanghai · the Strategic Priority Research Program of the Chinese Academy of Sciences

References (28)

Show source-provided references
1. A Reinforcement Learning-Enhanced Dung Beetle Optimization Approach for Agile Earth Observation Satellite Scheduling10.1109/LGRS.2025.3527925 ↗
2. Can near-real-time satellite precipitation products capture rainstorms and guide flood warning for the 2016 summer in South China?10.1109/LGRS.2017.2702137 ↗
3. Chang, S., Wu, B., Yan, N., Zhu, J., Wen, Q., and Xu, F. (2018). A refined crop drought monitoring method based on the Chinese GF-1 wide field view data. Sensors, 18.10.3390/s18041297 ↗
4. Ahmed, M.R., Rahaman, K.R., Kok, A., and Hassan, Q.K. (2017). Remote sensing-based quantification of the impact of flash flooding on the rice production: A case study over Northeastern Bangladesh. Sensors, 17.10.3390/s17102347 ↗
5. Estimating global ocean heat content from tidal magnetic satellite observations10.1038/s41598-019-44397-8 ↗
6. A review of technical development of military reconnaissance satellite abroad
7. A precedence-rule-based heuristic for satellite onboard activity planning10.1016/j.actaastro.2020.10.020 ↗
8. An anytime branch and bound algorithm for agile earth observation satellite onboard scheduling10.1016/j.asr.2017.07.026 ↗
9. Kim, C.H., Kim, S.J., and Choi, H.L. (2024, January 8–12). Heterogeneous satellite task scheduling with revisit time minimization using milp formulation. Proceedings of the AIAA SCITECH 2024 Forum, Orlando, FL, USA.10.2514/6.2024-0747 ↗
10. Satellite scheduling of large areal tasks for rapid response to natural disaster using a multi-objective genetic algorithm10.1016/j.ijdrr.2018.02.013 ↗
11. Chen, J., Chen, M., Wen, J., He, L., and Liu, X. (2022). A heuristic construction neural network method for the time-dependent agile earth observation satellite scheduling problem. Mathematics, 10.10.3390/math10193498 ↗
12. Li, F., Wan, Q., Wen, F., Zou, Y., He, Q., Li, D., and Zhong, X. (2024). Multi-Satellite Imaging Task Planning for Large Regional Coverage: A Heuristic Algorithm Based on Triple Grids Method. Remote Sens., 16.10.3390/rs16010194 ↗
13. Dynamic scheduling for emergency tasks on distributed imaging satellites with task merging10.1109/TPDS.2013.156 ↗
14. Deep reinforcement learning for multi-objective game strategy selection10.1016/j.cor.2024.106683 ↗
15. Sutton, R.S., McAllester, D., Singh, S., and Mansour, Y. (December, January 29). Policy gradient methods for reinforcement learning with function approximation. Proceedings of the 13th International Conference on Neural Information Processing Systems (NIPS’99), Denver, CO, USA.
16. Mastering the game of go without human knowledge10.1038/nature24270 ↗
17. A generic Markov decision process model and reinforcement learning method for scheduling agile earth observation satellites10.1109/TSMC.2020.3020732 ↗
18. Huang, Y., Mu, Z., Wu, S., Cui, B., and Duan, Y. (2021). Revising the observation satellite scheduling problem based on deep reinforcement learning. Remote Sens., 13.10.3390/rs13122377 ↗
19. An online distributed satellite cooperative observation scheduling algorithm based on multiagent deep reinforcement learning
20. Marl-based multi-satellite intelligent task planning method10.1109/ACCESS.2023.3337358 ↗
21. Deep reinforcement learning-based periodic earth observation scheduling for agile satellite constellation
22. Task scheduling under a novel framework for data relay satellite network via deep reinforcement learning10.1109/TVT.2022.3233358 ↗
23. Deep reinforcement learning-based resource allocation method for multi-satellite scheduling10.1016/j.cor.2025.107088 ↗
24. Reinforcement learning and adaptive/approximate dynamic programming: A survey from theory to applications in multi-agent systems
25. The surprising effectiveness of ppo in cooperative multi-agent games
26. Xu, Z., Li, Z., Guan, Q., Zhang, D., Li, Q., Nan, J., Liu, C., Bian, W., and Ye, J. (2018, January 19–23). Large-scale order dispatch in on-demand ride-hailing platforms: A learning and planning approach. Proceedings of the 24th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining, London, UK.10.1145/3219819.3219824 ↗
27. Enhancing Space-Air Communication through Anomaly Detection in LEO Satellite Constellations and Low-Altitude Aircraft Networks Using Graph Representation Learning10.1007/s11431-025-3013-5 ↗
28. A Comprehensive Survey of Orbital Edge Computing: Systems, Applications, and Algorithms10.1016/j.cja.2024.11.026 ↗