journal article·2025-01-17Open access

Deep Reinforcement Learning-Based Task Partitioning Ratio Decision Mechanism in High-Speed Rail Environments with Mobile Edge Computing Server

Seolwon Koo, Yujin Lim

Applied Sciences· Volume 15· Issue 2

Abstract

High-speed rail (HSR) environments present unique challenges due to their high mobility and dense passenger traffic, resulting in dynamic and unpredictable task generation patterns. Mobile Edge Computing (MEC) has emerged as a transformative paradigm to address these challenges by deploying computation resources closer to end-users. However, the limited resources of MEC servers necessitate efficient task partitioning, wherein a single task is divided into multiple sub-tasks for parallel processing across MEC servers. In the context of HSR environments, the task partitioning ratio is pivotal in ensuring quality of service (QoS) and optimizing resource utilization, particularly under dynamic and high-demand conditions. This paper proposes a deep reinforcement learning (DRL)-based task partitioning mechanism using Twin Delayed Deep Deterministic Policy Gradient (TD3) for HSR environments with MEC servers (MECSs). The proposed method dynamically adjusts task partitioning ratios by leveraging real-time information about task characteristics and server load conditions. The experimental results show that when the task arrival rate is 20, the delay is improved by about 5% compared to random and about 13% compared to no_partition. When it is 50, there is no significant difference from random and about 2% improvement compared to no_partition. The task throughput is almost the same when it is 20. However, when it is 50, random is much better. We also looked at the performance change according to the number of serving MECSs. In this process, we can also note the research direction of finding an appropriate number of serving MECSs K. The results highlight the efficacy of DRL-based approaches in dynamically adapting to the unique characteristics of HSR environments, achieving optimal resource allocation and maintaining high QoS. This paper contributes to advancing task partitioning strategies for HSR systems and lays the groundwork for future research in MEC-based HSR systems.
Source: crossref · Quality: baseline

Research context

OpenAlex topics: IoT and Edge/Fog Computing · Traffic Prediction and Management Techniques · Vehicular Ad Hoc Networks (VANETs)

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

Department of IT Engineering, Sookmyung Women’s University, Seoul 04310, Republic of Korea

References (25)

Show source-provided references
1. Future Railway Services-Oriented Mobile Communications Network10.1109/MCOM.2015.7295467 ↗
2. 5G Key Technologies for Smart Railways10.1109/JPROC.2020.2988595 ↗
3. Communication Systems of High-Speed Railway: A Survey10.1002/ett.4189 ↗
4. A Survey on High-Speed Railway Communications: A Radio Resource Management Perspective10.1016/j.comcom.2016.04.003 ↗
5. A Review of High-Performance Computing Applications in High-Speed Rail Systems10.1016/j.hspr.2023.05.001 ↗
6. A Survey on Mobile Edge Computing: The Communication Perspective10.1109/COMST.2017.2745201 ↗
7. Toward Computation Offloading in Edge Computing: A Survey10.1109/ACCESS.2019.2938660 ↗
8. Offloading Schemes in Mobile Edge Computing for Ultra-Reliable Low Latency Communications10.1109/ACCESS.2018.2800032 ↗
9. Computation Offloading for Vehicular Environments: A Survey10.1109/ACCESS.2020.3033828 ↗
10. Folo: Latency and Quality Optimized Task Allocation in Vehicular Fog Computing10.1109/JIOT.2018.2875520 ↗
11. Wu, S., Xia, W., Cui, W., Chao, Q., Lan, Z., Yan, F., and Shen, L. (2018, January 18–20). An Efficient Offloading Algorithm Based on Support Vector Machine for Mobile Edge Computing in Vehicular Networks. Proceedings of the 2018 10th International Conference on Wireless Communications and Signal Processing (WCSP), Hangzhou, China.10.1109/WCSP.2018.8555695 ↗
12. A Game-Based Computation Offloading Method in Vehicular Multiaccess Edge Computing Networks10.1109/JIOT.2020.2972061 ↗
13. RL/DRL Meets Vehicular Task Offloading Using Edge and Vehicular Cloudlet: A Survey10.1109/JIOT.2022.3155667 ↗
14. Deep Reinforcement Learning: A Brief Survey10.1109/MSP.2017.2743240 ↗
15. Deep Reinforcement Learning Based Resource Management for Multi-Access Edge Computing in Vehicular Networks10.1109/TNSE.2020.2978856 ↗
16. Ren, Y., Yu, X., Chen, X., Guo, S., and Qiu, X. (2020, January 15–19). Vehicular Network Edge Intelligent Management: A Deep Deterministic Policy Gradient Approach for Service Offloading Decision. Proceedings of the 2020 International Wireless Communications and Mobile Computing (IWCMC), Limassol, Cyprus.10.1109/IWCMC48107.2020.9148507 ↗
17. Dynamic Edge Computation Offloading for Internet of Vehicles with Deep Reinforcement Learning10.1109/TITS.2022.3178759 ↗
18. Chen, Y., and Wu, H. (2021, January 8–12). Resource Allocation for Edge Collaboration with Deep Deterministic Policy Gradient in Smart Railway. Proceedings of the 2021 IEEE 4th International Conference on Electronics Technology (ICET), Chengdu, China.10.1109/ICET51757.2021.9451071 ↗
19. A TP-DDPG Algorithm Based on Cache Assistance for Task Offloading in Urban Rail Transit10.1109/TVT.2023.3253508 ↗
20. Deep Reinforcement Learning for Computation and Communication Resource Allocation in Multiaccess MEC-Assisted Railway IoT Networks10.1109/TITS.2022.3205175 ↗
21. Guo, Q., Xu, Z., Yuan, J., and Wei, Y. (2024). Computation Offloading Strategy for Detection Task in Railway IoT with Integrated Sensing, Storage, and Computing. Electronics, 13.10.3390/electronics13152982 ↗
22. Mnih, V., Kavukcuoglu, K., Silver, D., Rusu, A.A., Veness, J., Bellemare, M.G., Graves, A., Riedmiller, M., Fidjeland, A.K., and Ostrovski, G. (2013). Playing Atari with Deep Reinforcement Learning. arXiv.
23. Lillicrap, T.P., Hunt, J.J., Pritzel, A., Heess, N., Erez, T., Tassa, Y., Silver, D., and Wierstra, D. (2015). Continuous Control with Deep Reinforcement Learning. arXiv.
24. Lopez, P.A., Behrisch, M., Bieker-Walz, L., Erdmann, J., Flötteröd, Y.-P., Hilbrich, R., Lücken, L., Rummel, J., Wagner, P., and Wiessner, E. (2018, January 4–7). Microscopic Traffic Simulation Using SUMO. Proceedings of the 2018 21st International Conference on Intelligent Transportation Systems (ITSC), Maui, HI, USA.10.1109/ITSC.2018.8569938 ↗
25. Zhang, W., Yao, D., and Yang, M. (2013, January 29–31). Implementation of LTE-R Transceiver and the Performance with WINNER D2a Channel Model. Proceedings of the 2013 5th IEEE International Symposium on Microwave, Antenna, Propagation and EMC Technologies for Wireless Communications (MAPE), Chengdu, China.10.1109/MAPE.2013.6689852 ↗