journal article·2023-11-03Open access

A Novel Fault-Tolerant Aware Task Scheduler Using Deep Reinforcement Learning in Cloud Computing

Mallu Shiva Rama Krishna, Sudheer Mangalampalli

Applied Sciences· Volume 13· Issue 21

Abstract

Task scheduling poses a wide variety of challenges in the cloud computing paradigm, as heterogeneous tasks from a variety of resources come onto cloud platforms. The most important challenge in this paradigm is to avoid single points of failure, as tasks of various users are running at the cloud provider, and it is very important to improve fault tolerance and maintain negligible downtime in order to render services to a wide range of customers around the world. In this paper, to tackle this challenge, we precisely calculated priorities of tasks for virtual machines (VMs) based on unit electricity cost and these priorities are fed to the scheduler. This scheduler is modeled using a deep reinforcement learning technique which is known as the DQN model to make decisions and generate schedules optimally for VMs based on priorities fed to the scheduler. This research is extensively conducted on Cloudsim. In this research, a real-time dataset known as Google Cloud Jobs is used and is given as input to the algorithm. This research is carried out in two phases by categorizing the dataset as a regular or large dataset with real-time tasks with fixed and varied VMs in both datasets. Our proposed DRFTSA is compared to existing state-of-the-art approaches, i.e., PSO, ACO, and GA algorithms, and results reveal that the proposed DRFTSA minimizes makespan compared to PSO, GA, and ACO by 30.97%, 35.1%, and 37.12%, rates of failure by 39.4%, 44.13%, and 46.19%, and energy consumption by 18.81%, 23.07%, and 28.8%, respectively, for both regular and large datasets for both fixed and varied VMs.
Source: crossref · Quality: baseline

Research context

OpenAlex topics: Cloud Computing and Resource Management · IoT and Edge/Fog Computing · Blockchain Technology Applications and Security

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

School of Computer Science and Engineering, VIT-AP University, Amaravati 522237, India

References (44)

Show source-provided references
1. An IFWA-BSA Based Approach for Task Scheduling in Cloud Computing
2. SLA-aware resource scheduling algorithm for cloud storage10.1186/s13638-019-1604-0 ↗
3. Multi Objective Trust aware task scheduling algorithm in cloud computing using Whale Optimization
4. Nabi, S., Ahmad, M., Ibrahim, M., and Hamam, H. (2022). AdPSO: Adaptive PSO-based task scheduling approach for cloud computing. Sensors, 22.10.3390/s22030920 ↗
5. Hybrid lion–GA optimization algorithm-based task scheduling approach in cloud computing10.1007/s13204-021-02336-y ↗
6. MOTS-ACO: An improved ant colony optimiser for multi-objective task scheduling optimisation problem in cloud data centres10.1049/ntw2.12033 ↗
7. A novel deep reinforcement learning scheme for task scheduling in cloud computing10.1007/s10586-022-03630-2 ↗
8. QL-HEFT: A novel machine learning scheduling scheme base on cloud computing environment10.1007/s00521-019-04118-8 ↗
9. Deep and reinforcement learning for automated task scheduling in large-scale cloud computing systems10.1002/cpe.5919 ↗
10. Performance and cost-efficient spark job scheduling based on deep reinforcement learning in cloud computing environments10.1109/TPDS.2021.3124670 ↗
11. Deep reinforcement learning for delay-oriented IoT task scheduling in SAGIN10.1109/TWC.2020.3029143 ↗
12. Multi-objective task scheduling optimization for load balancing in cloud computing environment using hybrid artificial bee colony algorithm with reinforcement learning10.1109/ACCESS.2022.3149955 ↗
13. An efficient approach to the map-reduce framework and genetic algorithm-based whale optimization algorithm for task scheduling in cloud computing environment10.1016/j.matpr.2020.09.064 ↗
14. Multiobjective task scheduling in cloud environment using decision tree algorithm10.1109/ACCESS.2022.3163273 ↗
15. Cheng, M., Ji, L., and Shahin, N. (2018, January 22–25). DRL-cloud: Deep reinforcement learning-based resource provisioning and task scheduling for cloud service providers. Proceedings of the 2018 23rd Asia and South Pacific Design Automation Conference (ASP-DAC), IEEE, Jeju, Republic of Korea.10.1109/ASPDAC.2018.8297294 ↗
16. Li, Z., Guan, P., Dong, Y., and Yang, Y. (2023). Multi-objective optimization of cloud task scheduling based on improved deep Q-learning algorithm. arXiv.10.21203/rs.3.rs-2998788/v1 ↗
17. Li, K., Peng, Z., Cui, D., and Li, Q. (2021). Sla-DQTS: SLA Constrained Adaptive Online task scheduling based on DDQN in cloud computing. Appl. Sci., 11.10.3390/app11209360 ↗
18. Riera, J.F., Batallé, J., Bonnet, J., Dias, M., McGrath, M., Petralia, G., Liberati, F., Giuseppi, A., Pietrabissa, A., and Ceselli, A. (2016, January 6–10). TeNOR: Steps towards an orchestration platform for multi-PoP NFV deployment. Proceedings of the 2016 IEEE NetSoft Conference and Workshops (NetSoft), Seoul, Republic of Korea.10.1109/NETSOFT.2016.7502419 ↗
19. A dynamic and failure-aware task scheduling framework for hadoop10.1109/TCC.2018.2805812 ↗
20. Random task scheduling scheme based on reinforcement learning in cloud computing10.1007/s10586-015-0484-2 ↗
21. Scheduling independent tasks in cloud environment based on modified differential evolution10.1002/cpe.6256 ↗
22. A modified PSO algorithm for task scheduling optimization in cloud computing10.1002/cpe.4970 ↗
23. Khodar, A., Chernenkaya, L.V., Alkhayat, I., Al-Afare, H.A.F., and Desyatirikova, E.N. (2020, January 27–30). Design model to improve task scheduling in cloud computing based on particle swarm optimization. Proceedings of the 2020 IEEE Conference of Russian Young Researchers in Electrical and Electronic Engineering (EIConRus), St. Petersburg and Moscow, Russia.10.1109/EIConRus49466.2020.9039501 ↗
24. Regressive whale optimization for workflow scheduling in cloud computing10.1142/S146902681950024X ↗
25. Al-Zoubi, H. (2019, January 21–23). Efficient task scheduling for applications on clouds. Proceedings of the 2019 6th IEEE International Conference on Cyber Security and Cloud Computing (CSCloud)/2019 5th IEEE International Conference on Edge Computing and Scalable Cloud (EdgeCom), Paris, France.10.1109/CSCloud/EdgeCom.2019.00012 ↗
26. Dynamic scheduler management using deep learning10.1109/TCCN.2020.2980529 ↗
27. Task scheduling of cloud computing using integrated particle swarm algorithm and ant colony algorithm10.1007/s10586-017-1479-y ↗
28. Zhao, J., Rodriguez, M.A., and Buyya, R. (2021, January 5–10). A deep reinforcement learning approach to resource management in hybrid clouds harnessing renewable energy and task scheduling. Proceedings of the 2021 IEEE 14th International Conference on Cloud Computing (CLOUD), Chicago, IL, USA.10.1109/CLOUD53861.2021.00037 ↗
29. MRLCC: An adaptive cloud task scheduling method based on meta reinforcement learning10.1186/s13677-023-00440-8 ↗
30. Task scheduling based on deep reinforcement learning in a cloud manufacturing environment10.1002/cpe.5654 ↗
31. Deep reinforcement learning for fault-tolerant workflow scheduling in cloud environment10.1007/s10489-022-03963-w ↗
32. An intelligent scheduling algorithm for resource management of cloud platform10.1007/s11042-018-6477-4 ↗
33. Intelligent decision-making of load balancing using deep reinforcement learning and parallel PSO in cloud environment10.1109/ACCESS.2022.3192628 ↗
34. Multi-objective workflow scheduling with deep-Q-network-based multi-agent reinforcement learning10.1109/ACCESS.2019.2902846 ↗
35. Wei, Y., Kudenko, D., Liu, S., Pan, L., Wu, L., and Meng, X. (2018). Collaborative Computing: Networking, Applications and Worksharing: 13th International Conference, CollaborateCom 2017, Edinburgh, UK, 11–13 December 2017, Proceedings 13, Springer International Publishing.
36. DDDQN-TS: A task scheduling and load balancing method based on optimized deep reinforcement learning in heterogeneous computing environment10.1002/int.22983 ↗
37. CloudSim: A toolkit for modeling and simulation of cloud computing environments and evaluation of resource provisioning algorithms10.1002/spe.995 ↗
38. Hussain, A., and Aleem, M. (Mendeley Data, 2018). Mendeley Data, GoCJ: Google Cloud Jobs Dataset.
39. Hybrid gradient descent cuckoo search (HGDCS) algorithm for resource scheduling in IaaS cloud computing environment10.1007/s10586-018-2856-x ↗
40. An efficient hardware implementation of reinforcement learning: The q-learning algorithm10.1109/ACCESS.2019.2961174 ↗
41. Mokhtari, A., Pooyan, J., and Salehi, M.A. (2022). FELARE: Fair scheduling of machine learning applications on heterogeneous edge systems. arXiv.10.1109/CLOUD55607.2022.00069 ↗
42. Proficient job scheduling in cloud computation using an optimized machine learning strategy
43. Dynamic Fault Tolerance Management Algorithm for VM Migration in Cloud Data Centers
44. ReLIEF: A Reinforcement Learning-Based Real-Time Task Assignment Strategy in Emerging Fault-Tolerant Fog Computing10.1109/JIOT.2023.3240007 ↗