GPU Usage Time-Based Ordering Management Technique for Tasks Execution to Prevent Running Failures of GPU Tasks in Container Environments
Source abstract
Abstract
In a cloud environment, graphics processing units (GPUs) are the primary devices used for high-performance computation. They exploit flexible resource utilization, a key advantage of cloud environments. Multiple users share G... | Find, read and cite all the research you need on Tech Science Press
Source: openalex_inverted_index · Quality: baseline
Research context
OpenAlex topics: Cloud Computing and Resource Management · Distributed and Parallel Computing Systems · Real-Time Systems Scheduling
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
References (45)
Show source-provided references
1. NVIDIA Docker [cited 2024 Nov 17]. Available from: https://github.com/NVIDIA/nvidia-docker.
2. CUDA [Online] [cited 2024 Nov 17]. Available from: https://docs.nvidia.com/cuda/cuda-toolkit-release-notes/index.html.
3. CUDA memory API [Online] [cited 2024 Nov 17]. Available from: https://docs.nvidia.com/cuda/cuda-runtime-api/group__CUDART__MEMORY.html.
4. Exploring the support for high performance applications in the container runtime environment10.1186/s13673-017-0124-3 ↗
5. KubCG: a dynamic Kubernetes scheduler for heterogeneous clusters
6. Voda: a GPU scheduling platform for elastic deep learning in kubernetes clusters
7. KubFBS: a fine-grained and balance-aware scheduling system for deep learning tasks based on Kubernetes10.1002/cpe.6836 ↗
8. Designing an improved ML task scheduling mechanism on kubernetes
9. KubeGPU: efficient sharing and isolation mechanisms for GPU resource management in container cloud10.1007/s11227-022-04682-2 ↗
10. FaST-GShare: enabling efficient spatio-temporal GPU sharing in serverless computing for deep learning inference
11. Adaptive and efficient GPU time sharing for hyperparameter tuning in cloud
12. QoS-aware cloud-edge collaborative micro-service scheduling in the IIoT
13. AMACE: agent based multi-criterions adaptation in cloud environment10.1186/s13673-018-0149-2 ↗
14. Improved multi objective salp swarm optimization for virtual machine placement in cloud computing10.1186/s13673-019-0174-9 ↗
15. KubeSC-RTP: smart scheduler for Kubernetes platform on CPU-GPU heterogeneous systems, Concurrency and Computation10.1002/cpe.7108 ↗
16. Kube-knots: resource harvesting through dynamic container orchestration in gpu-based datacenters
17. SchedTune: a heterogeneity-aware GPU scheduler for deep learning
18. Knowledge-based adaptable scheduler for SaaS providers in cloud computing10.1186/s13673-015-0031-4 ↗
19. Versatile cloud resource scheduling based on artificial intelligence in cloud-enabled fog computing environments
20. ArkGPU: enabling applications’ high-goodput co-location execution on multitasking GPUs10.1007/s42514-023-00154-y ↗
21. Horus: interference-aware and prediction-based scheduling in deep learning systems10.1109/TPDS.2021.3079202 ↗
22. An efficient and non-intrusive GPU scheduling framework for deep learning training systems
23. KubeShare: a framework to manage GPUs as first-class and shared resources in container cloud
24. gShare: a centralized GPU memory management framework to enable GPU memory sharing for containers10.1016/j.future.2021.12.016 ↗
25. Sarus: highly scalable docker containers for HPC systems
26. Beware of fragmentation: scheduling GPU-sharing workloads with fragmentation gradient descent
27. Dynamic logical resource reconstruction against straggler problem in edge federated learning
28. DSTS: a hybrid optimal and deep learning for dynamic scalable task scheduling on container cloud environment10.1186/s13677-022-00304-7 ↗
29. Differentiate quality of experience scheduling for deep learning inferences with docker containers in the cloud10.1109/TCC.2022.3154117 ↗
30. RTGPU: real-time GPU scheduling of hard deadline parallel tasks with fine-grain utilization10.1109/TPDS.2023.3235439 ↗
31. DeepBoot: dynamic scheduling system for training and inference deep learning tasks in GPU cluster10.1109/TPDS.2023.3293835 ↗
32. Multi-tier GPU virtualization for deep learning in cloud-edge systems10.1109/TPDS.2023.3274957 ↗
33. Dependent tasks offloading in mobile edge computing: a multi-objective evolutionary optimization strategy10.1016/j.future.2023.06.015 ↗
34. A stochastic approach for scheduling AI training jobs in GPU-based systems10.1109/TCC.2023.3336540 ↗
35. Dynamic GPU scheduling with multi-resource awareness and live migration support10.1109/TCC.2023.3264242 ↗
36. SMSS: stateful model serving in metaverse with serverless computing and GPU sharing10.1109/JSAC.2023.3345401 ↗
37. New YARN sharing GPU based on graphics memory granularity scheduling10.1016/j.parco.2023.103038 ↗
38. A profit-aware double-layer edge equipment deployment approach for cloud operators in multi-access edge computing
39. NVIDIA Multi-Process Service [Online] [cited 2024 Dec 02]. Available from: https://docs.nvidia.com/deploy/mps/index.html.
40. SLRUM [Online] [cited 2024 Dec 02]. Available from: https://slurm.schedmd.com/ https://docs.nvidia.com/deploy/mps/index.html.
41. Docker, docker ps [Online] [cited 2024 Nov 17]. Available from: https://docs.docker.com/engine/reference/commandline/ps/ https://docs.nvidia.com/deploy/mps/index.html.
42. NVIDIA NVIDIA system management interface [Online] [cited 2024 Nov 17]. Available from: https://developer.nvidia.com/management-library-nvml.
43. The kernel development community, cgroups [Online] [cited 2024 Nov 17]. Available from: https://www.kernel.org/doc/Documentation/cgroup-v1/cgroups.txt.
44. The kernel development community, cgroups freezer [Online] [cited 2024 Nov 17]. Available from: https://www.kernel.org/doc/Documentation/cgroup-v1/freezer-subsystem.txt.
45. Deep attention fusion network for attributed graph clustering