Adaptation of Parallel SaaS to Heterogeneous Co-Located Cloud Resources
Source abstract
Abstract
Cloud computing has received increasing attention due to its promise of delivering on-demand, scalable, and virtually unlimited resources. However, heterogeneity or co-location of virtual cloud resources can cause severe degradation of the efficiency of parallel computations because of a priori unknown application-specific performance metrics, load imbalance, and limitations of memory bandwidth. This paper presents the runtime adaptation of parallel discrete element method (DEM) Software as a Service (SaaS) to heterogeneous or co-located resources of the OpenStack cloud. The computational workload is adapted by using weighted repartitioning and runtime measured performance of parallel computations on Docker containers. The high improvement in performance up to 48.7% of the execution time is achieved, applying the runtime adapted repartitioning when the load imbalance is high enough. The low load imbalance leads to the close values of computational load, when small variations in the system load and performance can cause oscillations in subsets of particles. Memory stress tests cause heterogeneity of non-isolated containers, which reduces the performance of memory bandwidth bound DEM SaaS on the co-located resources. The runtime adapted repartitioning handles the constant and periodically variable performance of non-isolated containers and decreases the total execution time of DEM SaaS.
Source: crossref · Quality: baseline
Research context
OpenAlex topics: Parallel Computing and Optimization Techniques · Cloud Computing and Resource Management · Advanced Data Storage Technologies
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
Affiliations
Department of Graphical Systems, Vilnius Gediminas Technical University, 10223 Vilnius, Lithuania
Laboratory of Parallel Computing, Vilnius Gediminas Technical University, 10223 Vilnius, Lithuania
References (56)
Show source-provided references
1. Energy, Performance and Cost Efficient Cloud Datacentres: A Survey10.1016/j.cosrev.2021.100390 ↗
2. Mell, P., and Grance, T. (2011). The NIST Definition of Cloud Computing, Technical Report SP 800-145.10.6028/NIST.SP.800-145 ↗
3. (2022, December 01). OpenStack. Available online: https://www.openstack.org/.
4. (2022, December 01). Docker. Available online: https://www.docker.com/.
5. A Novel Hybrid Heuristic-Based List Scheduling Algorithm in Heterogeneous Cloud Computing Environment for Makespan Optimization10.1016/j.parco.2021.102828 ↗
6. Devine, K.D., Boman, E.G., and Karypis, G. (2006). Parallel Processing for Scientific Computing, Society for Industrial and Applied Mathematics. Chapter 6.
7. Allocation of Virtual Machines in Cloud Data Centers—A Survey of Problem Models and Optimization Algorithms10.1145/2797211 ↗
8. (2022, December 01). Resource Isolation Based on the L3 Cache and MBA. Available online: https://www.intel.com/content/www/us/en/developer/articles/technical/use-intel-resource-director-technology-to-allocate-memory-bandwidth.html.
9. (2022, December 01). Use Intel® Resource Director Technology to Allocate Memory Bandwidth. Available online: https://www.alibabacloud.com/help/en/container-service-for-kubernetes/latest/use-the-l3-cache-and-mba-to-improve-the-resource-isolation-of-tasks-with-different-priorities.
10. Memory Bandwidth Management for Efficient Performance Isolation in Multi-Core Platforms10.1109/TC.2015.2425889 ↗
11. A Survey of Mathematical Models, Simulation Approaches and Testbeds Used for Research in Cloud Computing10.1016/j.simpat.2013.04.002 ↗
12. A Discrete Numerical Model for Granular Assemblies10.1680/geot.1979.29.1.47 ↗
13. Development of Cloud Services for Patient-Specific Simulations of Blood Flows through Aortic Valves10.1016/j.advengsoft.2016.01.013 ↗
14. A Performance Comparison of Linux Containers and Virtual Machines Using Docker and KVM10.1007/s10586-017-1511-2 ↗
15. Performance Evaluation of Docker Container and Virtual Machine10.1016/j.procs.2020.04.152 ↗
16. Performance Evaluation of Bag of Gangs Scheduling in a Heterogeneous Distributed System10.1016/j.jss.2010.01.009 ↗
17. Evaluation of Gang Scheduling Performance and Cost in a Cloud Computing System10.1007/s11227-010-0481-4 ↗
18. Performance Analysis of Gang Scheduling in a Grid10.1007/s10922-014-9312-x ↗
19. Mohammadi, M., and Bazhirov, T. (2018, January 15–17). Comparative Benchmarking of Cloud Computing Vendors with High Performance Linpack. Proceedings of the 2nd International Conference on High Performance Compilation, Computing and Communications, Hongkong, China.10.1145/3195612.3195613 ↗
20. Shahid, M.A., Alam, M.M., and Su’ud, M.M. (2023). Performance Evaluation of Load-Balancing Algorithms with Different Service Broker Policies for Cloud Computing. Appl. Sci., 13.10.3390/app13031586 ↗
21. A green, secure, and deep intelligent method for dynamic IoT-edge-cloud offloading scenarios
22. Bojato, J., Donado, D., Jimeno, M., Moreno, G., and Villanueva-Polanco, R. (2022). Password Guessability as a Service (PGaaS). Appl. Sci., 12.10.3390/app12031562 ↗
23. Resilient and dependability management in distributed environments: A systematic and comprehensive literature review10.1007/s10586-022-03738-5 ↗
24. Micro-Mechanical Simulation of Geotechnical Problems Using Massively Parallel Computers10.1002/nag.317 ↗
25. Computation and Visualization of Discrete Particle Systems on gLite-Based Grid10.1016/j.advengsoft.2011.02.007 ↗
26. Parallel LES-DEM Simulation of Dense Flows in Fluidized Beds10.1016/j.applthermaleng.2016.07.161 ↗
27. Parallelised Finite/Discrete Element Simulation of Multi-Fracturing Solids and Discrete Systems10.1108/02644400110387154 ↗
28. Large-Scale Parallel Discrete Element Simulations of Granular Flow10.1108/02644400910975478 ↗
29. Parallel Multilevel Series K-Way Partitioning Scheme for Irregular Graphs10.1137/S0036144598334138 ↗
30. The Comparison of Two Domain Repartitioning Methods Used for Parallel Discrete Element Computations of the Hopper Discharge10.1016/j.advengsoft.2014.12.002 ↗
31. A Partitioning Strategy for Nonuniform Problems on Multiprocessors10.1109/TC.1987.1676942 ↗
32. Hybrid Parallelism in MFIX CFD-DEM Using OpenMP10.1016/j.powtec.2014.03.047 ↗
33. Hybrid Parallelization of the LIGGGHTS Open-Source DEM Code10.1016/j.powtec.2015.03.019 ↗
34. A Hybrid Parallel DEM Approach with Workload Balancing Based on HSFC10.1108/EC-01-2016-0019 ↗
35. OpenFPM: A Scalable Open Framework for Particle and Particle-Mesh Codes on Parallel Computers10.1016/j.cpc.2019.03.007 ↗
36. Comparison between Pure MPI and Hybrid MPI-OpenMP Parallelism for Discrete Element Method (DEM) of Ellipsoidal and Poly-Ellipsoidal Particles10.1007/s40571-018-0213-8 ↗
37. From CUDA to OpenCL: Towards a Performance-Portable Solution for Multi-Platform GPU Programming10.1016/j.parco.2011.10.002 ↗
38. Study on the Effect of Grain Morphology on Shear Strength in Granular Materials via GPU Based Discrete Element Method Simulations10.1016/j.powtec.2021.04.038 ↗
39. Billion Degree of Freedom Granular Dynamics Simulation on Commodity Hardware via Heterogeneous Data-Type Representation10.1007/s11044-020-09749-7 ↗
40. Quasi-Real-Time Simulation of Rotating Drum Using Discrete Element Method with Parallel GPU Computing10.1016/j.partic.2011.01.003 ↗
41. Implementing Discrete Element Method for Large-Scale Simulation of Particles on Multiple GPUs10.1016/j.compchemeng.2017.04.019 ↗
42. Application of GPU-DEM Simulation on Large-Scale Granular Handling and Processing in Ironmaking Related Industries10.1016/j.powtec.2019.08.043 ↗
43. The Performance Analysis of the Thermal Discrete Element Method Computations on the GPU10.31577/cai_2022_4_931 ↗
44. Combier, R. (2023, April 07). EDEM Now Available on Rescale’s Cloud Simulation Platform. Available online: https://rescale.com/blog/edem-now-available-on-rescales-cloud-simulation-platform/.
45. Fast, Flexible Particle Simulations—An Introduction to MercuryDPM10.1016/j.cpc.2019.107129 ↗
46. Bystrov, O., Pacevič, R., and Kačeniauskas, A. (2021). Performance of Communication- and Computation-Intensive SaaS on the OpenStack Cloud. Appl. Sci., 11.10.3390/app11167379 ↗
47. Heterogeneous architectures for computational intensive applications: A cost-effectiveness analysis10.1016/j.cam.2014.02.022 ↗
48. Dynamic Load Balancing with over Decomposition in Plasma Plume Simulations10.1016/j.jpdc.2022.01.023 ↗
49. Efficient Microscopy Image Analysis on CPU-GPU Systems with Cost-Aware Irregular Data Partitioning10.1016/j.jpdc.2022.02.004 ↗
50. Data Partitioning on Multicore and Multi-GPU Platforms Using Functional Performance Models10.1109/TC.2014.2375202 ↗
51. Performance Evaluation of Parallel Haemodynamic Computations on Heterogeneous Clouds10.31577/cai_2020_4_695 ↗
52. Zoltan Data Management Services for Parallel Dynamic Applications10.1109/5992.988653 ↗
53. Comparison of Dynamic Behaviour of EMA-3 Railgun under Differently Induced Loadings
54. Discrete-Element Method for Particle Capture by a Body in an Electrostatic Field10.1002/nme.2953 ↗
55. Norouzi, H.R., Zarghami, R., Sotudeh-Gharebagh, R., and Mostoufi, N. (2016). Coupled CFD-DEM Modeling: Formulation, Implementation and Application to Multiphase Flows, John Wiley & Sons.10.1002/9781119005315 ↗
56. (2023, February 01). Stress-ng. A Tool to Load and Stress a Computer System. Available online: https://github.com/ColinIanKing/stress-ng.