Optimizing Container Placement in Data Centers by Deep Reinforcement Learning
Source abstract
Abstract
As our society becomes increasingly digitized, the demand for computing power provided by data centers continues to grow; consequently, operating costs are increasing exponentially. Data centers supply virtualized servers to customers, primarily in the form of lightweight containers. Since the number of containers to be allocated is fixed, they should be optimally placed on physical servers to minimize the number of required servers and reduce costs. However, current data center operations do not prioritize reducing the number of physical servers through optimized container placement. Instead, containers are distributed across existing servers primarily to maintain stability. Therefore, costs associated with servers, auxiliary facilities, and electricity consumption have increased. To address this issue, we propose an optimization method that ensures economic efficiency without compromising system stability. Specifically, we utilize deep reinforcement learning (DRL), which has been widely applied in various fields, to optimize container placement. Our approach outperforms traditional heuristic algorithms and offers the additional advantage of handling fixed-size inputs, enabling flexible operation regardless of the number of containers. Using DRL in container placement has further reduced the number of servers and operating costs while enhancing overall system flexibility.
Source: crossref · Quality: baseline
Research context
OpenAlex topics: Cloud Computing and Resource Management · IoT and Edge/Fog Computing · Software-Defined Networks and 5G
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
Affiliations
Department of Computer Engineering, Chungnam National University, Daejeon 34134, Republic of Korea
References (20)
Show source-provided references
1. Energy efficiency in cloud computing data centers: A survey on software technologies10.1007/s10586-022-03713-0 ↗
2. Data center energy and cost saving evaluation10.1016/j.egypro.2015.07.178 ↗
3. A Novel Energy Efficient Scheduling for VM Consolidation and Migration in Cloud Data Centers
4. Emerging trends, techniques and open issues of containerization: A review10.1109/ACCESS.2019.2945930 ↗
5. A placement architecture for a container as a service (CaaS) in a cloud environment10.1186/s13677-019-0131-1 ↗
6. Deng, Q., Tan, X., Yang, J., Zheng, C., Wang, L., and Xu, Z. (2022, January 4–6). A Secure Container Placement Strategy Using Deep Reinforcement Learning in Cloud. Proceedings of the 2022 IEEE 25th International Conference on Computer Supported Cooperative Work in Design (CSCWD), Hangzhou, China.10.1109/CSCWD54268.2022.9776226 ↗
7. Kim, M.J., Hong, J.S., and Kim, W. (2019). An efficient representation using harmony search for solving the virtual machine consolidation. Sustainability, 11.10.3390/su11216030 ↗
8. Long, S., Li, Z., Xing, Y., Tian, S., Li, D., and Yu, R. (2020, January 14–16). A Reinforcement Learning-Based Virtual Machine Placement Strategy in Cloud Data Centers. Proceedings of the 2020 IEEE 22nd International Conference, Cuvu, Fiji.10.1109/HPCC-SmartCity-DSS50907.2020.00028 ↗
9. A survey on scheduling strategies for workflows in cloud environment and emerging trends10.1145/3325097 ↗
10. Machine learning-based orchestration of containers: A taxonomy and future directions10.1145/3510415 ↗
11. Wu, W., Fan, C., Huang, J., Liu, Z., and Yan, J. (2023). Machine learning for the multidimensional bin packing problem: Literature review and empirical evaluation. arXiv.
12. Energy optimized container placement for cloud data centers: A meta-heuristic approach10.1007/s11227-023-05462-2 ↗
13. Laterre, A., Fu, F., Jabri, M.K., Cohen, A.-S., Kas, D., Hajjar, K., Dahl, T.S., Kerkeni, A., and Beguir, K. (2018). Ranked reward: Enabling self-play reinforcement learning for combinatorial optimization. arXiv.
14. Li, J., Dong, J., Li, F., and Xu, H. (2024, January 15–17). Reinforcement learning based container placement strategies. Proceedings of the 2024 4th International Conference on Electronic Information Engineering and Computer (EIECT), Shenzhen, China.10.1109/EIECT64462.2024.10867252 ↗
15. CARL: Cost-Optimized Online Container Placement on VMs Using Adversarial Reinforcement Learning10.1109/TCC.2025.3528446 ↗
16. (2025, March 28). Kubernetes Scheduler. Available online: https://kubernetes.io/docs/concepts/scheduling-eviction/kube-scheduler/.
17. Park, U.Y. (2025, March 28). Actor-Critic, Artificial Intelligence and Machine Learning Dictionary, Wikidocs. Available online: https://wikidocs.net/163301.
18. Deep reinforcement learning: A brief survey10.1109/MSP.2017.2743240 ↗
19. Hare, J. (2019). Dealing with sparse rewards in reinforcement learning. arXiv.
20. Computational benefits of intermediate rewards for goal-reaching policy learning10.1613/jair.1.13326 ↗