Adaptive BBU Migration Based on Deep Q-Learning for Cloud Radio Access Network
Source abstract
Abstract
The efficiency of the current cellular network is limited due to the imbalance between resource availability and traffic demand. To overcome these limitations, baseband units (BBUs) are deployed on virtual machines (VMs) to form a virtual pool of BBUs. This setup enables the pooling of hardware resources, reducing the costs associated with building base stations (BSs) and simplifying both management and control. However, extreme levels of server resource use within the pool can increase physical maintenance costs and impact virtual BBU performance. This study introduces an adaptive, threshold-based dynamic migration strategy for virtual BBUs within the iCanCloud framework by setting upper and lower limits on the servers’ resource usage in the pool. The proposed method determines whether to initiate a migration by evaluating resource usage on each compute node and identifies the target node for migration if required. This aims to balance server load and cut energy consumption, and also to avoid unnecessary migration because of too high or too low server load, and effectively determine the time to trigger migration and not depend only on a certain instantaneous peak of server resource utilization. This paper used a deep Q-network learning method to predict resource utilization and make an accurate migration decision based on a history dataset. Experimental results show that as compared with Kalman filter prediction and other traditional methods, this model can effectively lower the cost of VM migration by decreasing the migration time and occurrence of it to enhance overall performance while reducing energy consumption.
Source: crossref · Quality: baseline
Research context
OpenAlex topics: IoT and Edge/Fog Computing · Caching and Content Delivery · Age of Information Optimization
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
Affiliations
Department of Electrical Engineering, College of Engineering, University of Baghdad, Baghdad 10011, Iraq
Department of Informatics Management System, College of Informatics Business, University of Information Technology and Communications, Baghdad 00964, Iraq
References (49)
Show source-provided references
1. Towards 6G Internet of Things: Recent advances, use cases, and open challenges
2. Enabling massive IoT toward 6G: A comprehensive survey10.1109/JIOT.2021.3063686 ↗
3. Faizan, Q. (2019). Enhancing QOS Performance of the 5G Network by Characterizing Mm-Wave Channel and Optimizing Interference Cancellation Scheme/Faizan Qamar, University of Malaya.
4. Bani-Bakr, A., Dimyati, K., Hindia, M.N., Wong, W.R., and Izam, T.F.T.M.N. (2021). Joint successful transmission probability, delay, and energy efficiency caching optimization in fog radio access network. Electronics, 10.10.3390/electronics10151847 ↗
5. Robot Path Planning in Unknown Environments with Multi-Objectives Using an Improved COOT Optimization Algorithm
6. Vision, requirements, and technology trend of 6G: How to tackle the challenges of system coverage, capacity, user data-rate and movement speed10.1109/MWC.001.1900333 ↗
7. Jabbar, S.Q., Kadhim, D.J., and Li, Y. (2018). Developing a Video Buffer Framework for Video Streaming in Cellular Networks. Wirel. Commun. Mob. Comput., 2018.10.1155/2018/6584845 ↗
8. Medium access control protocol design for wireless communications and networks review10.11591/ijece.v12i2.pp1711-1723 ↗
9. Enabling remote-control for the power sub stations over LTE-A networks10.1007/s11235-018-0465-x ↗
10. A new smart approach of an efficient energy consumption management by using a machine-learning technique
11. Toward green and soft: A 5G perspective10.1109/MCOM.2014.6736745 ↗
12. Wireless network cloud: Architecture and system requirements10.1147/JRD.2009.2037680 ↗
13. Gao, Z., Zhang, J., Yan, S., Xiao, Y., Simeonidou, D., and Ji, Y. (2019, January 3–7). Deep Reinforcement Learning for BBU Placement and Routing in C-RAN. Proceedings of the 2019 Optical Fiber Communications Conference and Exhibition (OFC), San Diego, CA, USA.10.1364/OFC.2019.W2A.22 ↗
14. Li, Y., Bhopalwala, M., Das, S., Yu, J., Mo, W., Ruffini, M., and Kilper, D.C. (2018, January 11–15). Joint Optimization of BBU Pool Allocation and Selection for C-RAN Networks. Proceedings of the 2018 Optical Fiber Communications Conference and Exposition (OFC), San Diego, CA, USA.10.1364/OFC.2018.Th1B.5 ↗
15. Things You Should Know About Fronthaul10.1109/JLT.2014.2382872 ↗
16. Towards 6G Technology: Insights into Resource Management for Cloud RAN Deployment10.3390/iot5020020 ↗
17. Zhang, Y., Budzisz, L., Meo, M., Conte, A., Haratcherev, I., Koutitas, G., Tassiulas, L., Marsan, M.A., and Lambert, S. (2013, January 23–25). An overview of energy-efficient base station management techniques. Proceedings of the 2013 24th Tyrrhenian International Workshop on Digital Communications-Green ICT (TIWDC), Genoa, Italy.
18. Ran, C., Wang, S.H., and Wang, C. (2015, January 9–12). Optimal load balancing in cloud radio access networks. Proceedings of the Wireless Communications and Networking Conference, WCNC, New Orleans, LA, USA.
19. Debaillie, B., Desset, C., and Louagie, F. (2015, January 11–14). A flexible and future-proof power model for cellular base stations. Proceedings of the 2015 IEEE 81st Vehicular Technology Conference, VTC Spring, Scotland, UK.10.1109/VTCSpring.2015.7145603 ↗
20. Cloud ran for mobile networks—A technology overview10.1109/COMST.2014.2355255 ↗
21. Vaezi, M., and Zhang, Y. (2017). Cloud Mobile Networks, Springer.10.1007/978-3-319-54496-0 ↗
22. Mahapatra, B., Kumar, R., Kumar, S., and Turuk, A.K. (2018, January 6–8). A Heterogeneous Load Balancing Approach in Centralized BBU-Pool of C-RAN Architecture. Proceedings of the 2018 3rd International Conference for Convergence in Technology (I2CT), Pune, India.10.1109/I2CT.2018.8529505 ↗
23. Deep Q-Learning based resource allocation and load balancing in a mobile edge system serving different types of user requests
24. Kingma, D.P., and Ba, J. (2014). Adam: A method for stochastic optimization. arXiv.
25. A super base station based centralized network architecture for 5g mobile communication systems10.1016/j.dcan.2015.02.003 ↗
26. Wang, C., Wang, Y., Gong, C., Wan, Y., Cai, L., and Luo, Q. (2013, January 8–11). A study on virtual bs live migration—A seamless and lossless mechanism for virtual bs migration. Proceedings of the Annual International Symposium on Personal, Indoor, and Mobile Radio Communications, PIMRC, London, UK.
27. Beloglazov, A., and Buyya, R. (December, January 29). Adaptive threshold-based approach for energy-efficient consolidation of virtual machines in cloud data centers. Proceedings of the 8th International Workshop on Middleware for Grids, Clouds and e-Science, MCG 2010, Bangalore, India.10.1145/1890799.1890803 ↗
28. Ferdouse, L., Ejaz, W., Anpalagan, A., and Khattak, A.M. (2017, January 3–7). Joint workload scheduling and bbu allocation in cloud-ran for 5g networks. Proceedings of the Symposium on Applied Computing, Marrakech, Morocco.10.1145/3019612.3019770 ↗
29. Toward a Live BBU Container Migration in Wireless Networks10.1109/OJCOMS.2022.3149965 ↗
30. Crow search based virtual machine placement strategy in cloud data centers with live migration10.1016/j.compeleceng.2017.12.032 ↗
31. Sabella, D., Rost, P., Sheng, Y., Pateromichelakis, E., Salim, U., Guitton-Ouhamou, P., Girolamo, D., and Giuliani, G. (2013, January 3–5). Ran as a service challenges of designing a flexible ran architecture in a cloud-based heterogeneous mobile network. Proceedings of the 2013 Future Network & Mobile Summit, Lisbon, Portugal.
32. Sharma, N.K., Sharma, P., and Guddeti, R.M. (2018, January 15–17). Energy efficient quality of service aware virtual machine migration in cloud computing. Proceedings of the International Conference on Recent Advances in Information Technology, RAIT, Dhanbad, India.10.1109/RAIT.2018.8389047 ↗
33. Melhem, S.B., Agarwal, A., Goel, N., and Zaman, M. (2017, January 24–26). Minimizing Biased VM Selection in Live VM Migration. Proceedings of the 2017 3rd International Conference of Cloud Computing Technologies and Applications (CloudTech), Rabat, Morocco.10.1109/CloudTech.2017.8284730 ↗
34. Beloglazov, A. (2013). Energy-Efficient Management of Virtual Machines in Data Centers for Cloud Computing. [Ph.D. Theis, University of Melbourne].
35. Energy-efficient framework for virtual machine consolidation in cloud data centers10.1109/CC.2017.8107643 ↗
36. Li, Z., and Wu, G. (2016, January 17–18). Optimizing VM Live Migration Strategy Based on Migration Time Cost Modeling. Proceedings of the 2016 Symposium on Architectures for Networking and Communications Systems, Santa Clara, CA, USA.10.1145/2881025.2881035 ↗
37. Razali, R.A.M., Ab Rahman, R., Zaini, N., and Samad, M. (2014, January 3–5). Virtual machine migration implementation in load balancing for Cloud computing. Proceedings of the 2014 5th International Conference on Intelligent and Advanced Systems (ICIAS), Kuala Lumpur, Malaysia.10.1109/ICIAS.2014.6869540 ↗
38. Raghunath, B.R., and Annappa, B. (2018, January 6–8). Dynamic Resource Allocation Using Fuzzy Prediction System. Proceedings of the 2018 3rd International Conference for Convergence in Technology (I2CT), Pune, India.10.1109/I2CT.2018.8529674 ↗
39. Yang, G., and Zhang, W.J. (2015, January 18–20). Research of optimized resource allocation strategy based on Openstack. Proceedings of the 2015 12th International Computer Conference on Wavelet Active Media Technology and Information Processing (ICCWAMTIP), Chengdu, China.
40. Wang, C., Cao, Y., Zhang, Z., and Wang, W. (2020). Dual threshold adaptive dynamic migration strategy of virtual resources based on bbu pool. Electronics, 9.10.3390/electronics9020314 ↗
41. Castane, G.G., Nunez, A., and Carretero, J. (2012, January 10–13). iCanCloud: A brief architecture overview. Proceedings of the 2012 10th IEEE International Symposium on Parallel and Distributed Processing with Applications, Madrid, Spain.10.1109/ISPA.2012.131 ↗
42. Energy-aware resource allocation heuristics for efficient management of data centers for Cloud computing10.1016/j.future.2011.04.017 ↗
43. Virtual machine selection and placement for dynamic consolidation in Cloud computing environment10.1007/s11704-015-4286-8 ↗
44. Song, Y., Wang, H., Li, Y., Feng, B., and Sun, Y. (2009, January 18–21). Multi-Tiered On-Demand Resource Scheduling for VM-Based Data Center. Proceedings of the 2009 9th IEEE/ACM International Symposium on Cluster Computing and the Grid, Shanghai, China.10.1109/CCGRID.2009.11 ↗
45. Li, Y., Hu, X., and Wang, F. (2020). A robust statistical framework for anomaly detection in sensor networks using median absolute deviation. Sensors, 20.
46. Feng, W., Qiao, M., and Li, X. (2020). An IoT-based anomaly detection method using interquartile range and K-means clustering for smart manufacturing. Sensors, 20.
47. A Load Ratio-Based Dynamic Scheduling Algorithm for Cloud Computing Environments
48. Makridakis, S., Spiliotis, E., and Assimakopoulos, V. (2018). Statistical and Machine Learning Forecasting Methods: Concerns and Ways Forward. PLoS ONE, 13.10.1371/journal.pone.0194889 ↗
49. Benvenuto, D., Giovanetti, M., Vassallo, L., Angeletti, S., and Ciccozzi, M. (2020). Application of the ARIMA Model on the COVID-2019 Epidemic Dataset. Data Brief, 29.10.1016/j.dib.2020.105340 ↗