journal article·2025Open access

Utility-Driven Edge Caching Optimization with Deep Reinforcement Learning under Uncertain Content Popularity

Mingoo Kwon, Kyeongmin Kim, Minseok Song

Computers, Materials & Continua· Volume 85· Issue 1

Abstract

Efficient edge caching is essential for maximizing utility in video streaming systems, especially under constraints such as limited storage capacity and dynamically fluctuating content popularity. Utility, defined as the bene... | Find, read and cite all the research you need on Tech Science Press
Source: openalex_inverted_index · Quality: baseline

Research context

OpenAlex topics: Caching and Content Delivery · Cooperative Communication and Network Coding

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

References (32)

Show source-provided references
1. A DQN-based cache strategy for mobile edge networks
2. ECC: edge collaborative caching strategy for differentiated services load-balancing
3. QoE-traffic optimization through collaborative edge caching in adaptive mobile video streaming10.1109/ACCESS.2018.2870855 ↗
4. Cisco. Cisco Annual Internet Report (2018–2023); 2020. [cited 2025 Jun 4]. Available from: https://www.cisco.com/./annual-internet-report/index.html,.
5. QoE-aware collaborative edge caching and computing for adaptive video streaming10.1109/TWC.2023.3331724 ↗
6. Cooperative edge caching in user-centric clustered mobile networks
7. Modeling dynamics of online video popularity10.1109/TMM.2016.2579600 ↗
8. Towards real-time video caching at edge servers: a cost-aware deep Q-learning solution10.1109/TMM.2021.3125803 ↗
9. Federated deep reinforcement learning for recommendation-enabled edge caching in mobile edge-cloud computing networks10.1109/JSAC.2023.3235443 ↗
10. Dynamic content update for wireless edge caching via deep reinforcement learning10.1109/LCOMM.2019.2931688 ↗
11. Deep reinforcement learning-based edge caching in wireless networks10.1109/TCCN.2020.2968326 ↗
12. A deep reinforcement learning-based technique for enhancing cache hit rate by adapting to dynamic file request patterns10.30693/SMJ.2025.14.1.26 ↗
13. Cost-effective, quality-oriented transcoding of live-streamed video on edge-servers
14. Bitrate adaptation for video streaming services in edge caching systems10.1109/ACCESS.2020.3011517 ↗
15. Hit ratio and content quality tradeoff for adaptive bitrate streaming in edge caching systems10.1109/JSYST.2020.3019035 ↗
16. Hit ratio and latency optimization for caching systems: a survey
17. Representation selection problem: optimizing video delivery through caching
18. Adaptive offline and online similarity-based caching10.1109/LNET.2020.3031961 ↗
19. Content placement in networks of similarity caches10.1016/j.comnet.2021.108570 ↗
20. Similarity caching in dynamic cooperative edge networks: an adversarial bandit approach10.1109/TMC.2024.3500132 ↗
21. Adaptive bitrate video caching and processing in mobile-edge computing networks10.1109/TMC.2018.2871147 ↗
22. EdgeDASH: exploiting network-assisted adaptive video streaming for edge caching10.1109/TNSM.2020.3037147 ↗
23. Coffee: cost-effective edge caching for 360 degree live video streaming
24. A utility-based optimization framework for edge service entity caching10.1109/TPDS.2019.2915218 ↗
25. Mehrabi A, Siekkinen M, Ylä-Jääski A. Cache-aware QoE-traffic optimization in mobile edge assisted adaptive video streaming. arXiv:1805.09255. 2018.10.1109/ACCESS.2018.2870855 ↗
26. Quality-aware transcoding task allocation under limited power in live-streaming systems10.1109/JSYST.2021.3103526 ↗
27. Caching in dynamic environments: a near-optimal online learning approach10.1109/TMM.2021.3132156 ↗
28. A proof for the queuing formula: L = λW10.1287/opre.9.3.383 ↗
29. Schulman J, Wolski F, Dhariwal P, Radford A, Kimov O. Proximal policy optimization algorithms. arXiv:1707. 06347. 2017.
30. Implementing action mask in proximal policy optimization (PPO) algorithm10.1016/j.icte.2020.05.003 ↗
31. Optuna: a next-generation hyperparameter optimization framework
32. Characteristics of youtube network traffic at a campus network-measurements, models, and implications10.1016/j.comnet.2008.09.022 ↗