journal article·2024-04-11Open access

Connection-Aware Heuristics for Scheduling and Distributing Jobs under Dynamic Dew Computing Environments

Pablo Sanabria, Sebastián Montoya, Andrés Neyem, Rodrigo Toro Icarte, Matías Hirsch, Cristian Mateos

Applied Sciences· Volume 14· Issue 8

Abstract

Due to the widespread use of mobile and IoT devices, coupled with their continually expanding processing capabilities, dew computing environments have become a significant focus for researchers. These environments enable resource-constrained devices to contribute computing power to a local network. One major challenge within these environments revolves around task scheduling, specifically determining the optimal distribution of jobs across the available devices in the network. This challenge becomes particularly pronounced in dynamic environments where network conditions constantly change. This work proposes integrating the “reliability” concept into cutting-edge human-design job distribution heuristics named ReleSEAS and RelBPA as a means of adapting to dynamic and ever-changing network conditions caused by nodes’ mobility. Additionally, we introduce a reinforcement learning (RL) approach, embedding both the notion of reliability and real-time network status into the RL agent. Our research rigorously contrasts our proposed algorithms’ throughput and job completion rates with their predecessors. Simulated results reveal a marked improvement in overall throughput, with our algorithms potentially boosting the environment’s performance. They also show a significant enhancement in job completion within dynamic environments compared to baseline findings. Moreover, when RL is applied, it surpasses the job completion rate of human-designed heuristics. Our study emphasizes the advantages of embedding inherent network characteristics into job distribution algorithms for dew computing. Such incorporation gives them a profound understanding of the network’s diverse resources. Consequently, this insight enables the algorithms to manage resources more adeptly and effectively.
Source: crossref · Quality: baseline

Research context

OpenAlex topics: Optimization and Search Problems · IoT and Edge/Fog Computing · Smart Parking Systems Research

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

Computer Science Department, Pontificia Universidad Católica de Chile, Macul 7820436, Región Metropolitana, Chile

Centro Nacional de Inteligencia Artificial CENIA, Macul 7820436, Región Metropolitana, Chile

ISISTAN-UNCPBA-CONICET, Tandil CP 7000, Buenos Aires, Argentina

Funding

National Agency for Research and Development (ANID)/Scholarship Program/DOCTORADO NACIONAL · National Center for Artificial Intelligence CENIA · CONICET

References (62)

Show source-provided references
1. Definition and categorization of dew computing
2. An introduction to dew computing: Definition, concept and implications10.1109/ACCESS.2017.2775042 ↗
3. Augmenting computing capabilities at the edge by jointly exploiting mobile devices: A survey10.1016/j.future.2018.06.005 ↗
4. Khalid, M.N.B. (2020, January 18–20). Deep Learning-Based Dew Computing with Novel Offloading Strategy. Proceedings of the International Conference on Security, Privacy and Anonymity in Computation, Communication and Storage, Nanjing, China.10.1007/978-3-030-68884-4_37 ↗
5. A Brief Survey of Future Computing Technologies in Cloud Environment
6. Battery-aware centralized schedulers for CPU-bound jobs in mobile Grids10.1016/j.pmcj.2015.08.003 ↗
7. New Heuristics for Scheduling and Distributing Jobs under Hybrid Dew Computing Environments10.1155/2021/8899660 ↗
8. Analysis of variants in Round Robin Algorithms for load balancing in Cloud Computing
9. Sanabria, P., Tapia, T.F., Toro Icarte, R., and Neyem, A. (2022). Solving Task Scheduling Problems in Dew Computing via Deep Reinforcement Learning. Appl. Sci., 12.10.3390/app12147137 ↗
10. Sutton, R.S., and Barto, A.G. (2018). Reinforcement Learning: An Introduction, MIT Press.
11. Akkaya, I., Andrychowicz, M., Chociej, M., Litwin, M., McGrew, B., Petron, A., Paino, A., Plappert, M., Powell, G., and Ribas, R. (2019). Solving rubik’s cube with a robot hand. arXiv.
12. Li, J., Monroe, W., Ritter, A., Galley, M., Gao, J., and Jurafsky, D. (2016). Deep reinforcement learning for dialogue generation. arXiv.10.18653/v1/D16-1127 ↗
13. Deep reinforcement learning for de novo drug design10.1126/sciadv.aap7885 ↗
14. A survey on mobile edge computing: The communication perspective10.1109/COMST.2017.2745201 ↗
15. Edge computing: A survey10.1016/j.future.2019.02.050 ↗
16. Drolia, U., Martins, R., Tan, J., Chheda, A., Sanghavi, M., Gandhi, R., and Narasimhan, P. (2013, January 18–21). The case for mobile edge-clouds. Proceedings of the 2013 IEEE 10th International Conference on Ubiquitous Intelligence and Computing and 2013 IEEE 10th International Conference on Autonomic and Trusted Computing, Vietri sul Mare, Italy.10.1109/UIC-ATC.2013.94 ↗
17. Towards a practical framework for code offloading in the Internet of Things10.1016/j.future.2018.09.056 ↗
18. Edge computing: Vision and challenges10.1109/JIOT.2016.2579198 ↗
19. A survey on the edge computing for the Internet of Things10.1109/ACCESS.2017.2778504 ↗
20. Opportunistic edge computing: Concepts, opportunities and research challenges10.1016/j.future.2018.07.040 ↗
21. Internet of ships: A survey on architectures, emerging applications, and challenges10.1109/JIOT.2020.2993411 ↗
22. A Two-Phase Energy-Aware Scheduling Approach for CPU-Intensive Jobs in Mobile Grids10.1007/s10723-016-9387-6 ↗
23. Hirsch, M., Mateos, C., Rodriguez, J.M., Zunino, A., Garí, Y., and Monge, D.A. (2017, January 4–8). A performance comparison of data-aware heuristics for scheduling jobs in mobile grids. Proceedings of the 2017 XLIII Latin American Computer Conference (CLEI), Córdoba, Argentina.10.1109/CLEI.2017.8226474 ↗
24. Exploiting Massive D2D Collaboration for Energy-Efficient Mobile Edge Computing10.1109/MWC.2017.1600321 ↗
25. Towards resource sharing in mobile device clouds10.1145/2534169.2491276 ↗
26. Heuristics to allocate high-performance cloudlets for computation offloading in mobile ad hoc clouds10.1007/s11227-015-1425-9 ↗
27. Exploiting composition of mobile devices for maximizing user QoS under energy constraints in mobile grid10.1016/j.ins.2014.04.018 ↗
28. Reliable resources brokering scheme in wireless grids based on non-cooperative bargaining game10.1016/j.jnca.2013.07.007 ↗
29. Mobile Computations with Surrounding Devices10.1145/2656214 ↗
30. Energy efficient and robust allocation of interdependent tasks on mobile ad hoc computational grid10.1002/cpe.3297 ↗
31. New scheduling approach using reinforcement learning for heterogeneous distributed systems10.1016/j.jpdc.2017.05.001 ↗
32. DRLCOA: Deep Reinforcement Learning Computation Offloading Algorithm in Mobile Cloud Computing
33. Cheng, M., Li, J., and Nazarian, S. (2018, January 22–25). DRL-cloud: Deep reinforcement learning-based resource provisioning and task scheduling for cloud service providers. Proceedings of the 2018 23rd Asia and South Pacific Design Automation Conference (ASP-DAC), Jeju, Republic of Korea.10.1109/ASPDAC.2018.8297294 ↗
34. Deep Reinforcement Learning for Online Computation Offloading in Wireless Powered Mobile-Edge Computing Networks10.1109/TMC.2019.2928811 ↗
35. Ha, S., Choi, E., Ko, D., Kang, S., and Lee, S. (2023, January 27–31). Efficient Resource Augmentation of Resource Constrained UAVs Through EdgeCPS. Proceedings of the 38th ACM/SIGAPP Symposium on Applied Computing, Tallinn, Estonia.10.1145/3555776.3577846 ↗
36. Ren, J., and Xu, S. (May, January 25). DDPG Based Computation Offloading and Resource Allocation for MEC Systems with Energy Harvesting. Proceedings of the 2021 IEEE 93rd Vehicular Technology Conference (VTC2021-Spring), Virtual.10.1109/VTC2021-Spring51267.2021.9448922 ↗
37. Deep reinforcement learning based mobile edge computing for intelligent Internet of Things10.1016/j.phycom.2020.101184 ↗
38. Decentralized adaptive resource-aware computation offloading & caching for multi-access edge computing networks
39. Heterogeneous Task Offloading and Resource Allocations via Deep Recurrent Reinforcement Learning in Partial Observable Multi-Fog Networks10.1109/JIOT.2020.3009540 ↗
40. Optimization of lightweight task offloading strategy for mobile edge computing based on deep reinforcement learning10.1016/j.future.2019.07.019 ↗
41. Li, J., Gao, H., Lv, T., and Lu, Y. (2018, January 15–18). Deep reinforcement learning based computation offloading and resource allocation for MEC. Proceedings of the 2018 IEEE Wireless Communications and Networking Conference (WCNC), Barcelona, Spain.10.1109/WCNC.2018.8377343 ↗
42. Task Offloading and Resource Allocation for Mobile Edge Computing by Deep Reinforcement Learning Based on SARSA10.1109/ACCESS.2020.2981434 ↗
43. Intelligent Caching for Vehicular Dew Computing in Poor Network Connectivity Environments10.1145/3643038 ↗
44. Khatua, S., Manerba, D., Maity, S., and De, D. (2023). Dew Computing: The Sustainable IoT Perspectives, Springer.
45. Pal, M.N., Sengupta, D., Tran, T.A., and De, D. (2023). Dew Computing: The Sustainable IoT Perspectives, Springer.
46. DoME: Dew computing based microservice execution in mobile edge using Q-learning10.1007/s10489-022-04087-x ↗
47. Cobbe, K., Klimov, O., Hesse, C., Kim, T., and Schulman, J. (2019, January 9–15). Quantifying generalization in reinforcement learning. Proceedings of the 36th International Conference on Machine Learning (ICML), Long Beach, CA, USA.
48. Cobbe, K., Hesse, C., Hilton, J., and Schulman, J. (2020, January 13–18). Leveraging procedural generation to benchmark reinforcement learning. Proceedings of the 37th International Conference on Machine Learning (ICML), Virtual Event.
49. DewSim: A trace-driven toolkit for simulating mobile device clusters in Dew computing environments10.1002/spe.2696 ↗
50. Manweiler, J., Santhapuri, N., Choudhury, R.R., and Nelakuditi, S. (2013, January 14–19). Predicting length of stay at wifi hotspots. Proceedings of the 2013 IEEE INFOCOM, Turin, Italy.10.1109/INFCOM.2013.6567123 ↗
51. Blanford, J.I., Huang, Z., Savelyev, A., and MacEachren, A.M. (2015). Geo-located tweets. Enhancing mobility maps and capturing cross-border movement. PLoS ONE, 10.10.1371/journal.pone.0129202 ↗
52. Human mobility: Models and applications10.1016/j.physrep.2018.01.001 ↗
53. A Survey of Human Mobility Models10.1109/ACCESS.2019.2939203 ↗
54. Falaki, H., Mahajan, R., Kandula, S., Lymberopoulos, D., Govindan, R., and Estrin, D. (2010, January 15–18). Diversity in Smartphone Usage. Proceedings of the 8th International Conference on Mobile Systems, Applications, and Services (MobiSys’10), New York, NY, USA.10.1145/1814433.1814453 ↗
55. Simulating human mobility patterns in urban areas10.1016/j.simpat.2015.12.002 ↗
56. The changing usage of a mature campus-wide wireless network10.1016/j.comnet.2008.05.003 ↗
57. Gorawski, M., and Grochla, K. (2014). Man-Machine Interactions 3, Springer.
58. Panisson, A. (2023, November 27). Pymobility v0.1—Python Implementation of Mobility Models. Available online: https://zenodo.org/records/9873.
59. Zhao, K., Tarkoma, S., Liu, S., and Vo, H. (2016, January 5–8). Urban human mobility data mining: An overview. Proceedings of the 2016 IEEE International Conference on Big Data (Big Data), Washington, DC, USA.10.1109/BigData.2016.7840811 ↗
60. Brockman, G., Cheung, V., Pettersson, L., Schneider, J., Schulman, J., Tang, J., and Zaremba, W. (2016). Openai gym. arXiv.
61. Zhang, A., Ballas, N., and Pineau, J. (2018). A dissection of overfitting and generalization in continuous reinforcement learning. arXiv.
62. Zhang, C., Vinyals, O., Munos, R., and Bengio, S. (2018). A study on overfitting in deep reinforcement learning. arXiv.