Deep Q-Learning Technique for Offloading Offline/Online Computation in Blockchain-Enabled Green IoT-Edge Scenarios
Source abstract
Abstract
The number of Internet of Things (IoT)-related innovations has recently increased exponentially, with numerous IoT objects being invented one after the other. Where and how many resources can be transferred to carry out tasks or applications is known as computation offloading. Transferring resource-intensive computational tasks to a different external device in the network, such as a cloud, fog, or edge platform, is the strategy used in the IoT environment. Besides, offloading is one of the key technological enablers of the IoT, as it helps overcome the resource limitations of individual objects. One of the major shortcomings of previous research is the lack of an integrated offloading framework that can operate in an offline/online environment while preserving security. This paper offers a new deep Q-learning approach to address the IoT-edge offloading enabled blockchain problem using the Markov Decision Process (MDP). There is a substantial gap in the secure online/offline offloading systems in terms of security, and no work has been published in this arena thus far. This system can be used online and offline while maintaining privacy and security. The proposed method employs the Post Decision State (PDS) mechanism in online mode. Additionally, we integrate edge/cloud platforms into IoT blockchain-enabled networks to encourage the computational potential of IoT devices. This system can enable safe and secure cloud/edge/IoT offloading by employing blockchain. In this system, the master controller, offloading decision, block size, and processing nodes may be dynamically chosen and changed to reduce device energy consumption and cost. TensorFlow and Cooja’s simulation results demonstrated that the method could dramatically boost system efficiency relative to existing schemes. The findings showed that the method beats four benchmarks in terms of cost by 6.6%, computational overhead by 7.1%, energy use by 7.9%, task failure rate by 6.2%, and latency by 5.5% on average.
Source: crossref · Quality: baseline
Research context
OpenAlex topics: IoT and Edge/Fog Computing · Advanced Technologies in Various Fields · Advanced Wireless Communication Technologies
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
Affiliations
Department of Computer Engineering, Shabestar Branch, Islamic Azad University, Shabestar 5381637181, Iran
Department of Computer Engineering, Tabriz Branch, Islamic Azad University, Tabriz 5157944533, Iran
Department of Computer Engineering, Faculty of Engineering and Natural Sciences, Kadir Has University, Istanbul 34083, Turkey
References (69)
Show source-provided references
1. Edge–Cloud Resource Scheduling in Space–Air–Ground-Integrated Networks for Internet of Vehicles10.1109/JIOT.2021.3065583 ↗
2. Applications of ML/DL in the management of smart cities and societies based on new trends in information technologies: A systematic literature review10.1016/j.scs.2022.104089 ↗
3. Radar sensor network resource allocation for fused target tracking: A brief review10.1016/j.inffus.2022.06.009 ↗
4. Continuous Authentication Through Finger Gesture Interaction for Smart Homes Using WiFi10.1109/TMC.2020.2994955 ↗
5. Artificial Intelligence in Underwater Digital Twins Sensor Networks
6. A memetic algorithm based on two_Arch2 for multi-depot heterogeneous-vehicle capacitated arc routing problem10.1016/j.swevo.2021.100864 ↗
7. Multiagent Deep Reinforcement Learning for Task Offloading and Resource Allocation in Cybertwin-Based Networks10.1109/JIOT.2021.3095677 ↗
8. Zenggang, X., Mingyang, Z., Xuemin, Z., Sanyuan, Z., Fang, X., Xiaochao, Z., Yunyun, W., and Xiang, L. (2022). Social Similarity Routing Algorithm based on Socially Aware Networks in the Big Data Environment. J. Signal Process. Syst., 1–15.10.1007/s11265-022-01790-3 ↗
9. Improving IoT Services Using a Hybrid Fog-Cloud Offloading10.1109/ACCESS.2021.3052458 ↗
10. Diversified Personalized Recommendation Optimization Based on Mobile Data10.1109/TITS.2020.3040909 ↗
11. Toward Concurrent Video Multicast Orchestration for Caching-Assisted Mobile Networks10.1109/TVT.2021.3119429 ↗
12. Towards real-time self-powered sensing with ample redundant charges by a piezostack-based frequency-converted generator from human motions10.1016/j.enconman.2022.115466 ↗
13. Decentralized adaptive resource-aware computation offloading & caching for multi-access edge computing networks
14. An adaptive hierarchical decomposition-based method for multi-step cutterhead torque forecast of shield machine10.1016/j.ymssp.2022.109148 ↗
15. 220 GHz Multi Circuit Integrated Front End Based on Solid-State Circuits for High Speed Communication System10.1049/cje.2021.00.295 ↗
16. Lv, Z., Chen, D., Feng, H., Zhu, H., and Lv, H. (2021). Digital Twins in Unmanned Aerial Vehicles for Rapid Medical Resource Delivery in Epidemics. IEEE Trans. Intell. Transp. Syst., 1–9.
17. A Privacy-Preserving Optimization of Neighborhood-Based Recommendation for Medical-Aided Diagnosis and Treatment10.1109/JIOT.2021.3051060 ↗
18. PPO-CPQ: A Privacy-Preserving Optimization of Clinical Pathway Query for E-Healthcare Systems10.1109/JIOT.2020.3007518 ↗
19. A privacy-preserving aggregation scheme based on negative survey for vehicle fuel consumption data10.1016/j.ins.2021.05.009 ↗
20. Smart and Practical Privacy-Preserving Data Aggregation for Fog-Based Smart Grids10.1109/TIFS.2020.3014487 ↗
21. Enabling technologies for fog computing in healthcare IoT systems10.1016/j.future.2018.07.049 ↗
22. Delay-Aware and Energy-Efficient Computation Offloading in Mobile-Edge Computing Using Deep Reinforcement Learning10.1109/TCCN.2021.3066619 ↗
23. Backscatter-Assisted Data Offloading in OFDMA-Based Wireless-Powered Mobile Edge Computing for IoT Networks10.1109/JIOT.2021.3057360 ↗
24. An Indirect Eavesdropping Attack of Keystrokes on Touch Screen through Acoustic Sensing10.1109/TMC.2019.2947468 ↗
25. Edge-Based Blockchain Architecture for Event-Driven IoT using Hierarchical Identity Based Encryption10.1016/j.ipm.2021.102528 ↗
26. Method of Reaching Consensus on Probability of Food Safety Based on the Integration of Finite Credible Data on Block Chain10.1109/ACCESS.2021.3108178 ↗
27. Collaborative Computation Offloading and Resource Allocation in Multi-UAV-Assisted IoT Networks: A Deep Reinforcement Learning Approach10.1109/JIOT.2021.3063188 ↗
28. Mobility-Aware Offloading and Resource Allocation in a MEC-Enabled IoT Network With Energy Harvesting10.1109/JIOT.2021.3081983 ↗
29. A Secure and Anonymous Communicate Scheme over the Internet of Things
30. Improving Visual Reasoning Through Semantic Representation10.1109/ACCESS.2021.3074937 ↗
31. A New Perspective of E-Trust in the Era of Social Media: Insights From Customer Satisfaction Data10.1109/TEM.2020.2985379 ↗
32. Emergency-level-based healthcare information offloading over fog network10.1007/s12083-018-0715-4 ↗
33. Edge-Enabled WBANs for Efficient QoS Provisioning Healthcare Monitoring: A Two-Stage Potential Game-Based Computation Offloading Strategy10.1109/ACCESS.2020.2992639 ↗
34. EEDTO: An energy-efficient dynamic task offloading algorithm for blockchain-enabled IoT-edge-cloud orchestrated computing10.1109/JIOT.2020.3033521 ↗
35. Blockchain Storage and Computation Offloading for Cooperative Mobile-Edge Computing10.1109/JIOT.2021.3056656 ↗
36. A Novel Ultrawideband Branch Waveguide Coupler With Low Amplitude Imbalance10.1109/TMTT.2022.3186326 ↗
37. Improving high-impact bug report prediction with combination of interactive machine learning and active learning10.1016/j.infsof.2021.106530 ↗
38. Representative Task Self-Selection for Flexible Clustered Lifelong Learning10.1109/TNNLS.2020.3042500 ↗
39. Li, J., Gao, H., Lv, T., and Lu, Y. (2018, January 15–18). Deep reinforcement learning based computation offloading and resource allocation for MEC. Proceedings of the 2018 IEEE Wireless Communications and Networking Conference (WCNC), Barcelona, Spain.10.1109/WCNC.2018.8377343 ↗
40. Energy-Efficient Resource Allocation for Blockchain-Enabled Industrial Internet of Things With Deep Reinforcement Learning10.1109/JIOT.2020.3030646 ↗
41. Optimized Computation Offloading Performance in Virtual Edge Computing Systems Via Deep Reinforcement Learning10.1109/JIOT.2018.2876279 ↗
42. BeCome: Blockchain-Enabled Computation Offloading for IoT in Mobile Edge Computing10.1109/TII.2019.2936869 ↗
43. Deep reinforcement learning assisted edge-terminal collaborative offloading algorithm of blockchain computing tasks for energy Internet10.1016/j.ijepes.2021.107022 ↗
44. Mobility Aware Blockchain Enabled Offloading and Scheduling in Vehicular Fog Cloud Computing10.1109/TITS.2021.3056461 ↗
45. Privacy-Preserved Task Offloading in Mobile Blockchain With Deep Reinforcement Learning10.1109/TNSM.2020.3010967 ↗
46. Artificial Intelligence and Blockchain-Assisted Offloading Approach for Data Availability Maximization in Edge Nodes10.1109/TVT.2021.3058689 ↗
47. A blockchain-based computation offloading method for edge computing in 5G networks10.1002/spe.2749 ↗
48. Blockchain-Based Task Offloading in Drone-Aided Mobile Edge Computing10.1109/MNET.011.2000222 ↗
49. Online Learning for Offloading and Autoscaling in Energy Harvesting Mobile Edge Computing10.1109/TCCN.2017.2725277 ↗
50. Wireless powered communication: Opportunities and challenges10.1109/MCOM.2015.7081084 ↗
51. Incentivizing Energy Trading for Interconnected Microgrids10.1109/TSG.2016.2614988 ↗
52. Incentive-Driven Deep Reinforcement Learning for Content Caching and D2D Offloading10.1109/JSAC.2021.3087232 ↗
53. Zheng, W., Liu, X., and Yin, L. (2021). Sentence Representation Method Based on Multi-Layer Semantic Network. Appl. Sci., 11.10.3390/app11031316 ↗
54. Multisource Heterogeneous Unsupervised Domain Adaptation via Fuzzy Relation Neural Networks10.1109/TFUZZ.2020.3018191 ↗
55. Deep Learning Empowered Task Offloading for Mobile Edge Computing in Urban Informatics10.1109/JIOT.2019.2903191 ↗
56. An Integration of Online Learning and Online Control for Green Offloading in Fog-Assisted IoT Systems10.1109/TGCN.2021.3083426 ↗
57. Online Distributed Offloading and Computing Resource Management With Energy Harvesting for Heterogeneous MEC-Enabled IoT10.1109/TWC.2021.3076201 ↗
58. A Tutorial on Interference Exploitation via Symbol-Level Precoding: Overview, State-of-the-Art and Future Directions10.1109/COMST.2020.2980570 ↗
59. Extendable Multiple Nodes Recurrent Tracking Framework with RTU++10.1109/TIP.2022.3192706 ↗
60. A Novel Learning Model of Driver Fatigue Features Representation for Steering Wheel Angle10.1109/TVT.2021.3130152 ↗
61. A novel hybrid multi-criteria group decision-making approach with intuitionistic fuzzy sets to design reverse supply chains for COVID-19 medical waste recycling channels10.1016/j.cie.2022.108228 ↗
62. Grass: Generative recursive autoencoders for shape structures
63. Fan, Q., Zhang, Z., and Huang, X. (2022). Parameter Conjugate Gradient with Secant Equation Based Elman Neural Network and its Convergence Analysis. Adv. Theory Simul.10.1002/adts.202200047 ↗
64. Zhou, L., Fan, Q., Huang, X., and Liu, Y. (2022). Weak and strong convergence analysis of Elman neural networks via weight decay regularization. Optimization, 1–23.10.1080/02331934.2022.2057852 ↗
65. DeepBAN: A Temporal Convolution-Based Communication Framework for Dynamic WBANs10.1109/TCOMM.2021.3094581 ↗
66. Many-Objective Deployment Optimization for a Drone-Assisted Camera Network10.1109/TNSE.2021.3057915 ↗
67. A privacy-aware method for COVID-19 detection in chest CT images using lightweight deep conventional neural network and blockchain10.1016/j.compbiomed.2022.105461 ↗
68. The COVID-19 epidemic analysis and diagnosis using deep learning: A systematic literature review and future directions10.1016/j.compbiomed.2021.105141 ↗
69. Wang, Z., Ramamoorthy, R., Xi, X., Rajagopal, K., Zhang, P., and Jafari, S. (2022). The effects of extreme multistability on the collective dynamics of coupled memristive neurons. Eur. Phys. J. Spéc. Top., 1–8.10.1140/epjs/s11734-022-00558-x ↗