journal article·2022-12-07Open access

COPP-DDPG: Computation Offloading with Privacy Preservation in a Vehicular Edge Network

Yancong Wang, Jian Wang, Hongchang Ke, Zemin Sun

Applied Sciences· Volume 12· Issue 24

Abstract

Vehicular edge computing (VEC) is emerging as a prospective technology in the era of 5G and beyond to support delay-sensitive and computation-intensive vehicular applications. However, designing an efficient approach for joint computation offloading and resource allocation is challenging due to the limited resources of VEC servers, the highly dynamic vehicular networks (VNs), different priorities of vehicular applications, and the threat of privacy disclosure. In this work, we propose a cooperative optimization for privacy-preserving and priority-aware offloading and resource allocation in VEC network (VECN) based on deep reinforcement learning (DRL). Firstly, we employed a privacy-preserving framework where the certificate authority (CA) is integrated into the VEC architecture. Furthermore, we formulated the dynamic optimization problem as a Markov decision process (MDP) by constructing a weighted cost function that integrates the priority of stochastic arrival tasks, privacy-preserving of offloading, and dynamic interaction between the edge servers and intelligent connected vehicles (ICVs). To solve this problem, a cooperative optimization for privacy and priority based on deep deterministic policy gradient (COPP-DDPG) is proposed by learning the optimal actions to minimize the weighted cost function. The simulation results show that COPP-DDPG has good convergence and outperforms the other four comparison algorithms in many aspects.
Source: crossref · Quality: baseline

Research context

OpenAlex topics: Privacy-Preserving Technologies in Data · IoT and Edge/Fog Computing · Vehicular Ad Hoc Networks (VANETs)

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

College of Computer Science and Technology, Jilin University, Changchun 130012, China

School of Computer Technology and Engineering, Changchun Institute of Technology, Changchun 130012, China

Funding

National Natural Science Foundation of China · Jilin Provincial Science and Technology Department of China

References (40)

Show source-provided references
1. Intelligent architecture for mobile HetNet in B5G10.1109/MNET.2019.1800364 ↗
2. Ready player one: UAV-clustering-based multi-task offloading for vehicular VR/AR gaming10.1109/MNET.2019.1800357 ↗
3. Edge computing for autonomous driving: Opportunities and challenges10.1109/JPROC.2019.2915983 ↗
4. A new era for web AR with mobile edge computing10.1109/MIC.2018.043051464 ↗
5. Mobile-aware and relay-assisted partial offloading scheme based on parked vehicles in B5G vehicular networks10.1016/j.phycom.2020.101163 ↗
6. Editorial: The Key Trends in B5G Technologies, Services and Applications10.1007/s11036-022-01999-3 ↗
7. B5G Ultrareliable Low Latency Networks for Efficient Secure Autonomous and Smart Internet of Vehicles10.1155/2021/3697733 ↗
8. Reducing Power Consumption for Autonomous Ground Vehicles via Resource Allocation Based on Road Segmentation in V2X-MEC With Resource Constraints10.1109/TVT.2022.3161641 ↗
9. Vehicular Edge Computing and Networking: A Survey10.1007/s11036-020-01624-1 ↗
10. Task offloading in vehicular edge computing networks via deep reinforcement learning10.1016/j.comcom.2022.04.006 ↗
11. Resource Management for Intelligent Vehicular Edge Computing Networks10.1109/TITS.2021.3114957 ↗
12. RAVEN: Resource Allocation using Reinforcement Learning for Vehicular Edge Computing Networks10.1109/LCOMM.2022.3196711 ↗
13. Privacy-Preserved Federated Learning for Autonomous Driving10.1109/TITS.2021.3081560 ↗
14. Edge-Assisted Vehicular Networks Security10.1109/JIOT.2019.2904323 ↗
15. Edge-centric trust management in vehicular networks10.1016/j.micpro.2021.104271 ↗
16. Liu, J., Zhang, S., and Liu, H. (2021, January 25–27). Distributed Collaborative Anomaly Detection for Trusted Digital Twin Vehicular Edge Networks. Proceedings of the WASA, Nanjing, China.10.1007/978-3-030-86130-8_30 ↗
17. Task Offloading in Vehicular Edge Computing Networks: A Load-Balancing Solution10.1109/TVT.2019.2959410 ↗
18. Adaptive Learning-Based Task Offloading for Vehicular Edge Computing Systems10.1109/TVT.2019.2895593 ↗
19. When Vehicular Fog Computing Meets Autonomous Driving: Computational Resource Management and Task Offloading10.1109/MNET.001.1900527 ↗
20. Tong, S., and Liu, Y. (IEEE Trans. Veh. Technol., 2022). Joint Task Offloading and Resource Allocation: A Historical Cumulative Contribution Based Collaborative Fog Computing Model, IEEE Trans. Veh. Technol., early access.10.1109/TVT.2022.3213084 ↗
21. Intelligent Task Offloading in Vehicular Edge Computing Networks10.1109/MWC.001.1900489 ↗
22. Liu, L., and Zhao, M. (IEEE Trans. Intell. Transp. Syst., 2022). Mobility-aware multi-hop task offloading for autonomous driving in vehicular edge computing and networks, IEEE Trans. Intell. Transp. Syst., early access.10.1109/TITS.2022.3142566 ↗
23. Wei, Z., and Li, B. (IEEE Trans. Mob. Comput, 2022). OCVC: An Overlapping-Enabled Cooperative Vehicular Fog Computing Protocol, IEEE Trans. Mob. Comput, early access.10.1109/ISCC55528.2022.9912804 ↗
24. Joint Task Offloading and Resource Allocation for Multi-Access Edge Computing Assisted by Parked and Moving Vehicles10.1109/TVT.2022.3149937 ↗
25. Wei, D., and Zhang, J. (IEEE Trans. Intell. Transp. Syst., 2022). Privacy-Aware Multiagent Deep Reinforcement Learning for Task Offloading in VANET, IEEE Trans. Intell. Transp. Syst., early access.10.1109/TITS.2022.3202196 ↗
26. Joint Optimization of Task Offloading and Resource Allocation Based on Differential Privacy in Vehicular Edge Computing10.1109/TCSS.2021.3074949 ↗
27. An edge computing-enabled computation offloading method with privacy preservation for internet of connected vehicles10.1016/j.future.2019.01.012 ↗
28. Gao, H., and Huang, W. (IEEE Trans. Intell. Transp. Syst., 2022). PPO2: Location Privacy-Oriented Task Offloading to Edge Computing Using Reinforcement Learning for Intelligent Autonomous Transport Systems, IEEE Trans. Intell. Transp. Syst., early access.10.1109/TITS.2022.3169421 ↗
29. Durrani, S., and Zhou, X. (2010, January 6–9). Effect of vehicle mobility on connectivity of vehicular ad hoc networks. Proceedings of the IEEE 2010 IEEE 72nd Vehicular Technology Conference-Fall, Ottawa, ON, Canada.10.1109/VETECF.2010.5594505 ↗
30. Routing in sparse vehicular ad hoc wireless networks10.1109/JSAC.2007.071005 ↗
31. Mobile-edge computing: Partial computation offloading using dynamic voltage scaling
32. Energy-Efficient resource allocation for mobile-edge computation offloading10.1109/TWC.2016.2633522 ↗
33. Zhang, Y., Qin, X., and Song, X. (2020, January 6–9). Mobility-Aware Cooperative Task Offloading and Resource Allocation in Vehicular Edge Computing. Proceedings of the WCNCW Workshops, Seoul, Republic of Korea.10.1109/WCNCW48565.2020.9124825 ↗
34. Joint Load Balancing and Offloading in Vehicular Edge Computing and Networks10.1109/JIOT.2018.2876298 ↗
35. (2021). Intelligent Transport Systems (ITS): Security; Trust and Privacy Management. Standard No. ETSI TS 102 941.
36. Förster, D., Kargl, F., and Löhr, H. (2015, January 22–26). A framework for evaluating pseudonym strategies in vehicular ad-hoc networks. Proceedings of the WISEC 15, New York, NY, USA.10.1145/2766498.2766520 ↗
37. Optimization and non-cooperative game of anonymity updating in vehicular networks10.1016/j.adhoc.2019.01.009 ↗
38. Freudiger, J., Manshaei, M.H., and Hubaux, J.P. (2009, January 9–13). On non-cooperative location privacy: A game-theoretic analysis. Proceedings of the CCS 2009, Chicago, IL, USA.10.1145/1653662.1653702 ↗
39. Distributed Task Allocation to Enable Collaborative Autonomous Driving with Network Softwarization10.1109/JSAC.2018.2869948 ↗
40. Lillicrap, T.P., Hunt, J.J., Pritzel, A., Heess, N., Erez, T., Tassa, Y., Silver, D., and Wierstra, D. (2015). Continuous Control with Deep Reinforcement Learning. arXiv.