Cloud–Edge Collaborative Model Adaptation Based on Deep Q-Network and Transfer Feature Extraction
Source abstract
Abstract
With the rapid development of smart devices and the Internet of Things (IoT), the explosive growth of data has placed increasingly higher demands on real-time processing and intelligent decision making. Cloud-edge collaborative computing has emerged as a mainstream architecture to address these challenges. However, in sky-ground integrated systems, the limited computing capacity of edge devices and the inconsistency between cloud-side fusion results and edge-side detection outputs significantly undermine the reliability of edge inference. To overcome these issues, this paper proposes a cloud-edge collaborative model adaptation framework that integrates deep reinforcement learning via Deep Q-Networks (DQN) with local feature transfer. The framework enables category-level dynamic decision making, allowing for selective migration of classification head parameters to achieve on-demand adaptive optimization of the edge model and enhance consistency between cloud and edge results. Extensive experiments conducted on a large-scale multi-view remote sensing aircraft detection dataset demonstrate that the proposed method significantly improves cloud-edge consistency. The detection consistency rate reaches 90%, with some scenarios approaching 100%. Ablation studies further validate the necessity of the DQN-based decision strategy, which clearly outperforms static heuristics. In the model adaptation comparison, the proposed method improves the detection precision of the A321 category from 70.30% to 71.00% and the average precision (AP) from 53.66% to 53.71%. For the A330 category, the precision increases from 32.26% to 39.62%, indicating strong adaptability across different target types. This study offers a novel and effective solution for cloud-edge model adaptation under resource-constrained conditions, enhancing both the consistency of cloud-edge fusion and the robustness of edge-side intelligent inference.
Source: crossref · Quality: baseline
Research context
OpenAlex topics: Video Surveillance and Tracking Methods · Traffic Prediction and Management Techniques · Advanced Neural Network Applications
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
Affiliations
Key Laboratory of Smart Manufacturing in Energy Chemical Process, Ministry of Education, East China University of Science and Technology, Shanghai 200237, China
Shanghai Aerospace Electronic Technology Institute, Shanghai 201109, China
Shanghai Key Laboratory of Collaborative Computing in Spacial Heterogeneous Networks (CCSN), Shanghai 201109, China
Funding
National Natural Science Foundation of China · Foundation of Shanghai Key Laboratory of Collaborative Computing in Spatial Heterogenous Networks
References (27)
Show source-provided references
1. KCES: A Workflow Containerization Scheduling Scheme Under Cloud-Edge Collaboration Framework10.1109/JIOT.2024.3466231 ↗
2. A Deep Neural Collaborative Filtering Based Service Recommendation Method with Multi-Source Data for Smart Cloud-Edge Collaboration Applications10.26599/TST.2023.9010050 ↗
3. From cloud manufacturing to cloud-edge collaborative manufacturing10.1016/j.rcim.2024.102790 ↗
4. Adversarial Robustness in Graph-Based Neural Architecture Search for Edge AI Transportation Systems10.1109/TITS.2022.3197713 ↗
5. Adaptive multi-source domain collaborative fine-tuning for transfer learning10.7717/peerj-cs.2107 ↗
6. Transfer Reinforcement Learning Across Homotopy Classes10.1109/LRA.2021.3057050 ↗
7. Multi-Objective Workflow Scheduling with Deep-Q-Network-Based Multi-Agent Reinforcement Learning10.1109/ACCESS.2019.2902846 ↗
8. Fine-tuning transfer learning based on DCGAN integrated with self-attention and spectral normalization for bearing fault diagnosis10.1016/j.measurement.2022.112421 ↗
9. Model Pruning Enables Efficient Federated Learning on Edge Devices10.1109/TNNLS.2022.3166101 ↗
10. Lightweight Deep Learning: An Overview10.1109/MCE.2022.3181759 ↗
11. A Lightweight Faster R-CNN for Ship Detection in SAR Images
12. Accelerating Convolutional Neural Network-Based Hyperspectral Image Classification by Step Activation Quantization
13. Knowledge Distillation: A Survey10.1007/s11263-021-01453-z ↗
14. Hierarchical Multi-Attention Transfer for Knowledge Distillation10.1145/3568679 ↗
15. Cross-domain sentiment classification via parameter transferring and attention sharing mechanism10.1016/j.ins.2021.07.001 ↗
16. An incentive mechanism for data sharing based on blockchain with smart contracts10.1016/j.compeleceng.2020.106587 ↗
17. Federated deep reinforcement learning based secure data sharing for Internet of Things10.1016/j.comnet.2021.108327 ↗
18. Real-time production scheduling using a deep reinforcement learning-based multi-agent approach
19. Dynamic constrained evolutionary optimization based on deep Q-network10.1016/j.eswa.2024.123592 ↗
20. Lee, S., Choo, H., and Ismail, R. (2021, January 4–6). Smart Manufacturing Scheduling System: DQN based on Cooperative Edge Computing. Proceedings of the 15th International Conference on Ubiquitous Information Management and Communication (IMCOM 2021), Seoul, Republic of Korea.
21. Qin, W., Chen, H., and Wang, L. (2022). PASD: A Prioritized Action Sampling-Based Dueling DQN for Cloud-Edge Collaborative Computation Offloading in Industrial IoT. China Conference on Wireless Sensor Networks, Springer Nature.10.1007/978-981-19-8350-4_2 ↗
22. Cyclone detection with end-to-end super resolution and faster R-CNN10.1007/s12145-024-01281-y ↗
23. A review of object detection based on deep learning10.1007/s11042-020-08976-6 ↗
24. Nawaz, S.A., Li, J., Bhatti, U.A., Shoukat, M.U., and Ahmad, R.M. (2022). AI-based object detection latest trends in remote sensing, multimedia and agriculture applications. Front. Plant Sci., 13.10.3389/fpls.2022.1041514 ↗
25. Anomaly detection in NetFlow network traffic using supervised machine learning algorithms
26. Zhu, H., Wei, H., Li, B., Yuan, X., and Kehtarnavaz, N. (2020). A Review of Video Object Detection: Datasets, Metrics and Methods. Appl. Sci., 10.10.3390/app10217834 ↗
27. A comprehensive review of object detection with deep learning10.1016/j.dsp.2022.103812 ↗