Decentralized Heterogeneous Federal Distillation Learning Based on Blockchain
Source abstract
Abstract
Load forecasting is a crucial aspect of intelligent Virtual Power Plant (VPP) management and a means of balancing the relationship between distributed power grids and traditional power grids. However, due to the continuous emergence of power consumption peaks, the power supply quality of the power grid cannot be guaranteed. Therefore, an intelligent calculation method is required to effectively predict the load, enabling better power grid dispatching and ensuring the stable operation of the power grid. This paper proposes a decentralized heterogeneous federated distillation learning algorithm (DHFDL) to promote trusted federated learning (FL) between different federates in the blockchain. The algorithm comprises two stages: common knowledge accumulation and personalized training. In the first stage, each federate on the blockchain is treated as a meta-distribution. After aggregating the knowledge of each federate circularly, the model is uploaded to the blockchain. In the second stage, other federates on the blockchain download the trained model for personalized training, both of which are based on knowledge distillation. Experimental results demonstrate that the DHFDL algorithm proposed in this paper can resist a higher proportion of malicious code compared to FedAvg and a Blockchain-based Federated Learning framework with Committee consensus (BFLC). Additionally, by combining asynchronous consensus with the FL model training process, the DHFDL training time is the shortest, and the training efficiency of decentralized FL is improved.
Source: openalex_inverted_index · Quality: baseline
Research context
OpenAlex topics: Blockchain Technology Applications and Security · Advanced Data and IoT Technologies · Machine Learning and ELM
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
References (21)
Show source-provided references
1. The concept and development of virtual power plant
2. A blockchain-based decentralized federated learning framework with committee consensus10.1109/MNET.011.2000263 ↗
3. Communication-efficient learning of deep networks from decentralized data
4. Salvaging federated learning by local adaptation
5. FEDBS: Learning on Non-IID data in federated learning using batch normalization
6. Overcoming forgetting in local adaptation of federated learning model
7. Robust and communication-efficient federated learning from non-i.i.d. data10.1109/TNNLS.2019.2944481 ↗
8. C. He, S. Li, J. So, X. Zeng, M. Zhang et al., “FedML: A research library and benchmark for federated machine learning,” arXiv:2007.13518, pp. 1–8, 2020. [Online]. Available: 10.48550/arXiv.2007.13518
9. A sustainable incentive scheme for federated learning10.1109/MIS.2020.2987774 ↗
10. Towards federated unsupervised representation learning
11. Deep leakage from gradients
12. Privacy-preserving federated learning model for healthcare data
13. O. Choudhury, A. Gkoulalas, T. Salonidis, I. Sylla, Y. Park et al., “Differential privacy-enabled federated learning for sensitive health data,” arXiv:1910.02578, pp. 1–6, 2019. [Online]. Available: 10.48550/arXiv.1910.02578
14. Efficient and secure federated learning based on secret sharing and gradient selection
15. Distilling knowledge via knowledge review
16. LTSM: Lightweight and trusted sharing mechanism of IoT data in smart city10.1109/JIOT.2021.3110097 ↗
17. Blockchained on-device federated learning10.1109/LCOMM.2019.2921755 ↗
18. Towards on-device federated learning: A direct acyclic graph-based blockchain approach10.1109/TNNLS.2021.3105810 ↗
19. VFChain: Enabling verifiable and auditable federated learning via blockchain systems10.1109/TNSE.2021.3050781 ↗
20. BlockShare: A blockchain empowered system for privacy-preserving verifiable data sharing
21. VQL: Efficient and verifiable cloud query services for blockchain systems10.1109/TPDS.2021.3113873 ↗