journal article·2021-03-31Open access

MADDPG-Based Security Situational Awareness for Smart Grid with Intelligent Edge

Wenxin Lei, Hong Wen, Jinsong Wu, Wenjing Hou

Applied Sciences· Volume 11· Issue 7

Abstract

Advanced communication and information technologies enable smart grids to be more intelligent and automated, although many security issues are emerging. Security situational awareness (SSA) has been envisioned as a potential approach to provide safe services for power systems’ operation. However, in the power cloud master station mode, massive heterogeneous power terminals make SSA complicated, and failure information cannot be promptly delivered. Moreover, the dynamic and continuous situational space also increases the challenges of SSA. By taking advantages of edge intelligence, this paper introduces edge computing between terminals and the cloud to address the drawbacks of the traditional power cloud paradigm. Moreover, a deep reinforcement learning algorithm based on the edge computing paradigm of multiagent deep deterministic policy gradient (MADDPG) is proposed. The minimum processing cost under the premise of minimum detection error rate is taken to analyze the smart grids’ SSA. Performance evaluations show that the algorithm under this paradigm can achieve faster convergence and the optimal goal, namely the provision of real-time protection for smart grids.
Source: crossref · Quality: baseline

Research context

OpenAlex topics: Smart Grid Security and Resilience · Blockchain Technology Applications and Security · Electricity Theft Detection Techniques

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

School of Aeronautics and Astronautics, University of Electronic Science and Technology of China, Chengdu 611731, China

Aircraft Swarm Intelligent Sensing and Cooperative Control Key Laboratory of Sichuan Province, UESTC, Chengdu 611731, China

School of Artificial Intelligence, Guilin University of Electronic Technology, Guilin 541004, China

Department of Electrical Engineering, Universidad de Chile, Santiago 8370451, Chile

Funding

National major R & D program · Chile CONICYT FONDECYT Regular · Chile CONICYT FONDEF

References (33)

Show source-provided references
1. Smart Grid—The New and Improved Power Grid: A Survey10.1109/SURV.2011.101911.00087 ↗
2. A survey on smart grid technologies and applications10.1016/j.renene.2019.08.092 ↗
3. Big Data Meet Cyber-Physical Systems: A Panoramic Survey10.1109/ACCESS.2018.2878681 ↗
4. Data-Driven Local Control Design for Active Distribution Grids Using Off-Line Optimal Power Flow and Machine Learning Techniques10.1109/TSG.2019.2905348 ↗
5. Cyber security in the Smart Grid: Survey and challenges10.1016/j.comnet.2012.12.017 ↗
6. Survey in Smart Grid and Smart Home Security: Issues, Challenges and Countermeasures10.1109/COMST.2014.2320093 ↗
7. Smart Grid Metering Networks: A Survey on Security, Privacy and Open Research Issues10.1109/COMST.2019.2899354 ↗
8. Cybersecurity at U.S. utilities due for an upgrade: Tech to detect intrusions into industrial control systems will be mandatory [News]
9. (2020, November 21). Assault on California Power Station Raises Alarm on Potential for Terrorism. Available online: http://goo.gl/RiuhI1.
10. Design of Smart Distribution Management System for Obtaining Real-Time Security Analysis and Predictive Operation in Korea10.1109/TSG.2012.2233769 ↗
11. Recent developments of FNET/GridEye—A situational awareness tool for smart grid10.17775/CSEEJPES.2016.00031 ↗
12. Ebrahimi, M.S., Daraei, M.H., Behzadan, V., Khajooeizadeh, A., Behrostaghi, S.A., and Tajvidi, M. (2011, January 13–16). A novel utilization of cluster-tree wireless sensor networks for situation awareness in Smart Grids. Proceedings of the IEEE PES Innovative Smart Grid Technologies, Perth, WA, USA.10.1109/ISGT-Asia.2011.6167088 ↗
13. Industrial Comparator for Smart Grid Sensor Calibration10.1109/JSEN.2017.2724299 ↗
14. Situation Awareness and Automation in the Electric Grid Control Room10.1016/j.promfg.2015.07.609 ↗
15. Rusitschka, S., Eger, K., and Gerdes, C. (2010, January 4–6). Smart Grid Data Cloud: A Model for Utilizing Cloud Computing in the Smart Grid Domain. Proceedings of the First IEEE International Conference on Smart Grid Communications, Gaithersburg, MD, USA.10.1109/SMARTGRID.2010.5622089 ↗
16. Cloud-Fog-based approach for Smart Grid monitoring10.1016/j.simpat.2019.101988 ↗
17. Edge Computing: Vision and Challenges10.1109/JIOT.2016.2579198 ↗
18. Liao, R.-F., Wen, H., Wu, J., Pan, F., Xu, A., Jiang, Y., Xie, F., and Cao, M. (2019). Deep-Learning-Based Physical Layer Authentication for Industrial Wireless Sensor Networks. Sensors, 19.10.3390/s19112440 ↗
19. Multiuser Physical Layer Authentication in Internet of Things with Data Augmentation10.1109/JIOT.2019.2960099 ↗
20. Designing for Situation Awareness of Future Power Grids: An Indicator System Based on Linear Eigenvalue Statistics of Large Random Matrices10.1109/ACCESS.2016.2581838 ↗
21. Assessing the Impact of Insufficient Situation Awareness on Power System Operation10.1109/TPWRS.2013.2240705 ↗
22. Big Data Analysis-Based Security Situational Awareness for Smart Grid10.1109/TBDATA.2016.2616146 ↗
23. Multi-Agent Based Attack-Resilient System Integrity Protection for Smart Grid10.1109/TSG.2020.2970755 ↗
24. pAElla: Edge AI-Based Real-Time Malware Detection in Data Centers10.1109/JIOT.2020.2986702 ↗
25. MTES: An Intelligent Trust Evaluation Scheme in Sensor-Cloud-Enabled Industrial Internet of Things10.1109/TII.2019.2930286 ↗
26. Internet of Things Based Smart Grids Supported by Intelligent Edge Computing10.1109/ACCESS.2019.2920488 ↗
27. Wide-Area Situational Awareness for Critical Infrastructure Protection10.1109/MC.2013.72 ↗
28. A Modified Hierarchical Attribute-Based Encryption Access Control Method for Mobile Cloud Computing10.1109/TCC.2015.2513388 ↗
29. A P2P network based edge computing smart grid model for efficient resources coordination10.1007/s12083-019-00870-9 ↗
30. Edge computing: A survey10.1016/j.future.2019.02.050 ↗
31. Ponzio, F., Urgese, G., Ficarra, E., and Di Cataldo, S. (2019). Dealing with Lack of Training Data for Convolutional Neural Networks: The Case of Digital Pathology. Electronics, 8.10.3390/electronics8030256 ↗
32. Alom, M.Z., Taha, T.M., Yakopcic, C., Westberg, S., Sidike, P., Nasrin, M.S., Hasan, M., Van Essen, B.C., Awwal, A.A.S., and Asari, V.K. (2019). A State-of-the-Art Survey on Deep Learning Theory and Architectures. Electronics, 8.10.3390/electronics8030292 ↗
33. A Review of False Data Injection Attacks Against Modern Power Systems10.1109/TSG.2015.2495133 ↗