Network Attack Path Selection and Evaluation Based on Q-Learning
Source abstract
Abstract
As the coupling relationship between information systems and physical power grids is getting closer, various types of cyber attacks have increased the operational risks of a power cyber-physical System (CPS). In order to effectively evaluate this risk, this paper proposed a method of cross-domain propagation analysis of a power CPS risk based on reinforcement learning. First, the Fuzzy Petri Net (FPN) was used to establish an attack model, and Q-Learning was improved through FPN. The attack gain was defined from the attacker’s point of view to obtain the best attack path. On this basis, a quantitative indicator of information-physical cross-domain spreading risk was put forward to analyze the impact of cyber attacks on the real-time operation of the power grid. Finally, the simulation based on Institute of Electrical and Electronics Engineers (IEEE) 14 power distribution system verifies the effectiveness of the proposed risk assessment method.
Source: crossref · Quality: baseline
Research context
OpenAlex topics: Smart Grid Security and Resilience · Network Security and Intrusion Detection · Information and Cyber Security
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
Affiliations
State Key Laboratory of Alternate Electrical Power System with Renewable Energy Sources, North China Electric Power University, Beijing 102206, China
Funding
National Natural Science Foundation of China
References (25)
Show source-provided references
1. Cyber-Physical Modeling and Cyber-Contingency Assessment of Hierarchical Control Systems10.1109/TSG.2014.2387381 ↗
2. Cyber–Physical System Security for the Electric Power Grid10.1109/JPROC.2011.2165269 ↗
3. A survey on advanced persistent threats: Techniques, solutions, challenges, and research opportunities10.1109/COMST.2019.2891891 ↗
4. The 2015 ukraine blackout: Implications for false data injection attacks10.1109/TPWRS.2016.2631891 ↗
5. Staff, T. (2016, January 26). Steinitz: Israel’s Electric Authority Hit by ‘Severe’ Cyber-Attack. The Times of Israel, Available online: https://www.timesofisrael.com/steinitz-israels-electric-authority-hit-by-severe-cyber-attack/.
6. A Coordinated Multi-Switch Attack for Cascading Failures in Smart Grid10.1109/TSG.2014.2302476 ↗
7. The LAP under facility disruptions during early post-earthquake rescue using PSO-GA hybrid algorithm
8. Liu, X. (2020). A network attack path prediction method using attack graph. J. Ambient Intell. Humaniz. Comput., 1–8.10.1007/s12652-020-02206-5 ↗
9. Swiler, L.P., Phillips, C., Ellis, D., and Chakerian, S. (2001, January 12–14). Computer-attack graph generation tool. Proceedings of the DARPA Information Survivability Conference and Exposition II, DISCEX’01, Anaheim, CA, USA.
10. Zhang, B., Lu, K., Pan, X., and Wu, Z. (2009, January 11–13). Reverse search based network attack graph generation. Proceedings of the International Conference on Computational Intelligence and Software Engineering, Wuhan, China.10.1109/CISE.2009.5365235 ↗
11. Singhal, A., and Ou, X. (2017). Security risk analysis of enterprise networks using probabilistic attack graphs. Network Security Metrics, Springer.10.1007/978-3-319-66505-4_3 ↗
12. Sutton, R.S., and Barto, A.G. (1998). Reinforcement Learning: An Introduction, MIT Press.10.1109/TNN.1998.712192 ↗
13. Q-learning10.1007/BF00992698 ↗
14. Reinforcement based mobile robot navigation in dynamic environment10.1016/j.rcim.2010.06.019 ↗
15. Optimal path planning approach based on Q-learning algorithm for mobile robots10.1016/j.asoc.2020.106796 ↗
16. Q-Learning-Based Vulnerability Analysis of Smart Grid against Sequential Topology Attacks10.1109/TIFS.2016.2607701 ↗
17. Yousefi, M., Mtetwa, N., Zhang, Y., and Tianfield, H. (2018, January 1–3). A Reinforcement Learning Approach for Attack Graph Analysis. Proceedings of the 2018 17th IEEE International Conference on Trust, Security and Privacy in Computing and Communications/12th IEEE International Conference on Big Data Science and Engineering (TrustCom/BigDataSE), New York, NY, USA.10.1109/TrustCom/BigDataSE.2018.00041 ↗
18. Fuzzy backward reasoning using fuzzy Petri nets10.1109/3477.891146 ↗
19. Common vulnerability scoring system10.1109/MSP.2006.145 ↗
20. Robust Routing Optimization for Smart Grids Considering Cyber-Physical Interdependence10.1109/TSG.2018.2888629 ↗
21. Asset-based dynamic impact assessment of cyberattacks for risk analysis in industrial control systems10.1109/TII.2017.2740571 ↗
22. Quantitative vulnerability assessment of cyber security for distribution automation systems10.3390/en8065266 ↗
23. Analysis of the Impact of Combined Information-Physical-Failure on Distribution Network CPS10.1109/ACCESS.2020.2978113 ↗
24. A survey of iot-enabled cyberattacks: Assessing attack paths to critical infrastructures and services10.1109/COMST.2018.2855563 ↗
25. A secure control framework for resource-limited adversaries10.1016/j.automatica.2014.10.067 ↗