journal article·2023-08-21Open access

An Integrated Testbed for Power System Cyber-Physical Operations Training

Manohar Chamana, Rabindra Bhatta, Konrad Schmitt, Rajendra Shrestha, Stephen Bayne

Applied Sciences· Volume 13· Issue 16

Abstract

The increased adoption of information and communication technology for smart grid applications will require innovative cyber–physical system (CPS) testbeds to support research and education in the field. Groundbreaking CPS testbeds with realistic and scalable platforms have progressively gained interest in recent years, with electric power flowing in the physical layer and information flowing in the network layer. However, CPSs are critical infrastructures and not designed for testing or direct training, as any misbehaving in an actual system operation could cause a catastrophic impact on its operation. Based on that, it is not easy to efficiently train professionals in CPSs. Aiming to support the advancement and encourage the training of industry professionals, this paper proposes and develops a complete testbed using a real-time simulator, protection and automation devices, and a supervisory control and data acquisition (SCADA) system. The testbed replicated the performance of smart grids, and the main potential cyber threats that electric grids may face. Different case scenarios include a distribution system protection study, a denial of service (DoS) attack, a jamming attack, a network packet manipulation attack, a sensor data manipulation attack, a false trip command attack, etc. The system’s performance before and after the cyberattacks are studied using packet-sniffing tools and a network packet analyzer. The impact on the grid is analyzed using metrics such as voltage oscillation, frequency deviation, and loss of active power generation. Moreover, the complex interdependencies between the cyber and physical domains are discussed in detail, providing insightful guidelines for key features and design decisions for future smart grid testbeds.
Source: crossref · Quality: baseline

Research context

OpenAlex topics: Smart Grid Security and Resilience · Electrostatic Discharge in Electronics · Network Time Synchronization Technologies

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

National Wind Institute, Texas Tech University, Lubbock, TX 79401, USA

Electrical and Computer Engineering Department, Texas Tech University, Lubbock, TX 79401, USA

Funding

Texas Workforce under the Wagner Peyser Program

References (61)

Show source-provided references
1. Networked Microgrids for Enhancing the Power System Resilience10.1109/JPROC.2017.2685558 ↗
2. The U.S. Department of Energy′s Microgrid Initiative10.1016/j.tej.2012.09.013 ↗
3. (2023, June 25). Reliability Considerations from the Integration of Smart Grid. Available online: www.nerc.com.
4. Palmintier, B., Krishnamurthy, D., Top, P., Smith, S., Daily, J., and Fuller, J. (2017, January 21). Design of the HELICS High Performance Transmission Distribution Communication Market. Proceedings of the 2017 Workshop on Modeling and Simulation of Cyber-Physical Energy Systems (MSCPES), Pittsburgh, PA, USA.10.1109/MSCPES.2017.8064542 ↗
5. Bryson, J., and Gallagher, P.D. (2012). NIST Special Publication 1108R2 NIST Framework and Roadmap for Smart Grid Interoperability Standards, Release 2.0.
6. Cybersecurity for distributed energy resources and smart inverters10.1049/iet-cps.2016.0018 ↗
7. (2023, June 25). Electric Power System Resiliency Challenges and Opportunities Power System Transformation. Available online: https://www.naseo.org/Data/Sites/1/resiliency-white-paper.pdf.
8. Zheng, X., Julien, C., Podorozhny, R., and Cassez, F. (2015, January 9–22). BraceAssertion: Runtime Verification of Cyber-Physical Systems. Proceedings of the 2015 IEEE 12th International Conference on Mobile Ad Hoc and Sensor Systems, Dallas, TX, USA.10.1109/MASS.2015.15 ↗
9. Oyewumi, I.A., Jillepalli, A.A., Richardson, P., Ashrafuzzaman, M., Johnson, B.K., Chakhchoukh, Y., Haney, M.A., Sheldon, F.T., and de Leon, D.C. (2019, January 7–8). ISAAC: The Idaho CPS Smart Grid Cybersecurity Testbed. Proceedings of the 2019 IEEE Texas Power and Energy Conference (TPEC), College Station, TX, USA.10.1109/TPEC.2019.8662189 ↗
10. Consideration of Cyber-Physical Interdependencies in Reliability Modeling of Smart Grids10.1109/TSUSC.2017.2757911 ↗
11. Analyzing the Cyber-Physical Impact of Cyber Events on the Power Grid10.1109/TSG.2015.2432013 ↗
12. Cyber-Physical Systems Security Education Through Hands-on Lab Exercises10.1109/MDAT.2020.3005365 ↗
13. Cyber-Physical Security Testbeds: Architecture, Application, and Evaluation for Smart Grid10.1109/TSG.2012.2226919 ↗
14. Cyber-physical system testbed for power system monitoring and wide-area control verification10.1049/iet-esi.2019.0084 ↗
15. Review on Testing of Cyber Physical Systems: Methods and Testbeds10.1109/ACCESS.2018.2869834 ↗
16. Flexible hardware-in-the-loop testbed for cyber physical power system simulation10.1049/iet-cps.2019.0001 ↗
17. A Survey on Smart Grid Cyber-Physical System Testbeds10.1109/COMST.2016.2627399 ↗
18. The Cybersecurity Landscape in Industrial Control Systems10.1109/JPROC.2015.2512235 ↗
19. New Educational Modules Using a Cyber-Distribution System Testbed10.1109/TPWRS.2018.2821178 ↗
20. Survey on Education for Cyber-Physical Systems10.1109/MDAT.2020.3009613 ↗
21. Real-time cyber physical system testbed for power system security and control10.1016/j.ijepes.2017.01.016 ↗
22. Gao, H., Peng, Y., Jia, K., Wen, Z., and Li, H. (2015, January 23–25). Cyber-Physical Systems Testbed Based on Cloud Computing and Software Defined Network. Proceedings of the 2015 International Conference on Intelligent Information Hiding and Multimedia Signal Processing (IIH-MSP), Adelaide, Australia.10.1109/IIH-MSP.2015.50 ↗
23. (2023, June 25). National Scada Test Bed: Fact Sheet, Available online: https://www.energy.gov.
24. Man-in-the-middle attacks and defence in a power system cyber-physical testbed10.1049/cps2.12014 ↗
25. Chen, B., Butler-Purry, K.L., Goulart, A., and Kundur, D. (2014, January 7–9). Implementing a real-time cyber-physical system test bed in RTDS and OPNET. Proceedings of the 2014 North American Power Symposium (NAPS), Pullman, WA, USA.10.1109/NAPS.2014.6965381 ↗
26. Georg, H., Muller, S.C., Dorsch, N., Rehtanz, C., and Wietfeld, C. (2013, January 21–24). INSPIRE: Integrated Co-Simulation of Power and ICT Systems for Real-Time Evaluation. Proceedings of the 2013 IEEE International Conference on Smart Grid Communications (SmartGridComm), Vancouver, BC, Canada.10.1109/SmartGridComm.2013.6688020 ↗
27. HELICS (2023, June 25). Tools With HELICS Support. Available online: https://docs.helics.org/en/latest/Tools_using_HELICS.html.
28. Sridhar, S., Ashok, A., Mylrea, M., Pal, S., Rice, M., and Gourisetti, S.N.G. (2017, January 18–22). A Testbed Environment for Buildings-to-Grid Cyber Resilience Research and Development. Proceedings of the 2017 Resilience Week (RWS), Wilmington, DE, USA.10.1109/RWEEK.2017.8088641 ↗
29. Cyber–Physical Security of a Smart Grid Infrastructure10.1109/JPROC.2011.2161428 ↗
30. Cyber Security of Smart Grid Communications: Risk Analysis and Experimental Testing10.1007/978-3-662-45928-7_7 ↗
31. Mohagheghi, S., Stoupis, J., and Wang, Z. (2009, January 15–18). Communication Protocols and Networks for Power Systems-Current Status and Future Trends. Proceedings of the 2009 IEEE/PES Power Systems Conference and Exposition, Seattle, WA, USA.10.1109/PSCE.2009.4840174 ↗
32. SCALABLE Network Technologies (2023, June 25). SCALABLE Network Technologies Cyber Security Solutions for Critical Infrastructure. Available online: https://www.keysight.com/us/en/assets/3122-1399/technical-overviews/Cyber-Security-Solutions-for-Critical-Infrastructure.pdf.
33. Cyber-Physical Security Testbed for Substations in a Power Grid10.1007/978-3-662-45928-7_10 ↗
34. Real Time Modeling and Simulation of Cyber-Power System10.1007/978-3-662-45928-7_3 ↗
35. Measuring Systemic Risk of Switching Attacks Based on Cybersecurity Technologies in Substations10.1109/TPWRS.2020.2986452 ↗
36. Cyber Attack Resilient Distance Protection and Circuit Breaker Control for Digital Substations10.1109/TII.2018.2884728 ↗
37. MITRE Enterprise Engineering (2020, October 10). Crown Jewels Analysis. Available online: https://www.mitre.org/publications/systems-engineering-guide/enterprise-engineering/systems-engineering-for-mission-assurance/crown-jewels-analysis.
38. Cyber-Physical Production Testbed: Literature Review and Concept Development10.1016/j.promfg.2018.06.050 ↗
39. Development and Application of a Real-Time Test Bed for Cyber–Physical System10.1109/JSYST.2015.2476367 ↗
40. Real-Time Detection of Hybrid and Stealthy Cyber-Attacks in Smart Grid10.1109/TIFS.2018.2854745 ↗
41. Real-time Control and Hardware-in-the-loop Simulation for Educational Purposes of Wind Energy Systems10.1016/j.ifacol.2020.12.2084 ↗
42. Yang, Y., Pranggono, B., Littler, T., Yao, Z., Im, E.G., McLaughlin, K., Wang, H., and Sezer, S. (2012, January 8–9). Man-in-the-middle attack test-bed investigating cyber-security vulnerabilities in smart grid SCADA systems. Proceedings of the International Conference on Sustainable Power Generation and Supply (SUPERGEN 2012), Hangzhou, China.10.1049/cp.2012.1831 ↗
43. Gupta, K., Sahoo, S., Panigrahi, B.K., Blaabjerg, F., and Popovski, P. (2021). On the Assessment of Cyber Risks and Attack Surfaces in a Real-Time Co-Simulation Cybersecurity Testbed for Inverter-Based Microgrids. Energies, 14.10.3390/en14164941 ↗
44. Zhang, L., Li, S., Wihl, L., Kazemtabrizi, M., Ali, S.O., Paquin, J., and Labbé, S. (2023, June 25). Cybersecurity Study of Power System Utilizing Advanced CPS Simulation Tools. Available online: http://conference-americas.pacw.org/.
45. (2022, March 10). REAL-TIME SIMULATION. Available online: https://www.opal-rt.com/.
46. Bian, D., Kuzlu, M., Pipattanasomporn, M., Rahman, S., and Wu, Y. (2015, January 26–30). Real-time co-simulation platform using OPAL-RT and OPNET for analyzing smart grid performance. Proceedings of the IEEE Power and Energy Society General Meeting, Denver, CO, USA.10.1109/PESGM.2015.7286238 ↗
47. (2023, June 25). Keysight. EXata Network Modeling—Critical Infrastructure. Keysight. Available online: https://www.keysight.com/us/en/product/SN050ECPA/exata-network-modeling-critical-infrastructure.html.
48. (2022, March 10). SCADA SurvalentONE. Available online: https://www.survalent.com/adms-platform-overview/.
49. Padullaparti, H., Pratt, A., Mendoza, I., Tiwari, S., Baggu, M., Bilby, C., and Ngo, Y. (2023, June 25). Peak Load Management in Distribution Systems Using Legacy Utility Equipment and Distributed Energy Resources Preprint, Available online: www.nrel.gov/publications.
50. (2017, January 14–17). University of Nebraska—Lincoln, IEEE Region 4, IEEE Computer Society, IEEE Communications Society, IEEE Power & Energy Society, and Institute of Electrical and Electronics Engineers. Proceedings of the 2017 IEEE International Conference on Electro Information Technology (EIT), Lincoln, NE, USA.
51. Ritchie, J., and Robertson, C.F.R. (2023, June 25). A Comparison of Phasor Communication Protocols and the Streaming Telemetry Transport Protocol (STTP) for the Transfer of Synchrophasor and Other Streaming Data. Available online: https://gridprotectionalliance.org.
52. Kite, D., and Jenkins, R. (2023, June 25). Automating Protection System Monitoring and Verification With the SEL RTAC. Available online: https://selinc.com/api/download/112761/?lang=en.
53. Paithankar, V.G., and Bhide, S.R. (2022). Fundamentals of Power System Protection, PHI Learning Pvt. Ltd.. [2nd ed.].
54. IEEE Standard For Electrical Power System Device Function Numbers, Acronyms, And Contact Designations (Standard No. IEEE Std C37.2-2008). Available online: https://www.academia.edu/9761872/IEEE_Standard_for_Electrical_Power_System_Device_Function_Numbers_IEEE_Std_C37_2_2008.
55. Ahmad, A., AbuHour, Y., and Alghanim, F. (2021). A Novel Model for Distributed Denial of Service Attack Analysis and Interactivity. Symmetry, 13.10.3390/sym13122443 ↗
56. Cortés-Leal, A., Del-Valle-Soto, C., Cardenas, C., Valdivia, L.J., and Del Puerto-Flores, J.A. (2022). Performance Metric Analysis for a Jamming Detection Mechanism under Collaborative and Cooperative Schemes in Industrial Wireless Sensor Networks. Sensors, 22.10.3390/s22010178 ↗
57. A Robust Iterated Extended Kalman Filter for Power System Dynamic State Estimation10.1109/TPWRS.2016.2628344 ↗
58. Hojabri, M., Dersch, U., Papaemmanouil, A., and Bosshart, P. (2019). A Comprehensive Survey on Phasor Measurement Unit Applications in Distribution Systems. Energies, 12.10.3390/en12234552 ↗
59. Bhamare, Y. (2023, June 25). Utilization of IEC 61850 GOOSE Messaging in Protection Applications in Distribution Network. Available online: https://api.semanticscholar.org/CorpusID:8309387.
60. Estimation of wind energy production in various sites in Australia for different wind turbine classes: A comparative technical and economic assessment10.1016/j.renene.2013.11.051 ↗
61. Operational planning steps in smart electric power delivery system10.1038/s41598-021-96769-8 ↗