journal article·2023Open access

Developing Transparent IDS for VANETs Using LIME and SHAP: An Empirical Study

Fayaz Hassan, Jianguo Yu, Zafi Sherhan Syed, Arif Hussain Magsi, Nadeem Ahmed

Computers, Materials & Continua· Volume 77· Issue 3

Abstract

Vehicular Ad-hoc Networks (VANETs) are mobile ad-hoc networks that use vehicles as nodes to create a wireless network. Whereas VANETs offer many advantages over traditional transportation networks, ensuring security in VANETs remains a significant challenge due to the potential for malicious attacks. This study addresses the critical issue of security in VANETs by introducing an intelligent Intrusion Detection System (IDS) that merges Machine Learning (ML)–based attack detection with Explainable AI (XAI) explanations. This study ML pipeline involves utilizing correlation-based feature selection followed by a Random Forest (RF) classifier that achieves a classification accuracy of 100% for the binary classification task of identifying normal and malicious traffic. An innovative aspect of this study is the incorporation of XAI methodologies, specifically the Local Interpretable Model-agnostic Explanations (LIME) and SHapley Additive exPlanations (SHAP). In addition, this research also considered key features identified by mutual information-based feature selection for the task at hand. The major findings from this study reveal that the XAI-based intrusion detection methods offer distinct insights into feature importance. Key features identified by mutual information, LIME, and SHAP predominantly relate to Transmission Control Protocol (TCP), Hypertext Transfer Protocol (HTTP), Domain Name System (DNS), and Message Queuing Telemetry Transport (MQTT) protocols, highlighting their significance in distinguishing normal and malicious network activity. This XAI approach equips cybersecurity experts with a robust means of identifying and understanding VANET malicious activities, forming a foundation for more effective security countermeasures.
Source: openalex_inverted_index · Quality: baseline

Research context

OpenAlex topics: Network Security and Intrusion Detection · Vehicular Ad Hoc Networks (VANETs) · Smart Grid Security and Resilience

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

References (43)

Show source-provided references
1. Content poisoning attack detection and prevention system in vehicular named data networking10.3390/su151410931 ↗
2. Intrusion detection system using machine learning for vehicular ad hoc networks based on ToN-IoT dataset10.1109/ACCESS.2021.3120626 ↗
3. Evaluation of classification algorithms for intrusion detection system: A review10.30880/jscdm.2021.02.01.004 ↗
4. S. Mane and D. Rao, “Explaining network intrusion detection system using explainable AI framework,” arXiv preprint arXiv:2103.07110, 2021.
5. Classification and detection of chronic kidney disease (CKD) using machine learning algorithms
6. Towards a rigorous evaluation of XAI methods on time series
7. An explainable AI-based intrusion detection system for DNS over HTTPS (DoH) attacks10.1109/TIFS.2022.3183390 ↗
8. Explainable signature-based machine learning approach for identification of faults in grid-connected photovoltaic systems
9. P. Michalopoulos, “Comparing explanations for black-box intrusion detection systems,” Ph.D. dissertation, Eindhoven University of Technology, Netherlands, 2020.
10. A comprehensive data set for network intrusion detection systems (UNSW-NB15 network data set
11. Toward generating a new intrusion detection dataset and intrusion traffic characterization10.5220/0006639801080116 ↗
12. Classifying IoT devices in smart environments using network traffic characteristics10.1109/TMC.2018.2866249 ↗
13. Detecting volumetric attacks on lot devices via sdn-based monitoring of mud activity
14. Internet of things security: A survey10.1016/j.jnca.2017.04.002 ↗
15. A survey on security control and attack detection for industrial cyber-physical systems10.1016/j.neucom.2017.10.009 ↗
16. Resilient reinforcement in secure state estimation against sensor attacks with a priori information10.1109/TAC.2019.2904438 ↗
17. Anomaly detection for in-vehicle network using cnn-lstm with attention mechanism10.1109/TVT.2021.3106940 ↗
18. PPTM: A privacy-preserving trust management scheme for emergency message dissemination in space–air–ground-integrated vehicular networks
19. Trove: A context-awareness trust model for vanets using reinforcement learning10.1109/JIOT.2020.2975084 ↗
20. TFL-DT: A trust evaluation scheme for federated learning in digital twin for mobile networks10.1109/JSAC.2023.3310094 ↗
21. Random forest modeling for network intrusion detection system10.1016/j.procs.2016.06.047 ↗
22. A detailed analysis of the KDD CUP 99 data set
23. Troubleshooting an intrusion detection dataset: The CICIDS2017 case study
24. A detailed analysis of CICIDS2017 dataset for designing intrusion detection systems
25. Benchmarking of machine learning for anomaly based intrusion detection systems in the CICIDS2017 dataset10.1109/ACCESS.2021.3056614 ↗
26. IoT network intrusion dataset
27. Towards the development of realistic botnet dataset in the Internet of Things for network forensic analytics: Bot-IoT dataset10.1016/j.future.2019.05.041 ↗
28. A review and analysis of the bot-iot dataset
29. MQTTset, a new dataset for machine learning techniques on MQTT10.3390/s20226578 ↗
30. Machine learning based IoT intrusion detection system: An MQTT case study (MQTT-IoT-IDS2020 dataset)
31. Towards machine learning based intrusion detection in IoT networks10.32604/cmc.2021.018466 ↗
32. X-IIoTID: A connectivity-agnostic and device-agnostic intrusion data set for industrial Internet of Things10.1109/JIOT.2021.3102056 ↗
33. Edge-IIoTset: A new comprehensive realistic cyber security dataset of IoT and IIoT applications for centralized and federated learning10.1109/ACCESS.2022.3165809 ↗
34. A survey on location privacy attacks and prevention deployed with IoT in vehicular networks
35. M. A. Ferrag, O. Friha, D. Hamouda, L. Maglaras and K. H. Janicke,“Edge-IIoT dataset,” 2022. [Online]. Available: https://dx.doi.org/10.21227/mbc1-1h68 (accessed on 15/01/2023)
36. Classification and explanation for intrusion detection system based on ensemble trees and SHAP method10.3390/s22031154 ↗
37. Explainable artificial intelligence for intrusion detection system10.3390/electronics11193079 ↗
38. R. T. Marco, “lime 0.2.0.1,” [Online]. Available: https://pypi.org/project/lime/ (accessed on 15/01/2023)
39. Explaining intrusion detection-based convolutional neural networks using shapley additive explanations (SHAP)10.3390/bdcc6040126 ↗
40. L. Scott, “shap 0.41.0,” [Online]. Available: https://pypi.org/project/shap/ (accessed on 15/01/2023)
41. XAI for intrusion detection system: Comparing explanations based on global and local scope10.1007/s11416-022-00441-2 ↗
42. S. Amarakoon, Y. Siriwardhana, P. Porambage, M. Liyanage, S. Y. Chang et al., “5G-NIDD: A comprehensive network intrusion detection dataset generated over 5G wireless network,” arXiv preprint arXiv:2212.01298, 2022.
43. Explainable AI: A review of machine learning interpretability methods10.3390/e23010018 ↗