Building an Effective Intrusion Detection System Using the Modified Density Peak Clustering Algorithm and Deep Belief Networks
Source abstract
Abstract
Machine learning plays an important role in building intrusion detection systems. However, with the increase of data capacity and data dimension, the ability of shallow machine learning is becoming more limited. In this paper, we propose a fuzzy aggregation approach using the modified density peak clustering algorithm (MDPCA) and deep belief networks (DBNs). To reduce the size of the training set and the imbalance of the samples, MDPCA is used to divide the training set into several subsets with similar sets of attributes. Each subset is used to train its own sub-DBNs classifier. These sub-DBN classifiers can learn and explore high-level abstract features, automatically reduce data dimensions, and perform classification well. According to the nearest neighbor criterion, the fuzzy membership weights of each test sample in each sub-DBNs classifier are calculated. The output of all sub-DBNs classifiers is aggregated based on fuzzy membership weights. Experimental results on the NSL-KDD and UNSW-NB15 datasets show that our proposed model has higher overall accuracy, recall, precision and F1-score than other well-known classification methods. Furthermore, the proposed model achieves better performance in terms of accuracy, detection rate and false positive rate compared to the state-of-the-art intrusion detection methods.
Source: crossref · Quality: baseline
Research context
OpenAlex topics: Network Security and Intrusion Detection · Anomaly Detection Techniques and Applications · Internet Traffic Analysis and Secure E-voting
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
Affiliations
School of Cyberspace Security, Beijing University of Posts and Telecommunications, Beijing 100876, China
College of Information Science and Engineering, Xinjiang University, Urumqi 830046, China
Guizhou Provincial Key Laboratory of Public Big Data, Guizhou University, Guiyang 550025, China
Funding
National Key R&D Program of China · National Natural Science Foundation of China
References (56)
Show source-provided references
1. A hybrid intrusion detection system based on ABC-AFS algorithm for misuse and anomaly detection10.1016/j.comnet.2018.02.028 ↗
2. Multi-level hybrid support vector machine and extreme learning machine based on modified K-means for intrusion detection system10.1016/j.eswa.2016.09.041 ↗
3. Anomaly-based intrusion detection system through feature selection analysis and building hybrid efficient model10.1016/j.jocs.2017.03.006 ↗
4. An anomaly-based intrusion detection system in presence of benign outliers with visualization capabilities10.1016/j.eswa.2018.04.038 ↗
5. Moustafa, N., Creech, G., and Slay, J. (2018). Anomaly Detection System Using Beta Mixture Models and Outlier Detection. Progress in Computing, Analytics and Networking, Springer.10.1007/978-981-10-7871-2_13 ↗
6. Syarif, A.R., and Gata, W. (2017, January 31). Intrusion detection system using hybrid binary PSO and K-nearest neighborhood algorithm. Proceedings of the 2017 11th International Conference on Information & Communication Technology and System (ICTS), Surabaya, Indonesia.10.1109/ICTS.2017.8265667 ↗
7. Parallel KNN and Neighborhood Classification Implementations on GPU for Network Intrusion Detection
8. A novel statistical technique for intrusion detection systems10.1016/j.future.2017.01.029 ↗
9. A feature reduced intrusion detection system using ANN classifier10.1016/j.eswa.2017.07.005 ↗
10. DTB-IDS: An intrusion detection system based on decision tree using behavior analysis for preventing APT attacks10.1007/s11227-015-1604-8 ↗
11. A survey of intrusion detection systems based on ensemble and hybrid classifiers10.1016/j.cose.2016.11.004 ↗
12. A Survey of Random Forest Based Methods for Intrusion Detection Systems
13. Yadahalli, S., and Nighot, M.K. (2017, January 17–19). Adaboost based parameterized methods for wireless sensor networks. Proceedings of the 2017 International Conference On Smart Technologies For Smart Nation (SmartTechCon), Karnataka, India.10.1109/SmartTechCon.2017.8358590 ↗
14. Roy, S.S., Krishna, P.V., and Yenduri, S. (2014, January 15–17). Analyzing Intrusion Detection System: An ensemble based stacking approach. Proceedings of the 2014 IEEE International Symposium on Signal Processing and Information Technology (ISSPIT), Noida, India.10.1109/ISSPIT.2014.7300605 ↗
15. Deep belief networks10.4249/scholarpedia.5947 ↗
16. A fast learning algorithm for deep belief nets10.1162/neco.2006.18.7.1527 ↗
17. Deep Learning-Based Intrusion Detection With Adversaries10.1109/ACCESS.2018.2854599 ↗
18. Machine Learning and Deep Learning Methods for Cybersecurity10.1109/ACCESS.2018.2836950 ↗
19. A malicious threat detection model for cloud assisted internet of things (CoT) based industrial control system (ICS) networks using deep belief network10.1016/j.jpdc.2018.04.005 ↗
20. Building an intrusion detection system using a filter-based feature selection algorithm10.1109/TC.2016.2519914 ↗
21. UNB (2018, December 10). NSL-KDD Dataset. Available online: https://www.unb.ca/cic/datasets/nsl.html.
22. A study on NSL-KDD dataset for intrusion detection system based on classification algorithms
23. Lopez-Martin, M., Carro, B., Sanchez-Esguevillas, A., and Lloret, J. (2017). Conditional variational autoencoder for prediction and feature recovery applied to intrusion detection in iot. Sensors, 17.10.3390/s17091967 ↗
24. Clustering by fast search and find of density peaks10.1126/science.1242072 ↗
25. ACCS (2018, December 10). UNSW-NB15 Dataset. Available online: https://www.unsw.adfa.edu.au/unsw-canberra-cyber/cybersecurity/ADFA-NB15-Datasets/.
26. Moustafa, N., and Slay, J. (2015, January 10–12). UNSW-NB15: A comprehensive data set for network intrusion detection systems (UNSW-NB15 network data set). Proceedings of the 2015 IEEE Military Communications and Information Systems Conference (MilCIS), Canberra, Australia.10.1109/MilCIS.2015.7348942 ↗
27. The evaluation of Network Anomaly Detection Systems: Statistical analysis of the UNSW-NB15 data set and the comparison with the KDD99 data set10.1080/19393555.2015.1125974 ↗
28. Unsupervised novelty detection–based structural damage localization using a density peaks-based fast clustering algorithm10.1177/1475921717691260 ↗
29. Nearest neighbors based density peaks approach to intrusion detection10.1016/j.chaos.2018.03.010 ↗
30. Ma, T., Wang, F., Cheng, J., Yu, Y., and Chen, X. (2016). A Hybrid Spectral Clustering and Deep Neural Network Ensemble Algorithm for Intrusion Detection in Sensor Networks. Sensors, 16.10.3390/s16101701 ↗
31. Thing, V.L. (2017, January 19–22). IEEE 802.11 network anomaly detection and attack classification: A deep learning approach. Proceedings of the 2017 IEEE Wireless Communications and Networking Conference (WCNC), San Francisco, CA, USA.10.1109/WCNC.2017.7925567 ↗
32. Naseer, S., and Saleem, Y. (2018). Enhanced Network Intrusion Detection using Deep Convolutional Neural Networks. KSII Trans. Internet Inf. Syst., 12.10.3837/tiis.2018.10.028 ↗
33. Tang, T., Zaidi, S.A.R., McLernon, D., Mhamdi, L., and Ghogho, M. (2018, January 25–29). Deep Recurrent Neural Network for Intrusion Detection in SDN-based Networks. Proceedings of the 2018 IEEE International Conference on Network Softwarization (NetSoft 2018), Montreal, ON, Canada.10.1109/NETSOFT.2018.8460090 ↗
34. A deep learning approach to network intrusion detection10.1109/TETCI.2017.2772792 ↗
35. Identification of malicious activities in industrial internet of things based on deep learning models
36. An evaluation of the performance of Restricted Boltzmann Machines as a model for anomaly network intrusion detection10.1016/j.comnet.2018.07.025 ↗
37. Li, C., Wang, J., and Ye, X. (2018). Using a Recurrent Neural Network and Restricted Boltzmann Machines for Malicious Traffic Detection. NeuroQuantology, 16.10.14704/nq.2018.16.5.1391 ↗
38. Deep Learning Method for Denial of Service Attack Detection Based on Restricted Boltzmann Machine10.1089/big.2018.0023 ↗
39. Supervised distance metric learning through maximization of the Jeffrey divergence10.1016/j.patcog.2016.11.010 ↗
40. Reducing the dimensionality of data with neural networks10.1126/science.1127647 ↗
41. A practical guide to training restricted Boltzmann machines
42. Training restricted Boltzmann machines: An introduction10.1016/j.patcog.2013.05.025 ↗
43. Swersky, K., Chen, B., Marlin, B., and De Freitas, N. (February, January 31). A tutorial on stochastic approximation algorithms for training restricted Boltzmann machines and deep belief nets. Proceedings of the 2010 Information Theory and Applications Workshop (ITA), San Diego, CA, USA.10.1109/ITA.2010.5454138 ↗
44. Training products of experts by minimizing contrastive divergence10.1162/089976602760128018 ↗
45. Tieleman, T. (2018, January 5–9). Training restricted Boltzmann machines using approximations to the likelihood gradient. Proceedings of the 25th international conference on Machine Learning, Helsinki, Finland.
46. KDDCup (2018, December 10). KDD Cup Dataset. Available online: http://archive.ics.uci.edu/ml/datasets/kdd+cup+1999+data.
47. Tavallaee, M., Bagheri, E., Lu, W., and Ghorbani, A.A. (2009, January 8–10). A detailed analysis of the KDD CUP 99 data set. Proceedings of the 2009 IEEE Symposium on Computational Intelligence for Security and Defense Applications, Ottawa, ON, Canada.10.1109/CISDA.2009.5356528 ↗
48. Creech, G. (2014). Developing a High-Accuracy Cross Platform Host-Based Intrusion Detection System Capable of Reliably Detecting Zero-Day Attacks. [Ph.D. Thesis, University of New South Wales].
49. Song, J., Takakura, H., Okabe, Y., Eto, M., Inoue, D., and Nakao, K. (2011, January 10–13). Statistical analysis of honeypot data and building of Kyoto 2006+ dataset for NIDS evaluation. Proceedings of the First Workshop on Building Analysis Datasets and Gathering Experience Returns for Security, Salzburg, Austria.10.1145/1978672.1978676 ↗
50. Toward developing a systematic approach to generate benchmark datasets for intrusion detection10.1016/j.cose.2011.12.012 ↗
51. Sharafaldin, I., Lashkari, A.H., and Ghorbani, A.A. (2018, January 22–24). Toward Generating a New Intrusion Detection Dataset and Intrusion Traffic Characterization. Proceedings of the ICISSP 2018: 4th International Conference on Information Systems Security and Privacy, Funchal, Portugal.10.5220/0006639801080116 ↗
52. Rectifier nonlinearities improve neural network acoustic models
53. Javaid, A., Niyaz, Q., Sun, W., and Alam, M. (2016, January 2–5). A deep learning approach for network intrusion detection system. Proceedings of the 9th EAI International Conference on Bio-Inspired Information and Communications Technologies (formerly BIONETICS), New York, NY, USA.10.4108/eai.3-12-2015.2262516 ↗
54. Tang, T.A., Mhamdi, L., McLernon, D., Zaidi, S.A.R., and Ghogho, M. (2016, January 26–29). Deep learning approach for network intrusion detection in software defined networking. Proceedings of the 2016 International Conference on Wireless Networks and Mobile Communications (WINCOM), Fez, Morocco.10.1109/WINCOM.2016.7777224 ↗
55. A deep learning approach for intrusion detection using recurrent neural networks10.1109/ACCESS.2017.2762418 ↗
56. A multiclass cascade of artificial neural network for network intrusion detection10.3233/JIFS-169230 ↗