Bootstrap and MRCD Estimators in Hotelling’s T2 Control Charts for Precise Intrusion Detection
Source abstract
Abstract
Intrusion detection systems (IDS) are crucial in safeguarding network security by identifying unauthorized access attempts through various techniques. Statistical Process Control (SPC), particularly Hotelling’s T2 control charts, is noted for monitoring network traffic against known attack patterns or anomaly detection. This research advances the domain by incorporating robust statistical estimators—namely, the Fast-MCD and MRCD (Minimum Regularized Covariance Determinant) estimators—into bootstrap-enhanced Hotelling’s T2 control charts. These enhanced charts aim to strengthen detection accuracy by offering improved resistance to outlier contamination, a prevalent challenge in intrusion detection. The methodology emphasizes the MRCD estimator’s robustness in overcoming the limitations of traditional T2 charts, especially in environments with a high incidence of outliers. Applying the proposed bootstrap-based robust T2 charts to the UNSW-NB15 dataset illustrates a marked enhancement in intrusion detection performance. Results indicate superior performance of the proposed method over conventional T2 and Fast-MCD-based T2 charts in detection accuracy, even in varied levels of outlier contamination. Despite increasing execution time, the precision and reliability in detecting intrusions present a justified trade-off. The findings underscore the significant potential of integrating robust statistical methods to enhance IDS effectiveness.
Source: crossref · Quality: baseline
Research context
OpenAlex topics: Network Security and Intrusion Detection · Anomaly Detection Techniques and Applications · Fault Detection and Control Systems
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
Affiliations
Department of Statistics, Institut Teknologi Sepuluh Nopember, Surabaya 60111, Indonesia
Department of Mathematical Sciences, Universiti Teknologi Malaysia, Johor Bahru 81310, Malaysia
Funding
Institut Teknologi Sepuluh Nopember
References (48)
Show source-provided references
1. Bace, R., and Mell, P. (2001). NIST Special Publication on Intrusion Detection Systems, National Institute of Standards and Technology. Nist Special Publication.
2. A framework for constructing features and models for intrusion detection systems10.1145/382912.382914 ↗
3. Wu, G., and Huang, Y. (2009, January 15–17). Design of a New Intrusion Detection System Based on Database. Proceedings of the 2009 International Conference on Signal Processing Systems, Singapore.10.1109/ICSPS.2009.139 ↗
4. Park, Y. (2005). A Statistical Process Control Approach for Network Intrusion Detection, Georgia Insitute of Technology.
5. Some applications of statistical methods to the analysis of physical and engineering data10.1002/j.1538-7305.1924.tb01347.x ↗
6. Hotteling, H. (1947). Multivariate Quality Control. Techiques of Statistical Analysis, McGraw-Hill.
7. Hawkins, D.M. (1980). Identification of Outliers, Springer.10.1007/978-94-015-3994-4 ↗
8. A multivariate robust control chart for individual observations10.1080/00224065.2009.11917781 ↗
9. Unmasking multivariate outliers and leverage point10.1080/01621459.1990.10474920 ↗
10. A comparison of multivariate control charts for individual observations10.1080/00224065.1996.11979698 ↗
11. Rousseeuw, P.J., and Leroy, A.M. (2005). Robust Regression and Outlier Detection, John Wiley & Sons.
12. Evaluasi Diagram Kontrol Multivariat berbasis Independen Principal Component Analysis (PCA)10.12962/j27213862.v1i2.6733 ↗
13. A Robust Hotelling Test10.1007/s001840200192 ↗
14. Robust estimation in multivariate control charts for individual observations10.1080/00224065.2003.11980234 ↗
15. A comparison of robust alternatives to hotelling’s T2 control chart10.1080/02664760902810813 ↗
16. A robust bivariate control chart alternative to the hotelling’s T2 control chart10.1002/qre.1474 ↗
17. An alternative hotelling T 2 control chart based on minimum vector variance (MVV)
18. Robust multivariate outlier labeling10.1080/03610910701569044 ↗
19. On the distribution of hotelling’s T2 statistic based on the successive differences covariance matrix estimator10.1080/00224065.2006.11918611 ↗
20. High breakdown estimation methods for phase I multivariate control charts10.1002/qre.837 ↗
21. Penggunaan Estimator Robust Reweighted Minimum Covariance Determinant pada Diagram Kontrol T2 Hotelling untuk Monitoring Penyebaran COVID-19 di Korea Selatan
22. Robust Adaptive Multivariate Hotelling T2 Control Chart Based on Kernel Density Estimation for Intrusion Detection System10.1016/j.eswa.2019.113105 ↗
23. The minimum regularized covariance determinant estimator10.1007/s11222-019-09869-x ↗
24. Bootstrap-Based T2 Multivariate Control Charts10.1080/03610918.2010.549989 ↗
25. Probabilistic techniques for intrusion detection based on computer audit data10.1109/3468.935043 ↗
26. Multivariate statistical analysis of audit trails for host-based intrusion detection10.1109/TC.2002.1017701 ↗
27. Qu, G., Hariri, S., and Yousif, M. (2005, January 6). Multivariate Statistical Analysis for Network Attacks Detection. Proceedings of the 3rd ACS/IEEE International Conference onComputer Systems and Applications, Cairo, Egypt.
28. Zhang, Z., Zhu, X., and Jin, J. (2007, January 19–25). SVC-Based Multivariate Control Charts for Automatic Anomaly Detection in Computer Networks. Proceedings of the International Conference on Autonomic and Autonomous Systems (ICAS), IEEE, Athens, Greece.10.1109/CONIELECOMP.2007.99 ↗
29. Tavallaee, M., Lu, W., Iqbal, S.A., and Ghorbani, A. (2008, January 5–8). A Novel Covariance Matrix based Approach for Detecting Network Anomalies. Proceedings of the Sixth Annual Conference on Communication Networks and Services Research, Halifax, NS, Canada.10.1109/CNSR.2008.80 ↗
30. A Dynamic Intrusion Detection System Based on Multivariate Hotelling’s T2 Statistics Approach for Network Environments10.1155/2015/850153 ↗
31. Network Anomalies Detection Using Statistical Technique: A Chi- Square approach
32. PCA-based multivariate statistical network monitoring for anomaly detection10.1016/j.cose.2016.02.008 ↗
33. Intrusion detection system using multivariate control chart Hotelling’s T2 based on PCA10.18517/ijaseit.8.5.3421 ↗
34. T2 control chart based on successive difference covariance matrix for intrusion detection system10.1088/1742-6596/1028/1/012220 ↗
35. Intrusion Detection System Using Bootstrap Resampling Approach of T2 Control Chart Based on Successive Difference Covariance Matrix
36. Moustafa, N., and Slay, J. (2015, January 10–12). UNSW-NB15: A comprehensive data set for network intrusion detection. Proceedings of the 2015 Military Communications and Information Systems Conference, MilCIS 2015-IEEE Stream, Canberra, Australia.10.1109/MilCIS.2015.7348942 ↗
37. The evaluation of Network Anomaly Detection Systems: Statistical analysis of the UNSW-NB15 data set and the comparison with the KDD99 data set10.1080/19393555.2015.1125974 ↗
38. Montgomery, D.C. (2013). Introduction to Statistical Quality Control, John Wiley & Sons, Inc.. [7th ed.].
39. Bootstrap Methods: Another Look at the Jacknife10.1214/aos/1176344552 ↗
40. Efron, B., and Tibshirani, R. (1994). An Introduction to the Bootstrap, CRC Press.10.1201/9780429246593 ↗
41. Alternatives to the median absolute deviation10.1080/01621459.1993.10476408 ↗
42. Influence function and efficiency of the minimum covariance determinant scatter matrix estimator10.1006/jmva.1999.1839 ↗
43. Han, J., Kamber, M., and Pei, J. (2012). Data Mining Concepts and Techniques, Morgan Kaufmann.
44. Evaluation Measure for Models Assesment Over Imbalanced Data Sets
45. B.I. Tool (2024, March 01). Bro-IDS Tool. Available online: https://www.bro.org/.
46. Witten, I.H., and Frank, E. (2005). Data Mining: Practical Machine Learning Tools and Techniques with Java Implementations, Elsevier.
47. Mei-Ling, S., Kanoksri, S., Indika, K.-A., Shu-Ching, C., Liwu, C., and Goldring, T. (2005). Handling nominal features in anomaly intrusion detection problems. Research Issues in Data Engineering: Stream Data Mining and Applications, Proceedings of the 15th International Workshop on Research Issues in Data Engineering: Stream Data Mining and Applications, Tokyo, Japan, 3–4 April 2005, IEEE.
48. Raymaekers, J., and Rousseeuw, P.J. (2023). The Cellwise Minimum Covariance Determinant Estimator. J. Am. Stat. Assoc., 1–12.10.1080/01621459.2023.2267777 ↗