A Hybrid Feature Selection Method for Advanced Persistent Threat Detection
Source abstract
Abstract
Advanced Persistent Threats (APTs) represent one of the most complex and dangerous categories of cyber-attacks characterised by their stealthy behaviour, long-term persistence, and ability to bypass traditional detection systems. The complexity of real-world network data poses significant challenges in detection. Machine learning models have shown promise in detecting APTs; however, their performance often suffers when trained on large datasets with redundant or irrelevant features. This study presents a novel, hybrid feature selection method designed to improve APT detection by reducing dimensionality while preserving the informative characteristics of the data. It combines Mutual Information (MI), Symmetric Uncertainty (SU) and Minimum Redundancy Maximum Relevance (mRMR) to enhance feature selection. MI and SU assess feature relevance, while mRMR maximises relevance and minimises redundancy, ensuring that the most impactful features are prioritised. This method addresses redundancy among selected features, improving the overall efficiency and effectiveness of the detection model. Experiments on a real-world APT datasets were conducted to evaluate the proposed method. Multiple classifiers including, Random Forest, Support Vector Machine (SVM), Gradient Boosting, and Neural Networks were used to assess classification performance. The results demonstrate that the proposed feature selection method significantly enhances detection accuracy compared to baseline models trained on the full feature set. The Random Forest algorithm achieved the highest performance, with near-perfect accuracy, precision, recall, and F1 scores (99.97%). The proposed adaptive thresholding algorithm within the selection method allows each classifier to benefit from a reduced and optimised feature space, resulting in improved training and predictive performance. This research offers a scalable and classifier-agnostic solution for dimensionality reduction in cybersecurity applications.
Source: openalex_inverted_index · Quality: baseline
Research context
OpenAlex topics: Advanced Malware Detection Techniques · Network Security and Intrusion Detection · Information and Cyber Security
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
References (58)
Show source-provided references
1. A literature review of financial losses statistics for cyber security and future trend10.30574/wjarr.2022.15.1.0573 ↗
2. Untargeted, targeted and universal adversarial attacks and defenses on time series
3. A survey on cyber-physical systems security10.1109/JIOT.2023.3289625 ↗
4. A comprehensive study on APT attacks and countermeasures for future networks and communications: challenges and solutions10.1007/s11227-016-1850-4 ↗
5. An improved behaviour specification to stop advanced persistent threat on governments and organizations network
6. A survey on feature selection techniques based on filtering methods for cyber attack detection10.3390/info14030191 ↗
7. Anomaly detection: a survey10.1145/1541880.1541882 ↗
8. Detecting APT using machine learning: comparative performance analysis with proposed model
9. AI-based anomaly detection for real-time cybersecurity
10. Detecting APT attacks based on network traffic using machine learning
11. A novel filter feature selection method for text classification: extensive feature selector10.1177/0165551521991037 ↗
12. A novel approach for APT attack detection based on feature intelligent extraction and representation learning10.1371/journal.pone.0305618 ↗
13. Feature selection based on mutual information with correlation coefficient10.1007/s10489-021-02524-x ↗
14. A novel relation aware wrapper method for feature selection10.1016/j.patcog.2023.109566 ↗
15. Machine learning-enabled iot security: open issues and challenges under advanced persistent threats
16. Dapt 2020-constructing a benchmark dataset for advanced persistent threats
17. A cyber kill chain approach for detecting advanced persistent threats
18. APT beaconing detection: a systematic review10.1016/j.cose.2022.102875 ↗
19. APTracker: a comprehensive and analytical malware dataset, based on attribution to APT groups10.1109/ACCESS.2024.3473021 ↗
20. Evaluating ML models on CTU-13 and IOT,-23 Datasets
21. Analyzing the usefulness of the DARPA OpTC dataset in cyber threat detection research
22. Synthetic network traffic data generation and classification of advanced persistent threat samples: a case study with GANs and XGBoost
23. Toward generating a new intrusion detection dataset and intrusion traffic characterization
24. APT datasets and attack modeling for automated detection methods: a review10.1016/j.cose.2020.101734 ↗
25. Characterization of semi-synthetic dataset for big-data semantic analysis
26. Anomaly-based intrusion detection system through feature selection analysis and building hybrid efficient model10.1016/j.jocs.2017.03.006 ↗
27. Wrappers for feature subset selection10.1016/S0004-3702(97)00043-X ↗
28. Filter-based feature selection and machine-learning classification of cancer data10.32604/iasc.2021.015460 ↗
29. Practical challenges and recommendations of filter methods for feature selection10.1142/S0219649220400195 ↗
30. Wrapper and hybrid feature selection methods using metaheuristic algorithms for English text classification: a systematic review10.1109/ACCESS.2022.3165814 ↗
31. IGRF-RFE: a hybrid feature selection method for MLP-based network intrusion detection on UNSW-NB15 dataset10.1186/s40537-023-00694-8 ↗
32. A detailed analysis of the KDD CUP 99 data set
33. A novel approach for detecting advanced persistent threats
34. Huang S, Poskitt CM, Shar LK. Security modelling for cyber-physical systems: a systematic literature review. arXiv:240407527. 2024.10.1145/3776549 ↗
35. Pols P, van den Berg J, Hague. The unified kill chain. CSA Thesis, Hague. 2017 [Internet]. p. 1–104. [cited 2025 Jun 24]. Available from: https://www.unifiedkillchain.com/assets/The-Unified-Kill-Chain.pdf.
36. Comparing attack models for it systems: Lockheed martin’s cyber kill chain, MITRE ATT&CK framework and diamond model
37. Hutchins EM, Cloppert MJ, Amin RM. Intelligence-driven computer network defense informed by analysis of adversary campaigns and intrusion kill chains. Vol. 1. Leading issues in information warfare & security research; 2011 [Internet]. [cited 2025 Jun 24]. Available from: https://securityandtechnology.org/wp-content/uploads/2020/07/lm-white-paper-intel-driven-defense.pdf.
38. APT-Dt-KC: advanced persistent threat detection based on kill-chain model10.1007/s11227-021-04201-9 ↗
39. Mitre att&ck: state of the art and way forward10.1145/3687300 ↗
40. A comprehensive survey on advanced persistent threat (APT) detection techniques
41. Cyber Kill Chain ontology to support automated cyber threat intelligence10.1016/j.ecolmodel.2023.110353 ↗
42. Cyber kill chain-based taxonomy of advanced persistent threat actors: analogy of tactics, techniques, and procedures
43. An intrusion detection model for cicids-2017 dataset using machine learning algorithms
44. UNSW-NB15: a comprehensive data set for network intrusion detection systems (UNSW-NB15 network data set)
45. A systematic literature review for APT detection and effective cyber situational awareness (ECSA) conceptual model10.1016/j.heliyon.2023.e17156 ↗
46. Learning to maximize mutual information for dynamic feature selection
47. Mutual information analysis: how, when and why?
48. Max-sliced mutual information
49. Theoretical evaluation of feature selection methods based on mutual information10.1016/j.neucom.2016.11.047 ↗
50. Agrawal · Recent advances in material, manufacturing, and machine learning · 2023 · 93410.1201/9781003370628-19 ↗
51. Feature selection based on mutual information criteria of max-dependency, max-relevance, and min-redundancy10.1109/TPAMI.2005.159 ↗
52. Model averaging prediction by K-fold cross-validation10.1016/j.jeconom.2022.04.007 ↗
53. Distance correlation-based feature selection in random forest10.3390/e25091250 ↗
54. A comprehensive survey of automated advanced persistent threat attribution: taxonomy, methods, challenges and open research problems
55. Decision trees10.1002/wics.1278 ↗
56. Deep learning in neural networks: an overview10.1016/j.neunet.2014.09.003 ↗
57. Mutual information: a way to quantify correlations10.1590/1806-9126-rbef-2022-0055 ↗
58. Automated anomaly detector adaptation using adaptive threshold tuning10.1145/2445566.2445569 ↗