journal article·2025Open access

Enhancing Android Malware Detection with XGBoost and Convolutional Neural Networks

Atif Raza Zaidi, Tahir Abbas, Ali Daud, Omar Alghushairy, Hussain Dawood, Nadeem Sarwar

Computers, Materials & Continua· Volume 84· Issue 2

Abstract

Safeguarding against malware requires precise machine-learning algorithms to classify harmful apps. The Drebin dataset of 15,036 samples and 215 features yielded significant and reliable results for two hybrid models, CNN + XGBoost and KNN + XGBoost. To address the class imbalance issue, SMOTE (Synthetic Minority Over-sampling Technique) was used to preprocess the dataset, creating synthetic samples of the minority class (malware) to balance the training set. XGBoost was then used to choose the most essential features for separating malware from benign programs. The models were trained and tested using 6-fold cross-validation, measuring accuracy, precision, recall, F1 score, and ROC AUC. The results are highly dependable, showing that CNN + XGBoost consistently outperforms KNN + XGBoost with an average accuracy of 98.76% compared to 97.89%. The CNN-based malware classification model, with its higher precision, recall, and F1 scores, is a secure choice. CNN + XGBoost, with its fewer all-fold misclassifications in confusion matrices, further solidifies this security. The calibration curve research, confirming the accuracy and cybersecurity applicability of the models’ probability projections, adds to the sense of reliability. This study unequivocally demonstrates that CNN + XGBoost is a reliable and effective malware detection system, underlining the importance of feature selection and hybrid models.
Source: openalex_inverted_index · Quality: baseline

Research context

OpenAlex topics: Advanced Malware Detection Techniques · Network Security and Intrusion Detection · Mobile and Web Applications

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

References (43)

Show source-provided references
1. Detecting Android malware using deep learning algorithms: a survey10.1016/j.compeleceng.2024.109544 ↗
2. Artificial intelligence algorithms for malware detection in Android-operated mobile devices10.3390/s22062268 ↗
3. Android malware detection and identification frameworks by leveraging the machine and deep learning techniques: a comprehensive review10.1016/j.teler.2024.100130 ↗
4. Akhtar Z. Malware detection and analysis: challenges and research opportunities. arXiv:2101.08429. 2021.
5. Review of deep learning: concepts, CNN architectures, challenges, applications, future directions10.1186/s40537-021-00444-8 ↗
6. Security testing of Android apps using malware analysis and XGBoost optimized by adaptive particle swarm optimization10.1007/s42979-023-02411-x ↗
7. Apk2Audio4AndMal: audio based malware family detection framework10.1109/ACCESS.2023.3258377 ↗
8. Yeboah · Demalvertising: enhanced detection and mitigation of malvertising on Android devices · 2024
9. A comprehensive analysis and evaluation of Android malware prediction using AI
10. EfficientNet convolutional neural networks-based Android malware detection10.1016/j.cose.2022.102622 ↗
11. Integrating CNN and XGBoost with synthetic samples for advanced Android malware detection
12. Ransomware attack detection using machine learning approaches
13. A new method for tuning the CNN pre-trained models as a feature extractor for malware detection10.1007/s10044-024-01381-x ↗
14. Android malware detection based on convolutional neural networks
15. Lakshmanarao · Data engineering and intelligent computing. Advances in intelligent systems and computing · 2021 · 1407 · 151
16. Android malware detection in bytecode level using TF-IDF and XGBoost10.1093/comjnl/bxac198 ↗
17. An efficient Android malware detection model using Convnets and Resnet Models
18. Enhanced Android malware detection through artificial neural networks technique10.58496/MJCS/2025/005 ↗
19. Android malware detection based on logistic regression and XGBoost
20. Android malware detection using machine learning and neural network: a hybrid approach with federated learning
21. Android malware detection using convolutional neural networks and light gradient boosting machine: a hybrid method
22. Reggi Tresna Utami M, Hilman MH, Yazid S. Enhancing phishing detection: integrating XGBoost with feature selection techniques. [cited 2025 Jan 1]. Available from: https://ssrn.com/abstract=5087049.
23. Explainable AI for Android malware detection: towards understanding why the models perform so well?
24. A comprehensive investigation into robust malware detection with explainable AI10.1016/j.csa.2024.100072 ↗
25. Accurate and robust malware detection: running XGBoost on runtime data from performance counters10.1109/TCAD.2021.3102007 ↗
26. AMN: attention-based multimodal network for Android malware classification
27. Secure AODV protocol for mobile networks using short digital signatures
28. AKANDO: a hybrid approach for effective Android botnet detection
29. Android malware detection methods based on convolutional neural network: a survey10.1109/TETCI.2023.3281833 ↗
30. Android malware defense through a hybrid multi-modal approach10.1016/j.jnca.2024.104035 ↗
31. New efficient cryptographic techniques for cloud computing security
32. Unveiling vulnerabilities in deep learning-based malware detection: differential privacy driven adversarial attacks10.1016/j.cose.2024.104035 ↗
33. Hybrid permission-based Android malware detection using deep learning-enhanced CNNs and XGBoost
34. Anticipating threats through malware detection approaches to safeguard data privacy and security: an in-depth study
35. Hybrid feature extraction and integrated deep learning for cloud-based malware detection10.1016/j.cose.2024.104233 ↗
36. Time series reconstruction with feature-driven imputation: a comparison of base learning algorithms10.1109/ACCESS.2024.3416321 ↗
37. Android malware analysis and detection: a systematic review10.1111/exsy.13488 ↗
38. Verifying the robustness of machine learning based intrusion detection against adversarial perturbation
39. A hybrid approach for Android malware detection using improved multi-scale convolutional neural networks and residual networks10.1016/j.eswa.2024.123675 ↗
40. An ensemble machine learning approach for detecting and classifying malware attacks on mobile devices
41. Advanced Android malware detection: merging deep learning and XGBoost techniques10.17671/gazibtd.1553548 ↗
42. Detecting Android malware with convolutional neural networks and Hilbert space-filling curves10.1007/s42979-024-03123-6 ↗
43. Drebin: effective and explainable detection of Android malware in your pocket10.14722/ndss.2014.23247 ↗