Advanced Techniques for Dynamic Malware Detection and Classification in Digital Security Using Deep Learning

The rapid evolution of malware presents a critical cybersecurity challenge, rendering traditional signature-based detection methods ineffective against novel variants. This growing threat affects individuals, organizations, and governments, highlighting the urgent need for robust malware detection mechanisms. Conventional machine learning-based approaches rely on static and dynamic malware analysis and often struggle to detect previously unseen threats due to their dependency on predefined signatures. Although machine learning algorithms (MLAs) offer promising detection capabilities, their reliance on extensive feature engineering limits real-time applicability. Deep learning techniques mitigate this issue by automating feature extraction but may introduce computational overhead, affecting deployment efficiency. This research evaluates classical MLAs and deep learning models to enhance malware detection performance across diverse datasets. The proposed approach integrates a novel text and image-based detection framework, employing an optimized Support Vector Machine (SVM) for textual data analysis and EfficientNet-B0 for image-based malware classification. Experimental analysis, conducted across multiple train-test splits over varying timescales, demonstrates 99.97% accuracy on textual datasets using SVM and 96.7% accuracy on image-based datasets with EfficientNet-B0, significantly improving zero-day malware detection. Furthermore, a comparative analysis with existing competitive techniques, such as Random Forest, XGBoost, and CNN-based (Convolutional Neural Network) classifiers, highlights the superior performance of the proposed model in terms of accuracy, efficiency, and robustness.