Malware Detection Issues, Challenges, and Future Directions: A Survey
Source abstract
Abstract
The evolution of recent malicious software with the rising use of digital services has increased the probability of corrupting data, stealing information, or other cybercrimes by malware attacks. Therefore, malicious software must be detected before it impacts a large number of computers. Recently, many malware detection solutions have been proposed by researchers. However, many challenges limit these solutions to effectively detecting several types of malware, especially zero-day attacks due to obfuscation and evasion techniques, as well as the diversity of malicious behavior caused by the rapid rate of new malware and malware variants being produced every day. Several review papers have explored the issues and challenges of malware detection from various viewpoints. However, there is a lack of a deep review article that associates each analysis and detection approach with the data type. Such an association is imperative for the research community as it helps to determine the suitable mitigation approach. In addition, the current survey articles stopped at a generic detection approach taxonomy. Moreover, some review papers presented the feature extraction methods as static, dynamic, and hybrid based on the utilized analysis approach and neglected the feature representation methods taxonomy, which is considered essential in developing the malware detection model. This survey bridges the gap by providing a comprehensive state-of-the-art review of malware detection model research. This survey introduces a feature representation taxonomy in addition to the deeper taxonomy of malware analysis and detection approaches and links each approach with the most commonly used data types. The feature extraction method is introduced according to the techniques used instead of the analysis approach. The survey ends with a discussion of the challenges and future research directions.
Source: crossref · Quality: baseline
Research context
OpenAlex topics: Advanced Malware Detection Techniques · Network Security and Intrusion Detection · Software Testing and Debugging Techniques
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
Affiliations
Faculty of Engineering, School of Computing, Universiti Teknologi Malaysia, Johor Bahru 81300, Johor, Malaysia
Department of Information Systems-Girls Section, King Khalid University, Mahayil 62529, Saudi Arabia
Funding
Deanship of Scientific Research at King Khalid University
References (100+)
Show source-provided references
1. Tight Arms Race: Overview of Current Malware Threats and Trends in Their Detection10.1109/ACCESS.2020.3048319 ↗
2. Morgan, S. (2021, July 15). Cybercrime Damages $6 Trillion by 2021. Available online: https://cybersecurityventures.com/hackerpocalypse-cybercrime-report-2016/.
3. Cannarile, A., Dentamaro, V., Galantucci, S., Iannacone, A., Impedovo, D., and Pirlo, G. (2022). Comparing Deep Learning and Shallow Learning Techniques for API Calls Malware Prediction: A Study. Appl. Sci., 12.10.3390/app12031645 ↗
4. Ransomware Automatic Data Acquisition Tool10.1109/ACCESS.2018.2868885 ↗
5. Urooj, U., Al-Rimy, B.A.S., Zainal, A., Ghaleb, F.A., and Rassam, M.A. (2022). Ransomware Detection Using the Dynamic Analysis and Machine Learning: A Survey and Research Directions. Appl. Sci., 12.10.3390/app12010172 ↗
6. Hansen, S.S., Larsen, T.M.T., Stevanovic, M., and Pedersen, J.M. (2016, January 15–18). An approach for detection and family classification of malware based on behavioral analysis. Proceedings of the 2016 International Conference on Computing, Networking and Communications (ICNC), Kauai, HI, USA.10.1109/ICCNC.2016.7440587 ↗
7. Vignau, B., Khoury, R., and Halle, S. (2019, January 22–26). 10 Years of IoT Malware: A Feature-Based Taxonomy. Proceedings of the 2019 IEEE 19th International Conference on Software Quality, Reliability and Security Companion (QRS-C), Sofia, Bulgaria.10.1109/QRS-C.2019.00088 ↗
8. Asam, M., Hussain, S.J., Mohatram, M., Khan, S.H., Jamal, T., Zafar, A., Khan, A., Ali, M.U., and Zahoora, U. (2021). Detection of exceptional malware variants using deep boosted feature spaces and machine learning. Appl. Sci., 11.10.3390/app112110464 ↗
9. Evolution of Malware and Its Detection Techniques10.1007/978-981-13-7166-0_14 ↗
10. Metamorphic malware identification using engine-specific patterns based on co-opcode graphs10.1016/j.csi.2020.103443 ↗
11. A Survey on Malware Analysis Techniques: Static, Dynamic, Hybrid and Memory Analysis10.18517/ijaseit.8.4-2.6827 ↗
12. Alert correlation framework for malware detection by anomaly-based packet payload analysis10.1016/j.jnca.2017.08.010 ↗
13. Saxena, S., and Mancoridis, S. (2019, January 5–6). Malware Detection using Behavioral Whitelisting of Computer Systems. Proceedings of the 2019 IEEE International Symposium on Technologies for Homeland Security (HST), Greater Boston, MA, USA.10.1109/HST47167.2019.9032977 ↗
14. Gajrani, J., Sarswat, J., Tripathi, M., Laxmi, V., Gaur, M.S., and Conti, M. (2015, January 8–10). A robust dynamic analysis system preventing SandBox detection by android malware. Proceedings of the ACM International Conference Proceeding Series, Sochi, Russian.10.1145/2799979.2800004 ↗
15. Memory access patterns for malware detection
16. A Comprehensive Review on Malware Detection Approaches10.1109/ACCESS.2019.2963724 ↗
17. Malware classification and composition analysis: A survey of recent developments
18. Deylami, H.M., Muniyandi, R.C., Ardekani, I.T., and Sarrafzadeh, A. (2016, January 12–14). Taxonomy of malware detection techniques: A systematic literature review. Proceedings of the 2016 14th Annual Conference on Privacy, Security and Trust (PST), Auckland, New Zealand.10.1109/PST.2016.7906998 ↗
19. A Study on Malware and Malware Detection Techniques
20. The rise of machine learning for detection and classification of malware: Research developments, trends and challenges10.1016/j.jnca.2019.102526 ↗
21. Alsmadi, T., and Alqudah, N. (2021, January 14–15). A Survey on malware detection techniques. Proceedings of the 2021 International Conference on Information Technology (ICIT), Amman, Jordan.10.1109/ICIT52682.2021.9491765 ↗
22. Comparative Analysis of Feature Extraction Methods of Malware Detection10.9790/0661-16334954 ↗
23. A Survey of Malware Detection Techniques based on Machine Learning
24. Feature selection: A data perspective
25. Trends of anti-analysis operations of malwares observed in API call logs10.1007/s11416-017-0290-x ↗
26. Sicato, J.C.S., Sharma, P.K., Loia, V., and Park, J.H. (2019). Vpnfilter malware analysis on cyber threat in smart home network. Appl. Sci., 9.10.3390/app9132763 ↗
27. A Survey on malware analysis and mitigation techniques10.1016/j.cosrev.2019.01.002 ↗
28. A state-of-the-art survey of malware detection approaches using data mining techniques10.1186/s13673-018-0125-x ↗
29. A Survey on Data Mining Methods for Malware Detection
30. Naz, S., and Singh, D.K. (2019, January 6–8). Review of Machine Learning Methods for Windows Malware Detection. Proceedings of the 2019 10th International Conference on Computing, Communication and Networking Technologies (ICCCNT), Kanpur, India.10.1109/ICCCNT45670.2019.8944796 ↗
31. A static heuristic approach to detecting malware targets10.1002/sec.1228 ↗
32. An Ensemble-Based Malware Detection Model Using Minimum Feature Set
33. Intelligent Windows Malware Type Detection based on Multiple Sources of Dynamic Characteristics
34. AMA: Static Code Analysis of Web Page for the Detection of Malicious Scripts10.1016/j.procs.2016.07.291 ↗
35. Enhanced Approach to Detect Malicious VBScript Files Based on Data Mining Techniques10.1016/j.procs.2018.10.127 ↗
36. Nonnegative matrix factorization and metamorphic malware detection10.1007/s11416-019-00331-0 ↗
37. A learning model to detect maliciousness of portable executable using integrated feature set
38. Khodamoradi, P., Fazlali, M., Mardukhi, F., and Nosrati, M. (2015, January 7–8). Heuristic metamorphic malware detection based on statistics of assembly instructions using classification algorithms. Proceedings of the 2015 18th CSI International Symposium on Computer Architecture and Digital Systems (CADS), Tehran, Iran.10.1109/CADS.2015.7377792 ↗
39. Graph embedding as a new approach for unknown malware detection10.1007/s11416-016-0278-y ↗
40. Comparative Analysis of Low-Dimensional Features and Tree-Based Ensembles for Malware Detection Systems10.1109/ACCESS.2020.2986014 ↗
41. G3MD: Mining frequent opcode sub-graphs for metamorphic malware detection of existing families10.1016/j.eswa.2018.06.012 ↗
42. Lu, R. (2019). Malware Detection with LSTM using Opcode Language. arXiv.
43. A Simple Method for Detection of Metamorphic Malware using Dynamic Analysis and Text Mining10.1016/j.procs.2015.06.031 ↗
44. Behavior-based features model for malware detection10.1007/s11416-015-0244-0 ↗
45. Mosli, R., Li, R., Yuan, B., and Pan, Y. (2016, January 10–12). Automated malware detection using artifacts in forensic memory images. Proceedings of the 2016 IEEE Symposium on Technologies for Homeland Security (HST), Waltham, MA, USA.10.1109/THS.2016.7568881 ↗
46. Two-Stage Ransomware Detection Using Dynamic Analysis and Machine Learning Techniques10.1007/s11277-020-07166-9 ↗
47. A New Malware Detection System Using Machine Learning Techniques for API Call Sequences10.1080/19361610.2018.1387734 ↗
48. Improvement of malware detection and classification using API call sequence alignment and visualization10.1007/s10586-017-1110-2 ↗
49. Energy Consumption Metrics for Mobile Device Dynamic Malware Detection10.1016/j.procs.2019.09.273 ↗
50. A system call refinement-based enhanced Minimum Redundancy Maximum Relevance method for ransomware early detection10.1016/j.jnca.2020.102753 ↗
51. Detection of malicious software by analyzing the behavioral artifacts using machine learning algorithms10.1016/j.infsof.2020.106273 ↗
52. A Data Mining Classification Approach for Behavioral Malware Detection10.1155/2016/8069672 ↗
53. Detecting Ransomware Using Process Behavior Analysis10.1016/j.procs.2020.02.249 ↗
54. Combined dynamic multi-feature and rule-based behavior for accurate malware detection10.1177/1550147719889907 ↗
55. Fraley, J.B., and Figueroa, M. (April, January 30). Polymorphic malware detection using topological feature extraction with data mining. Proceedings of the SoutheastCon 2016, Norfolk, VA, USA.10.1109/SECON.2016.7506685 ↗
56. Ndibanje, B., Kim, K.H., Kang, Y.J., Kim, H.H., Kim, T.Y., and Lee, H.J. (2019). Cross-Method-Based Analysis and Classification of Malicious Behavior by API Calls Extraction. Appl. Sci., 9.10.3390/app9020239 ↗
57. A multi-level deep learning system for malware detection10.1016/j.eswa.2019.04.064 ↗
58. A Method for Windows Malware Detection Based on Deep Learning10.1007/s11265-020-01588-1 ↗
59. A comparison of static, dynamic, and hybrid analysis for malware detection10.1007/s11416-015-0261-z ↗
60. Wael, D., Shosha, A., and Sayed, S.G. (2017, January 5–8). Malicious VBScript detection algorithm based on data-mining techniques. Proceedings of the 2017 International Conference on Advanced Control. Circuits Systems (ACCS) Systems & 2017 International Conference on New Paradigms in Electronics & Information Technology (PEIT), Alexandria, Egypt.10.1109/ACCS-PEIT.2017.8303028 ↗
61. Fuyong, Z., and Tiezhu, Z. (2017, January 21–24). Malware Detection and Classification Based on N-Grams Attribute Similarity. Proceedings of the 2017 IEEE International Conference on Computational Science and Engineering (CSE) and IEEE International Conference on Embedded and Ubiquitous Computing (EUC), Guangzhou, China.10.1109/CSE-EUC.2017.157 ↗
62. A Novel Approach to Detect Malware Based on API Call Sequence Analysis10.1155/2015/659101 ↗
63. Sihwail, R., Omar, K., Ariffin, K.A.Z., and Al Afghani, S. (2019). Malware Detection Approach Based on Artifacts in Memory Image and Dynamic Analysis. Appl. Sci., 9.10.3390/app9183680 ↗
64. Detection of Obfuscation in Java Malware10.1016/j.procs.2016.02.097 ↗
65. Automatic malware classification and new malware detection using machine learning10.1631/FITEE.1601325 ↗
66. Li, X., Qiu, K., Qian, C., and Zhao, G. (2020, January 27–30). An Adversarial Machine Learning Method Based on OpCode N-grams Feature in Malware Detection. Proceedings of the 2020 IEEE Fifth International Conference on Data Science in Cyberspace (DSC), Hong Kong, China.10.1109/DSC50466.2020.00066 ↗
67. Classification of ransomware families with machine learning based on N-gram of opcodes10.1016/j.future.2018.07.052 ↗
68. A chi-square-based decision for real-time malware detection using PE-file features
69. Malware classification using self organising feature maps and machine activity data10.1016/j.cose.2017.11.016 ↗
70. Ali, M., Shiaeles, S., Bendiab, G., and Ghita, B. (2020). MALGRA: Machine Learning and N-Gram Malware Feature Extraction and Detection System. Electronics, 9.10.3390/electronics9111777 ↗
71. Malware Detection in Mobile Devices by Analyzing Sequences of System Calls
72. Integrated Static and Dynamic Analysis for Malware Detection10.1016/j.procs.2015.02.149 ↗
73. Windows malware detection system based on LSVC recommended hybrid features10.1007/s11416-018-0327-9 ↗
74. An empirical study to estimate the stability of random forest classifier on the hybrid features recommended by filter based feature selection technique10.1007/s13042-019-00978-7 ↗
75. A study on variant malware detection techniques using static and dynamic features
76. DNS rule-based schema to botnet detection10.1080/17517575.2019.1644673 ↗
77. A Novel Approach to Detect Malware Variants Based on Classified Behaviors10.1109/ACCESS.2019.2924331 ↗
78. Deep learning based Sequential model for malware analysis using Windows exe API Calls10.7717/peerj-cs.285 ↗
79. Detection of malicious code by applying machine learning classifiers on static features: A state-of-the-art survey10.1016/j.istr.2009.03.003 ↗
80. A malware detection method based on family behavior graph10.1016/j.cose.2017.10.007 ↗
81. Trust-based Voting Method for Efficient Malware Detection10.1016/j.procs.2016.03.084 ↗
82. A Feature Extraction Method of Hybrid Gram for Malicious Behavior Based on Machine Learning
83. Multinomial malware classification via low-level features10.1016/j.diin.2018.04.019 ↗
84. Daku, H., Zavarsky, P., and Malik, Y. (2018, January 1–3). Behavioral-Based Classification and Identification of Ransomware Variants Using Machine Learning. Proceedings of the 2018 17th IEEE International Conference on Trust, Security and Privacy in Computing and Communications/12th IEEE International Conference on Big Data Science And Engineering (TrustCom/BigDataSE), New York, NY, USA.10.1109/TrustCom/BigDataSE.2018.00224 ↗
85. A dynamic Windows malware detection and prediction method based on contextual understanding of API call sequence10.1016/j.cose.2020.101760 ↗
86. A novel method for malware detection on ML-based visualization technique10.1016/j.cose.2019.101682 ↗
87. A feature-hybrid malware variants detection using CNN based opcode embedding and BPNN based API embedding10.1016/j.cose.2019.04.005 ↗
88. Recurrent neural network for detecting malware10.1016/j.cose.2020.102037 ↗
89. Santos, I., Brezo, F., Nieves, J., Penya, Y.K., Sanz, B., Laorden, C., and Bringas, P.G. (2010). Idea: Opcode-sequence-based Malware Detection. International Symposium on Engineering Secure Software and Systems, Springer.10.1007/978-3-642-11747-3_3 ↗
90. Garg, V., and Yadav, R.K. (2019, January 21–22). Malware Detection based on API Calls Frequency. Proceedings of the 2019 4th International Conference on Information Systems and Computer Networks (ISCON), Mathura, India.10.1109/ISCON47742.2019.9036219 ↗
91. A graph-based model for malware detection and classification using system-call groups10.1007/s11416-016-0267-1 ↗
92. Dynamic VSA: A framework for malware detection based on register contents10.1016/j.engappai.2015.05.008 ↗
93. SJang, S., Li, S., and Sung, Y. (2020). Generative adversarial network for global image-based local image to improve Malware classification using convolutional neural network. Appl. Sci., 10.10.3390/app10217585 ↗
94. Nisa, M., Shah, J.H., Kanwal, S., Raza, M., Khan, M.A., Damaševičius, R., and Blažauskas, T. (2020). Hybrid malware classification method using segmentation-based fractal texture analysis and deep convolution neural network features. Appl. Sci., 10.10.3390/app10144966 ↗
95. Control flow analysis10.1145/390013.808479 ↗
96. Zhao, Z. (2011, January 8–10). A virus detection scheme based on features of Control Flow Graph. Proceedings of the 2011 2nd International Conference on Artificial Intelligence, Management Science and Electronic Commerce, AIMSEC 2011—Proceedings, Zhengzhou, China.
97. Enhancing unsupervised neural networks based text summarization with word embedding and ensemble learning10.1016/j.eswa.2019.01.037 ↗
98. Amer, E., El-Sappagh, S., and Hu, J. (2020). Contextual identification of windows malware through semantic interpretation of API call sequence. Appl. Sci., 10.10.3390/app10217673 ↗
99. Nataraj, L., Karthikeyan, S., Jacob, G., and Manjunath, B.S. (2011, January 12–14). Malware images: Visualization and automatic classification. Proceedings of the ACM International Conference Proceeding Series, Rourkela Odisha, India.10.1145/2016904.2016908 ↗
100. El-Shafai, W., Almomani, I., and AlKhayer, A. (2021). Visualized malware multi-classification framework using fine-tuned cnn-based transfer learning models. Appl. Sci., 11.10.3390/app11146446 ↗