Breaking Alert Fatigue: AI-Assisted SIEM Framework for Effective Incident Response
Source abstract
Abstract
Contemporary security information and event management (SIEM) solutions struggle to identify critical security incidents effectively due to the overwhelming number of false alerts generated by disparate security products, which results in significant alert fatigue and hinders effective incident response. To overcome this challenge, we propose a next-generation SIEM framework that integrates security orchestration automation and response capabilities and utilizes a divide-and-conquer strategy to mitigate the impact of low-quality IDS alerts. The proposed framework leverages advanced machine learning and data visualization tools—including a cost-sensitive learning method and an event segmenting algorithm—to filter and correlate alerts plus an augmented visualization tool to expedite the triage process. The proposed framework was evaluated experimentally on a dataset collected from a real-world enterprise network, and we report highly convincing results. The alert screening scheme demonstrates significant potential for real-world security operations. We believe that our findings will contributing to the development of a next-generation SIEM system that effectively addresses alert fatigue and lays the foundation for future research in this field.
Source: crossref · Quality: baseline
Research context
OpenAlex topics: Network Security and Intrusion Detection · Anomaly Detection Techniques and Applications · Information and Cyber Security
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
Affiliations
Cybersecurity Research Institute, National Institute of Information and Communications Technology, Tokyo 184-8795, Japan
Funding
Ministry of Internal Affairs and Communications
References (75)
Show source-provided references
1. European Union Agency for Cybersecurity (2023, January 30). ENISA Threat Landscape. Available online: https://www.enisa.europa.eu/publications/enisa-threat-landscape-2021.
2. European Union Agency for Cybersecurity (2023, January 30). ENISA Threat Landscape. Available online: https://www.enisa.europa.eu/publications/enisa-threat-landscape-2022.
3. A Detailed Investigation and Analysis of Using Machine Learning Techniques for Intrusion Detection10.1109/COMST.2018.2847722 ↗
4. Mohammadpour, L., Ling, T.C., Liew, C.S., and Aryanfar, A. (2022). A Survey of CNN-Based Network Intrusion Detection. Appl. Sci., 12.10.3390/app12168162 ↗
5. Gu, G., Zhang, J., and Lee, W. (2008, January 10–13). BotSniffer: Detecting Botnet Command and Control Channels in Network Traffic. Proceedings of the 2008 Network and Distributed System Security Symposium, NDSS, The Internet Society, San Diego, CA, USA.
6. Obfuscation: The Hidden Malware10.1109/MSP.2011.98 ↗
7. Roesch, M. (1999, January 7–12). Snort: Lightweight intrusion detection for networks. Proceedings of the LISA, Seattle, WA, USA.
8. Bro: A system for detecting network intruders in real-time10.1016/S1389-1286(99)00112-7 ↗
9. Julien, V. (2023, January 30). Suricata IDS. Available online: https://suricata.io/.
10. VMware (2023, January 30). Advanced Threat Prevention with VMware NSX Distributed Firewall. Available online: https://business-iq.net/assets/8079-advanced-threat-prevention-with-vmware-nsx-distributed-firewall.
11. Fireeye2022 (2023, January 30). FireEye Network Security: Effective Protection against Cyber Breaches for Midsize to Large Organizations. Available online: https://docplayer.net/81314407-Fireeye-network-security.html.
12. TrendMicro (2023, January 30). Machine Learning and Next-Generation Intrusion Prevention System (NGIPS). Available online: https://documents.trendmicro.com/assets/wp/WP01_Machine_Learning_170608US.pdf.
13. Vaarandi, R., and Podins, K. (2010, January 25–29). Network IDS alert classification with frequent itemset mining and data clustering. Proceedings of the International Conference on Network and Service Management, Niagara Falls, ON, Canada.10.1109/CNSM.2010.5691262 ↗
14. McAfee (2023, January 30). Alert Fatigue: 31.9% of IT Security Professionals Ignore Alerts. Available online: https://www.mcafee.com/blogs/enterprise/cloud-security/alert-fatigue-31-9-of-it-security-professionals-ignore-alerts/.
15. González-Granadillo, G., González-Zarzosa, S., and Diaz, R. (2021). Security Information and Event Management (SIEM): Analysis, Trends, and Usage in Critical Infrastructures. Sensors, 21.10.3390/s21144759 ↗
16. Featureless Discovery of Correlated and False Intrusion Alerts10.1109/ACCESS.2020.3001374 ↗
17. A Survey on Secure Network: Intrusion Detection & Prevention Approaches
18. Walling, S., and Lodh, S. (2022, January 3–5). A Survey on Intrusion Detection Systems: Types, Datasets, Machine Learning methods for NIDS and Challenges. Proceedings of the 2022 13th International Conference on Computing Communication and Networking Technologies (ICCCNT), Kharagpur, India.10.1109/ICCCNT54827.2022.9984320 ↗
19. A Hybrid Intrusion Detection System Based on Scalable K-Means+ Random Forest and Deep Learning10.1109/ACCESS.2021.3082147 ↗
20. Optimization of Intrusion Detection Using Likely Point PSO and Enhanced LSTM-RNN Hybrid Technique in Communication Networks10.1109/ACCESS.2023.3240109 ↗
21. Machine and Deep Learning Solutions for Intrusion Detection and Prevention in IoTs: A Survey10.1109/ACCESS.2022.3220622 ↗
22. Detection of Real-Time Malicious Intrusions and Attacks in IoT Empowered Cybersecurity Infrastructures10.1109/ACCESS.2023.3238664 ↗
23. Transfer Learning Approach to IDS on Cloud IoT Devices Using Optimized CNN10.1109/ACCESS.2022.3233775 ↗
24. Alohali, M.A., Elsadig, M., Al-Wesabi, F.N., Al Duhayyim, M., Mustafa Hilal, A., and Motwakel, A. (2023). Enhanced Chimp Optimization-Based Feature Selection with Fuzzy Logic-Based Intrusion Detection System in Cloud Environment. Appl. Sci., 13.10.3390/app13042580 ↗
25. A multi-layered intrusion detection system for software defined networking10.1016/j.compeleceng.2022.108042 ↗
26. Awotunde, J.B., Folorunso, S.O., Imoize, A.L., Odunuga, J.O., Lee, C.C., Li, C.T., and Do, D.T. (2023). An Ensemble Tree-Based Model for Intrusion Detection in Industrial Internet of Things Networks. Appl. Sci., 13.10.3390/app13042479 ↗
27. Swift, D. (2023, January 30). A Practical Application of SIM/SEM/SIEM, Automating Threat Identification. Available online: https://www.sans.org/white-papers/1781/.
28. User and Entity Behavior Analysis under Urban Big Data10.1145/3374749 ↗
29. Podzins, O., and Romanovs, A. (2019, January 25). Why SIEM is Irreplaceable in a Secure IT Environment?. Proceedings of the 2019 Open Conference of Electrical, Electronic and Information Sciences (eStream), Vilnius, Lithuania.10.1109/eStream.2019.8732173 ↗
30. Shea, S. (2023, January 30). SOAR (Security Orchestration, Automation and Response). Available online: https://www.techtarget.com/searchsecurity/definition/SOAR.
31. Gartner (2023, January 30). Gartner: 2022 Market Guide for Security Orchestration, Automation and Response Solutions. Available online: https://swimlane.com/resources/gartner-soar-market-guide-2022.
32. AI/ML in Security Orchestration, Automation and Response: Future Research Directions10.32604/iasc.2021.016240 ↗
33. Gupta, N., Traore, I., and de Quinan, P.M.F. (2019, January 9–12). Automated Event Prioritization for Security Operation Center using Deep Learning. Proceedings of the 2019 IEEE International Conference on Big Data (Big Data), Los Angeles, CA, USA.10.1109/BigData47090.2019.9006073 ↗
34. A preliminary two-stage alarm correlation and filtering system using SOM neural network and K-means algorithm10.1016/j.cose.2010.02.001 ↗
35. Shittu, R., Healing, A., Ghanea-Hercock, R., Bloomfield, R., and Muttukrishnan, R. (2014, January 8–11). OutMet: A new metric for prioritising intrusion alerts using correlation and outlier analysis. Proceedings of the 39th Annual IEEE Conference on Local Computer Networks, Edmonton, AL, Canada.10.1109/LCN.2014.6925787 ↗
36. Comprehensive approach to intrusion detection alert correlation10.1109/TDSC.2004.21 ↗
37. Hassan, W.U., Guo, S., Li, D., Chen, Z., Jee, K., Li, Z., and Bates, A. (2019, January 24–27). NODOZE: Combatting Threat Alert Fatigue with Automated Provenance Triage. Proceedings of the Network and Distributed Systems Security (NDSS) Symposium, San Diego, CA, USA.10.14722/ndss.2019.23349 ↗
38. Sun, L., Versteeg, S., Boztas, S., and Rao, A. (2016). Detecting Anomalous User Behavior Using an Extended Isolation Forest Algorithm: An Enterprise Case Study. arXiv.
39. Chakir, E.M., Moughit, M., and Idrissi Khamlichi, Y. (2017, January 19–20). An efficient method for evaluating alerts of Intrusion Detection Systems. Proceedings of the 2017 International Conference on Wireless Technologies, Embedded and Intelligent Systems (WITS), Fez, Morocco.10.1109/WITS.2017.7934678 ↗
40. Aminanto, M.E., Zhu, L., Ban, T., Isawa, R., Takahashi, T., and Inoue, D. (2019). Proceedings of the Lecture Notes in Computer Science, Neural Information Processing (ICONIP) 2019, Springer.
41. Threat Alert Prioritization Using Isolation Forest and Stacked Auto Encoder With Day-Forward-Chaining Analysis10.1109/ACCESS.2020.3041837 ↗
42. Madani, A., Rezayi, S., and Gharaee, H. (2011, January 19–21). Log management comprehensive architecture in Security Operation Center (SOC). Proceedings of the IEEE 2011 International Conference on Computational Aspects of Social Networks (CASoN), Salamanca, Spain.10.1109/CASON.2011.6085959 ↗
43. IBM (2019, May 09). Log Event Extended Format (LEEF). Available online: https://www.ibm.com/support/knowledgecenter/SS42VS_DSM/b_Leef_format_guide.pdf.
44. McAfee (2020, September 30). McAfee Enterprise Security Manager 10.2.0 Product Guide (Unmanaged). Available online: https://docs.mcafee.com/bundle/enterprise-security-manager-10.2.0-product-guide-unmanaged/page/GUID-984F5DA6-8D84-4549-855B-C77D53CF96B9.html.
45. Debar, H., Curry, D., and Feinstein, B. (2023, January 30). The intrusion detection message exchange format (IDMEF). Available online: https://www.ietf.org/rfc/rfc4765.txt.
46. MITRE (2023, January 30). Common Event Expression—CEE, a Unified Event Language for Interoperability. Available online: http://makingsecuritymeasurable.mitre.org/docs/cee-intro-handout.pdf.
47. Azodi, A., Jaeger, D., Cheng, F., and Meinel, C. (2013, January 21–22). A new approach to building a multi-tier direct access knowledgebase for ids/siem systems. Proceedings of the 2013 IEEE 11th International Conference on Dependable, Autonomic and Secure Computing, Chengdu, China.10.1109/DASC.2013.48 ↗
48. Sapegin, A., Jaeger, D., Azodi, A., Gawron, M., Cheng, F., and Meinel, C. (2013, January 4–6). Hierarchical object log format for normalisation of security events. Proceedings of the IEEE 2013 9th International Conference on Information Assurance and Security (IAS), Gammarth, Tunisia.10.1109/ISIAS.2013.6947748 ↗
49. Brainwash: A data system for feature engineering
50. Khurana, U., Turaga, D., Samulowitz, H., and Parthasrathy, S. (2016, January 12–15). Cognito: Automated feature engineering for supervised learning. Proceedings of the IEEE 16th International Conference on Data Mining Workshops (ICDMW), Barcelona, Spain.10.1109/ICDMW.2016.0190 ↗
51. Li, D., Kotani, D., and Okabe, Y. (2020, January 13–17). Improving Attack Detection Performance in NIDS Using GAN. Proceedings of the 2020 IEEE 44th Annual Computers, Software, and Applications Conference (COMPSAC), Madrid, Spain.10.1109/COMPSAC48688.2020.0-162 ↗
52. Pezoa, F., Reutter, J.L., Suarez, F., Ugarte, M., and Vrgoč, D. (2016, January 11–15). Foundations of JSON schema. Proceedings of the 25th International Conference on World Wide Web. International World Wide Web Conferences Steering Committee, Montreal, QC, Canada.10.1145/2872427.2883029 ↗
53. Joloudari, J.H., Marefat, A., Nematollahi, M.A., Oyelere, S.S., and Hussain, S. (2023). Effective Class-Imbalance Learning Based on SMOTE and Convolutional Neural Networks. Appl. Sci., 13.10.3390/app13064006 ↗
54. Oliveira, N., Praça, I., Maia, E., and Sousa, O. (2021). Intelligent Cyber Attack Detection and Classification for Network-Based Intrusion Detection Systems. Appl. Sci., 11.10.3390/app11041674 ↗
55. Jadhav, A., Mostafa, S.M., Elmannai, H., and Karim, F. (2022). An Empirical Assessment of Performance of Data Balancing Techniques in Classification Task. Appl. Sci., 12.10.3390/app12083928 ↗
56. Liu, C., Cao, L., and Yu, P.S. (2014, January 6–11). A hybrid coupled k-nearest neighbor algorithm on imbalance data. Proceedings of the IEEE 2014 International Joint Conference on Neural Networks (IJCNN), Beijing, China.10.1109/IJCNN.2014.6889798 ↗
57. He, H., Bai, Y., Garcia, E.A., and Li, S. (2008, January 1–8). ADASYN: Adaptive synthetic sampling approach for imbalanced learning. Proceedings of the 2008 IEEE International Joint Conference on Neural Networks (IEEE World Congress on Computational Intelligence), Hong Kong, China.
58. Borderline over-sampling for imbalanced data classification10.1504/IJKESDP.2011.039875 ↗
59. Ndichu, S., Ban, T., Takahashi, T., and Inoue, D. (2023). AI-Assisted Security Alert Data Analysis with Imbalanced Learning Methods. Appl. Sci., 13.10.3390/app13031977 ↗
60. LIBSVM: A library for support vector machines10.1145/1961189.1961199 ↗
61. Ban, T., Samuel, N., Takahashi, T., and Inoue, D. (2021, January 9). Combat Security Alert Fatigue with AI-Assisted Techniques. Proceedings of the 2021 Cyber Security Experimentation and Test Workshop, CSET, New York, NY, USA.10.1145/3474718.3474723 ↗
62. Duda, R.O., Hart, P.E., and Stork, D.G. (2000). Pattern Classification, Wiley-Interscience. [2nd ed.].
63. Sammut, C., and Webb, G.I. (2010). Encyclopedia of Machine Learning, Springer.10.1007/978-0-387-30164-8 ↗
64. Out-of-sample tests of forecasting accuracy: An analysis and review10.1016/S0169-2070(00)00065-0 ↗
65. Old dog, new tricks: A modelling view of simple moving averages10.1080/00207543.2017.1380326 ↗
66. Learning from Imbalanced Data10.1109/TKDE.2008.239 ↗
67. Learning using privileged information: SVM+ and weighted SVM10.1016/j.neunet.2014.02.002 ↗
68. Cimpanu, C. (2023, January 30). Emotet, tOday’S Most Dangerous Botnet, Comes Back to Life. Available online: https://www.zdnet.com/article/emotet-todays-most-dangerous-botnet-comes-back-to-life/.
69. Pathria, R.K., and Beale, P.D. (2011). Statistical Mechanics, Academic Press. [3rd ed.].
70. Ndichu, S., Ban, T., Takahashi, T., and Inoue, D. (2021, January 15–18). A Machine Learning Approach to Detection of Critical Alerts from Imbalanced Multi-Appliance Threat Alert Logs. Proceedings of the 2021 IEEE International Conference on Big Data (Big Data), Orlando, FL, USA.10.1109/BigData52589.2021.9671956 ↗
71. Mathworks (2023, January 30). Hyperparameter Optimization in Classification Learner App. Available online: https://www.mathworks.com/help/stats/hyperparameter-optimization-in-classification-learner-app.html.
72. Evaluation: From Precision, Recall and F-measure to ROC, Informedness, Markedness & Correlation
73. Visualizing Data using t-SNE
74. Petrila, J., Cohn, B., Pritchett, W., Stiles, P., Stodden, V.V., Humowiecki, M., and Rozario, N. (2023, January 30). Legal Issues for IDS Use: Finding a Way Forward. Available online: https://aisp.upenn.edu/wp-content/uploads/2016/07/Legal-Issues.pdf.
75. Quality, N., and Commission, S. (2023, January 30). NDIS Code of Conduct, Available online: https://www.ndiscommission.gov.au/about/ndis-code-conduct.