journal article·2019-09-25Open access

Insider Threat Detection Based on User Behavior Modeling and Anomaly Detection Algorithms

Junhong Kim, Minsik Park, Haedong Kim, Suhyoun Cho, Pilsung Kang

Applied Sciences· Volume 9· Issue 19

Abstract

Insider threats are malicious activities by authorized users, such as theft of intellectual property or security information, fraud, and sabotage. Although the number of insider threats is much lower than external network attacks, insider threats can cause extensive damage. As insiders are very familiar with an organization’s system, it is very difficult to detect their malicious behavior. Traditional insider-threat detection methods focus on rule-based approaches built by domain experts, but they are neither flexible nor robust. In this paper, we propose insider-threat detection methods based on user behavior modeling and anomaly detection algorithms. Based on user log data, we constructed three types of datasets: user’s daily activity summary, e-mail contents topic distribution, and user’s weekly e-mail communication history. Then, we applied four anomaly detection algorithms and their combinations to detect malicious activities. Experimental results indicate that the proposed framework can work well for imbalanced datasets in which there are only a few insider threats and where no domain experts’ knowledge is provided.
Source: crossref · Quality: baseline

Research context

OpenAlex topics: Network Security and Intrusion Detection · Anomaly Detection Techniques and Applications · Advanced Malware Detection Techniques

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

School of Industrial Management Engineering, Korea University, Seoul, Korea

Funding

National Research Foundation of Korea · Korea Electric Power Corporation

References (39)

Show source-provided references
1. Generating Test Data for Insider Threat Detectors
2. A framework for understanding and predicting insider attacks10.1016/S0167-4048(02)01009-X ↗
3. Legg, P.A. (2015, January 25). Visualizing the insider threat: Challenges and tools for identifying malicious user activity. Proceedings of the 2015 IEEE Symposium on Visualization for Cyber Security (VizSec), Chicago, IL, USA.10.1109/VIZSEC.2015.7312772 ↗
4. Ted, E., Goldberg, H.G., Memory, A., Young, W.T., Rees, B., Pierce, R., Huang, D., Reardon, M., Bader, D.A., and Chow, E. (2013, January 11–14). Detecting insider threats in a real corporate database of computer usage activity. Proceedings of the 19th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, Chicago, IL, USA.
5. Mather, T., Kumaraswamy, S., and Latif, S. (2009). Cloud Security and Privacy: An Enterprise Perspective on Risks and Compliance, O’Reilly Media, Inc.
6. A survey of insider attack detection research10.1007/978-0-387-77322-3_5 ↗
7. The insider threat to information systems and the effectiveness of ISO1779910.1016/j.cose.2005.05.002 ↗
8. Wong, W.-K., Moore, A., Cooper, G., and Wagner, M. (August, January 28). Rule-based anomaly pattern detection for detecting disease. Proceedings of the Eighteenth National Conference on Artificial Intelligence (AAAI-02), Edmonton, AB, Canada.
9. Cappelli, D.M., Moore, A.P., and Trzeciak, R.F. (2012). The CERT Guide to Insider Threats: How to Prevent, Detect, and Respond to Information Technology Crimes (Theft, Sabotage, Fraud), Addison-Wesley.
10. Multi-source fusion for anomaly detection: Using across-domain and across-time peer-group consistency checks
11. Lunt, T.F., Jagannathan, R., Lee, R., Whitehurst, A., and Listgarten, S. (1989, January 27–31). Knowledge-based intrusion detection. Proceedings of the Annual AI Systems in Government Conference, Washington, DC, USA.
12. Insider threat detection using a graph-based approach10.1080/19361610.2011.529413 ↗
13. Parveen, P., Evans, J., Thuraisingham, B., Hamlen, K.W., and Khan, L. (2011, January 9–11). Insider threat detection using stream mining and graph mining. Proceedings of the Privacy, Security, Risk and Trust (PASSAT) and 2011 IEEE Third Inernational Conference on Social Computing (SocialCom), Boston, MA, USA.10.1109/PASSAT/SocialCom.2011.211 ↗
14. Mayhew, M., Atighetchi, M., Adler, A., and Greenstadt, R. (2015, January 26–28). Use of machine learning in big data analytics for insider threat detection. Proceedings of the MILCOM 2015—2015 IEEE Military Communications Conference, Tampa, FL, USA.10.1109/MILCOM.2015.7357562 ↗
15. Alpaydin, E. (2014). Introduction to Machine Learning, MIT Press.
16. Supervised and Unsupervised methods to detect Insider Threat from Enterprise Social and Online Activity Data
17. Ho, T.K. (1995, January 14–16). Random decision forests. Proceedings of the 3rd International Conference on Document Analysis and Recognition, Montreal, QC, Canada.
18. Liu, F.T., Ting, K.M., and Zhou, Z.-H. (2008, January 15–19). Isolation forest. Proceedings of the 2008 Eighth IEEE International Conference on Data Mining, Pisa, Italy.10.1109/ICDM.2008.17 ↗
19. Classification of imbalanced data: A review10.1142/S0218001409007326 ↗
20. Glasser, J., and Lindauer, B. (2013, January 23–24). Bridging the gap: A pragmatic approach to generating insider threat data. Proceedings of the 2013 IEEE Security and Privacy Workshops, San Francisco, CA, USA.10.1109/SPW.2013.37 ↗
21. Detecting insider threats using Ben-ware: Beneficial intelligent software for identifying anomalous human behavior
22. Young, W.T., Goldberg, H.G., Memory, A., Sartain, J.F., and Senator, T.E. (2013, January 23–24). Use of domain knowledge to detect insider threats in computer activities. Proceedings of the 2013 IEEE Security and Privacy Workshops, San Francisco, CA, USA.10.1109/SPW.2013.32 ↗
23. Nellikar, S. (2010). Insider Threat Simulation and Performance Analysis of Insider Detection Algorithms with Role Based Models. [Master’s Thesis, University of Illinois at Urbana-Champaign].
24. An introduction to variable and feature selection
25. Latent dirichlet allocation
26. Wallach, H.M. (2006, January 25–29). Topic modeling: Beyond bag-of-words. Proceedings of the 23rd International Conference on Machine Learning, Pittsburgh, PA, USA.10.1145/1143844.1143967 ↗
27. Distance between sets10.1038/234034a0 ↗
28. Wasserman, S., and Faust, K. (1994). Social Network Analysis: Methods and Analysis, Cambridge University Press.10.1017/CBO9780511815478 ↗
29. Classification with class imbalance problem
30. Anomaly detection: A survey10.1145/1541880.1541882 ↗
31. Barnett, V., and Lewis, T. (1994). Outliers in Statistical Data, Wiley.
32. Duda, R.O., Hart, P.E., and Stork, D.G. (2012). Pattern Classification, John Wiley & Sons.
33. An introduction to kernel-based learning algorithms10.1109/72.914517 ↗
34. Principal component analysis10.1016/0169-7439(87)80084-9 ↗
35. Novelty detection: A review—Part 1: Statistical approaches10.1016/j.sigpro.2003.07.018 ↗
36. Do we need hundreds of classifiers to solve real world classification problems
37. A survey of multiple classifier systems as hybrid systems10.1016/j.inffus.2013.04.006 ↗
38. Dynamic selection of classifiers—A comprehensive review10.1016/j.patcog.2014.05.003 ↗
39. An analysis of diversity measures10.1007/s10994-006-9449-2 ↗