An Efficient Analytical Approach to Visualize Text-Based Event Logs for Semiconductor Equipment
Source abstract
Abstract
Semiconductor equipment consists of a complex system in which numerous components are organically connected and controlled by many controllers. EventLog records all the information available during system processes. Because the EventLog records system runtime information so developers and engineers can understand system behavior and identify possible problems, it is essential for engineers to troubleshoot and maintain it. However, because the EventLog is text-based, complex to view, and stores a large quantity of information, the file size is very large. For long processes, the log file comprises several files, and engineers must look through many files, which makes it difficult to find the cause of the problem and therefore, a long time is required for the analysis. In addition, if the file size of the EventLog becomes large, the EventLog cannot be saved for a prolonged period because it uses a large amount of hard disk space on the CTC computer. In this paper, we propose a method to reduce the size of existing text-based log files. Our proposed method saves and visualizes text-based EventLogs in DB, making it easier to approach problems than the existing text-based analysis. We will confirm the possibility and propose a method that makes it easier for engineers to analyze log files.
Source: crossref · Quality: baseline
Research context
OpenAlex topics: Software System Performance and Reliability · Cloud Computing and Resource Management · Distributed systems and fault tolerance
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
Affiliations
Department of Smart Factory Convergence, Sungkyunkwan University, 2066 Seobu-ro, Jangan-gu, Suwon 16419, Korea
Funding
This research was supported by the MSIT (Ministry of Science and ICT), Korea, under the ITRC (Information Technology Research Center) support program (IITP-2021-2018-0-01417) supervised by the IITP (Institute for Information & Communications Technology Pl
References (38)
Show source-provided references
1. Towards automated log parsing for large-scale log data analysis10.1109/TDSC.2017.2762673 ↗
2. Guide to computer security log management
3. Event log modeling and analysis for system failure prediction10.1080/0740817X.2010.546385 ↗
4. Gainaru, A., Cappello, F., Trausan-Matu, S., and Kramer, B. (2011, January 2). Event log mining tool for large scale HPC systems. Proceedings of the European Conference on Parallel Processing, Rhodos, Greece.10.1007/978-3-642-23400-2_6 ↗
5. Liu, C., Pei, Y., Zeng, Q., and Duan, H. (2018, January 17–19). LogRank: An approach to sample business process event log for efficient discovery. Proceedings of the International Conference on Knowledge Science, Engineering and Management, Changchun, China.10.1007/978-3-319-99365-2_36 ↗
6. Dumais, S., Jeffries, R., Russell, D.M., Tang, D., and Teevan, J. (2014). Understanding user behavior through log data and analysis. Ways of Knowing in HCI, Springer.10.1007/978-1-4939-0378-8_14 ↗
7. Bright, C., and Logan, W. (2008, January 8–11). Selecting the right data storage approach for an automatic test system. Proceedings of the 2008 IEEE AUTOTESTCON, Salt Lake City, UT, USA.10.1109/AUTEST.2008.4662665 ↗
8. Advances and Challenges in Log Analysis: Logs contain a wealth of information for help in managing systems10.1145/2076796.2082137 ↗
9. Skibiński, P., and Swacha, J. (October, January 29). Fast and efficient log file compression. Proceedings of the 11th East-European Conference on Advances in Databases and Information Systems (ADBIS), ADBIS 2007, Varna, Bulgaria.
10. On-line data compression in a log-structured file system10.1145/143371.143376 ↗
11. Hätönen, K., Boulicaut, J.F., Klemettinen, M., Miettinen, M., and Masson, C. (2003, January 3–5). Comprehensive log compression with frequent patterns. Proceedings of the International Conference on Data Warehousing and Knowledge Discovery, Prague, Czech Republic.10.1007/978-3-540-45228-7_36 ↗
12. Zhu, J., He, S., Liu, J., He, P., Xie, Q., Zheng, Z., and Lyu, M.R. (2019, January 25–31). Tools and benchmarks for automated log parsing. Proceedings of the 2019 IEEE/ACM 41st International Conference on Software Engineering: Software Engineering in Practice (ICSE-SEIP), Montreal, QC, Canada.10.1109/ICSE-SEIP.2019.00021 ↗
13. He, P., Zhu, J., He, S., Li, J., and Lyu, M.R. (July, January 28). An evaluation study on log parsing and its use in log mining. Proceedings of the 2016 46th Annual IEEE/IFIP International Conference on Dependable Systems and Networks (DSN), Toulouse, France.10.1109/DSN.2016.66 ↗
14. Nagaraj, K., Killian, C., and Neville, J. (2012, January 25–27). Structured comparative analysis of systems logs to diagnose performance problems. Proceedings of the 9th {USENIX} Symposium on Networked Systems Design and Implementation ({NSDI} 12), San Jose, CA, USA.
15. Khatuya, S., Ganguly, N., Basak, J., Bharde, M., and Mitra, B. (2018, January 15–19). Adele: Anomaly detection from event log empiricism. Proceedings of the IEEE INFOCOM 2018-IEEE Conference on Computer Communications, Honolulu, HI, USA.10.1109/INFOCOM.2018.8486257 ↗
16. Makanju, A., Zincir-Heywood, A.N., and Milios, E.E. (2013, January 27–31). Investigating event log analysis with minimum apriori information. Proceedings of the 2013 IFIP/IEEE International Symposium on Integrated Network Management (IM 2013), Ghent, Belgium.
17. Fahrenkrog-Petersen, S.A., van der Aa, H., and Weidlich, M. (2019, January 24–26). PRETSA: Event log sanitization for privacy-aware process discovery. Proceedings of the 2019 International Conference on Process Mining (ICPM), Aachen, Germany.10.1109/ICPM.2019.00012 ↗
18. Li, T., Jiang, Y., Zeng, C., Xia, B., Liu, Z., Zhou, W., Zhu, X., Wang, W., Zhang, L., and Wu, J. (2017, January 13–17). FLAP: An end-to-end event log analysis platform for system management. Proceedings of the 23rd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, Halifax, NS, Canada.10.1145/3097983.3098022 ↗
19. Makanju, A., Brooks, S., Zincir-Heywood, A.N., and Milios, E.E. (2008, January 1–3). Logview: Visualizing event log clusters. Proceedings of the 2008 Sixth Annual Conference on Privacy, Security and Trust, Fredericton, NB, Canada.10.1109/PST.2008.17 ↗
20. Shengyan, S., Xiaoliu, S., Jianbao, Z., and Xinke, M. (2012, January 2–4). Research on system logs collection and analysis model of the network and information security system by using multi-agent technology. Proceedings of the 2012 Fourth International Conference on Multimedia Information Networking and Security, Nanjing, China.10.1109/MINES.2012.181 ↗
21. Zhuge, C., and Vaarandi, R. (2017, January 26–28). Efficient Event Log Mining with LogClusterC. Proceedings of the 2017 IEEE 3rd International Conference on Big Data Security on Cloud (Bigdatasecurity), IEEE International Conference on High Performance and Smart Computing (HPSC), and IEEE International Conference on Intelligent Data and Security (IDS), Beijing, China.10.1109/BigDataSecurity.2017.26 ↗
22. van Hee, K.M., Liu, Z., and Sidorova, N. (2011, January 19–21). Is my event log complete?—A probabilistic approach to process mining. Proceedings of the 2011 Fifth International Conference on Research Challenges in Information Science, Gosier, France.10.1109/RCIS.2011.6006848 ↗
23. Event log imperfection patterns for process mining: Towards a systematic approach to cleaning event logs10.1016/j.is.2016.07.011 ↗
24. Kim, K.P. (2020). Functional integration with process mining and process analyzing for structural and behavioral properness validation of processes discovered from event log datasets. Appl. Sci., 10.10.20944/preprints202002.0122.v1 ↗
25. Atzmueller, M., Bloemheuvel, S., and Kloepper, B. (2019, January 28–30). A Framework for Human-Centered Exploration of Complex Event Log Graphs. Proceedings of the International Conference on Discovery Science, Split, Croatia.10.1007/978-3-030-33778-0_26 ↗
26. Humphries, C., Prigent, N., Bidan, C., and Majorczyk, F. (2013, January 23). Elvis: Extensible log visualization. Proceedings of the Tenth Workshop on Visualization for Cyber Security, Vancouver, BC, Canada.10.1145/2517957.2517959 ↗
27. Koike, H., and Ohno, K. (2004, January 29). SnortView: Visualization system of snort logs. Proceedings of the 2004 ACM Workshop on Visualization and Data Mining for Computer Security, Washington, DC, USA.10.1145/1029208.1029232 ↗
28. Bauer, M., Fahrenkrog-Petersen, S.A., Koschmider, A., Mannhardt, F., van der Aa, H., and Weidlich, M. (2021, May 24). ELPaaS: Event Log Privacy as a Service. BPM (PhD/Demos). 2019. pp. 159–163. Available online: https://hanvanderaa.com/wp-content/uploads/2019/07/BPMDemo2019-ELPaaS-Event-Log-Privacy-as-a-Service.pdf.
29. de Leoni, M., and Dündar, S. (2020, January 30). Event-log abstraction using batch session identification and clustering. Proceedings of the 35th Annual ACM Symposium on Applied Computing, Brno, Czech Republic.10.1145/3341105.3373861 ↗
30. Studiawan, H., Sohel, F., and Payne, C. (2020, January 4–6). Automatic event log abstraction to support forensic investigation. Proceedings of the Australasian Computer Science Week Multiconference, Melbourne, VIC, Australia.10.1145/3373017.3373018 ↗
31. Martin, N., Benoît, B., and Caris, A. (2014, January 28–30). Event log knowledge as a complementary simulation model construction input. Proceedings of the 2014 4th International Conference on Simulation and Modeling Methodologies, Technologies and Applications (SIMULTECH), Vienna, Austria.10.5220/0005100404560462 ↗
32. Leemans, M., van der Aalst, W.M., and van den Brand, M.G. (2018, January 20–23). The Statechart Workbench: Enabling scalable software event log analysis using process mining. Proceedings of the 2018 IEEE 25th International Conference on Software Analysis, Evolution and Reengineering (SANER), Campobasso, Italy.10.1109/SANER.2018.8330248 ↗
33. Eliciting and utilising knowledge for security event log analysis: An association rule mining and automated planning approach10.1016/j.eswa.2018.07.006 ↗
34. Quality-informed semi-automated event log generation for process mining10.1016/j.dss.2020.113265 ↗
35. Hinkka, M., Lehto, T., and Heljanko, K. (2018). Exploiting event log event attributes in RNN based prediction. Data-Driven Process Discovery and Analysis, Springer.10.1007/978-3-030-30278-8_40 ↗
36. Yang, J., Sandström, K., Nolte, T., and Behnam, M. (2012, January 17–21). Data distribution service for industrial automation. Proceedings of the 2012 IEEE 17th International Conference on Emerging Technologies & Factory Automation (ETFA 2012), Krakow, Poland.10.1109/ETFA.2012.6489544 ↗
37. The IEC 61499 standard and its semantics10.1109/MIE.2009.934796 ↗
38. Villareal, G., Na, J., Lee, J., and Ho, T. (May, January 30). Advantages of using big data in semiconductor manufacturing. Proceedings of the 2018 29th Annual SEMI Advanced Semiconductor Manufacturing Conference (ASMC), Saratoga Springs, NY, USA.10.1109/ASMC.2018.8373166 ↗