journal article·2025-07-11Open access

A Goal-Oriented Evaluation Methodology for Privacy-Preserving Process Mining

Ibrahim Ileri, Tugba Gurgen Erdogan, Ayca Kolukisa-Tarhan

Applied Sciences· Volume 15· Issue 14

Abstract

Process mining (PM) is a growing field that looks at how to find, analyze, and improve process models using data from information systems. It automates much of the detailed work that usually requires a lot of manual effort. But there are concerns about privacy when dealing with this kind of data. This research introduces a novel, goal-oriented model evaluation methodology leveraging the privacy-preserving process mining (PPPM) cycle for diverse domains. The methodology encompasses the following: establishing goals and questions, targeted data acquisition, data refinement, log inspection, PPPM analysis, question resolution and interpretation, performance assessment, and possible improvement recommendations. The proposed methodology was applied in a case study analyzing four real-life event logs from different domains, yielding quantitative insights into the operational efficiency of the privacy-preserving approaches. To improve how well PPPM approaches work, we identified key issues and errors that affect their results and time utility performance. Our preliminary application of the proposed methodology indicates its potential to facilitate improvements by guiding the implementation of PPPM techniques across various domains.
Source: crossref · Quality: baseline

Research context

OpenAlex topics: Business Process Modeling and Analysis · Data Quality and Management · Big Data and Business Intelligence

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

Computer Engineering Department, TED University, Ankara 06420, Turkey

Computer Engineering Department, Hacettepe University, Ankara 06800, Turkey

References (39)

Show source-provided references
2. EPSU (2025, July 04). The General Data Protection Regulation (GDPR): An EPSU Briefing. European Federation of Public Service Unions. Available online: https://www.epsu.org/sites/default/files/article/files/GDPR_FINAL_EPSU.pdf.
3. Privacy for Process Mining: A Systematic Literature Review10.1109/ACCESS.2025.3568889 ↗
4. Hevner, A., and Chatterjee, S. (2010). Design Research in Information Systems: Theory and Practice, Springer Science & Business Media.10.1007/978-1-4419-5653-8 ↗
5. Yin, R.K. (2017). Case Study Research and Applications: Design and Methods, Sage Publications.
6. van der Aalst, W.M.P. (2022). Process Mining: A 360 Degree Overview. Process Mining Handbook, Springer International Publishing.10.1007/978-3-031-08848-3_1 ↗
7. Process mining manifesto
8. The ProM framework: A new era in process mining tool support
9. Günther, C.W., and Rozinat, A. (2012, January 3–6). Disco: Discover your processes. Proceedings of the Demonstration Track of the 10th International Conference on Business Process Management, BPM Demos 2012, Tallinn, Estonia. CEUR Workshop Proceedings.
10. PM4Py: A process mining library for Python10.1016/j.simpa.2023.100556 ↗
11. Leemans, S.J.J., Fahland, D., and van der Aalst, W.M.P. (2013, January 24–28). Discovering block-structured process models from event logs—A constructive approach. Proceedings of the International Conference on Applications and Theory of Petri Nets and Concurrency, Milan, Italy.10.1007/978-3-642-38697-8_17 ↗
12. Berti, A., and Van der Aalst, W.M.P. (2021). A novel token-based replay technique to speed up conformance checking and process enhancement. Transactions on Petri Nets and Other Models of Concurrency XV, Springer.10.1007/978-3-662-63079-2_1 ↗
13. (2025, July 04). HIPAA Privacy Rule, Available online: https://www.hhs.gov/sites/default/files/ocr/privacy/hipaa/administrative/privacyrule/privrulepd.pdf.
14. Keele, S. (2007). Guidelines for Performing Systematic Literature Reviews in Software Engineering, EBSE. Technical Report, ver. 2.3 EBSE Technical Report.
15. k-anonymity: A model for protecting privacy10.1142/S0218488502001648 ↗
16. l-diversity: Privacy beyond k-anonymity10.1145/1217299.1217302 ↗
17. Li, N., Li, T., and Venkatasubramanian, S. (2007, January 15–20). t-closeness: Privacy beyond k-anonymity and l-diversity. Proceedings of the 2007 IEEE 23rd International Conference on Data Engineering, Istanbul, Turkey.10.1109/ICDE.2007.367856 ↗
18. PRETSA: Event Log Sanitization for Privacy-aware Process Discovery: (Extended Abstract)10.1007/s00287-019-01203-z ↗
19. TLKC-Privacy Model for Process Mining
20. Vaidya, J., Shafiq, B., Basu, A., and Hong, Y. (2013, January 17–20). Differentially private naive bayes classification. Proceedings of the 2013 IEEE/WIC/ACM International Joint Conferences on Web Intelligence (WI) and Intelligent Agent Technologies (IAT), Atlanta, GA, USA.10.1109/WI-IAT.2013.80 ↗
21. Differentially private random decision forests using smooth sensitivity10.1016/j.eswa.2017.01.034 ↗
22. Su, D., Cao, J., Li, N., Bertino, E., and Jin, H. (2016, January 9–11). Differentially private k-means clustering. Proceedings of the Sixth ACM Conference on Data and Application Security and Privacy, New Orleans, LA, USA.10.1145/2857705.2857708 ↗
23. Privacy-Preserving Process Mining: Differential Privacy for Event Logs10.1007/s12599-019-00613-3 ↗
24. Fahrenkog-Petersen, S.A., Kabierski, M., Rosel, F., Van Der Aa, H., and Weidlich, M. (November, January 31). SaCoFa: Semantics-aware Control-flow Anonymization for Process Mining. Proceedings of the 2021 3rd International Conference on Process Mining (ICPM), Eindhoven, The Netherlands.10.1109/ICPM53251.2021.9576857 ↗
25. Fahrenkrog-Petersen, S.A., van der Aa, H., and Weidlich, M. (2020). PRIPEL: Privacy-preserving event log publishing including contextual information. Business Process Management, Proceedings of the 18th International Conference, BPM 2020, Seville, Spain, 13–18 September 2020, Proceedings 18, Springer International Publishing.10.1007/978-3-030-58666-9_7 ↗
26. Rafiei, M., Wangelik, F., and van der Aalst, W.M.P. (2022, January 23–28). TraVaS: Differentially private trace variant selection for process mining. Proceedings of the International Conference on Process Mining, Bozen-Bolzano, Italy.10.1007/978-3-031-27815-0_9 ↗
27. Basili, V.R. (1992). Software Modeling and Measurement: The Goal/Question/Metric Paradigm, University of Maryland. Technical Report CS-TR-2956, UMIACS-TR-92-96.
28. Mannhardt, F. (2025, July 04). (Felix). Sepsis Cases—Event Log. Available online: https://data.4tu.nl/articles/_/12707639/1.
29. Van Dongen, B.F., Weber, B., Ferreira, D.R., and Weerdt, J.D. (2013, January 26). BPI Challenge 2013. Proceedings of the 3rd Business Process Intelligence Challenge, Beijing, China.10.1007/978-3-319-06257-0_7 ↗
30. Buijs, J. (2025, July 04). Environmental Permit Application Process (‘Wabo’), Coselog Project. Available online: https://data.4tu.nl/collections/_/5065529/1.
31. De Leoni, M., and Mannhardt, F. (2025, July 04). Road Traffic Fine Management Process. Available online: https://data.4tu.nl/articles/_/12683249/1.
32. Fujita, T. (2025, July 04). AnonyPy (Version 0.2.1) [Python Library]. Available online: https://pypi.org/project/anonypy/.
33. Holohan, N., Braghin, S., Mac Aonghusa, P., and Levacher, K. (2019). Diffprivlib: The IBM differential privacy library. arXiv.
34. Scikit-learn: Machine learning in Python
35. Van Dongen, B.F., Alves de Medeiros, A.K., and Wen, L. (2009). Process mining: Overview and outlook of petri net discovery algorithms. Transactions on Petri Nets and Other Models of Concurrency II: Special Issue on Concurrency in Process-Aware Information Systems, Springer.10.1007/978-3-642-00899-3_13 ↗
36. Buijs, J.C.A.M., Van Dongen, B.F., and van Der Aalst, W.M. (2012). On the role of fitness, precision, generalization and simplicity in process discovery. On the Move to Meaningful Internet Systems: OTM 2012, Proceedings of the Confederated International Conferences: CoopIS, DOA-SVI, and ODBASE 2012, Rome, Italy, 10–14 September 2012, Proceedings, Part I, Springer.
37. A comparison of the two one-sided tests procedure and the power approach for assessing the equivalence of average bioavailability10.1007/BF01068419 ↗
38. Statistical comparisons of classifiers over multiple data sets
39. SWOT analysis: It’s time for a product recall10.1016/S0024-6301(96)00095-7 ↗