journal article·2026-02-25Open access

BPMN Assistant: An LLM-Based Approach to Business Process Modeling

Josip Tomo Licardo, Nikola Tanković, Darko Etinger

Applied Sciences· Volume 16· Issue 5

Abstract

This paper presents BPMN Assistant, a tool that leverages Large Language Models for natural language-based creation and editing of BPMN diagrams. While direct XML generation is common, it is verbose, slow, and prone to syntax errors during complex modifications. We introduce a specialized JSON-based intermediate representation designed to facilitate atomic editing operations through function calling. We evaluate our approach against direct XML manipulation using a suite of state-of-the-art models, including GPT-5.1, Claude 4.5 Sonnet, and DeepSeek V3. Results demonstrate that the JSON-based approach significantly outperforms direct XML in editing tasks, achieving higher or equivalent success rates across all evaluated models. Conformance checking evaluation confirms that generated models preserve executable semantics, with JSON achieving an average F1 score of 0.72 compared to 0.69 for XML, though frontier models like GPT-5.1 and Claude 4.5 Sonnet demonstrated superior precision with direct XML generation. Furthermore, despite requiring more input context, our approach reduces generation latency by approximately 43% and output token count by over 75%, offering a more reliable and responsive solution for interactive process modeling.
Source: crossref · Quality: baseline

Research context

OpenAlex topics: Business Process Modeling and Analysis · Model-Driven Software Engineering Techniques · Scientific Computing and Data Management

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

Faculty of Informatics, Juraj Dobrila University of Pula, Zagrebačka 30, 52100 Pula, Croatia

Funding

Juraj Dobrila University of Pula

References (43)

Show source-provided references
1. Object Management Group (2010). Business Process Model and Notation (BPMN), Version 2.0, Object Management Group (OMG). Technical report.
2. Potential Pitfalls of Process Modeling: Part A10.1108/14637150610668024 ↗
3. Opportunities and Constraints: The Current Struggle with BPMN10.1108/14637151011018001 ↗
4. IT-Business Alignment: A Systematic Literature Review10.1016/j.procs.2021.01.154 ↗
5. Gaaloul, K., Schmidt, R., Nurcan, S., Guerreiro, S., and Ma, Q. (2015). On the Fragmentation of Process Information: Challenges, Solutions, and Outlook. Proceedings of the Enterprise, Business-Process and Information Systems Modeling, Springer.10.1007/978-3-319-19237-6 ↗
6. Bellan, P., Dragoni, M., and Ghidini, C. (2020, January 27). A Qualitative Analysis of the State of the Art in Process Extraction from Text. Proceedings of the AIxIA 2020 Discussion Papers Workshop Co-Located with the 19th International Conference of the Italian Association for Artificial Intelligence (AIxIA2020), Online.
7. Let Me Tell You a Story—On How to Build Process Models
8. Davis, F.D., Riedl, R., vom Brocke, J., Léger, P.M., and Randolph, A.B. (2015). Measuring Cognitive Load During Process Model Creation. Proceedings of the Information Systems and Neuroscience, Springer.10.1007/978-3-319-18702-0 ↗
9. Disentangling Organizational Agility from Flexibility, Adaptability, and Versatility: A Systematic Review10.1186/s43093-024-00405-6 ↗
10. Learning from Quality Issues of BPMN Models from Industry10.1109/MS.2015.81 ↗
11. Process Mining: A Research Agenda10.1016/j.compind.2003.10.001 ↗
12. Mouratidis, H., and Rolland, C. (2011). Process Model Generation from Natural Language Text. Proceedings of the Advanced Information Systems Engineering, Springer.10.1007/978-3-642-21640-4 ↗
13. Ralyté, J., Franch, X., Brinkkemper, S., and Wrycza, S. (2012). Generating Natural Language Texts from Business Process Models. Proceedings of the Advanced Information Systems Engineering, Springer.10.1007/978-3-642-31095-9 ↗
14. Mendling, J., Leopold, H., and Thom, L.H. (2019). Natural Language Processing with Process Models (NLP4RE Report Paper). Proceedings of the CEUR Workshop Proceedings, RWTH Aachen.
15. De Weerdt, J., and Pufahl, L. (2024). Large Language Models Can Accomplish Business Process Management Tasks. Proceedings of the Business Process Management Workshops, Springer.10.1007/978-3-031-50974-2 ↗
16. Kampik, T., Warmuth, C., Rebmann, A., Agam, R., Egger, L.N.P., Gerber, A., Hoffart, J., Kolk, J., Herzig, P., and Decker, G. (2023). Large Process Models: Business Process Management in the Age of Generative AI. arXiv.10.1007/s13218-024-00884-3 ↗
17. Advancements and Applications of Generative Artificial Intelligence and Large Language Models on Business Management: A Comprehensive Review10.32996/jcsts.2024.6.1.26 ↗
18. Klievtsova, N., Benzin, J.V., Kampik, T., Mangler, J., and Rinderle-Ma, S. (2023). Conversational Process Modeling: Can Generative AI Empower Domain Experts in Creating and Redesigning Process Models?. arXiv.
19. Rebmann, A., Schmidt, F.D., Glavaš, G., and Van Der Aa, H. (2024). Evaluating the Ability of LLMs to Solve Semantics-Aware Process Mining Tasks. 2024 6th International Conference on Process Mining (ICPM), IEEE.10.1109/ICPM63005.2024.10680677 ↗
20. Köpke, J., and Safan, A. (2024, January 1–6). Introducing the BPMN-Chatbot for Efficient LLM-Based Process Modeling. Proceedings of the International Conference on Business Process Management, Krakow, Poland.10.1007/978-3-031-78666-2_20 ↗
21. Kourani, H., Berti, A., Schuster, D., and Van Der Aalst, W.M. (2024, January 3–9). ProMoAI: Process Modeling with Generative AI. Proceedings of the Thirty-ThirdInternational Joint Conference on Artificial Intelligence, Jeju, Republic of Korea.
22. Berti, A., and Qafari, M.S. (2023). Leveraging Large Language Models (LLMs) for Process Mining (Technical Report). arXiv.
23. Process Modeling With Large Language Models10.1007/978-3-031-61007-3_18 ↗
24. Ferreira, R.C.B., Thom, L.H., and Fantinato, M. (2017). A Semi-automatic Approach to Identify Business Process Elements in Natural Language Texts. Proceedings of the 19th International Conference on Enterprise Information Systems, SciTePress.10.5220/0006305902500261 ↗
25. A Universal Prompting Strategy for Extracting Process Model Information from Natural Language Text Using Large Language Models
26. Busch, K., Rochlitzer, A., Sola, D., and Leopold, H. (2023). Just Tell Me: Prompt Engineering in Business Process Management. arXiv.10.1007/978-3-031-34241-7_1 ↗
27. Kourani, H., Berti, A., Schuster, D., and van der Aalst, W.M.P. (2024). Evaluating Large Language Models on Business Process Modeling: Framework, Benchmark, and Self-Improvement Analysis. arXiv.10.1007/s10270-025-01318-w ↗
28. Hörner, L.F., Möller, M., and Reichert, M. (2026). Automatically Generating BPMN 2.0 Process Models from Natural Language Process Descriptions: Challenges, Framework, Quality Assessment. Bus. Inf. Syst. Eng.10.1007/s12599-025-00983-x ↗
29. Bellan, P., Dragoni, M., Ghidini, C., van der Aa, H., and Ponzetto, S.P. (2023). Process Extraction from Text: Benchmarking the State of the Art and Paving the Way for Future Challenges. arXiv.
30. Gaaloul, W., Sheng, M., Yu, Q., and Yangui, S. (2025). Automated Generation of BPMN Processes from Textual Requirements. Proceedings of the Service-Oriented Computing, Springer.
31. Hurst, A., Lerer, A., Goucher, A.P., Perelman, A., Ramesh, A., Clark, A., Ostrow, A.J., Welihinda, A., and Hayes, A. (2024). GPT-4o System Card. arXiv.
32. Comanici, G., Bieber, E., Schaekermann, M., Pasupat, I., Sachdeva, N., Dhillon, I., Blistein, M., Ram, O., Zhang, D., and Rosen, E. (2025). Gemini 2.5: Pushing the Frontier with Advanced Reasoning, Multimodality, Long Context, and Next Generation Agentic Capabilities. arXiv.
33. Grattafiori, A., Dubey, A., Jauhri, A., Pandey, A., Kadian, A., Al-Dahle, A., Letman, A., Mathur, A., Schelten, A., and Vaughan, A. (2024). The Llama 3 Herd of Models. arXiv.
34. Yang, A., Yang, B., Zhang, B., Hui, B., Zheng, B., Yu, B., Li, C., Liu, D., and Huang, F. (2025). Qwen2.5 Technical Report. arXiv.
35. DeepSeek-AI, Liu, A., Feng, B., Xue, B., Wang, B., Wu, B., Lu, C., Zhao, C., Deng, C., and Zhang, C. (2024). DeepSeek-V3 Technical Report. arXiv.
36. A Method for Extracting BPMN Models from Textual Descriptions Using Natural Language Processing10.1016/j.procs.2024.06.196 ↗
37. Graph Matching Algorithms for Business Process Model Similarity Search10.1007/978-3-642-03848-8_5 ↗
38. An Intelligent Graph Edit Distance-Based Approach for Finding Business Process Similarities
39. Waspada, I., and Sarno, R. (2020). An Improved Method of Graph Edit Distance for Business Process Model Similarity Measurement. 2020 4th International Conference on Informatics and Computational Sciences (ICICoS), IEEE.10.1109/ICICoS51170.2020.9299037 ↗
40. Similarity of Business Process Models—A State-of-the-Art Analysis10.1145/3092694 ↗
41. New Quality Metrics for Evaluating Process Models10.1007/978-3-642-00328-8_16 ↗
42. The Business Process Model Quality Metrics10.1007/978-3-319-68185-6_10 ↗
43. PM4Py: A Process Mining Library for Python10.1016/j.simpa.2023.100556 ↗