Multi-Perspective Data Fusion Framework Based on Hierarchical BERT: Provide Visual Predictions of Business Processes
Source abstract
Abstract
Predictive Business Process Monitoring (PBPM) is a significant research area in Business Process Management (BPM) aimed at accurately forecasting future behavioral events. At present, deep learning methods are widely cited in PBPM research, but no method has been effective in fusing data information into the control flow for multi-perspective process prediction. Therefore, this paper proposes a process prediction method based on the hierarchical BERT and multi-perspective data fusion. Firstly, the first layer BERT network learns the correlations between different category attribute data. Then, the attribute data is integrated into a weighted event-level feature vector and input into the second layer BERT network to learn the impact and priority relationship of each event on future predicted events. Next, the multi-head attention mechanism within the framework is visualized for analysis, helping to understand the decision-making logic of the framework and providing visual predictions. Finally, experimental results show that the predictive accuracy of the framework surpasses the current state-of-the-art research methods and significantly enhances the predictive performance of BPM.
Source: openalex_inverted_index · Quality: baseline
Research context
OpenAlex topics: Business Process Modeling and Analysis · Big Data and Business Intelligence · Personal Information Management and User Behavior
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
References (44)
Show source-provided references
1. Advances in business process management10.1016/j.datak.2004.01.001 ↗
2. Dumas · Fundamentals of Business Process Management · 2018 · 1
3. Business process mining: An industrial application10.1016/j.is.2006.05.003 ↗
4. Business process management: A comprehensive survey10.1155/2013/507984 ↗
5. M. Polato, A. Sperduti, A. Burattin and M. de Leoni, “Time and activity sequence prediction of business process instances,” arXiv:1602.07566, 2016.
6. Pourbafrani · Process Mining Workshops · 2022 · 140
7. Global conformance checking measures using shallow representation and deep learning10.1016/j.engappai.2023.106393 ↗
8. Nguyen · Service-Oriented Computing–ICSOC 2018 Workshops · 2019 · 33510.1007/978-3-030-17642-6_28 ↗
9. LSTM-based anomaly detection of process instances: Benchmark and tweaks
10. Lee · Research Challenges in Information Science · 2022 · 24810.1007/978-3-031-05760-1_15 ↗
11. M. Hinkka, T. Lehto and K. Heljanko, “Exploiting event log event attributes in RNN based prediction,” arXiv:1904.06895, 2020.10.1007/978-3-030-46633-6_4 ↗
12. Predicting process behaviour using deep learning10.1016/j.dss.2017.04.003 ↗
13. Tax · Advanced Information Systems Engineering · 2017 · 47710.1007/978-3-319-59536-8_30 ↗
14. Attention is all you need
15. Z. A. Bukhsh, A. Saeed and R. M. Dijkman, “ProcessTransformer: Predictive business process monitoring with transformer network,” arXiv:2104.00721v1, 2021.
16. A multi-perspective approach for the analysis of complex business processes behavior10.1016/j.eswa.2021.114934 ↗
17. A multi-view deep learning approach for predictive business process monitoring10.1109/TSC.2021.3051771 ↗
18. A Markov prediction model for data-driven semi-structured business processes10.1007/s10115-013-0697-8 ↗
19. Interpretable classifiers using rules and Bayesian analysis: Building a better stroke prediction model10.1214/15-AOAS848 ↗
20. Activity recognition framework in sports videos10.1007/s11042-021-10519-6 ↗
21. Deep learning based semantic similarity detection using text data10.5755/j01.itc.49.4.27118 ↗
22. A fault detection algorithm for pipeline insulation layer based on immune neural network10.1016/j.ijpvp.2022.104611 ↗
23. Infrared image segmentation using growing immune field and clone threshold10.1016/j.infrared.2017.11.029 ↗
24. Deep learning for predictive business process monitoring: Review and benchmark
25. Predicting the next process event using convolutional neural networks
26. Using convolutional neural networks for predictive process analytics
27. MM-Pred: A deep predictive model for multi-attribute event sequence
28. HAM-Net: Predictive business process monitoring with a hierarchical attention mechanism10.1016/j.knosys.2021.107722 ↗
29. Prediction of the air quality index of Hefei based on an improved ARIMA model10.3934/math.2023953 ↗
30. Analyses of some structural properties on a class of hierarchical scale-free networks10.1142/S0218348X22501365 ↗
31. Single-valued neutrosophic set with quaternion information: A promising approach to assess image quality10.1142/S0218348X23400741 ↗
32. Camargo · Business Process Management · 2019 · 286
33. Multi-task prediction method of business process based on BERT and transfer learning10.1016/j.knosys.2022.109603 ↗
34. S. Sun, L. Mao, D. Dong and L. Wu, Multiview machine learning. Singapore: Springer, 2019. 10.1007/978-981-13-3029-2 (accessed on 28/02/2023)10.1007/978-981-13-3029-2 ↗
35. A multi-view multi-dimensional ensemble learning approach to mining business process deviances
36. Risk-aware business process management using multi-view modeling: Method and tool10.1007/s00766-021-00348-2 ↗
37. van der Aalst · Process Mining: Discovery, Conformance and Enhancement of Business Processes · 201110.1007/978-3-642-19345-3 ↗
38. J. Devlin, M. W. Chang, K. Lee and K. Toutanova, “BERT: Pre-training of deep bidirectional transformers for language understanding,” arXiv:1810.04805, 2018.
39. S. Vashishth, S. Upadhyay, G. S. Tomar and M. Faruqui, “Attention interpretability across NLP tasks,” arXiv:1909.11218, 2019.
40. S. Abnar and W. Zuidema, “Quantifying attention flow in transformers,” arXiv:2005.00928, 2020.10.18653/v1/2020.acl-main.385 ↗
41. J. Vig, “Visualizing attention in transformer-based language representation models,” arXiv:1904.02679v2, 2019.
42. BINet: Multi-perspective business process anomaly classification10.1016/j.is.2019.101458 ↗
43. Anomalous behavior detection based on the isolation forest model with multiple perspective business processes10.3390/electronics11213640 ↗
44. Multi-perspective anomaly detection in business process execution events