Backpack Process Model (BPPM): A Process Mining Approach for Curricular Analytics
Source abstract
Abstract
Curricular analytics is the area of learning analytics that looks for insights and evidence on the relationship between curricular elements and the degree of achievement of curricular outcomes. For higher education institutions, curricular analytics can be useful for identifying the strengths and weaknesses of the curricula and for justifying changes in learning pathways for students. This work presents the study of curricular trajectories as processes (i.e., sequence of events) using process mining techniques. Specifically, the Backpack Process Model (BPPM) is defined as a novel model to unveil student trajectories, not by the courses that they take, but according to the courses that they have failed and have yet to pass. The usefulness of the proposed model is validated through the analysis of the curricular trajectories of N = 4466 engineering students considering the first courses in their program. We found differences between backpack trajectories that resulted in retention or in dropout; specific courses in the backpack and a larger initial backpack sizes were associated with a higher proportion of dropout. BPPM can contribute to understanding how students handle failed courses they must retake, providing information that could contribute to designing and implementing timely interventions in higher education institutions.
Source: crossref · Quality: baseline
Research context
OpenAlex topics: Business Process Modeling and Analysis · Online Learning and Analytics · Big Data and Business Intelligence
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
Affiliations
Department of Computer Science, School of Engineering, Pontificia Universidad Católica de Chile, Santiago 7820436, Chile
Institute of Informatics, Universidad Austral de Chile, Valdivia 5110701, Chile
Computer Science Department, Universidad de Cuenca, Cuenca 010107, Ecuador
Funding
National Agency for Research and Development (ANID) · FONDECYT -CHILE Regular Project · Escuela de Ingeniería UC / Investigación en Pregrado (IPRE)
References (54)
Show source-provided references
1. The current landscape of learning analytics in higher education10.1016/j.chb.2018.07.027 ↗
2. Banihashem, S.K., Aliabadi, K., Ardakani, S.P., Delaver, A., Ahmadabadi, M.N., Ardakani, S.P., and Delavar, A. (2018). Learning Analytics: A Systematic Literature Review. Interdiscip. J. Virtual Learn. Med. Sci., 9.10.5812/ijvlms.63024 ↗
3. Competency analytics tool: Analyzing curriculum using course competencies10.1007/s10639-017-9584-3 ↗
4. For Learners, with Learners: Identifying Indicators for an Academic Advising Dashboard for Students
5. Ochoa, X. (2021, March 25). Simple Metrics for Curricular Analytics. In Proceedings of the 1st Learning Analytics for Curriculum and Program Quality Improvement Workshop, Sixth International Learning Analytics and Knowledge Conference (LAK), Available online: http://ceur-ws.org/Vol-1590/paper-04.pdf.
6. Core Curriculum Analysis: A Tool for Educational Design10.1080/13892240903069785 ↗
7. Simanca, F., Crespo, R.G., Rodríguez-Baena, L., and Burgos, D. (2019). Identifying Students at Risk of Failing a Subject by Using Learning Analytics for Subsequent Customised Tutoring. Appl. Sci., 9.10.3390/app9030448 ↗
8. Leaving late: Understanding the extent and predictors of college late departure10.1016/j.ssresearch.2017.10.001 ↗
9. Application of Graph Theory to Analysing Student Success Through Development of Progression Maps
10. Student Perceptions Matter: Early Signs of Undergraduate Student Retention/Attrition10.2190/CS.14.4.c ↗
11. Predicting Engineering Student Attrition Risk Using a Probabilistic Neural Network and Comparing Results with a Backpropagation Neural Network and Logistic Regression10.1007/s11162-017-9473-z ↗
12. Zúniga-Prieto, M.A., Ortiz, M., Ulloa, M., and Jiménez, A. (2020, January 1–2). Applying the LALA Framework for the adoption of a Learning Analytics tool in Latin America: Two case studies in Ecuador. Proceedings of the Third Latin American Conference on Learning Analytics, Cuenca, Ecuador. In press.
13. Temporal analysis for dropout prediction using self-regulated learning strategies in self-paced MOOCs10.1016/j.compedu.2019.103728 ↗
14. Jivet, I., Scheffel, M., Specht, M., and Drachsler, H. (2018, January 5–9). License to evaluate: Preparing learning analytics dashboards for educational practice. Proceedings of the 8th International Conference on Learning Analytics and Knowledge, Sydney, NSW, Australia.10.1145/3170358.3170421 ↗
15. Process Mining in the Education Domain
16. A survey on educational process mining
17. Salazar-Fernández, J.P., Sepúlveda, M., and Munoz-Gama, J. (2019, January 18–19). Describing Educational Trajectories of Engineering Students in Individual High-Failure Rate Courses that Lead to Late Dropout. Proceedings of the Second Latin American Conference on Learning Analytics, Valdivia, Chile. Available online: http://ceur-ws.org/Vol-2425/paper03.pdf.
18. Munoz-Gama, J., Maldonado-Mahauad, J., Salazar-Fernández, J.P., Bustamante, D., and Sepúlveda, M. (2020, January 1–2). Backpack Process Model (BPPM): Curricular Analytics through Process Mining. Proceedings of the III Conferencia Latinoamericana de Analíticas de Aprendizaje, Cuenca, Ecuador. In press.
19. Navigating the First Semester: An Exploration of Short-Term Changes in Motivational Beliefs Among Engineering Undergraduates10.1002/jee.20187 ↗
20. Student Employment and Persistence: Evidence of Effect Heterogeneity of Student Employment on College Dropout10.1007/s11162-017-9458-y ↗
21. Why They Leave: Understanding Student Attrition from Engineering Majors?
22. Kuley, E.A., Maw, S., and Fonstad, T. (June, January 31). Engineering Student Retention and Attrition Literature Review. Proceedings of the Canadian Engineering Education Association, Hamilton, ON, Canada. Available online: https://ojs.library.queensu.ca/index.php/PCEEA/article/view/5813/pdf.
23. Bandura, A. (1997). Self-Efficacy: The Exercise of Control, W.H. Freeman.
24. Engineering Dropouts: A Qualitative Examination of Why Undergraduates Leave Engineering10.1002/jee.20054 ↗
25. Metaphor use in a specific genre of engineering discourse10.1080/03043790600797145 ↗
26. Between Hope and Fear: The Psychology of Risk10.1016/S0065-2601(08)60416-5 ↗
27. Arnold, K.E., and Pistilli, M.D. (2012). Course signals at Purdue: Using learning analytics to increase student success. LAK ’12: Proceedings of the 2nd International Conference on Learning Analytics and Knowledge, ACM.10.1145/2330601.2330666 ↗
28. van der Aalst, W. (2016). Process Mining: The Missing Link. Process Mining: Data Science in Action, Springer.10.1007/978-3-662-49851-4 ↗
29. Recommendations for enhancing the usability and understandability of process mining in healthcare10.1016/j.artmed.2020.101962 ↗
30. Utama, N.I., Sutrisnowati, R.A., Kamal, I.M., Bae, H., and Park, Y.-J. (2020). Mining Shift Work Operation from Event Logs. Appl. Sci., 10.10.3390/app10207202 ↗
31. A practitioner’s guide to process mining: Limitations of the directly-follows graph10.1016/j.procs.2019.12.189 ↗
32. Bin Ahmadon, M.A., and Yamaguchi, S. (2020). Verification Method for Accumulative Event Relation of Message Passing Behavior with Process Tree for IoT Systems. Information, 11.10.3390/info11040232 ↗
33. Zdravkovic, J., Kirikova, M., and Johannesson, P. (2015). PM^2: A Process Mining Project Methodology. Advanced Information Systems Engineering, Springer.
34. Dumas, M., la Rosa, M., Mendling, J., and Reijers, H.A. (2013). Introduction to Business Process Management. Fundamentals of Business Process Management, Springer.10.1007/978-3-642-33143-5 ↗
35. Mining theory-based patterns from Big data: Identifying self-regulated learning strategies in Massive Open Online Courses10.1016/j.chb.2017.11.011 ↗
36. The ClearPath Method for Care Pathway Process Mining and Simulation10.1007/978-3-030-11641-5_19 ↗
37. Lorenz, R., Senoner, J., Sihn, W., and Netland, T. (2021). Using process mining to improve productivity in make-to-stock manufacturing. Int. J. Prod. Res., 1–12.10.1080/00207543.2021.1906460 ↗
38. e-Research and learning theory: What do sequence and process mining methods contribute?10.1111/bjet.12146 ↗
39. Zhou, X., Zacharewicz, G., Chen, D., and Chu, D. (2020). A Method for Building Service Process Value Model Based on Process Mining. Appl. Sci., 10.10.3390/app10207311 ↗
40. Salazar-Fernandez, J.P., Sepúlveda, M., and Munoz-Gama, J. (2019, January 9–11). Influence of student diversity on educational trajectories in engineering high-failure rate courses that lead to late dropout. Proceedings of the 2019 IEEE Global Engineering Education Conference (EDUCON), Dubai, United Arab Emirates.10.1109/EDUCON.2019.8725143 ↗
41. Berti, A., van Zelst, S.J., and van der Aalst, W. (2019). Process mining for python (PM4Py): Bridging the gap between process-and data science. arXiv.
42. bupaR: Enabling reproducible business process analysis10.1016/j.knosys.2018.10.018 ↗
43. Günther, C.W., and Rozinat, A. (2012). Disco: Discover Your Processes, BPM (Demos). Available online: http://ceur-ws.org/Vol-940/paper8.pdf.
44. Geyer-Klingeberg, J., Nakladal, J., Baldauf, F., and Veit, F. (2018, January 9–14). Process Mining and Robotic Process Automation: A Perfect Match. Proceedings of the International Conference on Business Process Management, Sydney, Australia. Available online: http://ceur-ws.org/Vol-2196/BPM_2018_paper_28.pdf.
45. Has the open door become a revolving door? The impact on attrition of moving from elite to mass higher education10.1080/03075079.2019.1629411 ↗
46. They have gone, and now what? Understanding re-enrolment patterns in the Catalan public higher education system10.1080/07294360.2015.1137886 ↗
47. Engineering Students’ Intelligence Beliefs and Learning10.1002/jee.20051 ↗
48. The Relationship between Barrier Courses and Persistence in Engineering10.2190/3QTU-6EEL-HQHF-XYF0 ↗
49. Haag, S., and Collofello, J. (2008, January 22–25). Engineering undergraduate persistence and contributing factors. Proceedings of the 38th Annual Frontiers in Education Conference, Saratoga Springs, NY, USA.10.1109/FIE.2008.4720285 ↗
50. Inclusion Programs at Elite Universities: The Case of Chile
51. Bose, R.J.C., Mans, R.S., and Van Der Aalst, W.M. (2013, January 16–19). Wanna improve process mining results?. Proceedings of the 2013 IEEE Symposium on Computational Intelligence and Data Mining (CIDM), Singapore.10.1109/CIDM.2013.6597227 ↗
52. Salazar-Fernandez, J., Sepúlveda, M., Munoz-Gama, J., and Nussbaum, M. (2021). Curricular Analytics to Characterize Educational Trajectories in High-Failure Rate Courses That Lead to Late Dropout. Appl. Sci., 11.10.3390/app11041436 ↗
53. Combining Academics and Social Engagement: A Major-Specific Early Alert Method to Counter Student Attrition in Science, Technology, Engineering, and Mathematics10.1177/1521025118780502 ↗
54. Tariq, Z., Khan, N., Charles, D., McClean, S., McChesney, I., and Taylor, P. (2020). Understanding Contrail Business Processes through Hierarchical Clustering: A Multi-Stage Framework. Algorithms, 13.10.3390/a13100244 ↗