Towards Predicting Student’s Dropout in University Courses Using Different Machine Learning Techniques
Source abstract
Abstract
Early and precisely predicting the students’ dropout based on available educational data belongs to the widespread research topic of the learning analytics research field. Despite the amount of already realized research, the progress is not significant and persists on all educational data levels. Even though various features have already been researched, there is still an open question, which features can be considered appropriate for different machine learning classifiers applied to the typical scarce set of educational data at the e-learning course level. Therefore, the main goal of the research is to emphasize the importance of the data understanding, data gathering phase, stress the limitations of the available datasets of educational data, compare the performance of several machine learning classifiers, and show that also a limited set of features, which are available for teachers in the e-learning course, can predict student’s dropout with sufficient accuracy if the performance metrics are thoroughly considered. The data collected from four academic years were analyzed. The features selected in this study proved to be applicable in predicting course completers and non-completers. The prediction accuracy varied between 77 and 93% on unseen data from the next academic year. In addition to the frequently used performance metrics, the comparison of machine learning classifiers homogeneity was analyzed to overcome the impact of the limited size of the dataset on obtained high values of performance metrics. The results showed that several machine learning algorithms could be successfully applied to a scarce dataset of educational data. Simultaneously, classification performance metrics should be thoroughly considered before deciding to deploy the best performance classification model to predict potential dropout cases and design beneficial intervention mechanisms.
Source: crossref · Quality: baseline
Research context
OpenAlex topics: Online Learning and Analytics · Software System Performance and Reliability · Artificial Intelligence in Healthcare
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
Affiliations
Department of Informatics, Faculty of Natural Sciences, Constantine the Philosopher University in Nitra, Tr. A. Hlinku 1, 949 01 Nitra, Slovakia
Funding
Cultural and Educational Agency of the Ministry of Education of the Slovak Republic · ERASMUS+ Programme 2018, KA2
References (39)
Show source-provided references
1. An Effective Prediction Model for Online Course Dropout Rate10.4018/IJDET.2020100106 ↗
2. Wang, W., Yu, H., and Miao, C. (2017, January 6–9). Deep Model for Dropout Prediction in MOOCs. Proceedings of the 2nd International Conference on Cryptography, Security and Privacy, Beijing, China.10.1145/3126973.3126990 ↗
3. A Survey of Machine Learning Approaches for Student Dropout Prediction in Online Courses10.1145/3388792 ↗
4. Queiroga, E.M., Lopes, J.L., Kappel, K., Aguiar, M., Araújo, R.M., Munoz, R., Villarroel, R., and Cechinel, C. (2020). A Learning Analytics Approach to Identify Students at Risk of Dropout: A Case Study with a Technical Distance Education Course. Appl. Sci., 10.10.3390/app10113998 ↗
5. Lu, X., Wang, S., Huang, J., Chen, W., and Yan, Z. (2017, January 27–30). What Decides the Dropout in MOOCs?. Proceedings of the International Conference on Database Systems for Advanced Applications, Suzhou, China.10.1007/978-3-319-55705-2_25 ↗
6. Feature Extraction and Learning Effect Analysis for MOOCS Users Based on Data Mining
7. Prediction in MOOCs: A Review and Future Research Directions10.1109/TLT.2018.2856808 ↗
8. Mubarak, A.A., Cao, H., and Zhang, W. (2020). Prediction of students’ early dropout based on their interaction logs in online learning environment. Interact. Learn. Environ.10.1080/10494820.2020.1727529 ↗
9. Jin, C. (2020). MOOC student dropout prediction model based on learning behavior features and parameter optimization. Interact. Learn. Environ.10.1080/10494820.2020.1802300 ↗
10. Identification of Changes in VLE Stakeholders’ Behavior Over Time Using Frequent Patterns Mining10.1109/ACCESS.2021.3056191 ↗
11. Shaun, R., Baker, J.D., and Inventado, P.S. (2014). Educational Data Mining and Learning Analytics, Springer. Chapter 4.10.1007/978-1-4614-3305-7_4 ↗
12. Siemens, G., and Baker, R.S.J.D. (May, January 29). Learning analytics and educational data mining. Proceedings of the 2nd International Conference on Cryptography, Security and Privacy, Vancouver, BC, Canada.
13. Predicting MOOCs Dropout Using Only Two Easily Obtainable Features from the First Week’s Activities10.1007/978-3-030-22244-4_20 ↗
14. Romero, C., Ventura, S., Baker, R., and Pechenizkiy, M. (2010). Handbook of Educational Data Mining (Chapman & Hall/CRC Data Mining and Knowledge Discovery Series), CRC Press.
15. Skalka, J., and Drlik, M. (2020). Automated Assessment and Microlearning Units as Predictors of At-risk Students and Students’ Outcomes in the Introductory Programming Courses. Appl. Sci., 10.10.3390/app10134566 ↗
16. Utilising learning analytics to support study success in higher education: A systematic review10.1007/s11423-020-09788-z ↗
17. Understanding Time-Based Trends in Stakeholders’ Choice of Learning Activity Type Using Predictive Models10.1109/ACCESS.2018.2887057 ↗
18. Romero, C., Ventura, S., Pechenizkiy, M., and Baker, R.S.J.D. (2010). Classiers for educational data mining. Educational Data Mining Handbook, CRC Press.10.1201/b10274 ↗
19. Lang, C., Siemens, G., Wise, A., and Gasevic, D. (2017). Handbook of Learning Analytics, SOLAR.10.18608/hla17 ↗
20. Kloft, M., Stiehler, F., Zheng, Z., and Pinkwart, N. (2014, January 25–29). Predicting MOOC Dropout over Weeks Using Machine Learning Methods. Proceedings of the EMNLP 2014 Workshop on Analysis of Large Scale Social Interaction in MOOCs, Doha, Qatar.10.3115/v1/W14-4111 ↗
21. Learning Technology for Education in Cloud
22. An Early Feedback Prediction System for Learners At-Risk Within a First-Year Higher Education Course10.1109/TLT.2019.2912167 ↗
23. Kennedy, G., Coffrin, C., De Barba, P., and Corrin, L. (2015, January 16–20). Predicting success. Proceedings of the Fifth International Conference on Tangible, Embedded, and Embodied Interaction, Poughkeepsie, NY, USA.10.1145/2723576.2723593 ↗
24. A supervised learning framework: Using assessment to identify students at risk of dropping out of a MOOC
25. Benko, L., Reichel, J., and Munk, M. (2015, January 26–27). Analysis of student behavior in virtual learning environment depending on student assessments. Proceedings of the 2015 13th International Conference on Emerging eLearning Technologies and Applications (ICETA), Stary Smokovec, Slovakia.10.1109/ICETA.2015.7558496 ↗
26. Herodotou, C., Rienties, B., Boroowa, A., Zdrahal, Z., Hlosta, M., and Naydenova, G. (2017, January 13–17). Implementing predictive learning analytics on a large scale. Proceedings of the Seventh International Learning Analytics & Knowledge Conference, Vancouver, BC, Canada.10.1145/3027385.3027397 ↗
27. Early dropout prediction using data mining: A case study with high school students10.1111/exsy.12135 ↗
28. On the Use of Soft Computing Methods in Educational Data Mining and Learning Analytics Research: A Review of Years 2010–201810.1007/s40593-020-00200-8 ↗
29. Web usage mining for predicting final marks of students that use Moodle courses10.1002/cae.20456 ↗
30. Rastrollo-Guerrero, J.L., Gómez-Pulido, J.A., and Durán-Domínguez, A. (2020). Analyzing and Predicting Students’ Performance by Means of Machine Learning: A Review. Appl. Sci., 10.10.3390/app10031042 ↗
31. Erratum: Corrigendum to “Temporal predication of dropouts in MOOCs: Reaching the low hanging fruit through stacking generalization” (Computers in Human Behavior (2016) 58 (119–129)(S074756321530279X)(10.1016/j.chb.2015.12.007))10.1016/j.chb.2016.08.051 ↗
32. A predictive approach based on efficient feature selection and learning algorithms’ competition: Case of learners’ dropout in MOOCs10.1007/s10639-019-09934-y ↗
33. Turcani, M., Balogh, Z., Munk, M., Kapusta, J., and Benko, L. (2018, January 2–4). Identification of Important Activities for Teaching Programming Languages by Decision Trees. Proceedings of the 12th International Scientific Conference on Distance Learning in Applied Informatics (DIVAI), Štúrovo, Slovakia.
34. Hagedoorn, T.R., and Spanakis, G. (2017, January 6–8). Massive Open Online Courses Temporal Profiling for Dropout Prediction. Proceedings of the 2017 IEEE 29th International Conference on Tools with Artificial Intelligence (ICTAI), Boston, MA, USA.
35. Learning Analytics to identify dropout factors of Computer Science studies through Bayesian networks10.1080/0144929X.2018.1485053 ↗
36. Predictive analytics in education: A comparison of deep learning frameworks10.1007/s10639-019-10068-4 ↗
37. Ali, M. (2021, February 10). PyCaret: An Open Source, Low-Code Machine Learning Library in Python. Available online: https://pycaret.readthedocs.io/en/latest/index.html.
38. Approximate Statistical Tests for Comparing Supervised Classification Learning Algorithms10.1162/089976698300017197 ↗
39. Ferguson, R., Cooper, A., Drachsler, H., Kismihók, G., Boyer, A., Tammets, K., and Monés, A.M. (2015, January 16–20). Learning analytics. Proceedings of the Fifth International Conference on Tangible, Embedded, and Embodied Interaction, Poughkeepsie, NY, USA.10.1145/2723576.2723637 ↗