Multi-Class Phased Prediction of Academic Performance and Dropout in Higher Education
Source abstract
Abstract
The application of intelligent systems in the higher education sector is an active field of research, powered by the abundance of available data and by the urgency to define effective, data-driven strategies to overcome students’ dropout and improve students’ academic performance. This work applies machine learning techniques to develop prediction models that can contribute to the early detection of students at risk of dropping out or not finishing their degree in due time. It also evaluates the best moment for performing the prediction along the student’s enrollment year. The models are built on data of undergraduate students from a Polytechnic University in Portugal, enrolled between 2009 and 2017, comprising academic, social–demographic, and macroeconomic information at three different phases during the first academic year of the students. Five machine learning algorithms are used to train prediction models at each phase, and the most relevant features for the top performing models are identified. Results show that the best models use Random Forest, either incorporating strategies to deal with the imbalanced nature of the data or using such strategies at the data level. The best results are obtained at the end of the first semester, when some information about the academic performance after enrollment is already available. The overall results compare fairly with some similar works that address the early prediction of students’ dropout or academic performance.
Source: crossref · Quality: baseline
Research context
OpenAlex topics: Online Learning and Analytics · Imbalanced Data Classification Techniques
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
Affiliations
Polythecnic Institute of Portalegre, 7300-110 Portalegre, Portugal
VALORIZA—Research Center for Endogenous Resource Valorization, 7300-555 Portalegre, Portugal
Funding
SATDAP—Capacitação da Administração Pública 388 · Portuguese Foundation for Science and Technology
References (41)
Show source-provided references
1. Student psychological distress and degree dropout or completion: A discrete-time, competing risks survival analysis10.1080/07294360.2017.1404557 ↗
2. Interrupted trajectories: The impact of academic failure on the social mobility of working-class students10.1080/01425692.2013.816042 ↗
3. Rastrollo-Guerrero, J.L., Gómez-Pulido, J.A., and Durán-Domínguez, A. (2020). Analyzing and predicting students’ performance by means of machine learning: A review. Appl. Sci., 10.10.3390/app10031042 ↗
4. Predicting academic success in higher education: Literature review and best practices10.1186/s41239-020-0177-7 ↗
5. Early segmentation of students according to their academic performance: A predictive modelling approach10.1016/j.dss.2018.09.001 ↗
6. Predicting academic performance by considering student heterogeneity10.1016/j.knosys.2018.07.042 ↗
7. Deep learning with data transformation and factor analysis for student performance prediction
8. The potential for student performance prediction in small cohorts with minimal available attributes10.1111/bjet.12836 ↗
9. Comparing Different Resampling Methods in Predicting Students’ Performance Using Machine Learning Techniques10.1109/ACCESS.2020.2986809 ↗
10. Using data mining techniques to predict student performance to support decision making in university admission systems10.1109/ACCESS.2020.2981905 ↗
11. Educational data mining: Prediction of students’ academic performance using machine learning algorithms10.1186/s40561-022-00192-z ↗
12. Predictive modelling of student dropout using ensemble classifier method in higher education10.25046/aj040425 ↗
13. Predicting student dropout: A machine learning approach10.1080/21568235.2020.1718520 ↗
14. Kabathova, J., and Drlik, M. (2021). Towards predicting student’s dropout in university courses using different machine learning techniques. Appl. Sci., 11.10.3390/app11073130 ↗
15. Bottcher, A., Thurner, V., Hafner, T., and Hertle, J. (2021, January 21–23). A data science-based approach for identifying counseling needs in first-year students. Proceedings of the IEEE Global Engineering Education Conference, EDUCON, Vienna, Austria.10.1109/EDUCON46332.2021.9454042 ↗
16. A real-life machine learning experience for predicting university dropout at different stages using academic data10.1109/ACCESS.2021.3115851 ↗
17. A two-phase machine learning approach for predicting student outcomes10.1007/s10639-020-10260-x ↗
18. Identifying at-risk students based on the phased prediction model10.1007/s10115-019-01374-x ↗
19. Predicting students’ performance in e-learning using learning process and behaviour data10.1038/s41598-021-03867-8 ↗
20. Transfer-Learning Methods in Programming Course Outcome Prediction10.1145/3152714 ↗
21. Nagy, M., and Molontay, R. (2018, January 21–23). Predicting Dropout in Higher Education Based on Secondary School Performance. Proceedings of the INES 2018—IEEE 22nd International Conference on Intelligent Engineering Systems, Las Palmas de Gran Canaria, Spain.10.1109/INES.2018.8523888 ↗
22. Predicting University Students’ Academic Success and Major Using Random Forests10.1007/s11162-019-09546-y ↗
23. Boosting methods for multi-class imbalanced data classification: An experimental review10.1186/s40537-020-00349-y ↗
24. Classification with class imbalance problem: A review
25. SMOTE: Synthetic minority over-sampling technique10.1613/jair.953 ↗
26. Borderline over-sampling for imbalanced data classification10.1504/IJKESDP.2011.039875 ↗
27. RUSBoost: A hybrid approach to alleviating class imbalance10.1109/TSMCA.2009.2029559 ↗
28. A decision-theoretic generalization of on-line learning and an application to boosting10.1007/3-540-59119-2_166 ↗
29. Random forests10.1023/A:1010933404324 ↗
30. Induction of decision trees10.1007/BF00116251 ↗
31. Chen, C., Liaw, A., and Breiman, L. (2004). Using Random Forest to Learn Imbalanced Data, University of California. Technical Report.
32. Exploratory undersampling for class-imbalance learning10.1109/TSMCB.2008.2007853 ↗
33. Martins, M.V., Tolledo, D., Machado, J., Baptista, L.M., and Realinho, V. (2021). Early Prediction of Student’s Performance in Higher Education: A Case Study, Springer International Publishing.10.1007/978-3-030-72657-7_16 ↗
34. McKinney, W. (July, January 28). Data Structures for Statistical Computing in Python. Proceedings of the 9th Python in Science Conference, Austin, TX, USA.
35. Seaborn: Statistical data visualization10.21105/joss.03021 ↗
36. Scikit-learn: Machine learning in Python
37. Imbalanced-learn: A python toolbox to tackle the curse of imbalanced datasets in machine learning
38. A literature review on one-class classification and its potential applications in big data10.1186/s40537-021-00514-x ↗
39. Academic performance prediction based on multisource, multifeature behavioral data10.1109/ACCESS.2020.3002791 ↗
40. Gallego, M.G., Perez de los Cobos, A.P., and Gallego, J.C.G. (2021). Identifying Students at Risk to Academic Dropout in Higher Education. Educ. Sci., 11.10.3390/educsci11080427 ↗
41. Predicting performance of electrical engineering students using cognitive and non-cognitive features for identification of potential dropouts10.1177/0020720916688484 ↗