journal article·2023-05-20Open access

Student Dropout Prediction for University with High Precision and Recall

Sangyun Kim, Euteum Choi, Yong-Kee Jun, Seongjin Lee

Applied Sciences· Volume 13· Issue 10

Abstract

Since a high dropout rate for university students is a significant risk to local communities and countries, a dropout prediction model using machine learning is an active research domain to prevent students from dropping out. However, it is challenging to fulfill the needs of consulting institutes and the office of academic affairs. To the consulting institute, the accuracy in the prediction is of the utmost importance; to the offices of academic affairs and other offices, the reason for dropping out is essential. This paper proposes a Student Dropout Prediction (SDP) system, a hybrid model to predict the students who are about to drop out of the university. The model tries to increase the dropout precision and the dropout recall rate in predicting the dropouts. We then analyzed the reason for dropping out by compressing the feature set with PCA and applying K-means clustering to the compressed feature set. The SDP system showed a precision value of 0.963, which is 0.093 higher than the highest-precision model of the existing works. The dropout recall and F1 scores, 0.766 and 0.808, respectively, were also better than those of gradient boosting by 0.117 and 0.011, making them the highest among the existing works; Then, we classified the reasons for dropping out into four categories: “Employed”, “Did Not Register”, “Personal Issue”, and “Admitted to Other University.” The dropout precision of “Admitted to Other University” was the highest, at 0.672. In post-verification, the SDP system increased counseling efficiency by accurately predicting dropouts with high dropout precision in the “High-Risk” group while including more dropouts in total dropouts. In addition, by predicting the reasons for dropouts and presenting guidelines to each department, the students could receive personalized counseling.
Source: crossref · Quality: baseline

Research context

OpenAlex topics: Online Learning and Analytics · Imbalanced Data Classification Techniques · Artificial Intelligence in Healthcare

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

Department of Informatics, Gyeongsang National University, Jinju-daero 501, Jinjusi 52828, Republic of Korea

Research Center for Aircraft Parts Technology, Gyeongsang National University, Jinju-daero 501, Jinjusi 52828, Republic of Korea

Division of Aerospace and Software Engineering, Gyeongsang National University, Jinju-daero 501, Jinjusi 52828, Republic of Korea

Department of Bio & Medical Bigdata (BK4+ Program), Gyeongsang National University, Jinju-daero 501, Jinjusi 52828, Republic of Korea

Department of AI Convergence Engineering, Gyeongsang National University, Jinju-daero 501, Jinjusi 52828, Republic of Korea

Funding

National Research Foundation of Korea (NRF)

References (26)

Show source-provided references
1. (2022, December 15). South Korea’s Basic Education Statistics. Available online: https://kess.kedi.re.kr/index.
2. An Analysis of the Factors Affecting Local College Freshmen’s Intention of Dropout: Focused on C-College
3. Barros, T.M., Souza Neto, P.A., Silva, I., and Guedes, L.A. (2019). Predictive Models for Imbalanced Data: A School Dropout Perspective. Educ. Sci., 9.10.3390/educsci9040275 ↗
4. Baranyi, M., Nagy, M., and Molontay, R. (2020, January 7–9). Interpretable deep learning for university dropout prediction. Proceedings of the 21st Annual Conference on Information Technology Education, Omaha, NE, USA.10.1145/3368308.3415382 ↗
5. Predicting student drop-out in higher institution using data mining techniques10.1088/1742-6596/1496/1/012005 ↗
6. Shynarbek, N., Orynbassar, A., Sapazhanov, Y., and Kadyrov, S. (2021, January 25–26). Prediction of Student’s Dropout from a University Program. Proceedings of the 16th International Conference on Electronics Computer and Computation (ICECCO), Kaskelen, Kazakhstan.10.1109/ICECCO53203.2021.9663763 ↗
7. Forecasting Students Dropout: A UTAD University Study
8. A real-life machine learning experience for predicting university dropout at different stages using academic data10.1109/ACCESS.2021.3115851 ↗
9. Lee, S., and Chung, J.Y. (2019). The machine learning-based dropout early warning system for improving the performance of dropout prediction. Educ. Sci., 9.10.3390/app9153093 ↗
10. Predicting student’s dropout in university classes using two-layer ensemble machine learning approach: A novel stacked generalization10.1016/j.caeai.2022.100066 ↗
11. Survey on deep learning with class imbalance10.1186/s40537-019-0192-5 ↗
12. Two modifications of CNN
13. (2022, December 15). Imbalanced Learn. Available online: https://imbalanced-learn.org/stable/references/generated/.
14. Asymptotic properties of nearest neighbor rules using edited data10.1109/TSMC.1972.4309137 ↗
15. SMOTE: Synthetic minority over-sampling technique10.1613/jair.953 ↗
16. Han, H., Wang, W.-Y., and Mao, B.-H. (2005, January 23–26). Borderline-SMOTE: A new over-sampling method in imbalanced data sets learning. Proceedings of the IEEE 2005 International Conference on Advances in Intelligent Computing, Hefei, China.10.1007/11538059_91 ↗
17. He, H., Bai, Y., Garcia, E.A., and Li, S. (2008, January 1–8). ADASYN: Adaptive synthetic sampling approach for imbalanced learning. Proceedings of the 2008 IEEE International Joint Conference on Neural Networks, Hong Kong, China.
18. A study of the behavior of several methods for balancing machine learning training data10.1145/1007730.1007735 ↗
19. Gustavo, E.A.P.A., Batista, A., and Bazzan, M.C. (2003, January 3–5). Monard Balancing Training Data for Automated Annotation of Keywords: A Case Study. Proceedings of the WOB, Macaé, RJ, Brazil.
20. (2022, December 15). dmlc XGBoost. Available online: https://xgboost.readthedocs.io/en/stable/.
21. (2022, December 15). CatBoost. Available online: https://catboost.ai/.
22. Improving identification of difficult small classes by balancing class distribution10.1007/3-540-48229-6_9 ↗
23. An experiment with the edited nearest-nieghbor rule10.1109/TSMC.1976.4309523 ↗
24. (2022, December 15). ClusterCentroids, Imbalanced-Learn, Accessed 0808, 2022. Available online: https://imbalanced-learn.org/stable/references/generated/imblearn.under_sampling.ClusterCentroids.html.
25. Training and assessing classification rules with imbalanced data10.1007/s10618-012-0295-5 ↗
26. Borderline over-sampling for imbalanced data classification