journal article·2020-12-29Open access

Predicting Student Performance Using Data Mining and Learning Analytics Techniques: A Systematic Literature Review

Abdallah Namoun, Abdullah Alshanqiti

Applied Sciences· Volume 11· Issue 1

Abstract

The prediction of student academic performance has drawn considerable attention in education. However, although the learning outcomes are believed to improve learning and teaching, prognosticating the attainment of student outcomes remains underexplored. A decade of research work conducted between 2010 and November 2020 was surveyed to present a fundamental understanding of the intelligent techniques used for the prediction of student performance, where academic success is strictly measured using student learning outcomes. The electronic bibliographic databases searched include ACM, IEEE Xplore, Google Scholar, Science Direct, Scopus, Springer, and Web of Science. Eventually, we synthesized and analyzed a total of 62 relevant papers with a focus on three perspectives, (1) the forms in which the learning outcomes are predicted, (2) the predictive analytics models developed to forecast student learning, and (3) the dominant factors impacting student outcomes. The best practices for conducting systematic literature reviews, e.g., PICO and PRISMA, were applied to synthesize and report the main results. The attainment of learning outcomes was measured mainly as performance class standings (i.e., ranks) and achievement scores (i.e., grades). Regression and supervised machine learning models were frequently employed to classify student performance. Finally, student online learning activities, term assessment grades, and student academic emotions were the most evident predictors of learning outcomes. We conclude the survey by highlighting some major research challenges and suggesting a summary of significant recommendations to motivate future works in this field.
Source: crossref · Quality: baseline

Research context

OpenAlex topics: Online Learning and Analytics · Software System Performance and Reliability

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

Faculty of Computer and Information Systems, Islamic University of Madinah, Madinah 42351, Saudi Arabia

Funding

The Deanship of Scientific Research, Distinguished Project, Islamic University of Madinah, KSA

References (100+)

Show source-provided references
1. Big data and analytics in higher education: Opportunities and challenges10.1111/bjet.12230 ↗
2. Prediction of student’s performance by modelling small dataset size10.1186/s41239-019-0160-3 ↗
3. Hellas, A., Ihantola, P., Petersen, A., Ajanovski, V.V., Gutica, M., Hynninen, T., Knutas, A., Leinonen, J., Messom, C., and Liao, S.N. (2018, January 2–4). Predicting academic performance: A systematic literature review. Proceedings of the Companion of the 23rd Annual ACM Conference on Innovation and Technology in Computer Science Education, Larnaca, Cyprus.10.1145/3293881.3295783 ↗
4. Mining educational data to analyze students’ performance
5. Zhang, L., and Li, K.F. (2018, January 16–18). Education analytics: Challenges and approaches. Proceedings of the 2018 32nd International Conference on Advanced Information Networking and Applications Workshops (WAINA), Krakow, Poland.10.1109/WAINA.2018.00086 ↗
6. Daud, A., Aljohani, N.R., Abbasi, R.A., Lytras, M.D., Abbas, F., and Alowibdi, J.S. (2017, January 3–7). Predicting student performance using advanced learning analytics. Proceedings of the 26th International Conference on World Wide Web Companion, Perth, Australia.10.1145/3041021.3054164 ↗
7. Implementing outcome-based education (OBE) framework: Implications for assessment of students’ performance
8. Yassine, S., Kadry, S., and Sicilia, M.A. (2016, January 10–13). A framework for learning analytics in moodle for assessing course outcomes. Proceedings of the 2016 IEEE Global Engineering Education Conference (EDUCON), Abu Dhabi, UAE.10.1109/EDUCON.2016.7474563 ↗
9. Rajak, A., Shrivastava, A.K., and Shrivastava, D.P. (2018, January 28–29). Automating outcome based education for the attainment of course and program outcomes. Proceedings of the 2018 Fifth HCT Information Technology Trends (ITT), Dubai, UAE.10.1109/CTIT.2018.8649532 ↗
10. Kitchenham, B., and Charters, S. (2007). Guidelines for Performing Systematic Literature Reviews in Software Engineering, EBSE.
11. Okoli, C., and Schabram, K. (2010). A guide to conducting a systematic literature review of information systems research. Ssrn Eletronic J., 10.10.2139/ssrn.1954824 ↗
12. Empowering students through outcome-based education (OBE)10.7227/RIE.87.1.4 ↗
13. Course and program outcomes assessment methods in outcome-based education: A review10.1177/0022057419854351 ↗
14. Natarajan, R. (2015, January 5–8). Leveraging technology in outcome-based education. Proceedings of the International Conference on Transformations in Engineering Education, New Delhi, India.
15. An expert comparison of accreditation support tools for the undergraduate computing programs
16. Importance and benefits of learning outcomes10.9790/0837-2203056567 ↗
17. A learning outcome inspired survey instrument for assessing the quality of continuous improvement cycle10.4018/IJICTE.2019040107 ↗
18. A holistic quality assurance framework to acquire national and international10.36478/jeasci.2019.6685.6698 ↗
19. Singh, R., and Sarkar, S. (2012). Teaching Quality Counts: How Student Outcomes Relate to Quality of Teaching in Private and Public Schools in India, Young Lives.
20. Online public health education for low and middle-income countries: Factors influencing successful student outcomes10.3991/ijet.v6i4.1797 ↗
21. Family engagement in education and intervention: Implementation and evaluation to maximize family, school, and student outcomes10.1016/j.jsp.2017.04.002 ↗
22. An exploratory study of student motivations for taking online courses and learning outcomes
23. Feature extraction for next-term prediction of poor student performance10.1109/TLT.2019.2913358 ↗
24. A review on predicting student’s performance using data mining techniques10.1016/j.procs.2015.12.157 ↗
25. Tatar, A.E., and Düştegör, D. (2020). Prediction of academic performance at undergraduate graduation: Course grades or grade point average?. Appl. Sci., 10.10.3390/app10144967 ↗
26. Predicting student performance using personalized analytics10.1109/MC.2016.119 ↗
27. Predictive analytic models of student success in higher education: A review of methodology
28. Rastrollo-Guerrero, J.L., Gómez-Pulido, J.A., and Durán-Domínguez, A. (2020). Analyzing and predicting students’ performance by means of machine learning: A review. Appl. Sci., 10.10.3390/app10031042 ↗
29. Predicting student performance and its influential factors using hybrid regression and multi-label classification10.1109/ACCESS.2020.3036572 ↗
30. Predictors of academic performance, success and retention amongst undergraduate nursing students: A systematic review
31. Beyond perceived ability: The contribution of psychosocial factors to academic performance10.1111/nyas.13210 ↗
32. Felix, I., Ambrósio, A.P., Lima, P.D.S., and Brancher, J.D. (November, January 29). Data mining for student outcome prediction on moodle: A systematic mapping. Proceedings of the Brazilian Symposium on Computers in Education (Simpósio Brasileiro de Informática na Educação-SBIE), Fortaleza, Brazil.
33. Educational data mining: A survey and a data mining-based analysis of recent works10.1016/j.eswa.2013.08.042 ↗
34. Literature survey on student’s performance prediction in education using data mining techniques
35. Using machine learning algorithms to predict students’ performance and improve learning outcome: A literature based review
36. Hu, X., Cheong, C.W., Ding, W., and Woo, M. (2017, January 13–17). A systematic review of studies on predicting student learning outcomes using learning analytics. Proceedings of the Seventh International Learning Analytics & Knowledge Conference, Vancouver, BC, Canada.10.1145/3027385.3029438 ↗
37. Online vs traditional homework: A systematic review on the benefits to students’ performance10.1016/j.compedu.2020.103869 ↗
38. The effects of interactive whiteboards (IWBs) on student performance and learning: A literature review10.2190/ET.38.3.b ↗
39. Domains and predictors of first-year student success: A systematic review10.1016/j.edurev.2018.01.001 ↗
40. The successful graduate student: A review of the factors for success
41. Guidelines for conducting systematic mapping studies in software engineering: An update10.1016/j.infsof.2015.03.007 ↗
42. Preferred reporting items for systematic reviews and meta-analyses: The PRISMA statement
43. Ming, N.C., and Ming, V.L. (2012). Predicting student outcomes from unstructured data. UMAP Workshops, CEUR Workshop Proceedings.
44. Heise, N., Meyer, C.A., Garbe, B.A., Hall, H.A., and Clapp, T.R. (2020). Table quizzes as an assessment tool in the gross anatomy laboratory. J. Med. Educ. Curric. Dev., 7.10.1177/2382120520941822 ↗
45. The efficacy of medical student selection tools in Australia and New Zealand10.5694/mja17.00400 ↗
46. Analysis of the factors influencing learners’ performance prediction with learning analytics10.1109/ACCESS.2019.2963503 ↗
47. Adaptability: How students’ responses to uncertainty and novelty predict their academic and non-academic outcomes10.1037/a0032794 ↗
48. Receiver operating characteristic (ROC) area under the curve (AUC): A diagnostic measure for evaluating the accuracy of predictors of education outcomes10.1080/10824669.2018.1523734 ↗
49. Predicting student outcome measures using the ASCA national model program audit
50. Student ratings of teaching quality in primary school: Dimensions and prediction of student outcomes10.1016/j.learninstruc.2013.07.001 ↗
51. Harred, R., Cody, C., Maniktala, M., Shabrina, P., Barnes, T., and Lynch, C. (2019, January 2–5). How Long is Enough? Predicting Student Outcomes with Same-Day Gameplay Data in an Educational Math Game. Proceedings of the Educational Data Mining (Workshops), Montréal, QC, Canada.
52. Social support and classroom management are related to secondary students’ general school adjustment: A multilevel structural equation model using student and teacher ratings10.1037/edu0000256 ↗
53. Secondary school advisors as mentors and secondary attachment figures10.1002/jcop.20356 ↗
54. Porayska-Pomsta, K., Mavrikis, M., Cukurova, M., Margeti, M., and Samani, T. (2018, January 27–30). Leveraging non-cognitive student self-reports to predict learning outcomes. Proceedings of the International Conference on Artificial Intelligence in Education, London, UK.10.1007/978-3-319-93846-2_86 ↗
55. Kórösi, G., Esztelecki, P., Farkas, R., and Tóth, K. (2018, January 11–13). Clickstream-based outcome prediction in short video MOOCs. Proceedings of the 2018 International Conference on Computer, Information and Telecommunication Systems (CITS), Colmar, France.10.1109/CITS.2018.8440182 ↗
56. Teacher-student relationships: The positives and negatives of assessing both perspectives10.1016/j.appdev.2017.09.002 ↗
57. Predicting kindergarteners’ achievement and motivation from observational measures of teaching effectiveness10.1080/00220973.2016.1277338 ↗
58. Correlates of students’ internalization and defiance of classroom rules: A self-determination theory perspective10.1111/bjep.12213 ↗
59. Simjanoska, M., Gusev, M., Ristov, S., and Bogdanova, A.M. (2014, January 3–5). Intelligent student profiling for predicting e-assessment outcomes. Proceedings of the 2014 IEEE Global Engineering Education Conference (EDUCON), Istanbul, Turkey.10.1109/EDUCON.2014.6826157 ↗
60. Pang, Y., Judd, N., O’Brien, J., and Ben-Avie, M. (2017, January 18–21). Predicting students’ graduation outcomes through support vector machines. Proceedings of the 2017 IEEE Frontiers in Education Conference (FIE), Indianapolis, IN, USA.10.1109/FIE.2017.8190666 ↗
61. Liu, K.F.R., and Chen, J.S. (2011, January 11–13). Prediction and assessment of student learning outcomes in calculus a decision support of integrating data mining and Bayesian belief networks. Proceedings of the 2011 3rd International Conference on Computer Research and Development, Shanghai, China.
62. Predictive modeling to forecast student outcomes and drive effective interventions in online community college courses
63. Prediction of student outcome in educational sector by using decision tree
64. A multivariate approach to predicting student outcomes in web-enabled blended learning courses10.1016/j.iheduc.2015.05.002 ↗
65. Utilizing early engagement and machine learning to predict student outcomes10.1016/j.compedu.2018.12.006 ↗
66. Iatrellis, O., Savvas, I.Κ., Fitsilis, P., and Gerogiannis, V.C. (2020). A two-phase machine learning approach for predicting student outcomes. Educ. Inf. Technol., 1–20.10.1007/s10639-020-10260-x ↗
67. Kuzilek, J., Vaclavek, J., Zdrahal, Z., and Fuglik, V. (2019, January 16–19). Analysing Student VLE Behaviour Intensity and Performance. Proceedings of the European Conference on Technology Enhanced Learning, Delft, The Netherlands.10.1007/978-3-030-29736-7_45 ↗
68. Raga, R., and Raga, J. (2019, January 2–4). Early Prediction of Student Performance in Blended Learning Courses Using Deep Neural Networks. Proceedings of the 2019 International Symposium on Educational Technology (ISET), Hradec Kralove, Czech Republic.10.1109/ISET.2019.00018 ↗
69. Walsh, K.R., and Mahesh, S. (2017, January 10–12). Exploratory study using machine learning to make early predictions of student outcomes. Proceedings of the Twenty-third Americas Conference on Information Systems, Data Science and Analytics for Decision Support (SIGDSA), Boston, MA, USA.
70. Olama, M.M., Thakur, G., McNair, A.W., and Sukumar, S.R. (2014). Predicting student success using analytics in course learning management systems. Next-Generation Analyst II, International Society for Optics and Photonics.10.1117/12.2050641 ↗
71. Professor–student rapport scale: Six items predict student outcomes10.1177/0098628312475033 ↗
72. Professor–student rapport scale predicts student outcomes10.1080/00986283.2010.510976 ↗
73. Kuzilek, J., Vaclavek, J., Fuglik, V., and Zdrahal, Z. (2018, January 3–5). Student Drop-out Modelling Using Virtual Learning Environment Behaviour Data. Proceedings of the European Conference on Technology Enhanced Learning, Leeds, UK.10.1007/978-3-319-98572-5_13 ↗
74. Zaporozhko, V.V., Parfenov, D.I., and Shardakov, V.M. (2019, January 3–4). Development Approach of Formation of Individual Educational Trajectories Based on Neural Network Prediction of Student Learning Outcomes. Proceedings of the International Conference of Artificial Intelligence, Medical Engineering, Education, Moscow, Russia.10.1007/978-3-030-39162-1_28 ↗
75. Predicting students’ outcomes from emotional response in the classroom and attendance10.1080/10494820.2018.1528282 ↗
76. Eagle, M., Carmichael, T., Stokes, J., Blink, M.J., Stamper, J.C., and Levin, J. (2018, January 15–18). Predictive Student Modeling for Interventions in Online Classes. Proceedings of the 11th International Conference on Educational Data Mining EDM, Buffalo, NY, USA.
77. Alonso, J.M., and Casalino, G. (2019, January 6–7). Explainable Artificial Intelligence for Human-Centric Data Analysis in Virtual Learning Environments. Proceedings of the International Workshop on Higher Education Learning Methodologies and Technologies Online, Novedrate, Italy.10.1007/978-3-030-31284-8_10 ↗
78. Kőrösi, G., and Farkas, R. (2020, January 23–24). MOOC Performance Prediction by Deep Learning from Raw Clickstream Data. Proceedings of the International Conference on Advances in Computing and Data Sciences, Maharashtra, India.10.1007/978-981-15-6634-9_43 ↗
79. Culligan, N., Quille, K., and Bergin, S. (2016, January 24–27). Veap: A visualization engine and analyzer for press#. Proceedings of the 16th Koli Calling International Conference on Computing Education Research, Koli, Finland.10.1145/2999541.2999553 ↗
80. Umer, R., Mathrani, A., Susnjak, T., and Lim, S. (2019, January 27–29). Mining Activity Log Data to Predict Student’s Outcome in a Course. Proceedings of the 2019 International Conference on Big Data and Education, London, UK.10.1145/3322134.3322140 ↗
81. Case-based Instruction in Undergraduate Engineering: Does Student Confidence Predict Learning
82. Beyond engagement analytics: Which online mixed-data factors predict student learning outcomes?10.1007/s10639-016-9464-2 ↗
83. Do situational academic emotions predict academic outcomes in a lecture course?10.1016/j.sbspro.2012.12.144 ↗
84. Tsiakmaki, M., Kostopoulos, G., Kotsiantis, S., and Ragos, O. (2020). Implementing AutoML in educational data mining for prediction tasks. Appl. Sci., 10.10.3390/app10010090 ↗
85. Al-Shabandar, R., Hussain, A., Laws, A., Keight, R., Lunn, J., and Radi, N. (2017, January 14–19). Machine learning approaches to predict learning outcomes in Massive open online courses. Proceedings of the 2017 International Joint Conference on Neural Networks (IJCNN), Anchorage, AK, USA.10.1109/IJCNN.2017.7965922 ↗
86. Yu, C.H., Wu, J., and Liu, A.C. (2019). Predicting learning outcomes with MOOC clickstreams. Educ. Sci., 9.10.3390/educsci9020104 ↗
87. Using machine learning to predict physics course outcomes10.1103/PhysRevPhysEducRes.15.020120 ↗
88. Nguyen, V.A., Nguyen, Q.B., and Nguyen, V.T. (2018, January 13–15). A model to forecast learning outcomes for students in blended learning courses based on learning analytics. Proceedings of the 2nd International Conference on E-Society, E-Education and E-Technology, Taipei, Taiwan.10.1145/3268808.3268827 ↗
89. Guo, S., and Wu, W. (2015, January 10–12). Modeling student learning outcomes in MOOCs. Proceedings of the 4th International Conference on Teaching, Assessment, and Learning for Engineering, Zhuhai, China.
90. A learning analytics approach to the evaluation of an online learning package in a Hong Kong University
91. The use of an online learning and teaching system for monitoring computer aided design student participation and predicting student success10.1007/s10798-015-9346-8 ↗
92. Gratiano, S.M., and Palm, W.J. (2016, January 26–29). Can a five minute, three question survey foretell first-year engineering student performance and retention?. Proceedings of the 123rd ASEE Annual Conference & Exposition, New Orleans, LA, USA.
93. Vasić, D., Kundid, M., Pinjuh, A., and Šerić, L. (2015, January 16–18). Predicting student’s learning outcome from Learning Management system logs. Proceedings of the 2015 23rd International Conference on Software, Telecommunications and Computer Networks (SoftCOM), Bol (Island of Brac), Croatia.10.1109/SOFTCOM.2015.7314114 ↗
94. Felix, I., Ambrosio, A., Duilio, J., and Simões, E. (2019, January 14–15). Predicting student outcome in moodle. Proceedings of the Conference: Academic Success in Higher Education, Porto, Portugal.
95. Alkoot, F.M. (2016, January 22–24). Using classifiers to predict student outcome at HITN-PAAET. Proceedings of the 18th International Conference on Machine Learning and Data Analysis, Tokyo, Japan.
96. Fine-grained learning performance prediction via adaptive sparse self-attention networks10.1016/j.ins.2020.08.017 ↗
97. Does attendance in private schools predict student outcomes at age 15? Evidence from a longitudinal study10.3102/0013189X18785632 ↗
98. Teacher characteristics and student learning in mathematics: A comprehensive assessment10.1177/0895904818755468 ↗
99. A national study of the differential impact of novice teacher certification on teacher traits and race-based mathematics achievement10.1177/0022487119849564 ↗
100. Lima, P.D.S.N., Ambrósio, A.P.L., Félix, I.M., Brancher, J.D., and Ferreira, D.J. (2018, January 3–6). Content Analysis of Student Assessment Exams. Proceedings of the 2018 IEEE Frontiers in Education Conference (FIE), San Jose, CA, USA.