journal article·2021-12-13Open access

Predicting Academic Performance Using an Efficient Model Based on Fusion of Classifiers

Ansar Siddique, Asiya Jan, Fiaz Majeed, Adel Ibrahim Qahmash, Noorulhasan Naveed Quadri, Mohammad Osman Abdul Wahab

Applied Sciences· Volume 11· Issue 24

Abstract

In the past few years, educational data mining (EDM) has attracted the attention of researchers to enhance the quality of education. Predicting student academic performance is crucial to improving the value of education. Some research studies have been conducted which mainly focused on prediction of students’ performance at higher education. However, research related to performance prediction at the secondary level is scarce, whereas the secondary level tends to be a benchmark to describe students’ learning progress at further educational levels. Students’ failure or poor grades at lower secondary negatively impact them at the higher secondary level. Therefore, early prediction of performance is vital to keep students on a progressive track. This research intended to determine the critical factors that affect the performance of students at the secondary level and to build an efficient classification model through the fusion of single and ensemble-based classifiers for the prediction of academic performance. Firstly, three single classifiers including a Multilayer Perceptron (MLP), J48, and PART were observed along with three well-established ensemble algorithms encompassing Bagging (BAG), MultiBoost (MB), and Voting (VT) independently. To further enhance the performance of the abovementioned classifiers, nine other models were developed by the fusion of single and ensemble-based classifiers. The evaluation results showed that MultiBoost with MLP outperformed the others by achieving 98.7% accuracy, 98.6% precision, recall, and F-score. The study implies that the proposed model could be useful in identifying the academic performance of secondary level students at an early stage to improve the learning outcomes.
Source: crossref · Quality: baseline

Research context

OpenAlex topics: Online Learning and Analytics · Software System Performance and Reliability · Artificial Intelligence in Healthcare

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

Department of Software Engineering, University of Gujrat, Gujrat 50700, Pakistan

Department of Information Technology, University of Gujrat, Gujrat 50700, Pakistan

College of Education, King Khalid University, Abha 61413, Saudi Arabia

College of Computer Science, King Khalid University, Abha 61413, Saudi Arabia

Department of English, Faculty of Languages and Translation, King Khalid University, Abha 61413, Saudi Arabia

Funding

Deanship of Scientific Research at King Khalid University

References (62)

Show source-provided references
1. Kamran, S., Nawaz, I., Aslam, S., Zaheer, S., and Shaukat, U. (2016, January 5–6). Student’s performance in the context of data mining. Proceedings of the 2016 19th International Multi-Topic Conference (INMIC), Islamabad, Pakistan.
2. Kamran, S., Nawaz, I., Aslam, S., Zaheer, S., and Shaukat, U. (2017). Student’s Performance: A Data Mining Perspective, LAP Lambert Academic Publishing.
3. Prediction of educational institution using predictive analytic techniques10.1007/s10639-018-9827-y ↗
4. Kaur, A., Umesh, N., and Singh, B. (2021, July 16). Machine Learning Approach to Predict Student Academic Performance. Available online: www.ijraset.com734.
5. Do government schools improve learning for poor students? Evidence from rural Pakistan10.1080/03054985.2019.1637726 ↗
6. Abid, A., Kallel, I., Blanco, I., and Benayed, M. (2018). Selecting relevant educational attributes for predicting students’ academic performance. Intelligent Systems Design and Applications, Proceedings of the 17th International Conference on Intelligent Systems Design and Applications (ISDA 2017), Delhi, India, 14–16 December 2017, Springer.10.1007/978-3-319-76348-4_63 ↗
7. Knowledge economy: Characteristics and dimensions
8. An Early Feedback Prediction System for Learners At-Risk within a First-Year Higher Education Course10.1109/TLT.2019.2912167 ↗
9. Student Academic Performance Prediction using Supervised Learning Techniques10.3991/ijet.v14i14.10310 ↗
10. Comparative analysis of ensemble algorithms’ prediction accuracies in education data mining
11. Educational data mining & students’ performance prediction
12. Educational Data Mining: A Review of the State of the Art10.1109/TSMCC.2010.2053532 ↗
13. Arun, D.K., Namratha, V., Ramyashree, B.V., Jain, Y.P., and Choudhury, A.R. (2021, January 27–29). Student academic performance prediction using educational data mining. Proceedings of the 2021 International Conference on Computer Communication and Informatics (ICCCI), Coimbatore, India.10.1109/ICCCI50826.2021.9457021 ↗
14. Using Educational Data Mining to Predict Students’ Academic Performance for Applying Early Interventions
15. Tracking, grading, and student motivation: Using group composition and status to predict self-concept and interest in ninth-grade mathematics10.1037/0022-0663.98.4.788 ↗
16. Which Factors Have the Greatest Impact on Student’s Performance10.1088/1742-6596/1288/1/012077 ↗
17. Predicting Academic Performance of Students Using a Hybrid Data Mining Approach10.1007/s10916-019-1295-4 ↗
18. Md Zubair Rahman, A.M.J. (2021, July 05). Model of Tuned J48 Classification and Analysis of Performance Prediction in Educational Data Mining. Available online: http://www.ripublication.com.
19. An overview and comparison of supervised data mining techniques for student exam performance prediction10.1016/j.compedu.2019.103676 ↗
20. The impact of COVID-19 on student experiences and expectations: Evidence from a survey10.1016/j.jpubeco.2020.104271 ↗
21. Predicting Students’ GPA and Developing Intervention Strategies Based on Self-Regulatory Learning Behaviors10.1109/ACCESS.2017.2740980 ↗
22. Mining Educational Data to Predict Student’s academic Performance using Ensemble Methods10.14257/ijdta.2016.9.8.13 ↗
23. Hutt, S., Gardener, M., Kamentz, D., Duckworth, A.L., and D’Mello, S.K. (2018, January 7–9). Prospectively predicting 4-year college graduation from student applications. Proceedings of the LAK ‘18: International Conference on Learning Analytics and Knowledge, Sydney, Australia.10.1145/3170358.3170395 ↗
24. A Machine Learning Approach for Tracking and Predicting Student Performance in Degree Programs10.1109/JSTSP.2017.2692560 ↗
25. Shaukat, K., Luo, S., Varadharajan, V., Hameed, I.A., Chen, S., Liu, D., and Li, J. (2020). Performance Comparison and Current Challenges of Using Machine Learning Techniques in Cybersecurity. Energies, 13.10.3390/en13102509 ↗
26. Improved students’ performance prediction for multi-class imbalanced problems using hybrid and ensemble approach in educational data mining10.1088/1742-6596/1529/5/052041 ↗
27. Predicting dropout using student- and school-level factors: An ecological perspective10.1037/spq0000152 ↗
28. Mining educational data to predict students performance10.1007/s10639-021-10575-3 ↗
29. Madni, H.A., Anwar, Z., and Shah, M.A. (2017, January 7–8). Data mining techniques and applications—A decade review. Proceedings of the International Conference on Automation and Computing (ICAC), Huddersfield, UK.10.23919/IConAC.2017.8082090 ↗
30. The WEKA data mining software: An update10.1145/1656274.1656278 ↗
31. Cenitta, D., Arjunan, R.V., and Prema, K.V. (2021, January 27–29). Missing data imputation using machine learning algorithm for supervised learning. Proceedings of the 2021 International Conference on Computer Communication and Informatics (ICCCI), Coimbatore, India.10.1109/ICCCI50826.2021.9402558 ↗
32. An Investigation of Credit Card Default Prediction in the Imbalanced Datasets10.1109/ACCESS.2020.3033784 ↗
33. Incorporation of multimodal multi objective optimization in designing a filter based feature selection technique10.1016/j.asoc.2020.106823 ↗
34. Krishnan, N., and Karthikeyan, M. (2014, January 18–20). IEEE signal processing/computational intelligence/computer joint societies chapter. Proceedings of the 2014 IEEE International Conference on Computational Intelligence and Computing Research, Coimbatore, India.
35. Salloum, S.A., Alshurideh, M., Elnagar, A., and Shaalan, K. (2020, January 9–14). Mining in educational data: Review and future directions. Proceedings of the Joint European—US Workshop on Applications of Invariance in Computer Vision, Ponta Delgada, Portugal.10.1007/978-3-030-44289-7_9 ↗
36. RHEM: A robust hybrid ensemble model for students’ performance assessment on cloud computing course
37. Musiliu, B. (2021, August 10). Single Classifiers and Ensemble Approach for Predicting Student’s Academic Performance. Available online: www.rsisinternational.org.
38. On learning algorithm selection for classification10.1016/j.asoc.2004.12.002 ↗
39. Taxonomy for characterizing ensemble methods in classification tasks: A review and annotated bibliography10.1016/j.csda.2009.07.017 ↗
40. On ensemble techniques of weight-constrained neural networks10.1007/s12530-019-09324-2 ↗
41. Fake News Detection Using Machine Learning Ensemble Methods10.1155/2020/8885861 ↗
42. TLEL: A two-layer ensemble learning approach for just-in-time defect prediction10.1016/j.infsof.2017.03.007 ↗
43. Massive LMS log data analysis for the early prediction of course-agnostic student performance10.1016/j.compedu.2020.104108 ↗
44. University Students Result Analysis and Prediction System by Decision Tree Algorithm10.25046/aj050315 ↗
45. Rank Allocation to J48 Group of Decision Tree Classifiers using Binary and Multiclass Intrusion Detection Datasets10.1016/j.procs.2018.05.186 ↗
46. An empirical comparison of voting classification algorithms: Bagging, boosting, and variants10.1023/A:1007515423169 ↗
47. An Unsupervised Ensemble Clustering Approach for the Analysis of Student Behavioral Patterns10.1109/ACCESS.2021.3049157 ↗
48. An Intelligent Prediction System for Educational Data Mining Based on Ensemble and Filtering approaches10.1016/j.procs.2020.03.358 ↗
49. A Survey on Machine Learning Techniques for Cyber Security in the Last Decade10.1109/ACCESS.2020.3041951 ↗
50. Classifier Selection and Ensemble Model for Multi-class Imbalance Learning in Education Grants Prediction10.1080/08839514.2021.1877481 ↗
51. A brief introduction to boosting
52. Dengue Fever Prediction: A Data Mining Problem
53. Predicting student academic performance using multi-model heterogeneous ensemble approach10.1108/JARHE-09-2017-0113 ↗
54. Dutta, S., and Bandyopadhyay, S.K. (2020). Forecasting of Campus Placement for Students Using Ensemble Voting Classifier. Asian J. Res. Comput. Sci., 1–12.10.9734/ajrcos/2020/v5i430138 ↗
55. Hybridization of Machine Learning Techniques in Predicting Mental Disorder
56. Wasif, M., Waheed, H., Aljohani, N.R., and Hassan, S.-U. (2019). Understanding student learning behavior and predicting their performance. Cognitive Computing in Technology-Enhanced Learning, IGI Global.10.4018/978-1-5225-9031-6.ch001 ↗
57. An appraisal of online gambling on undergraduate students’ academic performance in university of Ilorin, Nigeria
58. Application of machine learning and data mining in predicting the performance of intermediate and secondary education level student10.1007/s10639-020-10189-1 ↗
59. Alam, T.M., Mushtaq, M., Shaukat, K., Hameed, I.A., Sarwar, M.U., and Luo, S. (2021). A Novel Method for Performance Measurement of Public Educational Institutions Using Machine Learning Models. Appl. Sci., 11.10.3390/app11199296 ↗
60. Educational Data Mining: Enhancement of Student Performance model using Ensemble Methods10.1088/1757-899X/551/1/012061 ↗
61. Enhancement of Predicting Students Performance Model Using Ensemble Approaches and Educational Data Mining Techniques10.1155/2021/6241676 ↗
62. Saleem, F., Ullah, Z., Fakieh, B., and Kateb, F. (2021). Intelligent Decision Support System for Predicting Student’s E-Learning Performance Using Ensemble Machine Learning. Mathematics, 9.10.3390/math9172078 ↗