journal article·2026-06-24Open access

Predicting Student Engagement Characteristics Using a Multi-Instance Localization Approach with a Gradient-Boosted Deep LSTM Classifier

Henda Adgaeg, Muesser Nat

Applied Sciences· Volume 16· Issue 13

Abstract

The prediction of student engagement characteristics involves forecasting and analyzing student interaction with educational materials using engagement prediction models. This process encompasses the prediction of cognitive, behavioral, and emotional dimensions of engagement. The existing student engagement prediction models have some limitations, including poor convergence, less generalizability, complexity issues, overfitting, false errors, and limited resources. Hence, the research proposes the Multi-Instance Localization-based Gradient Boosted Long Short-Term Memory (MIL-GBLTM) model to tackle the challenge of predicting student engagement characteristics in online classes. The integration of effective MIL with a Triplet Attention mechanism focuses on the significant features that help with engagement prediction; LSTM layers capture intricate sequential patterns, and fractional gradient boosting is used for fine-tuning for accurate prediction, alongside ensemble-based learning. The LSTM layers with the Triplet Attention module refine temporal attention, and Fractional Gradient Boosting ensures the model’s adaptability and robustness. By combining these components, the proposed model is able to predict accurate student engagement with high convergence. This integrated approach enhances the capabilities of engagement prediction models in educational contexts, facilitating more effective interventions and personalized student support in online learning environments. Experimental results demonstrate that the proposed MIL-GBLTM model outperforms other existing models by achieving the highest accuracy of 96.55% with a k-fold of 10, utilizing the wacv2016 dataset.
Source: crossref · Quality: baseline

Research context

OpenAlex topics: Online Learning and Analytics · Intelligent Tutoring Systems and Adaptive Learning · Mental Health via Writing

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

Department of Management Information Systems, School of Applied Sciences, Cyprus International University, Mersin 99258, Turkey

References (37)

Show source-provided references
1. Allen, I.E., and Seaman, J. (2015). Grade level. Tracking Online Education in the United States, Quahog Research Group, LLC.
2. Terry, A. (2008). The Theory and Practice of Online Learning, Athabasca University.
3. Rossett, A. (2002). The Forum Report: E-Learning Adoption Rates and Barriers. ASTD E-Learning Handbook, McGraw-Hill.
4. Bates, A.W. (1997). Restructuring the University for Technological Change. Carnegie Foundation for the Advancement of Teaching What Kind University, The University of British Columbia.
5. Predicting student dropout in subscription-based online learning environments: The beneficial impact of the logit leaf model10.1016/j.dss.2020.113325 ↗
6. Student engagement predictions in an e-learning system and their impact on student course assessment scores10.1155/2018/6347186 ↗
7. Sharma, P., Joshi, S., Gautam, S., Maharjan, S., Khanal, S.R., Reis, M.C., Arroso, B.J., and de Jesus Filipe, V.M. (2022). Student engagement detection using emotion analysis, eye tracking and head movement with machine learning. International Conference on Technology and Innovation in Learning, Teaching and Education, Springer Nature.10.1007/978-3-031-22918-3_5 ↗
8. Emotion-induced engagement in Internet video advertisements
9. Personality traits and intelligence predict academic school grades10.1016/j.lindif.2008.02.001 ↗
10. Facial emotion recognition based real-time learner engagement detection system in online learning context using deep learning models10.1007/s11042-022-13558-9 ↗
11. Multimodal engagement analysis from facial videos in the classroom
12. A multimodal facial cues-based engagement detection system in e-learning context using deep learning approach10.1007/s11042-023-14392-3 ↗
13. Advanced, analytic, automated (AAA) measurement of engagement during learning10.1080/00461520.2017.1281747 ↗
14. Students engagement level detection in online e-learning using hybrid efficientnetb7 together with TCN, LSTM, and Bi-LSTM10.1109/ACCESS.2022.3206779 ↗
15. Using machine learning to predict student difficulties from learning session data10.1007/s10462-018-9620-8 ↗
16. Combining supervised and unsupervised machine learning algorithms to predict the learners’ learning styles10.1016/j.procs.2019.01.012 ↗
17. Predicting at-risk students at different percentages of course length for early intervention using machine learning models10.1109/ACCESS.2021.3049446 ↗
18. Automated detection of engagement using video-based estimation of facial expressions and heart rate10.1109/TAFFC.2016.2515084 ↗
19. Kaur, A., Mustafa, A., Mehta, L., and Dhall, A. (2018). Prediction and localization of student engagement in the wild. 2018 Digital Image Computing: Techniques and Applications (DICTA), IEEE.10.1109/DICTA.2018.8615851 ↗
20. Deep facial spatiotemporal network for engagement prediction in online learning10.1007/s10489-020-02139-8 ↗
21. Neural network model for video-based analysis of student’s emotions in e-learning10.3103/S1060992X22030055 ↗
22. Application of deep learning on student engagement in e-learning environments10.1016/j.compeleceng.2021.107277 ↗
23. Three-dimensional DenseNet self-attention neural network for automatic detection of student’s engagement10.1007/s10489-022-03200-4 ↗
24. Classifying emotions and engagement in online learning based on a single facial expression recognition neural network10.1109/TAFFC.2022.3188390 ↗
25. ATL-BP: A student engagement dataset and model for affect transfer learning for behavior prediction10.1109/TBIOM.2022.3210479 ↗
26. Villegas-Ch, W., Román-Cañizares, M., and Palacios-Pacheco, X. (2020). Improvement of an online education model with the integration of machine learning and data analysis in an LMS. Appl. Sci., 10.10.3390/app10155371 ↗
27. Student behavior analysis to measure engagement levels in online learning environments10.1007/s11760-021-01869-7 ↗
28. Yang, Y., Hooshyar, D., Pedaste, M., Wang, M., Huang, Y.-M., and Lim, H. (2020). Prediction of students’ procrastination behavior through their submission behavioral pattern in online learning. J. Ambient Intell. Humaniz. Comput., 1–18.10.1007/s12652-020-02041-8 ↗
29. Using machine learning to predict student retention from socio-demographic characteristics and app-based engagement metrics10.1038/s41598-023-32484-w ↗
30. Shiri, F.M., Perumal, T., Mustapha, N., and Mohamed, R. (2023). A comprehensive overview and comparative analysis on deep learning models: CNN, RNN, LSTM, GRU. arXiv.
31. Automatic detection of students’ engagement during online learning: A bagging ensemble deep learning approach10.1109/ACCESS.2024.3425820 ↗
32. (2026, January 01). Student Engagement Dataset. Available online: https://www.kaggle.com/datasets/joyee19/studentengagement/data.
33. Gupta, A., D’Cunha, A., Awasthi, K., and Balasubramanian, V. (2026, January 01). DAiSEE Dataset. Available online: https://people.iith.ac.in/vineethnb/resources/daisee/index.html.
34. (2026, January 01). wacv2016 Dataset Link. Available online: https://github.com/e-drishti/wacv2016/tree/master/dataset.
35. Optimizing student engagement in edge-based online learning with advanced analytics10.1016/j.array.2023.100301 ↗
36. Multimodal engagement recognition from image traits using deep learning techniques10.1109/ACCESS.2024.3353053 ↗
37. Alarefah, W., Jarraya, S.K., and Abuzinadah, N. (2025). Transformer-Based Student Engagement Recognition Using Few-Shot Learning. Computers, 14.10.3390/computers14030109 ↗