Implementation of Artificial Intelligence Technologies for the Assessment of Students’ Attentional State: A Scoping Review
Source abstract
Abstract
Artificial intelligence (AI) has recently erupted into the field of education, offering novel opportunities, particularly in the analysis of student behaviour. There is a lack of knowledge on the use of AI in assessing attention; hence, a scoping review (ScR) is proposed. The aim is to explore and analyse the scientific literature related to such implementations in educational settings. We included empirical studies published in English between 2017 and 2023, focusing on the application of AI in formal learning environments. Theoretical reviews and studies conducted outside the field of education were excluded. The databases consulted were Scopus, Web of Science, and APA PsycInfo. The studies were selected by three independent reviewers using Rayyan, and the data were organised with predefined forms and analysed using VOSviewer. A total of 26 studies were identified. Research conducted in Asia (China) was predominant, although we found significant contributions from Europe and America. The methodological approaches were primarily experimental, focusing on mechanical observation and AI-based analytical techniques. The approaches adopted and the elements common to AI applications are discussed, highlighting implications for researchers, professionals and teachers.
Source: crossref · Quality: baseline
Research context
OpenAlex topics: Technology and Human Factors in Education and Health
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
Affiliations
Department of General Teaching and Specific Teaching Methods, University of Alicante, 03690 Alicante, Spain
Department of Teaching and School Organisation, University of Murcia, 30100 Murcia, Spain
Department of Computer Science and Artificial Intelligence, University of Alicante, 03690 Alicante, Spain
Funding
Conselleria de Innovación, Universidades, Ciencia y Sociedad Digital, Generalitat Valenciana
References (71)
Show source-provided references
1. Gates, B. (2025, March 20). Gates Notes. Available online: https://www.gatesnotes.com/The-Age-of-AI-Has-Begun.
2. La personalización del aprendizaje: Estrategias de adaptación de contenido con inteligencia artificial en entornos educativos
3. González-Calatayud, V., Prendes-Espinosa, P., and Roig-Vila, R. (2021). Artificial Intelligence for Student Assessment: A Systematic review. Appl. Sci., 11.10.3390/app11125467 ↗
4. Exploring students’ experience of CHATGPT in STEM education10.1016/j.caeai.2024.100360 ↗
5. Potencialidades de la Inteligencia Artificial en Educación Superior: Un Enfoque desde la Personalización10.37843/rted.v14i1.296 ↗
6. Artificial Intelligence-Supported Student Engagement Research: Text mining and Systematic analysis10.1111/ejed.70008 ↗
7. Inteligencia Artificial en Educación Superior: Oportunidades y Riesgos
8. Giray, L. (2024). Ten Myths about Artificial Intelligence in Education. High. Learn. Res. Commun., 14.10.18870/hlrc.v14i1.1508 ↗
9. La revolución de la Inteligencia Artificial en tiempos de negacionismo tecnológico
10. Students’ Attention Monitoring System in Learning Environments based on Artificial Intelligence10.1109/TLA.2022.9662181 ↗
11. Analyzing students’ attention by gaze tracking and object detection in classroom teaching
12. Artificial intelligence-based system for detecting attention levels in students
13. Using IoT to predict student attention levels in e-learning classes: A review10.1063/5.0204934 ↗
14. Hou, C., Ai, J., Lin, Y., Guan, C., Li, J., and Zhu, W. (2022). Evaluation of online teaching quality based on facial expression recognition. Future Internet, 14.10.3390/fi14060177 ↗
15. Trabelsi, Z., Alnajjar, F., Parambil, M.M.A., Gochoo, M., and Ali, L. (2023). Real-Time Attention Monitoring System for Classroom: A deep learning approach for student’s behavior recognition. Big Data Cogn. Comput., 7.10.3390/bdcc7010048 ↗
16. Nguyen, D.D., Nguyen, X.H., Than, T., and Nguyen, M.S. (2021, January 21–22). Automated attendance system in the classroom using artificial intelligence and internet of things technology. Proceedings of the 2021 8th NAFOSTED Conference on Information and Computer Science (NICS), Hanoi, Vietnam.10.1109/NICS54270.2021.9700991 ↗
17. Parambil, M.M.A., Ali, L., Alnajjar, F., and Gochoo, M. (2022, January 21–24). Smart Classroom: A Deep Learning Approach towards Attention Assessment through Class Behavior Detection. Proceedings of the 2022 Advances in Science and Engineering Technology International Conferences (ASET), Dubai, United Arab Emirates.10.1109/ASET53988.2022.9735018 ↗
18. Martínez-Ballesté, A., Batista, E., Figueroa, E., Torruella, G.F., Llurba, C., Quiles-Rodríguez, J., Unciti, O., and Palau, R. (2024, January 2–4). A proposal for the smart classroom infrastructure using IoT and artificial intelligence. Proceedings of the 2022 IEEE 46th Annual Computers, Software, and Applications Conference (COMPSAC), Osaka, Japan.
19. Llurba, C., Fretes, G., and Palau, R. (2024). Classroom emotion monitoring based on image processing. Sustainability, 16.10.20944/preprints202401.1323.v1 ↗
20. Jeong, M., Park, J., and Oh, S.H. (2025). Cyber Environment Test Framework for Simulating Command and Control Attack Methods with Reinforcement Learning. Appl. Sci., 15.10.3390/app15042120 ↗
21. Cazorla, M., and Roig Vila, R. (2024, January 6–7). Interdisciplinary collaboration in the elaboration of datasets on Artificial Intelligence and Education. The case of MEEBAI. Proceedings of the 3rd International Congress: Education and Knowledge, Alicante, Spain.
22. Robots sociales, música y movimiento: Percepciones de las personas mayores sobre el robot Pepper para su formación (Social robots, music and movement: Older people’s perceptions of the Pepper training robot)
23. Gough, D., Oliver, S., and Thomas, J. (2017). Introduction to Systematic Reviews, Sage. [2nd ed.].10.53841/bpsptr.2017.23.2.95 ↗
24. Bibliometric studies in tourism10.1016/j.annals.2016.10.006 ↗
25. Characteristics of systematic reviews in the social sciences10.1016/j.acalib.2021.102396 ↗
26. Immersive virtual reality as a pedagogical tool in education: A systematic literature review of quantitative learning outcomes and experimental design10.1007/s40692-020-00169-2 ↗
27. Artificial intelligence-based robots in education: A systematic review of selected SSCI publications10.1016/j.caeai.2022.100091 ↗
28. The PRISMA 2020 statement: An updated guideline for reporting systematic reviews
29. Preferred reporting items for systematic reviews and meta-analyses: The PRISMA statement10.7326/0003-4819-151-4-200908180-00135 ↗
30. PRISMA extension for scoping reviews (PRISMA-ScR): Checklist and explanation10.7326/M18-0850 ↗
31. Dogan, M.E., Goru Dogan, T., and Bozkurt, A. (2023). The Use of Artificial Intelligence (AI) in Online Learning and Distance Education Processes: A Systematic Review of Empirical Studies. Appl. Sci., 13.10.3390/app13053056 ↗
32. A tale of two databases: The use of Web of Science and Scopus in academic papers10.1007/s11192-020-03387-8 ↗
33. Google Scholar, Microsoft Academic, Scopus, Dimensions, Web of Science, and OpenCitations’ COCI: A multidisciplinary comparison of coverage via citations10.1007/s11192-020-03690-4 ↗
34. From print to digital (1985–2015): APA’s evolving role in psychological publishing10.1037/amp0000229 ↗
35. The dominance of English in the international scientific periodical literature and the future of language use in science10.1075/aila.20.06ham ↗
36. Ramıírez-Castañeda, V. (2020). Disadvantages in preparing and publishing scientific papers caused by the dominance of the English language in science: The case of Colombian researchers in biological sciences. PLoS ONE, 15.10.1101/2020.02.15.949982 ↗
37. Rayyan—A web and mobile app for systematic reviews10.1186/s13643-016-0384-4 ↗
38. Software survey: VOSviewer, a computer program for bibliometric mapping10.1007/s11192-009-0146-3 ↗
39. Yu, L.H., and Yu, Z.G. (2023). Qualitative and quantitative analyses of artificial intelligence ethics in education using VOSviewer and CitNetExplorer. Front. Psychol., 14.10.3389/fpsyg.2023.1061778 ↗
40. Danese, M., and Gioia, D. (2021). Spatial Analysis for Landscape Changes: A Bibliometric Review. Appl. Sci., 11.10.3390/app112110078 ↗
41. The revised JBI critical appraisal tool for the assessment of risk of bias quasi-experimental studies10.11124/JBIES-23-00268 ↗
42. Measuring the differences between traditional learning and game-based learning using electroencephalography (EE) physiologically based methodology
43. Characterizing attentive behavior in intelligent environments10.1016/j.neucom.2017.05.091 ↗
44. Intelligent tutoring system to improve learning outcomes10.3233/AIC-190624 ↗
45. How Does Prior Knowledge Influence Eye Fixations and Sequences of Cognitive and Metacognitive SRL Processes during Learning with an Intelligent Tutoring System?10.1007/s40593-018-0165-4 ↗
46. Liang, J.M., Su, W.C., Chen, Y.L., Wu, S.L., and Chen, J.J. (2019). Smart Interactive Education System Based on Wearable Devices. Sensors, 19.10.3390/s19153260 ↗
47. Associating Facial Expressions and Upper-Body Gestures with Learning Tasks for Enhancing Intelligent Tutoring Systems10.1007/s40593-020-00195-2 ↗
48. Serrano-Mamolar, A., Arevalillo-Herráez, M., Chicote-Huete, G., and Boticario, J.G. (2021). An Intra-Subject Approach Based on the Application of HMM to Predict Concentration in Educational Contexts from Nonintrusive Physiological Signals in Real-World Situations. Sensors, 21.10.20944/preprints202101.0039.v1 ↗
49. A study on posture-based teacher-student behavioral engagement pattern10.1016/j.scs.2021.102749 ↗
50. Araya, R., and Sossa-Rivera, J. (2021). Automatic Detection of Gaze and Body Orientation in Elementary School Classrooms. Front. Robot. AI, 8.10.3389/frobt.2021.729832 ↗
51. Gao, Q., and Tan, Y. (2022). Impact of Different Styles of Online Course Videos on Students’ Attention During the COVID-19 Pandemic. Front. Public Health, 10.10.3389/fpubh.2022.858780 ↗
52. Analysis and Research on the Characteristics of Modern English Classroom
53. Villegas-Ch., W., García-Ortiz, J., Urbina-Camacho, I., and Mera-Navarrete, A. (2023). Proposal for a System for the Identification of the Concentration of Students Who Attend Online Educational Models. Computers, 12.10.3390/computers12040074 ↗
54. Inferring Students’ Self-Assessed Concentration Levels in Daily Life Using Biosignal Data From Wearables10.1109/ACCESS.2023.3260061 ↗
55. Ma, Y., Wei, Y., Shi, Y., Li, X., Tian, Y., and Zhao, Z. (2023). Online Learning Engagement Recognition Using Bidirectional Long-Term Recurrent Convolutional Networks. Sustainability, 15.10.3390/su15010198 ↗
56. Student Action Recognition for Improving Teacher Feedback During Tele-Education10.1109/TLT.2023.3301094 ↗
57. Characteristic Behaviors of Elementary Students in a Low Attention State During Online Learning Identified Using Electroencephalography10.1109/TLT.2023.3289498 ↗
58. Attention monitoring of students during online classes using XGBoost classifier10.1016/j.caeai.2023.100191 ↗
59. Simonetti, I., Tamborra, L., Giorgi, A., Ronca, V., Vozzi, A., Aricò, P., Borghini, G., Sciaraffa, N., Trettel, A., and Babiloni, F. (2023). Neurophysiological Evaluation of Students’ Experience during Remote and Face-to-Face Lessons: A Case Study at Driving School. Brain Sci., 13.10.3390/brainsci13010095 ↗
60. Alkabbany, I., Ali, A.M., Foreman, C., Tretter, T., Hindy, N., and Farag, A. (2023). An Experimental Platform for Real-Time Students Engagement Measurements from Video in STEM Classrooms. Sensors, 23.10.3390/s23031614 ↗
61. Emotion recognition in learning scenes supported by smart classroom and its application10.18280/ts.400235 ↗
62. Hasnine, M.N., Nguyen, H.T., Tran, T.T.T., Bui, H.T.T., Akçapınar, G., and Ueda, H. (2023). A Real-Time Learning Analytics Dashboard for Automatic Detection of Online Learners’ Affective States. Sensors, 23.10.3390/s23094243 ↗
63. Wang, Z., Yao, J., Zeng, C., Li, L., and Tan, C. (2023). Students’ Classroom Behavior Detection System Incorporating Deformable DETR with Swin Transformer and Light-Weight Feature Pyramid Network. Systems, 11.10.3390/systems11070372 ↗
64. Difficulty level moderates the effects of another’s presence as spectator or co-actor on learning from video lectures10.1007/s11423-023-10256-7 ↗
65. Mudawi, N.A., Pervaiz, M., Alabduallah, B.I., Alazeb, A., Alshahrani, A., Alotaibi, S.S., and Jalal, A. (2023). Predictive Analytics for Sustainable E-Learning: Tracking Student Behaviors. Sustainability, 15.10.3390/su152014780 ↗
66. The retrospective pre-post: A practical method to evaluate learning from an educational program10.1111/j.1553-2712.2011.01270.x ↗
67. Field mapping of knowledge in entrepreneurial intentions through analysis of social knowledge network
68. Mapping knowledge structure by keyword co-occurrence: A first look at journal papers in Technology Foresight10.1007/s11192-010-0259-8 ↗
69. Brickenkamp, R., and Zilmer, E. (1998). The d2 Test of Attention (d2), Hogrefe and Huber Publishers.10.1037/t03299-000 ↗
70. Artificial intelligence in education: The three paradigms10.1016/j.caeai.2021.100020 ↗
71. Two Decades of Artificial Intelligence in Education: Contributors, Collaborations, Research Topics, Challenges, and Future Directions