journal article·2024-08-09Open access

Using Integrated Multimodal Technology: A Way to Personalise Learning in Health Science and Biomedical Engineering Students

María Consuelo Sáiz-Manzanares, Raúl Marticorena-Sánchez, María Camino Escolar-Llamazares, Irene González-Díez, Luis Jorge Martín-Antón

Applied Sciences· Volume 14· Issue 16

Abstract

Monitoring the learning process during task solving through different channels will facilitate a better understanding of the learning process. This understanding, in turn, will provide teachers with information that will help them to offer individualised education. In the present study, monitoring was carried out during the execution of a task applied in a self-regulated virtual environment. The data were also analysed using data fusion techniques. The objectives were as follows: (1) to examine whether there were significant differences between students in cognitive load (biomarkers: fixations, saccades, pupil diameter, galvanic skin response—GSR), learning outcomes and perceived student satisfaction with respect to the type of degree (health sciences vs. engineering; and (2) to determine whether there were significant differences in cognitive load metrics, learning outcomes and perceived student satisfaction with respect to task presentation (visual and auditory vs. visual). We worked with a sample of 31 university students (21 health sciences and 10 biomedical engineering). No significant differences were found in the biomarkers (fixations, saccades, pupil diameter and GSR) or in the learning outcomes with respect to the type of degree. Differences were only detected in perceived anxiety regarding the use of virtual laboratories, being higher in biomedical engineering students. Significant differences were detected in the biomarkers of the duration of use of the virtual laboratory and in some learning outcomes related to the execution and presentation of projects with respect to the variable form of the visualisation of the laboratory (visual and auditory vs. visual). Also, in general, the use of tasks presented in self-regulated virtual spaces increased learning outcomes and perceived student satisfaction. Further studies will delve into the detection of different forms of information processing depending on the form of presentation of learning tasks.
Source: crossref · Quality: baseline

Research context

OpenAlex topics: Visual and Cognitive Learning Processes · Learning Styles and Cognitive Differences · Innovative Teaching and Learning Methods

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

DATAHES Research Group, UIC Nº 348 JCYL, Department of Health Sciences, Faculty of Health Sciences, University of Burgos, 09001 Burgos, Spain

ADMIRABLE Research Group, Department of Computer Engineering, Higher Polytechnic School, University of Burgos, 09006 Burgos, Spain

DATAHES Research Group, Department of Health Sciences, Faculty of Health Sciences, University of Burgos, 09001 Burgos, Spain

GIR Nº 179 Educational Psychology Research Group, UIC Nº 348 JCYL, Department of Psychology, Faculty of Education and Social Work, University of Valladolid, 47011 Valladolid, Spain

Funding

MINISTRY OF SCIENCE AND INNOVATION AND UNIVERSITIES. STATE RESEARCH AGENCY. Government of Spain · EUROPEAN COMMISSION

References (41)

Show source-provided references
1. Using Eye Tracking Technology to Analyse Cognitive Load in Multichannel Activities in University Students10.1080/10447318.2023.2188532 ↗
2. La mesure de la réaction électrodermale10.1016/j.encep.2011.05.004 ↗
3. A review on data fusion in multimodal learning analytics and educational data mining10.1002/widm.1458 ↗
4. The use of eye tracking technology to explore learning and performance within virtual reality and mixed reality settings: A scoping review10.1080/10494820.2019.1702560 ↗
5. Targeted transfer learning through distribution barycenter medium for intelligent fault diagnosis of machines with data decentralization10.1016/j.eswa.2023.122997 ↗
6. Scoping Review of Bioelectrical Signals Uses in Videogames for Evaluation Purposes10.1109/ACCESS.2022.3213070 ↗
7. Capturing patterns of learners’ self-regulatory interactions with instructional material during game-based learning with auto-recurrence quantification analysis10.3389/fpsyg.2022.813677 ↗
8. Exploring multiuser virtual teaching simulation as an alternative learning environment for student instructors10.1007/s11251-021-09555-4 ↗
9. Sáiz-Manzanares, M.C., and Marticorena-Sánchez, R. (2024). Manual for the Development of Self-Regulated Virtual Laboratories, Servicio de Publicaciones de la Universidad de Burgos.
10. The Impact of Contextualized Emotions on Self-Regulated Learning and Scientific Reasoning during Learning with a Game-Based Learning Environment10.1007/s40593-019-00191-1 ↗
11. How Does Prior Knowledge Influence Eye Fixations and Sequences of Cognitive and Metacognitive SRL Processes during Learning with an Intelligent Tutoring System?10.1007/s40593-018-0165-4 ↗
12. The effect of portfolio-based education and evaluation on clinical competence of nursing students: A pretest–posttest quasiexperimental crossover study10.2147/AMEP.S231760 ↗
13. Flipped laboratory classes: Student performance and perceptions in undergraduate food science and technology10.1111/1541-4329.12235 ↗
14. A three-step model for the gamification of training and automaticity acquisition10.1111/jcal.12539 ↗
15. Introducing support for learner control: Temporal and organizational cues in instructional videos10.1111/bjet.13408 ↗
16. A Multisensor Interface to Improve the Learning Experience in Arc Welding Training Tasks10.1109/THMS.2023.3251955 ↗
17. Frasson, C., Mylonas, P., and Troussas, C. (2023). Distraction Detection and Monitoring Using Eye Tracking in Virtual Reality. Augmented Intelligence and Intelligent Tutoring Systems, Springer Nature.10.1007/978-3-031-32883-1 ↗
18. Gaze-enabled activity recognition for augmented reality feedback10.1016/j.cag.2024.103909 ↗
19. Lee, B.-C., Choi, J., Ahn, J., and Martin, B.J. (2024). The different contributions of the eight prefrontal cortex subregions to reactive responses after unpredictable slip perturbations and vibrotactile cueing. Front. Hum. Neurosci., 17.10.3389/fnhum.2023.1236065 ↗
20. Gaze-based human intention prediction in the hybrid foraging search task10.1016/j.neucom.2024.127648 ↗
21. Direct voluntary control of pupil constriction and dilation: Exploratory evidence from pupillometry, optometry, skin conductance, perception, and functional MRI10.1016/j.ijpsycho.2021.08.001 ↗
22. The effect of flight phase on electrodermal activity and gaze behavior: A simulator study10.1016/j.apergo.2023.103989 ↗
23. In robot we trust? The effect of emotional expressions and contextual cues on anthropomorphic trustworthiness10.1016/j.apergo.2023.103967 ↗
24. An optimized deep convolutional neural network for adaptive learning using feature fusion in multimodal data10.1016/j.dajour.2023.100277 ↗
25. Analysing domain-specific problem-solving processes within authentic computer-based learning and training environments by using eye-tracking: A scoping review10.1186/s40461-023-00140-2 ↗
26. Measuring self-regulated learning and the role of AI: Five years of research using multimodal multichannel data10.1016/j.chb.2022.107540 ↗
27. What multimodal data can tell us about the students’ regulation of their learning process?10.1016/j.learninstruc.2019.04.004 ↗
28. Mu, S., Cui, M., and Huang, X. (2020). Multimodal Data Fusion in Learning Analytics: A Systematic Review. Sensors, 20.10.3390/s20236856 ↗
29. Machine learning for cognitive behavioral analysis: Datasets, methods, paradigms, and research directions10.1186/s40708-023-00196-6 ↗
30. Multimodal data fusion using sparse canonical correlation analysis and cooperative learning: A COVID-19 cohort study10.1038/s41746-024-01128-2 ↗
31. Advancing SRL research with artificial intelligence10.1016/j.chb.2023.107847 ↗
32. Academic development of multimodal learning analytics: A bibliometric analysis10.1080/10494820.2021.1936075 ↗
33. Measuring cognitive load in augmented reality with physiological methods: A systematic review10.1111/jcal.12882 ↗
34. EM-COGLOAD: An investigation into age and cognitive load detection using eye tracking and deep learning10.1016/j.csbj.2024.03.014 ↗
35. Interaction recognition and intervention based on context feature fusion of learning behaviors in interactive learning environments10.1080/10494820.2021.1871632 ↗
36. Cognitive load theory and individual differences10.1016/j.lindif.2024.102423 ↗
37. Hernández Armenteros, J., Pérez-García, J.A., and Furió Párraga, B. (2019). La Universidad Española en cifras. Informe 2017/2018, CRUE. Available online: https://www.crue.org/wp-content/uploads/2020/02/UEC-1718_FINAL_DIGITAL.pdf.
38. Campbell, D.F. (2005). Diseños Experimentales y Cuasiexperimentales en la Investigación Social [Experimental and Quasiexperimental Designs for Research], Amorrortu. [9th ed.].
39. Pallant, J. (2016). SPSS Survival Manual, Open University Press. [6th ed.].
40. IBM Corp. (2024). SPSS Statistical Package for the Social Sciences (SPSS), IBM Corp.. [28th ed.].
41. Orange: Data Mining Toolbox in Python