journal article·2024-08-29Open access

Work Route for the Inclusion of Learning Analytics in the Development of Interactive Multimedia Experiences for Elementary Education

Andrés Solano, Carlos Alberto Peláez, Johann A. Ospina, Huizilopoztli Luna-García, Jorge Andrick Parra, Gabriel Mauricio Ramírez, Fernando Moreira, Jesús Alfonso López Sotelo, Klinge Orlando Villalba-Condori

Applied Sciences· Volume 14· Issue 17

Abstract

Interactive multimedia experiences (IME) can be a pedagogical resource that has a strong potential to enhance learning experiences in early childhood. Learning analytics (LA) has become an important tool that allows us to understand more clearly how these multimedia experiences can contribute to the learning processes of these students. This article proposes a work route that defines a set of activities and techniques, as well as a flow for their application, by taking into consideration the importance of including LA guidelines when designing IMEs for elementary education. The work route’s graphical representation is inspired by the foundations of the Essence standard’s graphical notation language. The guidelines are grouped into five categories, namely (i) a data analytics dashboard, (ii) student data, (iii) teacher data, (iv) learning activity data, and (v) student progress data. The guidelines were validated through two approaches. The first involved a case study, where the guidelines were applied to an IME called Coco Shapes, which was aimed at transition students at the Colegio La Fontaine in Cali (Colombia), and the second involved the judgments of experts who examined the usefulness and clarity of the guidelines. The results from these approaches allowed us to obtain precise and effective feedback regarding the hypothesis under study. Our findings provide promising evidence of the value of our guidelines, which were included in the design of an IME and contributed to the greater personalized monitoring available to teachers to evaluate student learning.
Source: crossref · Quality: baseline

Research context

OpenAlex topics: Online Learning and Analytics · E-Learning and Knowledge Management · Educational Innovations and Technology

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

Facultad de Ingeniería y Ciencias Básicas, Universidad Autónoma de Occidente, Cali 760030, Colombia

Unidad Académica de Ingeniería Eléctrica, Universidad Autónoma de Zacatecas, Jardín Juarez 147, Centro, Zacatecas 98000, Mexico

Facultad de Ingeniería, Universidad Autónoma de Bucaramanga, Bucaramanga 680006, Colombia

Facultad de Ingenierías, Universidad de Medellín, Medellín 050010, Colombia

Research on Economics, Management and Information Technologies, Universidade Portucalense, 4200-072 Porto, Portugal

Universidad Nacional Pedro Henríquez Ureña, Santo Domingo 1423, Dominican Republic

Funding

Vicerrectorado de Investigación Universidad Nacional Pedro Henríquez Ureña, Santo Domingo, República Dominicana · Laboratorio de Tecnologías Interactivas y Experiencia de Usuario, Universidad Autónoma de Zacatecas, México

References (57)

Show source-provided references
1. Proposal to Conceive Multimedia Systems from a Value Creation Perspective and a Collaborative Work Routes Approach
2. Siemens, G., Gasevic, G., Haythornthwaite, C., Dawson, S., Buckingham, S., Ferguson, R., and Baker, R. (2011). Open Learning Analytics: An Integrated & Modularized Platform. [Ph.D. Dissertation, Open University Press].
3. Peláez, C.A., Solano, A., De La Rosa, E.A., López, J.A., Parra, J.A., Ospina, J.A., Ramírez, G.M., and Moreira, F. (2023, January 23–28). Learning analytics in the design of interactive multimedia experiences for elementary education: A systematic review. Proceedings of the XXIII International Conference on Human Computer Interaction, Copenhagen, Denmark.10.1145/3612783.3612785 ↗
4. Cassano, F., Piccinno, A., Roselli, T., and Rossano, V. (2019). Gamification and learning analytics to improve engagement in university courses. Methodologies and Intelligent Systems for Technology Enhanced Learning, 8th International Conference 8, Springer International Publishing.10.1007/978-3-319-98872-6_19 ↗
5. Srinivasa, K., and Muralidhar, K. (2021). A Beginer’s Guide to Learning Analytics, Springer.
6. How do preschoolers interact with peers? Characterising child and group behaviour in games with tangible interfaces in school10.1016/j.ijhcs.2022.102849 ↗
7. AI in education and learning analytics in Singapore: An overview of key projects and initiatives
8. Setting learning analytics in context: Overcoming the barriers to large-scale adoption10.18608/jla.2014.13.7 ↗
9. Bobek, V., and Horvat, T. (2023). Technological Adoption in Emerging Economies: Insights from Latin America and the Caribbean with a Focus on Low-Income Consumers. New Topics in Emerging Markets, IntechOpen.
10. Wise, A. (2014, January 24–28). Designing pedagogical interventions to supportstudent use of learning analytics. Proceedings of the Fourth International Conference on Learning Analytics and Knowledge, Indianapolis, IN, USA.10.1145/2567574.2567588 ↗
11. Manyukhina, Y., and Wise, D. (2024, July 26). British Educational Research Association, BERA. Retrieved from Children’s Agency: What Is It, and What should Be Done?. 2021, Available online: https://www.bera.ac.uk/blog/childrens-agency-what-is-it-and-what-should-be-done.
12. Design science in information systems research10.2307/25148625 ↗
13. Object Management Group (2018). Essence–Kernel and Language for Software Engineering Methods, OMG.
14. Peláez, C.A., and Solano, A. (2023). A Practice for the Design of Interactive Multimedia Experiences Based on Gamification: A Case Study in Elementary Education. Sustainability, 15.10.3390/su15032385 ↗
15. Give me a customizable dashboard: Personalized learning analytics dashboards in higher education10.1007/s10758-017-9316-1 ↗
16. Relationship between the multimedia technology and education in improving learning quality10.1016/j.sbspro.2013.07.102 ↗
17. Multimedia tools in the teaching and learning processes: A systematic review10.1016/j.heliyon.2020.e05312 ↗
18. Departamento Administrativo Nacional de Estadística—DANE (2020). Educación, Ciencia, Tecnología e Innovación—ECTeI—Reporte Estadístico No.1.
19. Portulans Institute, University of Oxford, and Saïd Business School (2023, April 27). Network Readiness Index 2022. (Countries Benchmarking the Future of the Network Economy). Available online: https://networkreadinessindex.org/countries/.
20. Qudrat-Ullah, H. (2023). Learning Analytics and Interactive Multimedia Experience in Enhancing Student Learning Experience: A Systemic Approach. Complex Tasks with Systems Thinking, Springer Nature.10.1007/978-3-031-40635-5 ↗
21. Budiarto, F., and Jazuli, A. (2021, January 19). Interactive Learning Multimedia Improving Learning Motivation Elementary School Students. Proceedings of the ICONESS 2021: Proceedings of the 1st International Conference on Social Sciences, Purwokerto, Indonesia.10.4108/eai.19-7-2021.2312497 ↗
22. Learning design and learning analytics: Snapshot 202010.18608/jla.2020.73.2 ↗
23. Dabbebi, I., Gilliot, J., and Iksal, S. (2019, January 2–4). User centered approach for learning analytics dashboard generation. Proceedings of the CSEDU 2019: 11th International Conference on Computer Supported Education, Heraklion, Crete, Greece.
24. Development of learning analytics dashboard based on model learning management system
25. Intelligent Learning Analytics Dashboards: Automated Drill-Down Recommendations to Support Teacher Data Exploration10.18608/jla.2021.7279 ↗
26. Designing in Context: Reaching Beyond Usability in Learning Analytics Dashboard Design
27. Chicaiza, J., Cabrera-Loayza, M., Elizalde, R., and Piedra, N. (2020, January 7–12). Application of data anonymization in Learning Analytics. Proceedings of the 3rd International Conference on Applications of Intelligent Systems, Las Palmas de Gran Canaria, Spain.10.1145/3378184.3378229 ↗
28. Assessment of the influence of adaptive E-learning on learning effectiveness of primary school pupils10.1016/j.chb.2018.05.033 ↗
29. Dimitriadis, Y., Martínez, R., and Wiley, K. (2021). Human-centered design principles for actionable learning analytics. Research on E-Learning and ICT in Education: Technological, Pedagogical and Instructional Perspectives, Springer.10.1007/978-3-030-64363-8_15 ↗
30. Hallifax, S., Serna, A., Marty, J.C., and Lavoué, É. (2019, January 16–19). Adaptive gamification in education: A literature review of current trends and developments. Proceedings of the 14th European Conference on Technology Enhanced Learning, EC-TEL 2019, Delft, The Netherlands.10.1007/978-3-030-29736-7_22 ↗
31. How different are students and their learning styles?10.5455/2320-6012.ijrms20130808 ↗
32. Learning through multimedia: Speech recognition enhancing accessibility and interaction
33. Heimgärtner, R. (2012). Cultural Differences in Human-Computer Interaction: Towards Culturally Adaptive Human-Machine Interaction, Oldenbourg Wissenschaftsverlag Verlag.10.1524/9783486719895 ↗
34. Farah, J.C., Moro, A., Bergram, K., Purohit, A.K., Gillet, D., and Holzer, A. (2020, January 14–18). Bringing computational thinking to non-STEM undergraduates through an integrated notebook application. Proceedings of the 15th European Conference on Technology Enhanced Learning, Heidelberg, Germany.
35. Naranjo, D.M., Prieto, J.R., Moltó, G., and Calatrava, A. (2019). A visual dashboard to track learning analytics for educational cloud computing. Sensors, 19.10.3390/s19132952 ↗
36. Papamitsiou, Z., Giannakos, M.N., and Ochoa, X. (2020, January 23–27). From childhood to maturity: Are we there yet? Mapping the intellectual progress in learning analytics during the past decade. Proceedings of the Tenth International Conference on Learning Analytics & Knowledge, Frankfurt, Germany.10.1145/3375462.3375519 ↗
37. Kumar, V. (2012). 101 Design Methods: A Structured Approach for Driving Innovation in Your Organization, John Wiley & Sons.
38. IDEO (2011). Human Centered Design Toolkit, IDEO.
39. A survey of value sensitive design methods10.1561/1100000015 ↗
40. Pressman, R., and Maxim, B. (2015). Software Engineering. A Practitioner’s Approach, Mc Graw Hill.
41. ISACA (2012). COBIT 5: A Business Framework for the Governance and Management of Enterprise IT, ISACA.
42. A design science research methodology and its application to accounting information systems research10.1016/j.accinf.2011.02.004 ↗
43. MMALA: Developing and Evaluating a Maturity Model for Adopting Learning Analytics10.18608/jla.2024.8099 ↗
44. FoLA 2—A Method for Co-Creating Learning Analytics-Supported Learning Design10.18608/jla.2022.7643 ↗
45. A multilevel framework and method for learning analytics integrated learning design10.18608/jla.2020.73.8 ↗
46. Design principles for learning analytics information systems in higher education10.1080/0960085X.2020.1816144 ↗
47. Distinguishing and contrasting two strategies for design science research10.1057/ejis.2013.35 ↗
48. A design science research methodology for information systems research10.2753/MIS0742-1222240302 ↗
49. Hollander, M., and Wolfe, D. (1999). Solutions Manual to Accompany: Nonparametric Statistical Methods, Wiley.
50. Wasserman, L. (2006). All of Nonparametric Statistics, Springer Science & Business Media.
51. Pérez, E. (2011). Mágenes Sobre la Universidad del Valle: Versiones de Diversos Sectores Sociales. Estudio Regional y Nacional, Universidad del Valle.
52. Examining perceptions and attitudes: A review of Likert-type scales versus Q-methodology10.1177/0193945916661302 ↗
53. R Core Team (2022). R: A Language and Environment for Statistical Computing, Foundation for Statistical Computing.
54. Jockers, M.L., and Thalken, R. (2020). Text Analysis with R, Springer International Publishing.10.1007/978-3-030-39643-5 ↗
55. Little, R.J., and Rubin, D.B. (2019). Statistical Analysis with Missing Data, John Wiley & Sons.10.1002/9781119482260 ↗
56. Mohammad, S., and Turney, P. (2010, January 5). Emotions evoked by common words and phrases: Using mechanical turk to create an emotion lexicon. Proceedings of the NAACL HLT 2010 Workshop on Computational Approaches to Analysis and Generation of Emotion in Text, Los Angeles, CA, USA.
57. Field, A., Miles, J., and Field, Z. (2017). Discovering Statistics Using R, W. Ross MacDonald School Resource Services Library.