E-Assessment in E-Learning Degrees: Comparison vs. Face-to-Face Assessment through Perceived Stress and Academic Performance in a Longitudinal Study
Source abstract
Abstract
The COVID-19 pandemic has become both a challenge and an opportunity to implement certain changes in the world of education. One of the most important differences has been online evaluation, which had, until now, been marginal in most prestigious universities. This study compared the academic achievement of the last cohort that performed classroom assessment and the first group that was graded for an official degree using synchronous online evaluation. Other variables measured were the self-assessment of students in this second group, in order to understand how it affected their perception of the process using three different indicators: stress, difficulty, and fairness. Nine hundred and nineteen students participated in the study. The results indicate that online assessment resulted in grades that were 10% higher while enjoying the same degree of validity and reliability. In addition, stress and difficulty levels were also in line with the on-site experience, as was the perception that the results were fair. The results allow us to conclude that online evaluation, when proctored, provides the same guarantees as desktop exams, with the added bonus of certain advantages which strongly support their continued use, especially in degrees with many students who may come from many different locations.
Source: crossref · Quality: baseline
Research context
OpenAlex topics: Student Assessment and Feedback · Online Learning and Analytics · Innovative Teaching Methods
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
Affiliations
Department of Education, Faculty of Social Sciences and Applied Languages, Villanueva de la Cañada, Alfonso X the Wise University, 28691 Madrid, Spain
References (67)
Show source-provided references
1. The Debate on Learning Assessments in Developing Countries10.1080/03057925.2012.670480 ↗
2. Participation in Cross-National Learning Assessments and Impact on Capacity Development: Programmes, Practice, Structures and Teacher Competency. Case Study of Kenya, Tanzania and South Africa10.1016/j.evalprogplan.2017.07.003 ↗
3. Pisani, L., Borisova, I., and Dowd, A.J. (2015). International Development and Early Learning Assessment Technical Working Paper, Save the Children.
4. Wagner, D.A. (2017). Learning as Development: Rethinking International Education in a Changing World, Routledge.10.4324/9780203115305 ↗
5. Lockheed, M. (2008). Measuring Progress with Tests of Learning: Pros and Cons for “Cash on Delivery Aid” in Education. SSRN J., 147.10.2139/ssrn.1213162 ↗
6. Introduction: Assessment as a Tool for Learning10.1016/S0191-491X(97)86211-6 ↗
7. The Impact of Assessment on Student LearningHow Can the Research Literature Practically Help to Inform the Development of Departmental Assessment Strategies and Learner-Centred Assessment Practices?10.1177/1469787402003002004 ↗
8. Research, Teaching and Performance Evaluation in Academia: The Salience of Quality10.1080/03075079.2015.1104659 ↗
9. Authentic Assessment: Creating a Blueprint for Course Design10.1080/02602938.2017.1412396 ↗
10. Counting and Comparing School Performance: An Analysis of Media Coverage of PISA in Australia, 2000–201410.1080/02680939.2016.1252856 ↗
11. PISA Proficiency Scores Predict Educational Outcomes10.1016/j.lindif.2012.10.012 ↗
12. Evaluation of Competence-Based Teaching in Higher Education: From Theory to Practice10.1016/j.evalprogplan.2015.03.001 ↗
13. How to Measure Students’ Innovation Competences in Higher Education: Evaluation of an Assessment Tool in Authentic Learning Environments10.1016/j.stueduc.2018.05.007 ↗
14. Enhanced Requirements for Assessment in a Competency-Based, Time-Variable Medical Education System10.1097/ACM.0000000000002066 ↗
15. The Concept of Formative Assessment
16. Adapting Assessment Tasks to Support Three-Dimensional Learning10.1021/acs.jchemed.7b00645 ↗
17. Stakes in the Eye of the Beholder: An International Study of Learners’ Perceptions within Programmatic Assessment10.1111/medu.13532 ↗
18. Sevillano, M.L. (2004). Didáctica en el Siglo XXI: Ejes en el Aprendizaje y Enseñanza de Calidad, McGraw-Hill Interamericana de España.
19. Self-Regulated Learning Strategies Predict Learner Behavior and Goal Attainment in Massive Open Online Courses10.1016/j.compedu.2016.10.001 ↗
20. “Now That’s the Feedback I Want!’ Students’ Reactions to Feedback on Graded Work and What They Do with It10.1080/02602938.2016.1142500 ↗
21. Sánchez-Cabrero, R., Estrada-Chichón, J.L., Abad-Mancheño, A., and Mañoso-Pacheco, L. (2021). Models on Teaching Effectiveness in Current Scientific Literature. Educ. Sci., 11.10.3390/educsci11080409 ↗
22. How Technology Shapes Assessment Design: Findings from a Study of University Teachers10.1111/bjet.12439 ↗
23. Formative Assessment, Communication Skills and ICT in Initial Teacher Training10.3916/C52-2017-07 ↗
24. Classroom Assessment Techniques: An Assessment and Student Evaluation Method10.4236/ce.2012.326136 ↗
25. Two Decades of Havoc: A Synthesis of Criticism against PISA10.1007/s10833-019-09367-x ↗
26. Formative Assessment: A Critical Review
27. Pre-Eminence of Determining Factors in Second Language Learning: An Educator’s Perspective from Spain10.1016/j.heliyon.2021.e06282 ↗
28. Competencias sociales y emocionales del profesorado de Educación Infantil y su relación con la gestión del clima de aula
29. Enhancing Teaching through Constructive Alignment10.1007/BF00138871 ↗
30. Effective Online Instructional and Assessment Strategies10.1080/08923640701341653 ↗
31. Using Learning Analytics to Scale the Provision of Personalised Feedback10.1111/bjet.12592 ↗
32. Learning in Digital Networks-ICT Literacy: A Novel Assessment of Students’ 21st Century Skills10.1016/j.compedu.2017.01.014 ↗
33. Sánchez-Cabrero, R., Arigita-García, A., Barrientos-Fernández, A., and León-Mejía, A.C. (2019). Online Explorative Study on the Learning Uses of Virtual Reality among Early Adopters. J. Vis. Exp., e60188.10.3791/60188-v ↗
34. Assessment, Feedback and Marking Guides in Distance Education10.1080/02680513.2011.538565 ↗
35. Use of Electronic Surveys in Course Evaluation10.1111/1467-8535.00293 ↗
36. E-Learning Success Determinants: Brazilian Empirical Study10.1016/j.compedu.2017.12.001 ↗
37. Hentea, M., Shea, M.J., and Pennington, L. (2003, January 16–18). A Perspective on Fulfilling the Expectations of Distance Education. Proceedings of the 4th Conference on Information Technology Curriculum, Lafayette, IN, USA.10.1145/947121.947158 ↗
38. Tucker, S.Y. (2000). Assessing the Effectiveness of Distance Education versus Traditional On-Campus Education, AERA.
39. Prediction and Assessment of Student Behaviour in Open and Distance Education in Computers Using Bayesian Networks10.1016/j.compedu.2003.09.005 ↗
40. Asynchronous Discussions and Assessment in Online Learning10.1080/15391523.2007.10782485 ↗
41. Online Formative Assessment in Higher Education: A Review of the Literature10.1016/j.compedu.2011.06.004 ↗
42. Online vs. Traditional Teaching Evaluation: A Cross-Sectional Study10.1016/j.sbspro.2012.05.145 ↗
43. Educar y evaluar en tiempos de Coronavirus: La situación en España
44. Policy Brief: Education during COVID-19 and beyond
45. García, E., and Weiss, E. (2020). COVID-19 and Student Performance, Equity, and U.S. Education Policy: Lessons from Pre-Pandemic Research to Inform Relief, Recovery, and Rebuilding, Economic Policy Institute.
46. Education, the Science of Learning, and the COVID-19 Crisis10.1007/s11125-020-09468-z ↗
47. Online Assessment in Moodle: A Framework for Supporting Our Students
48. COVID-19 and Digital Disruption in UK Universities: Afflictions and Affordances of Emergency Online Migration10.1007/s10734-020-00561-y ↗
49. Khalaf, K., El-Kishawi, M., Moufti, M.A., and Al Kawas, S. (2020). Introducing a Comprehensive High-Stake Online Exam to Final-Year Dental Students during the COVID-19 Pandemic and Evaluation of Its Effectiveness. Med. Educ. Online, 25.10.1080/10872981.2020.1826861 ↗
50. Garcia-Penalvo, F.J., Corell, A., Abella-Garcia, V., and Grande, M. (2020). Online Assessment in Higher Education in the Time of COVID-19. Educ. Knowl. Soc., 21.
51. González-González, C.S., Infante-Moro, A., and Infante-Moro, J.C. (2020). Implementation of E-Proctoring in Online Teaching: A Study about Motivational Factors. Sustainability, 12.10.3390/su12083488 ↗
52. Contract Cheating: A Survey of Australian University Students10.1080/03075079.2018.1462788 ↗
53. Respondus Inc. (2021, April 28). LockDown Browser + Respondus Monitor. Available online: https://web.respondus.com/he/monitor/.
54. What Happens When You Close the Door on Remote Proctoring? Moving Toward Authentic Assessments with a People-Centered Approach
55. Prevention of Digital Cheating with Respondus Monitor
56. Examining the Effect of Proctoring on Online Test Scores10.24059/olj.v21i1.885 ↗
57. Implementing Remotely Proctored Testing in Nursing Education10.1016/j.teln.2020.10.008 ↗
58. World Medical Association (2013). World Medical Association Declaration of Helsinki–Ethical Principles for Medical Research Involving Human Subjects. JAMA, 310, 2191–2194.10.1001/jama.2013.281053 ↗
59. La adaptación al ámbito educativo de los futuros docentes de secundaria según su área académica
60. Educational Evaluation Schemes and Gender Gaps in Student Achievement10.1016/j.econedurev.2013.05.002 ↗
61. Astin, A.W., and Antonio, A.L. (2012). Assessment for Excellence: The Philosophy and Practice of Assessment and Evaluation in Higher Education, Rowman & Littlefield Publishers.
62. (2021, July 21). La Verdad, Exámenes “Online” a Trompicones y Entre Quejas de los Estudiantes. Available online: https://www.laverdad.es/murcia/examenes-online-trompicones-20200603001115-ntvo.html.
63. (2021, July 21). Levante, Profesores de la UNED Denuncian un Aprobado General en Varias Carreras. Available online: https://www.levante-emv.com/comunitat-valenciana/2020/12/31/profesores-uned-denuncian-aprobado-general-26904289.html.
64. Online or Face-to-Face? Students’ Experiences and Preferences in e-Learning10.1016/j.iheduc.2010.09.004 ↗
65. Providing Online Exams for Online Learners: Does It Really Matter for Them?10.1007/s10639-019-10020-6 ↗
66. Students’ Perceptions of the Value of the Elements of an Online Learning Environment: Looking Back in Moving Forward10.1080/09539960802364592 ↗
67. Ramli, N.H., Alavi, M., Mehrinezhad, S.A., and Ahmadi, A. (2018). Academic Stress and Self-Regulation among University Students in Malaysia: Mediator Role of Mindfulness. Behav. Sci., 8.10.3390/bs8010012 ↗