journal article·2023-03-03Open access

The Extended Information Systems Success Measurement Model: e-Learning Perspective

Teodora Vuckovic, Darko Stefanovic, Danijela Ciric Lalic, Rogério Dionisio, Ângela Oliveira, Djordje Przulj

Applied Sciences· Volume 13· Issue 5

Abstract

This study investigated the crucial factors for measuring the success of the information system used in the e-learning process, considering the transformations in the work environment. This study was motivated by the changes caused by COVID-19 witnessed after the shift to fully online learning environments supported by e-learning systems, i.e., learning emphasized with information systems. Empirical research was conducted on a sample comprising teaching staff from two European universities: the University of Novi Sad, Faculty of Technical Sciences in Serbia and the Polytechnic Institute of Castelo Branco in Portugal. By synthesizing knowledge from review of the prior literature, supported by the findings of this study, the authors propose an Extended Information System Success Measurement Model—EISSMM. EISSMM underlines the importance of workforce agility, which includes the factors of proactivity, adaptability, and resistance to change, in the information system performance measurement model. The results of our research provide more extensive evidence and findings for scholars and practitioners that could support measuring information system success primarily in e-learning and other various contextual settings, highlighting the importance of people’s responses to work environment changes.
Source: crossref · Quality: baseline

Research context

OpenAlex topics: Digital Transformation in Industry · Technology Adoption and User Behaviour · Organizational and Employee Performance

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

Faculty of Technical Sciences, University of Novi Sad, 21000 Novi Sad, Serbia

DiSAC R&D Unit, Polytechnic Institute of Castelo Branco, 6000-084 Castelo Branco, Portugal

References (100+)

Show source-provided references
1. Information Systems Success: The Quest for the Dependent Variable10.1287/isre.3.1.60 ↗
2. User Acceptance of Information Technology: Toward a Unified View10.2307/30036540 ↗
3. E-learning motivation and educational portal acceptance in developing countries10.1108/14684521111113597 ↗
4. Lolić, T., Ristić, S., Stefanović, D., and Marjanović, U. (2018, January 19–21). Acceptance of E-Learning System at Faculty of Technical Sciences. Proceedings of the Cental European Conference on Information and Intelligent Systems, Varazdin, Croatia.
5. Lolic, T., Dionisio, R., Ciric, D., Ristic, S., and Stefanovic, D. (2020, January 8–11). Factors Influencing Students Usage of an e-Learning System: Evidence from IT Students. Proceedings of the International Joint Conference on Industrial Engineering and Operations Management—IJCIEOM, Rio de Janeiro, Brazil.10.1007/978-3-030-43616-2_22 ↗
6. Assessing Engineering Students’ Acceptance of an E-Learning System: A Longitudinal Study
7. Information Technology for Development Information system success among manufacturing SMEs: Case of developing countries
8. Assessing eGovernment systems success: A validation of the DeLone and McLean model of information systems success10.1016/j.giq.2007.06.002 ↗
9. Technology Acceptance Model 3 and a Research Agenda on Interventions10.1111/j.1540-5915.2008.00192.x ↗
10. Unified Theory of Acceptance and Use of Technology: A Synthesis and the Road Ahead
11. Consumer Acceptance and Use of Information Technology: Extending the Unified Theory of Acceptance and Use of Technology10.2307/41410412 ↗
12. Forrester (2019). IT Spending Forecasts, Forrester.
13. Gartner (2019). Gartner Worldwide IT Spending Forecast Available, Gartner Inc.
14. Workforce agility: The new employee strategy for the knowledge economy10.1080/02683960110132070 ↗
15. Stefanovic, D. (2012). Prilog Istraživanju Uslova za Integraciju Savremenih Ict u Poslovanju Industrijskih Proizvodno—Poslovnih Sistema. [Ph.D. Thesis, Univerzitet u Novom Sadu].
16. The DeLone and McLean model of information systems success: A ten-year update10.1080/07421222.2003.11045748 ↗
17. Perceived Usefulness, Perceived Ease of Use, and User Acceptance of Information Technology10.2307/249008 ↗
18. Theoretical Extension of the Technology Acceptance Model: Four Longitudinal Field Studies10.1287/mnsc.46.2.186.11926 ↗
19. The Theory of Planned Behavior10.1016/0749-5978(91)90020-T ↗
20. Social Cognitive Theory and Individual Reactions to Computing Technology10.2307/249749 ↗
21. The role of involvement in learning management system success10.1007/s12528-010-9032-5 ↗
22. Measuring Electronic Government Procurement Success and Testing for the Moderating Effect of Computer Self-efficacy
23. Janssen, M., Lamersdorf, W., Pries-Heje, J., and Rosemann, M. (2010, January 20–23). E-Government. E-Services and Global processes. Proceedings of the Joint IFIP TC 8 and TC 6 International Conferences, EGES 2010 and GISP 2010, Held as Part of WCC 2010, Brisbane, Australia.
24. Exploring nursing e-learning systems success based on information system success model10.1097/NCN.0b013e31821a1651 ↗
25. Measuring the success of the Greek Taxation Information System10.1016/j.ijinfomgt.2009.03.013 ↗
26. Chen, Y., and Chu, P. (2012). Electronic Governance and Cross-Boundary Collaboration: Innovations and Advancing Tools, IGI Global.10.4018/978-1-60960-753-1 ↗
27. Alkhalaf, S., Nguyen, A., Drew, S., and Jones, V. (2013, January 16–17). Measuring the Information Quality of e-Learning Systems in KSA: Attitudes and Perceptions of Learners. Proceedings of the Robot Intelligence Technology and Applications 2012, Advances in Intelligent Systems and Computing, Berlin, Germany.10.1007/978-3-642-37374-9_75 ↗
28. Visser, M., Biljon, J.V., and Herselman, M. (2012, January 1–3). Modeling management information systems’ success. Proceedings of the South African Institute for Computer Scientists and Information Technologists Conference, Pretoria, South Africa.10.1145/2389836.2389881 ↗
29. DeLone & McLean IS Success Model in Evaluating Knowledge Transfer in a Virtual Learning Environment10.4018/jissc.2010040103 ↗
30. Abdelsalam, H., Reddick, C., and Kadi, H. (2012). Managing E-Government Projects: Concepts, Issues and Best Practices, IGI Global.
31. Assessing e-Excise sucess with Delone and Mclean’s model
32. Examining success factors of open source software repositories: The case of OSOR.eu portal
33. Critical success factors for adoption of web-based learning management systems in Tanzania
34. Komba, M.M., and Ngulube, P. (2014). Emerging Issues and Prospects in African E-Government, IGI Global.
35. Meta-analysis of the DeLone and McLean information systems success model at individual level: An examination of the heterogeneity of the studies
36. Development and evaluation of the mobile library service system success model A case study of Taiwan10.1108/EL-06-2014-0094 ↗
37. The influence of information system success factors towards user satisfaction in universiti teknikal Malaysia Melaka
38. Analysis of Relationship between Three Dimensions of Quality, User Satisfaction, and E-Learning Usage of Binus Online Learning
39. Seyal, A.H., Rahman, M.N.A., Zurainah, A., and Tazrajiman, S. (2015, January 11–15). Evaluating User Satisfaction with Bruneian E-Government Website: A Case of e-Darussalam. Proceedings of the 26th IBIMA Conference, Madrid, Spain.
40. An Empirical Test of Information System Success Model in a University’s Electronic Services
41. Assessing users satisfaction with web digital library: The case of Universiti Teknologi MARA10.1108/IJILT-06-2015-0019 ↗
42. Gorla, N., and Chiravuri, A. (2016, January 7–8). Developing electronic government success models for G2C and G2B scenarios. Proceedings of the 2016 International Conference on Information Management ICIM 2016, London, UK.10.1109/INFOMAN.2016.7477527 ↗
43. Modelling digital library success using the DeLone and McLean information system success model10.1177/0961000617726123 ↗
44. The path of new information technology affecting educational equality in the new digital divide-based on information system success model
45. The influence of service quality in information system success model as an antecedent of mobile learning in education organizations: Case study in Jordan10.1504/IJMLO.2017.080893 ↗
46. Santos, A.D., Santoso, A.J., and Setyohadi, D.B. (2017, January 7–8). The analysis of academic information system success: A case study at Instituto Profissional de Canossa (IPDC) Dili timor-leste. Proceedings of the 2017 International Conference on Soft Computing, Intelligent System and Information Technology, Thessaloniki, Greece.10.1109/ICSIIT.2017.14 ↗
47. E-government: A citizen relationship marketing analysis10.1007/s12208-016-0164-9 ↗
48. Hassan, N.S., and Seyal, A.H. (2015, January 16–17). Measuring Success of Higher Education Centralised Administration Information System: An e-Government Initiative. Proceedings of the 15th European Conference on eGovernment 2015: ECEG 2015, Ljubljana, Slovenia.
49. An extension of Delone and McLean IS success model with self-efficacy: Online learning usage in Yemen10.1108/IJILT-11-2017-0116 ↗
50. What Makes Learning Management Systems Effective for Learning?10.1177/0047239518795828 ↗
51. Mediating effects of user experience usability: An empirical study on mobile library application in China10.1108/EL-04-2017-0086 ↗
52. Towards a model of quality features for mobile social networks apps in learning environments: An extended information system success model10.3991/ijim.v13i05.9791 ↗
53. Effect of social media activities to determinants public participate intention of e-government10.1016/j.procs.2019.11.119 ↗
54. Cross-boundary e-government systems: Determinants of performance10.1016/j.giq.2019.02.001 ↗
55. Lee, E.Y., and Jeon, Y.J.J. (2020). The difference of user satisfaction and net benefit of a mobile learning management system according to self-directed learning: An investigation of cyber university students in hospitality. Sustainability, 12.10.3390/su12072672 ↗
56. Delone and mclean model evaluation of information system success: A case study of master program of civil engineering universitas lambung mangkurat
57. Does sociability quality of web-based collaborative learning information system influence students’ satisfaction and system usage?10.1186/s41239-020-00189-z ↗
58. Perceptions of learning management system quality, satisfaction, and usage: Differences among students of the arts
59. Assessing citizen adoption of e-Government initiatives in Gambia: A validation of the technology acceptance model in information systems success10.1016/j.giq.2010.09.004 ↗
60. An empirical study of instructor adoption of web-based learning systems10.1016/j.compedu.2009.02.021 ↗
61. Acceptance of Mobile Learning: A Respecification and Validation of Information System Success
62. The success of learning management system among distance learners in Malaysian universities
63. Antecedences to continued intentions of adopting e-learning system in blended learning instruction: A contingency framework based on models of information system success and task-technology fit10.1016/j.compedu.2011.07.008 ↗
64. An empirical study on behavioural intention to reuse e-learning systems in rural China10.1111/j.1467-8535.2011.01261.x ↗
65. System-related factors that predict students’ satisfaction with the blackboard learning system at the University of Botswana
66. Akram, M.S., and Malik, A. (2012, January 2–6). Evaluating citizens’ readiness to embrace e-government services. Proceedings of the 2012 ACM Conference on High Integrity Language Technology, Boston, MA, USA.10.1145/2307729.2307740 ↗
67. A hybrid information system model for trust in e-government initiative adoption in public sector organization
68. Investigating the effect of information systems factors on trust in e-government initiative adoption in palestinian public sector10.19026/rjaset.5.4447 ↗
69. Empirical study on continuance intentions towards E-Learning 2.0 systems10.1080/0144929X.2014.934291 ↗
70. Cauter, L.V., Snoeck, M., and Crompvoets, J. (2014). Lecture Notes in Computer Science, Springer.
71. Evaluating e-government systems in Turkey: The case of the ‘e-movable system10.3233/IP-140341 ↗
72. User’s Satisfaction on E-government Services: An Integrated Model10.1016/j.sbspro.2014.11.148 ↗
73. Alteration of influencing factors of e-learning continued intention for different degrees of online participation10.19173/irrodl.v16i4.2084 ↗
74. A conceptual model for assessing blog-based learning system success in the context of business education10.1016/j.ijme.2016.09.002 ↗
75. Chinese students’ behavior intention to use mobile library apps and effects of education level and discipline10.1108/LHT-06-2016-0061 ↗
76. Modelling the factors that affect individuals zutilization of online learning systems: An empirical study combining the task technology fit model with the theory of planned behaviour10.1111/j.1467-8535.2010.01054.x ↗
77. The role of transformational leadership as a mediating variable in DeLone and McLean information system success model: The context of online learning usage in Yemen10.1016/j.tele.2018.03.012 ↗
78. Acceptance and satisfaction of learning management system enabled blended learning based on a modified DeLone-McLean information system success model
79. Developing and validating a model for assessing paid mobile learning app success10.1080/10494820.2018.1484773 ↗
80. Factors influencing users’ satisfaction and loyalty to digital libraries in Chinese universities10.1016/j.chb.2018.01.029 ↗
81. Online learning usage and performance among students within public universities in Yemen
82. Mobile Technology in the Classroom: What Drives Student-Lecturer Interactions?10.1080/10447318.2017.1380970 ↗
83. Priskila, R., Setyohadi, D.B., and Santoso, A.J. (2018, January 21–22). An investigation of factors affecting the success of regional financial management information system (case study of Palangka Raya Government). Proceedings of the 2018 International Seminar on Research of Information Technology and Intelligent Systems ISRITI, Ypguakarta, Indonesia.10.1109/ISRITI.2018.8864479 ↗
84. Fahrianta, R.Y., Chandrarin, G., and Subiyantoro, E. (2018, January 9). The Conceptual Model of Integration of Acceptance and Use of Technology with the Information Systems Success. Proceedings of the 2018 IOP Conference Series: Materials Science and Engineering, Bandung, Indonesian.10.1088/1757-899X/407/1/012144 ↗
85. A study on senior high school students’ acceptance of mobile learning management system
86. The determinants and impact of system usage and satisfaction on e-learning success and faculty-student interaction in indonesian private universities
87. Albelali, S.A., and Alaulamie, A.A. (2019, January 1–3). Gender Differences in Students’ Continuous Adoption of Mobile Learning in Saudi Higher Education. Proceedings of the 2nd International Conference on Computer Applications & Information Security ICCAIS 2019, Riyadh, Saudi Arabia.10.1109/CAIS.2019.8769554 ↗
88. A review of the generic end-user adoption of e-government services10.1177/0020852319861895 ↗
89. Citizen Satisfaction with Mandatory E-Government Services: A Conceptual Framework and an Empirical Validation10.1109/ACCESS.2020.3004541 ↗
90. An examination of citizen satisfaction with mandatory e-government services: Comparison of two information systems success models
91. The study of DeLone-McLean information system success model: The relationship between system quality and information quality
92. Empirical investigation to explore factors that achieve high quality of mobile learning system based on students’ perspectives
93. Perceived usefulness, ease of use, and usage of information technology: A replication10.2307/249577 ↗
94. On the test-retest reliability of perceived usefulness and perceived ease of use scales10.2307/249803 ↗
95. The Psychological Origins of Perceived Usefulness and Ease of Use10.1016/S0378-7206(98)00096-2 ↗
96. Stefanovic, D., Spasojevic, I., Havzi, S., Lolic, T., and Ristic, S. (2021, January 17–19). Information systems success models in the e-learning context: A systematic literature review. Proceedings of the 2021 20th International Symposium INFOTEH-JAHORINA (INFOTEH), East Sarajevo, Bosnia and Herzegovina.10.1109/INFOTEH51037.2021.9400653 ↗
97. Ciric, D., Lolic, T., Gracanin, D., Stefanovic, D., and Lalic, B. (2020, January 3–6). The Application of ICT Solutions in Manufacturing Companies in Serbia. Proceedings of the IFIP Advances in Information and Communication Technology, Wroclaw, Poland.10.1007/978-3-030-57997-5_15 ↗
98. The core competence of the corporation
99. Agile manufacturing: The drivers, concepts and attributes10.1016/S0925-5273(98)00219-9 ↗
100. Human factors in agile manufacturing: A brief overview with emphasis on communication and information infrastructure10.1002/(SICI)1520-6564(199724)7:1<3::AID-HFM1>3.0.CO;2-7 ↗