A Fuzzy DEMATEL-Based User-Centric Design Evaluation of Gamified Recommender Systems
Source abstract
Abstract
Gamified recommender systems, which mix game design with recommendation frameworks, are a new way to increase user involvement and satisfaction. Even though they have a lot of potential, there has not been any systematic research on how their design affects how people use them. This study introduces a fuzzy DEMATEL-based framework for the assessment and enhancement of gamified recommender systems. Four theoretically grounded gamified recommender system prototypes were developed as a novel contribution, as no readily available systems exist for these designs. The assessment utilized nine user-centric criteria—Effectiveness, Transparency, Persuasiveness, Satisfaction, Trust, Usefulness, Ease of Use, Efficiency, and Education—systematically derived from a PRISMA-guided literature review. This study integrates gamification theory, systematic review, and fuzzy decision-making to formulate a comprehensive framework for identifying the key factors influencing adoption. The fuzzy DEMATEL was applied to evaluate feedback from 25 end-users, and it was found that usefulness and ease of use were the most essential factors for satisfaction and system effectiveness. Analysis of design showed that competition in Points, Badges, and Leaderboards (PBL) design boosts short-term motivation, Acknowledgments, Objectives, and Progression (AOP) boosts progress and openness, Acknowledgments, Competition, and Time Pressure (ACT) boosts efficiency in competitive situations but might lower satisfaction, and Acknowledgments, Objectives, and Social Pressure (AOS) depends on social influence and accountability.
Source: crossref · Quality: baseline
Research context
OpenAlex topics: Educational Games and Gamification · Recommender Systems and Techniques · AI in Service Interactions
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
Affiliations
Department of Computer Information Systems, Near East University, Lefkoşa 99138, Turkey
Department of Physics, University of Sierra Leone, Freetown 00232, Sierra Leone
References (70)
Show source-provided references
1. Beheshti, A., Yakhchi, S., Mousaeirad, S., Ghafari, S.M., Goluguri, S.R., and Edrisi, M.A. (2020). Towards cognitive recommender systems. Algorithms, 13.10.3390/a13080176 ↗
2. The impact of recommendation system on user satisfaction: A moderated mediation approach10.3390/jtaer19010024 ↗
3. Recommendation systems: Principles, methods and evaluation10.1016/j.eij.2015.06.005 ↗
4. Evaluating conversational recommender systems: A landscape of research10.1007/s10462-022-10229-x ↗
5. Recommender systems and their ethical challenges10.1007/s00146-020-00950-y ↗
6. A systematic review and research perspective on recommender systems10.1186/s40537-022-00592-5 ↗
7. A systematic review and taxonomy of explanations in decision support and recommender systems10.1007/s11257-017-9195-0 ↗
8. Empirical Analysis of the Impact of Recommender Systems on Sales10.2753/MIS0742-1222270205 ↗
9. The effect of gamification on motivation and engagement
10. Gamifying education: What is known, what is believed and what remains uncertain: A critical review10.1186/s41239-017-0042-5 ↗
11. Hamari, J., Koivisto, J., and Sarsa, H. (2014, January 6–9). Does gamification work? A literature review of empirical studies on gamification. Proceedings of the 47th Hawaii International Conference on System Sciences, Waikoloa, HI, USA.10.1109/HICSS.2014.377 ↗
12. A definition for gamification: Anchoring gamification in the service marketing literature10.1007/s12525-015-0212-z ↗
13. The impact of gamification on students’ learning, engagement and behavior based on their personality traits10.1186/s40561-019-0098-x ↗
14. Gamification in education10.3390/encyclopedia3040089 ↗
15. Gamification of courses in the e-learning environment10.1088/1757-899X/878/1/012035 ↗
16. A machine learning approach for improved shop-floor operator support using a two-level collaborative filtering and gamification features10.1016/j.procir.2020.05.160 ↗
17. Gamified learning systems’ personalized feedback report dashboards via custom machine learning algorithms and recommendation systems
18. Leaderboard design principles to enhance learning and motivation in a gamified educational environment: Development study10.2196/14746 ↗
19. Barragán-Pulido, S., Barragán-Pulido, M.L., Alonso-Hernández, J.B., Castro-Sánchez, J.J., and Rabazo-Méndez, M.J. (2023). Development of students’ skills through gamification and serious games: An exploratory study. Appl. Sci., 13.10.3390/app13095495 ↗
20. Cubela, D., Rossner, A., and Neis, P. (2023). Using problem-based learning and gamification as a catalyst for student engagement in data-driven engineering education: A report. Educ. Sci., 13.10.3390/educsci13121223 ↗
21. Shaping virtual retail: Identifying key influences in metaverse shopping with fuzzy DEMATEL10.57019/jmv.1546324 ↗
22. Development of community tourism enhancement in emerging cities using gamification and adaptive tourism recommendation10.1016/j.jksuci.2021.04.007 ↗
23. Automating gamification personalization to the user and beyond10.1109/TLT.2022.3162409 ↗
24. Capturing the complexity of gamification elements: A holistic approach for analysing existing and deriving novel gamification designs10.1080/0960085X.2020.1796531 ↗
25. Designing and developing a novel hybrid adaptive learning path recommendation system for a gamification mathematics geometry course10.12973/eurasia.2017.01225a ↗
26. Tondello, G.F., Orji, R., and Nacke, L.E. (2017, January 9–12). Recommender systems for personalized gamification. Proceedings of the 25th Conference on User Modeling, Adaptation and Personalization (UMAP 2017), Bratislava, Slovakia.10.1145/3099023.3099114 ↗
27. Effects of a personalized fitness recommender system using gamification and continuous player modeling: System design and long-term validation study10.2196/19968 ↗
28. Eliyas, S., and P, R. (2023). A Model of Gamification by Combining and Motivating E-Learners and Filtering Jobs for Candidates. Eng. Proc., 59.10.3390/engproc2023059007 ↗
29. Akhriza, T.M., and Mumpuni, I.D. (2020, January 4–5). Gamification of the lecturer career promotion system with a recommender system. Proceedings of the 2020 Fifth International Conference on Informatics and Computing (ICIC), Gorontalo, Indonesia.
30. Fallahi, A., Bastanfard, A., Amini, A., and Saboohi, H. (2025). A study on enhancing user engagement by employing gamified recommender systems. arXiv.
31. Koivisto, J., and Hamari, J. (2018, January 21–23). Gamification of Education and Learning: A Review of Empirical Literature. Proceedings of the 2nd International GamiFIN Conference (GamiFIN 2018), Pori, Finland. Available online: https://trepo.tuni.fi/bitstream/handle/10024/104598/gamification_of_education_2018.pdf.
32. Gamification applications in e-learning: A literature review10.1007/s10758-020-09487-x ↗
33. Taqi, A.M., Qadous, M., Salah, M., and Özdamlı, F. (2023). Gamification in recommendation systems: A systematic analysis. Communications in Computer and Information Science, Springer.10.1007/978-3-031-48858-0_12 ↗
34. Pelissari, R., Alencar, P.S., Amor, S.B., and Duarte, L.T. (2022). The use of multiple criteria decision aiding methods in recommender systems: A literature review. Lecture Notes in Computer Science Intelligent Systems, Springer.10.1007/978-3-031-21686-2_37 ↗
35. Decision support model for introduction of gamification solution using AHP
36. Multiple criteria decision-making techniques and their applications: A review of the literature from 2000 to 2014
37. Mora, A., Riera, D., Gonzalez, C., and Arnedo-Moreno, J. (2015, January 16–18). A literature review of gamification design frameworks. Proceedings of the 2015 7th International Conference on Games and Virtual Worlds for Serious Applications (VS-Games), Skövde, Sweden.10.1109/VS-GAMES.2015.7295760 ↗
38. Saaty, T.L. (1980). The Analytic Hierarchy Process, McGraw–Hill.10.21236/ADA214804 ↗
39. Saaty, T.L. (1996). Decision Making with Dependence and Feedback: The Analytic Network Process, RWS Publications.
40. Hwang, C.L., and Yoon, K. (1981). Multiple Attribute Decision Making: Methods and Applications, Springer.10.1007/978-3-642-48318-9 ↗
41. Fontela, E., and Gabus, A. (1976). The DEMATEL Observer, Battelle Geneva Institute.
42. Spherical fuzzy sets-based integrated DEMATEL, ANP, and VIKOR approach and its application for renewable energy selection in Turkey10.1016/j.asoc.2024.111465 ↗
43. Preference-Based Multi-Attribute Decision-Making Method with Spherical-Z Fuzzy Sets for Green Product Design10.1016/j.engappai.2023.106767 ↗
44. Gabus, A., and Fontela, E. (1973). Perceptions of the World Problematique: Communication Procedure, Communicating with Those Bearing Collective Responsibility (DEMATEL Report No. 1), Battelle Geneva Research Centre.
45. Identification of a Threshold Value for the DEMATEL Method: Using the Maximum Mean De-Entropy Algorithm10.1007/978-3-642-02298-2_115 ↗
46. Choosing knowledge management strategies by using a combined ANP and DEMATEL approach10.1016/j.eswa.2007.07.025 ↗
47. Green Supplier Development: Analytical Evaluation Using Rough Set Theory10.1016/j.jclepro.2010.01.016 ↗
48. A Combined MCDM Model Based on DEMATEL and ANP for the Selection of Airline Service Quality Improvement Criteria: A Study Based on the Taiwanese Airline Industry10.1016/j.jairtraman.2016.07.004 ↗
49. Implementation of the fuzzy DEMATEL method in higher education course selection: The case of Eskişehir Vocational School
50. Using a hybrid decision-making model to evaluate the sustainable development performance of high-tech listed companies10.3846/16111699.2015.1110713 ↗
51. Rodrigo, M.M., Matsuda, N., and Dimitrova, V. (2022). GARFIELD: A Recommender System to Personalize Gamified Learning. Artificial Intelligence in Education, Springer.
52. Proposing a Strategy Map Based on Sustainability Balanced Scorecard and DEMATEL for Manufacturing Companies
53. Hajarian, M., and Hemmati, S. (2020, January 16–17). A gamified word-of-mouth recommendation system for increasing customer purchase. Proceedings of the 4th International Conference on Smart Cities, Internet of Things and Applications (SCIoT 2020), Mashhad, Iran.10.1109/SCIOT50840.2020.9250209 ↗
54. Identification of a threshold value for the DEMATEL method using the maximum mean de-entropy algorithm to find critical services provided by a semiconductor intellectual property mall10.1016/j.eswa.2009.01.073 ↗
55. Defuzzification within a multicriteria decision model10.1142/S0218488503002387 ↗
56. Selecting management systems for sustainable development in SMEs: A novel hybrid model based on DEMATEL, ANP, and ZOGP10.1016/j.eswa.2007.11.058 ↗
57. Application of fuzzy DEMATEL to develop a cause and effect model of municipal solid waste management in Metro Manila10.1007/s10661-008-0601-2 ↗
58. Tzeng, G.-H., and Huang, J.-J. (2011). Multiple Attribute Decision Making: Methods and Applications, Chapman and Hall/CRC. [1st ed.].10.1201/b11032 ↗
59. AGE-Learn: Ontology-Based Representation of Personalized Gamification in E-Learning10.1016/j.procs.2020.09.096 ↗
60. Page, M.J., McKenzie, J.E., Bossuyt, P.M., Boutron, I., Hoffmann, T.C., Mulrow, C.D., Shamseer, L., Tetzlaff, J.M., Akl, E.A., and Brennan, S.E. (2020). The PRISMA 2020 statement: An updated guideline for reporting systematic reviews. BMJ, 372.10.31222/osf.io/v7gm2 ↗
61. Cesário, V., and Nisi, V. (2022). Designing with Teenagers: A Teenage Perspective on Enhancing Mobile Museum Experiences. Int. J. Child-Comput. Interact., 33.10.1016/j.ijcci.2022.100454 ↗
62. Automatic Generation and Recommendation of Personalized Challenges for Gamification10.1007/s11257-019-09255-2 ↗
63. Psychology-Informed Recommender Systems10.1561/1500000090 ↗
64. González-González, C.S., Toledo-Delgado, P.A., Muñoz-Cruz, V., and Torres-Carrion, P.V. (2019). Serious Games for Rehabilitation: Gestural Interaction in Personalized Gamified Exercises through a Recommender System. J. Biomed. Inform., 97.10.1016/j.jbi.2019.103266 ↗
65. Mostafa, L., and Elbarawy, A.M. (November, January 30). Enhance Job Candidate Learning Path Using Gamification. Proceedings of the 2018 28th International Conference on Computer Theory and Applications (ICCTA), Alexandria, Egypt.10.1109/ICCTA45985.2018.9499189 ↗
66. Kazhamiakin, R., Marconi, A., Martinelli, A., Pistore, M., and Valetto, G. (2016, January 12–15). A Gamification Framework for the Long-Term Engagement of Smart Citizens. Proceedings of the 2016 IEEE International Smart Cities Conference (ISC2), Trento, Italy.10.1109/ISC2.2016.7580746 ↗
67. Khalil, M., Wong, J., De Koning, B., Ebner, M., and Paas, F. (2018, January 17–20). Gamification in MOOCs: A review of the state of the art. Proceedings of the 2018 IEEE Global Engineering Education Conference (EDUCON), Santa Cruz de Tenerife, Spain.10.1109/EDUCON.2018.8363430 ↗
68. A Gamified Recommendation Framework10.14419/ijet.v8i1.11.28092 ↗
69. Fundamental Characteristics and Applicability of the RADAR Method: Proof of Ranking Consistency10.31181/sor31202635 ↗
70. Green Decoration Materials Selection under Interior Environment Characteristics: A Grey-Correlation-Based Hybrid MCDM Method10.1016/j.rser.2017.08.050 ↗