Improving User Experience with Recommender Systems by Informing the Design of Recommendation Messages
Source abstract
Abstract
Advice-giving systems such as decision support systems and recommender systems (RS) utilize algorithms to provide users with decision support by generating ‘advice’ ranging from tailored alerts for situational exception events to product recommendations based on preferences. Related extant research of user perceptions and behaviors has predominantly taken a system-level view, whereas limited attention has been given to the impact of message design on recommendation acceptance and system use intentions. Here, a comprehensive model was developed and tested to explore the presentation choices (i.e., recommendation message characteristics) that influenced users’ confidence in—and likely acceptance of—recommendations generated by the RS. Our findings indicate that the problem and solution-related information specificity of the recommendation increase both user intention and the actual acceptance of recommendations while decreasing the decision-making time; a shorter decision-making time was also observed when the recommendation was structured in a problem-to-solution sequence. Finally, information specificity was correlated with information sufficiency and transparency, confirming prior research with support for the links between user beliefs, user attitudes, and behavioral intentions. Implications for theory and practice are also discussed.
Source: crossref · Quality: baseline
Research context
OpenAlex topics: Technology Adoption and User Behaviour · Digital Marketing and Social Media · Behavioral Health and Interventions
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
Affiliations
Department of Information Technologies, HEC Montréal, Montréal, QC H3T 2A7, Canada
Blue Yonder, 76149 Karlsruhe, Germany
Department of Marketing, HEC Montréal, Montréal, QC H3T 2A7, Canada
Funding
Blue Yonder · UX Chair
References (69)
Show source-provided references
1. Candillier, L., Jack, K., Fessant, F., and Meyer, F. (2009). Collaborative and Social Information Retrieval and Access: Techniques for Improved User Modeling, IGI Global.
2. Lops, P., de Gemmis, M., and Semeraro, G. (2011). Recommender Systems Handbook, Springer.
3. Recommender system application developments: A survey10.1016/j.dss.2015.03.008 ↗
4. Ricci, F., Rokach, L., and Shapira, B. (2015). Recommender Systems Handbook, Springer.10.1007/978-1-4899-7637-6 ↗
5. A systematic review and taxonomy of explanations in decision support and recommender systems10.1007/s11257-017-9195-0 ↗
6. Sarwar, B., Karypis, G., Konstan, J., and Riedl, J. (2022, June 01). Application of Dimensionality Reduction in Recommender System—A Case Study. Available online: https://apps.dtic.mil/sti/citations/ADA439541.
7. An MDP-based recommender system
8. E-commerce product recommendation agents: Use, characteristics, and impact10.2307/25148784 ↗
9. Pu, P., Chen, L., and Hu, R. (2011, January 23–27). A user-centric evaluation framework for recommender systems. Proceedings of the Fifth ACM Conference on Recommender Systems, Chicago, IL, USA.10.1145/2043932.2043962 ↗
10. A survey of recommendation system: Research challenges
11. Bigras, É., Léger, P.M., and Sénécal, S. (2019). Recommendation Agent Adoption: How Recommendation Presentation Influences Employees’ Perceptions, Behaviors, and Decision Quality. Appl. Sci., 9.10.3390/app9204244 ↗
12. Perceived usefulness, perceived ease of use, and user acceptance of information technology10.2307/249008 ↗
13. SUMI: The Software Usability Measurement Inventory10.1111/j.1467-8535.1993.tb00076.x ↗
14. A Combined Corpus and Systemic-Functional Analysis of the Problem-Solution Pattern in a Student and Professional Corpus of Technical Writing10.2307/3588401 ↗
15. Introduction to Message Design10.1080/23796529.2012.11674702 ↗
16. Schnabel, T., Bennett, P.N., and Joachims, T. (2018). Improving recommender systems beyond the algorithm. arXiv.
17. Gunawardana, A., and Shani, G. (2015). Recommender Systems Handbook, Springer.
18. Research Note—In CARSs We Trust: How Context-Aware Recommendations Affect Customers’ Trust and Other Business Performance Measures of Recommender Systems10.1287/isre.2015.0610 ↗
19. Regulatory Focus and Efficacy of Health Messages10.1086/504141 ↗
20. Situational Complexity and the Perception of Credible Evidence
21. Increased affective influence: Situational complexity or deliberation time?10.5406/amerjpsyc.123.1.0029 ↗
22. The Essential Impact of Context on Organizational Behavior10.5465/amr.2006.20208687 ↗
23. Scientific Knowledge Communication in Online Q&A Communities: Linguistic Devices as a Tool to Increase the Popularity and Perceived Professionalism of Knowledge Contributions
24. Organizational transparency: A new perspective on managing trust in organization-stakeholder relationships
25. Yoo, K.H., Gretzel, U., and Zanker, M. (2012). Persuasive Recommender Systems: Conceptual Background and Implications, Springer Science & Business Media.10.1007/978-1-4614-4702-3 ↗
26. Information Design Theories10.1080/23796529.2014.11674713 ↗
27. Consumer decision making in knowledge-based recommendation10.1007/s10844-010-0134-3 ↗
28. Design guidelines for effective recommender system interfaces based on a usability criteria conceptual model: Results from a college student population10.1080/01449290903004012 ↗
29. Information design–principles and guidelines10.1080/23796529.2010.11674679 ↗
30. Holliday, D., Wilson, S., and Stumpf, S. (2016, January 7–10). User trust in intelligent systems: A journey over time. Proceedings of the 21st International Conference on Intelligent User Interfaces, Sonoma, CA, USA.10.1145/2856767.2856811 ↗
31. Lamche, B., Adıgüzel, U., and Wörndl, W. (2014, January 6–10). Interactive explanations in mobile shopping recommender systems. Proceedings of the 8th ACM Conference on Recommender Systems, Foster City, CA, USA.
32. Zanker, M., and Schoberegger, M. (2014, January 6–10). An empirical study on the persuasiveness of fact-based explanations for recommender systems. Proceedings of the 8th ACM Conference on Recommender Systems, Foster City, CA, USA.
33. Kunkel, J., Donkers, T., Michael, L., Barbu, C.M., and Ziegler, J. (2019, January 4–9). Let Me Explain: Impact of Personal and Impersonal Explanations on Trust in Recommender Systems. Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems, Glasgow, UK.10.1145/3290605.3300717 ↗
34. Visualization of Explanations in Recommender Systems10.12720/joams.2.2.140-144 ↗
35. Adoption of ERP systems: Does information transparency matter?10.1016/j.tele.2014.09.005 ↗
36. Antecedents and consequents of information usefulness in user-generated online reviews: A multi-group moderation analysis of review valence10.17705/1thci.00102 ↗
37. The impact of electronic word- of-mouth: The adoption of online opinions in online customer communities10.1108/10662240810883290 ↗
38. Petty, R.E., and Cacioppo, J.T. (1986). Communication and Persuasion: Central and Peripheral Routes to Attitude Change, Springer.10.1007/978-1-4612-4964-1 ↗
39. Influence of Social Media on Chinese Students’ Choice of an Overseas Study Destination: An Information Adoption Model Perspective10.1080/10548408.2014.873318 ↗
40. Coursaris, C.K., Van Osch, W., Nah, F.F.-H., and Tan, C.-H. (2016). International Conference on HCI in Business, Government, and Organizations, Springer International Publishing.
41. Tintarev, N., and Masthoff, J. (2010). Recommender Systems Handbook, Springer US.
42. Pu, P., and Chen, L. (February, January 29). Trust building with explanation interfaces. Proceedings of the 11th International Conference on Intelligent user Interfaces, Sydney, Australia.
43. Kizilcec, R.F. (2016, January 7–12). How much information? Effects of transparency on trust in an algorithmic interface. Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems, San Jose, CA, USA.10.1145/2858036.2858402 ↗
44. Sinha, R., and Swearingen, K. (2002). CHI’02 Extended abstracts on Human Factors in Computing Systems, Association for Computing Machinery.
45. Davis, F.D. (1985). A Technology Acceptance Model for Empirically Testing New End-User Information Systems: Theory and Results. [Doctoral Dissertation, Massachusetts Institute of Technology].
46. The relation of interface usability characteristics, perceived usefulness, and perceived ease of use to end-user satisfaction with enterprise resource planning (ERP) systems10.1016/j.chb.2003.10.004 ↗
47. User satisfaction with mobile websites: The impact of perceived usefulness (PU), perceived ease of use (PEOU) and trust10.1108/NBRI-01-2014-0005 ↗
48. Online university students’ satisfaction and persistence: Examining perceived level of presence, usefulness and ease of use as predictors in a structural model10.1016/j.compedu.2011.02.008 ↗
49. Berkovsky, S., Taib, R., and Conway, D. (2017, January 13–16). How to recommend? User trust factors in movie recommender systems. Proceedings of the 22nd International Conference on Intelligent User Interfaces, Limassol, Cyprus.10.1145/3025171.3025209 ↗
50. Sharma, A., and Cosley, D. (2013, January 13–17). Do social explanations work? Studying and modeling the effects of social explanations in recommender systems. Proceedings of the 22nd International Conference on World Wide Web, Rio de Janeiro, Brazil.10.1145/2488388.2488487 ↗
51. Supporting trust calibration and the effective use of decision aids by presenting dynamic system confidence information10.1518/001872006779166334 ↗
52. Jameson, A., Willemsen, M.C., Felfernig, A., de Gemmis, M., Lops, P., Semeraro, G., and Chen, L. (2015). Recommender Systems Handbook, Springer.
53. Toward Contextualized Theories of Trust: The Role of Trust in Global Virtual Teams10.1287/isre.1040.0028 ↗
54. Coursaris, C.K., Hassanein, K., Head, M., and Bontis, N. The impact of distractions on the usability and the adoption of mobile devices for wireless data services. Proceedings of the European Conference on Information Systems, Available online: https://aisel.aisnet.org/ecis2007/28.10.1016/j.chb.2012.03.006 ↗
55. The impact of distractions on the usability and intention to use mobile devices for wireless data services10.1016/j.chb.2012.03.006 ↗
56. Tintarev, N., and Masthoff, J. (2007, January 17–20). A Survey of Explanations in Recommender Systems. Proceedings of the 2007 IEEE 23rd International Conference on Data Engineering Workshop, Istanbul, Turkey.10.1109/ICDEW.2007.4401070 ↗
57. How should I explain? A comparison of different explanation types for recommender systems10.1016/j.ijhcs.2013.12.007 ↗
58. Chan, S.H., and Song, Q. (2010). Decision Support Systems, InTech.
59. Prospect Theory: An Analysis of Decision under Risk10.2307/1914185 ↗
60. Overcoming Ineffective Mental Representations in Base-Rate Problems10.1287/isre.7.2.233 ↗
61. Falconnet, A., Van Osch, W., Chen, S.L., Beringer, J., Fredette, M., Sénécal, S., Léger, P.M., and Coursaris, C.K. (2020). Information Systems and Neuroscience: NeurosIS Retreat 2020, Springer International Publishing.
62. Reiter, E. (2019, January 29). Natural Language Generation Challenges for Explainable AI. Proceedings of the 1st Workshop on Interactive Natural Language Technology for Explainable Artificial Intelligence (NL4XAI 2019), Tokyo, Japan.10.18653/v1/W19-8402 ↗
63. Reducing recommender systems biases: An investigation of rating display designs10.25300/MISQ/2019/13949 ↗
64. Impact of content characteristics and emotion on behavioral engagement in social media: Literature review and research agenda10.1007/s10660-019-09353-8 ↗
65. Rzepka, C., and Berger, B. (2022, June 01). User Interaction with AI-Enabled Systems: A Systematic Review of IS Research. Available online: https://www.researchgate.net/profile/Benedikt-Berger-2/publication/329269262_User_Interaction_with_AI-enabled_Systems_A_Systematic_Review_of_IS_Research/links/5bffb55392851c63cab02730/User-Interaction-with-AI-enabled-Systems-A-Systematic-Review-of-IS-Research.pdf.
66. Information Technology Enabled Persuasion: An Experimental Investigation of the Role of Communication Channel, Strategy and Affect10.17705/1thci.00099 ↗
67. Matsui, T., and Yamada, S. (2019, January 16–20). The effect of subjective speech on product recommendation virtual agent. Proceedings of the 24th International Conference on Intelligent User Interfaces: Companion, Marina del Ray, CA, USA.10.1145/3308557.3308697 ↗
68. Should AI-Based, conversational digital assistants employ social- or task-oriented interaction style? A task-competency and reciprocity perspective for older adults10.1016/j.chb.2018.08.048 ↗
69. Léger, P.M., Sénécal, S., Courtemanche, F., de Guinea, A.O., Titah, R., Fredette, M., and Labonte-LeMoyne, É. (2014). Precision is in the eye of the beholder: Application of eye fixation-related potentials to information systems research. Assoc. Inf. Syst.10.17705/1jais.00376 ↗