Optimizing Chatbots to Improve Customer Experience and Satisfaction: Research on Personalization, Empathy, and Feedback Analysis
Source abstract
Abstract
This study addresses the ongoing challenge of optimizing chatbot interactions to significantly enhance customer experience and satisfaction through personalized, empathetic responses. Using advanced NLP tools and strong statistical methodologies, we developed and evaluated a multi-layered analytical framework to accurately identify user intents, assess customer feedback, and generate emotionally intelligent interactions. With over 270,000 customer chatbot interaction records in our dataset, we employed spaCy-based NER and clustering algorithms (HDBSCAN and K-Means) to categorize customer queries precisely. Text classification was performed using random forest, logistic regression, and SVM, achieving near-perfect accuracy. Sentiment analysis was conducted using VADER, Naive Bayes, and TextBlob, complemented by semantic analysis via LDA. Statistical tests, including Chi-square, Kruskal–Wallis, Dunn’s test, ANOVA, and logistic regression, confirmed the significant impact of tailored, empathetic response strategies on customer satisfaction. Correlation analysis indicated that traditional measures like sentiment polarity and text length insufficiently capture customer satisfaction nuances. The results underscore the critical role of context-specific adjustments and emotional responsiveness, paving the way for future research into chatbot personalization and customer-centric system optimization.
Source: crossref · Quality: baseline
Research context
OpenAlex topics: AI in Service Interactions · Sentiment Analysis and Opinion Mining · Digital Marketing and Social Media
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
Affiliations
Department of Management, Bar-Ilan University, Ramat Gan 5290002, Israel
References (63)
Show source-provided references
1. Artificial Intelligence and the ‘Good Society’: The US, EU, and UK approach
2. Can machines talk? Comparison of Eliza with modern dialogue systems10.1016/j.chb.2016.01.004 ↗
3. In the shades of the uncanny valley: An experimental study of human–chatbot interaction10.1016/j.future.2018.01.055 ↗
4. Huo, P., Yang, Y., Zhou, J., Chen, C., and He, L. (2020, January 19–24). TERG: Topic-Aware Emotional Response Generation for Chatbot. Proceedings of the 2020 International Joint Conference on Neural Networks (IJCNN), Glasgow, UK.10.1109/IJCNN48605.2020.9206719 ↗
5. Making conversations with chatbots more personalized10.1016/j.chb.2020.106627 ↗
6. Blame the Bot: Anthropomorphism and Anger in Customer–Chatbot Interactions10.1177/00222429211045687 ↗
7. How Service Quality Influences Customer Acceptance and Usage of Chatbots?
8. I, Chatbot: Modeling the determinants of users’ satisfaction and continuance intention of AI-powered service agents10.1016/j.tele.2020.101473 ↗
9. Chatbots or me? Consumers’ switching between human agents and conversational agents10.1016/j.jretconser.2023.103264 ↗
10. Random Forest10.1023/A:1010933404324 ↗
11. Support-vector networks10.1023/A:1022627411411 ↗
12. McCallum, A., and Nigam, K. (1998, January 26–30). A comparison of event models for naive bayes text classification. Proceedings of the AAAI Conference on Artificial Intelligence, Madison, WI, USA. Available online: https://api.semanticscholar.org/CorpusID:7311285.
13. Trust me, if you can: A study on the factors that influence consumers’ purchase intention triggered by chatbots based on brain image evidence and self-reported assessments10.1080/0144929X.2020.1743362 ↗
14. Powers, D.M.W. (2020). Evaluation: From precision, recall and F-measure to ROC, informedness, markedness and correlation. arXiv.
15. Establishing and maintaining long-term human-computer relationships10.1145/1067860.1067867 ↗
16. Brave new world: Service robots in the frontline10.1108/JOSM-04-2018-0119 ↗
17. Giving an “e-human touch” to e-tailing: The moderating roles of static information quantity and consumption motive in the effectiveness of an anthropomorphic information agent10.1002/dir.20075 ↗
18. Using corpora in machine-learning chatbot systems10.1075/ijcl.10.4.06sha ↗
19. The managed teacher: Emotional labour, education, and technology
20. Chatbot e-service and customer satisfaction regarding luxury brands10.1016/j.jbusres.2018.10.004 ↗
21. The Influence of Avatars on Online Consumer Shopping Behavior10.1509/jmkg.70.4.019 ↗
22. Radziwill, N.M., and Benton, M.C. (2017). Evaluating Quality of Chatbots and Intelligent Conversational Agents. arXiv.
23. Managing the human–chatbot divide: How service scripts influence service experience10.1108/JOSM-06-2019-0203 ↗
24. Chatbot as an emergency exist: Mediated empathy for resilience via human-AI interaction during the COVID-19 pandemic10.1016/j.ipm.2022.103074 ↗
25. Wardhana, A.K., Ferdiana, R., and Hidayah, I. (2021, January 28–30). Empathetic chatbot enhancement and development: A literature review. Proceedings of the 2021 International Conference on Artificial Intelligence and Mechatronics Systems (AIMS), Bandung, Indonesia.10.1109/AIMS52415.2021.9466027 ↗
26. Effect of AI chatbot empathy and identity disclosure on willingness to donate: The mediation of humanness and social presence10.1080/0144929X.2022.2105746 ↗
27. The mind in the machine: Anthropomorphism increases trust in an autonomous vehicle10.1016/j.jesp.2014.01.005 ↗
28. Almost human: Anthropomorphism increases trust resilience in cognitive agents
29. Service and technology: Opportunities and paradoxes10.1108/09604520110410584 ↗
30. Touch versus Tech: When Technology Functions as a Barrier or a Benefit to Service Encounters10.1509/jm.13.0056 ↗
31. Communicability of traditional interfaces VS chatbots in healthcare and smart home domains10.1080/0144929X.2019.1637025 ↗
32. The influence of conversational agent embodiment and conversational relevance on socially desirable responding10.1016/j.dss.2018.08.011 ↗
33. Um, T., Kim, T., and Chung, N. (2020). How does an Intelligence Chatbot Affect Customers Compared with Self-Service Technology for Sustainable Services?. Sustainability, 12.10.3390/su12125119 ↗
34. Frontline robots in tourism and hospitality: Service enhancement or cost reduction?10.1007/s12525-020-00432-5 ↗
35. Customer service chatbots: Anthropomorphism and adoption10.1016/j.jbusres.2020.04.030 ↗
36. Do We Trust in AI? Role of Anthropomorphism and Intelligence
37. Millennials’ attitude toward chatbots: An experimental study in a social relationship perspective10.1108/IJRDM-12-2019-0406 ↗
38. Designing Embodied Virtual Agents as Product Specialists in a Multi-Product Category E-Commerce: The Roles of Source Credibility and Social Presence10.1080/10447318.2020.1722399 ↗
39. Idiosyncratic service experiences: When customers desire the extraordinary in a service encounter10.1016/j.jbusres.2017.11.016 ↗
40. The Impact of Empowerment on Customer Contact Employees’ Roles in Service Organizations10.1177/109467050031005 ↗
41. The impact of code switching on service encounters10.1016/j.jretai.2006.10.008 ↗
42. Institution-based trust in interorganizational exchange relationships: The role of online B2B marketplaces on trust formation10.1016/S0963-8687(02)00017-3 ↗
43. Trust in inter-organizational exchanges: A case study in business to business electronic commerce10.1016/j.dss.2003.12.005 ↗
44. The effect of virtual sales agent (VSA) gender—Product gender congruence on product advice credibility, trust in VSA and online vendor, and purchase intention10.1016/j.chb.2016.02.046 ↗
45. Enhancing user experience with conversational agent for movie recommendation: Effects of self-disclosure and reciprocity10.1016/j.ijhcs.2017.02.005 ↗
46. How can we trust a robot?10.1145/3173087 ↗
47. Nordheim, C.B. (2018). Trust in Chatbots for Customer Service–Findings from a Questionnaire Study. [Master’s Thesis, Universitetet i Oslo].
48. Should AI-Based, conversational digital assistants employ social-or task-oriented interaction style? A task-competency and reciprocity perspective for older adults10.1016/j.chb.2018.08.048 ↗
49. A valued agent: How ECAs affect website customers’ satisfaction and behaviors10.1016/j.jretconser.2015.05.008 ↗
50. Advancing the strategic messages affecting robot trust effect: The dynamic of user-and robot-generated content on human–robot trust and interaction outcomes10.1089/cyber.2016.0199 ↗
51. Exploring the effects of specialist versus generalist embodied virtual agents in a multi-product category online store10.1016/j.tele.2017.10.005 ↗
52. Trust in and adoption of online recommendation agents
53. Living up to the chatbot hype: The influence of anthropomorphic design cues and communicative agency framing on conversational agent and company perceptions10.1016/j.chb.2018.03.051 ↗
54. A study of demographic embodiments of product recommendation agents in electronic commerce10.1016/j.ijhcs.2010.05.005 ↗
55. Chatbots and the new world of HCI10.1145/3085558 ↗
56. What makes you continuously use chatbot services? Evidence from Chinese online travel agencies10.1007/s12525-020-00454-z ↗
57. Research on artificial intelligence customer service on consumer attitude and its impact during online shopping10.1088/1742-6596/1575/1/012192 ↗
58. Natural language processing: An introduction10.1136/amiajnl-2011-000464 ↗
59. “Don’t Neglect the User!”—Identifying Types of Human-Chatbot Interactions and their Associated Characteristics10.1007/s10796-021-10212-x ↗
60. Glossary of terms10.1023/A:1017181826899 ↗
61. Induction of decision trees10.1023/A:1022643204877 ↗
62. Yun, J., and Park, J. (2022). The Effects of Chatbot Service Recovery with Emotion Words on Customer Satisfaction, Repurchase Intention, and Positive Word-Of-Mouth. Front. Psychol., 13.10.3389/fpsyg.2022.922503 ↗
63. Evolving the online customer experience… is there a role for online customer support?10.1016/j.chb.2016.02.084 ↗