Mining the Chatbot Brain to Improve COVID-19 Bot Response Accuracy
Source abstract
Abstract
People often communicate with auto-answering tools such as conversational agents due to their 24/7 availability and unbiased responses. However, chatbots are normally designed for specific purposes and areas of experience and cannot answer questions outside their scope. Chatbots employ Natural Language Understanding (NLU) to infer their responses. There is a need for a chatbot that can learn from inquiries and expand its area of experience with time. This chatbot must be able to build profiles representing intended topics in a similar way to the human brain for fast retrieval. This study proposes a methodology to enhance a chatbot's brain functionality by clustering available knowledge bases on sets of related themes and building representative profiles. We used a COVID-19 information dataset to evaluate the proposed methodology. The pandemic has been accompanied by an “infodemic” of fake news. The chatbot was evaluated by a medical doctor and a public trial of 308 real users. Evaluations were obtained and statistically analyzed to measure effectiveness, efficiency, and satisfaction as described by the ISO9214 standard. The proposed COVID-19 chatbot system relieves doctors from answering questions. Chatbots provide an example of the use of technology to handle an infodemic.
Source: openalex_inverted_index · Quality: baseline
Research context
OpenAlex topics: Misinformation and Its Impacts · AI in Service Interactions · COVID-19 diagnosis using AI
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
References (56)
Show source-provided references
1. Building an arabic flight booking dialogue system using a hybrid rule-based and data driven approach10.1109/ACCESS.2021.3049732 ↗
2. Daniel jurafsky/James H. martin: Speech and language processing. an introduction to natural language processing, computational linguistics, and speech recognition10.1515/zfsw.2002.21.1.134 ↗
3. Arabic language challenges in text based conversational agents compared to the English language
4. World Health Organization, “Corona virus pandemic,” 2020. [Online]. Available: https://www.who.int/home.
5. UNICEF, “Coronavirus disease (COVID-19) information center,” 2020. [Online]. Available: https://www.unicef.org/coronavirus/covid-19.
6. Médecins Sans Frontières (MSF), “Our response to the coronavirus COVID-19 pandemic,” 2020. [Online]. Available: https://www.msf.org/covid-19-depth.
7. Saudi Press Agency, “Saudi health broadcasts two billion awareness messages about Corona,” 2020. [Online]. Available: https://www.saudi24news.com/2020/04/saudi-health-broadcasts-two-billion-awareness-messages-about-corona-2.html.
8. Ministry of Health, “MOH sends out over 3 billion educational text messages on novel coronavirus,” 2020. [Online]. Available: https://www.moh.gov.sa/en/Ministry/MediaCenter/News/Pages/News-2020-04-16-006.aspx.
9. Digital response during the COVID-19 pandemic in Saudi Arabia10.2196/19338 ↗
10. Information overload and infodemic in the COVID-19 pandemic
11. How to fight an infodemic: The four pillars of infodemic management10.2196/21820 ↗
12. Gender affordances of conversational agents10.1016/j.intcom.2012.05.001 ↗
13. Disbot: A Portuguese disaster support dynamic knowledge chatbot10.3390/app10249082 ↗
14. Unleashing the potential of chatbots in education: A state-of-the-art analysis
15. Roos · Chatbots in Education: A Passing Trend or a Valuable Pedagogical Tool? · 2018
16. LABEEB: Intelligent conversational agent approach to enhance course teaching and allied learning outcomes attainment10.4316/JACSM.201901001 ↗
17. Development of an AI userbot for engineering design education using an intent and flow combined framework10.3390/app10227970 ↗
18. Chatbot learning partners: Connecting learning experiences, interest and competence10.1016/j.chb.2018.12.023 ↗
19. Evaluation of developing educational chatbots based on the seven principles for good teaching
20. The impact of eHealth on the quality and safety of health care: A systematic overview10.1371/journal.pmed.1000387 ↗
21. What is eHealth (6)? development of a conceptual model for ehealth: Qualitative study with key informants10.2196/jmir.8106 ↗
22. The essential role of technology in the public health battle against COVID-1910.1089/pop.2020.0187 ↗
23. van Gemert-Pijnen · eHealth Research, Theory and Development: A Multi-Disciplinary Approach · 201810.4324/9781315385907 ↗
24. Twitter discussions and emotions about the COVID-19 pandemic: Machine learning approach10.2196/20550 ↗
25. Capturing public concerns about coronavirus using arabic tweets: An NLP-driven approach
26. COVID-19: Detecting government pandemic measures and public concerns from twitter arabic data using distributed machine learning10.3390/ijerph18010282 ↗
27. Employing a chatbot for news dissemination during crisis: Design, implementation and evaluation10.3390/fi12070109 ↗
28. AI chatbot design during an epidemic like the novel coronavirus10.3390/healthcare8020154 ↗
29. Conversational agents in healthcare: A systematic review10.1093/jamia/ocy072 ↗
30. A chatbot versus physicians to provide information for patients with breast cancer: Blind, randomized controlled noninferiority trial10.2196/15787 ↗
31. A self diagnosis medical chatbot using artificial intelligence
32. Embodied conversational agents in clinical psychology: A scoping review10.2196/jmir.6553 ↗
33. Smartphone-based conversational agents and responses to questions about mental health, interpersonal violence, and physical health10.1001/jamainternmed.2016.0400 ↗
34. Chatbot acceptance in healthcare: Explaining user adoption of conversational agents for disease diagnosis
35. Acceptability of artificial intelligence (AI)-led chatbot services in healthcare: A mixed-methods study10.1177/2055207619871808 ↗
36. Artificial intelligence (AI) applications for COVID-19 pandemic10.1016/j.dsx.2020.04.012 ↗
37. Artificial intelligence and COVID-19: Deep learning approaches for diagnosis and treatment10.1109/ACCESS.2020.3001973 ↗
38. Robots under COVID-19 pandemic: A comprehensive survey10.1109/ACCESS.2020.3045792 ↗
39. Chatbots in the fight against the COVID-19 pandemic10.1038/s41746-020-0280-0 ↗
40. Mental health of family, friends, and co-workers of COVID-19 patients in Japan10.1016/j.psychres.2020.113067 ↗
41. Implementation of a digital chatbot to screen health system employees during the COVID-19 pandemic10.1093/jamia/ocaa130 ↗
42. An artificial intelligence-based first-line defence against COVID-19: Digitally screening citizens for risks via a chatbot10.1038/s41598-020-75912-x ↗
43. User reactions to COVID-19 screening chatbots from reputable providers10.1093/jamia/ocaa167 ↗
44. News text topic clustering optimized method based on TF-iDF algorithm on spark10.32604/cmc.2020.06431 ↗
45. EP-Bot: Empathetic chatbot using auto-growing knowledge graph10.32604/cmc.2021.015634 ↗
46. Singh · Building an Enterprise Chatbot · 2019 · 28110.1007/978-1-4842-5034-1_7 ↗
47. MongoDB Architecture Guide · 2016 · 1
48. Grinberg · Flask web development · 2018
49. Markus Hofmann · RapidMiner: Data Mining use Cases and Business Analytics Application · 2014
50. Kassambara · Practical Guide to Cluster Analysis in R: Unsupervised Machine Learning · 2017
51. An improved KNN algorithm for text classification
52. Class-specific deep feature weighting for naïve Bayes text classifiers10.1109/ACCESS.2020.2968984 ↗
53. Trends & methods in chatbot evaluation
54. A survey on evaluation methods for chatbots
55. Determining sample size for research activities10.1177/001316447003000308 ↗
56. Power comparisons of shapiro-wilk, kolmogorov-smirnov, lilliefors and anderson-darling tests