journal article·2025-10-07Open access

Early Oral Cancer Detection with AI: Design and Implementation of a Deep Learning Image-Based Chatbot

Pablo Ormeño-Arriagada, Gastón Márquez, Carla Taramasco, Gustavo Gatica, Juan Pablo Vasconez, Eduardo Navarro

Applied Sciences· Volume 15· Issue 19

Abstract

Oral cancer remains a critical global health challenge, with delayed diagnosis driving high morbidity and mortality. Despite progress in artificial intelligence, computer vision, and medical imaging, early detection tools that are accessible, explainable, and designed for patient engagement remain limited. This study presents a novel system that combines a patient-centred chatbot with a deep learning framework to support early diagnosis, symptom triage, and health education. The system integrates convolutional neural networks, class activation mapping, and natural language processing within a conversational interface. Five deep learning models were evaluated (CNN, DenseNet121, DenseNet169, DenseNet201, and InceptionV3) using two balanced public datasets. Model performance was assessed using accuracy, sensitivity, specificity, diagnostic odds ratio (DOR), and Cohen’s Kappa. InceptionV3 consistently outperformed the other models across these metrics, achieving the highest diagnostic accuracy (77.6%) and DOR (20.67), and was selected as the core engine of the chatbot’s diagnostic module. The deployed chatbot provides real-time image assessments and personalised conversational support via multilingual web and mobile platforms. By combining automated image interpretation with interactive guidance, the system promotes timely consultation and informed decision-making. It offers a prototype for a chatbot, which is scalable and serves as a low-cost solution for underserved populations and demonstrates strong potential for integration into digital health pathways. Importantly, the system is not intended to function as a formal screening tool or replace clinical diagnosis; rather, it provides preliminary guidance to encourage early medical consultation and informed health decisions.
Source: crossref · Quality: baseline

Research context

OpenAlex topics: Artificial Intelligence in Healthcare and Education · COVID-19 diagnosis using AI · Artificial Intelligence in Healthcare

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

Facultad de Ingeniería, Negocios y Ciencias AgroAmbientales, Universidad de Viña del Mar, Viña del Mar 2580022, Chile

Departamento de Ciencias de la Computación y Tecnología de la Información, Universidad del Bío-Bío, Chillán 4081112, Chile

Centro para la Prevención y el Control del Cáncer (CECAN), Facultad de Ingeniería, Universidad Andrés Bello, Viña del Mar 2520000, Chile

Facultad de Ingeniería, Universidad Andrés Bello, Viña del Mar 2520000, Chile

Funding

Agencia Nacional de Investigación y Desarrollo of Chile (ANID) · Centro de Prevención y Control de Cáncer (CECAN)

References (45)

Show source-provided references
1. AI-Based Medical Chatbot for Disease Prediction
2. Al Kuwaiti, A., Nazer, K., Al-Reedy, A., Al-Shehri, S., Al-Muhanna, A., Subbarayalu, A.V., Al Muhanna, D., and Al-Muhanna, F.A. (2023). A review of the role of artificial intelligence in healthcare. J. Pers. Med., 13.10.3390/jpm13060951 ↗
3. A framework for understanding selection bias in real-world healthcare data10.1093/jrsssa/qnae039 ↗
4. Gonzales, A., Guruswamy, G., and Smith, S.R. (2023). Synthetic data in health care: A narrative review. PLoS Digit. Health, 2.10.1371/journal.pdig.0000082 ↗
5. Current treatment strategies and risk stratification for oral carcinoma10.1200/EDBK_389810 ↗
6. Pierfelice, T.V., D’Amico, E., Cinquini, C., Iezzi, G., D’Arcangelo, C., D’Ercole, S., and Petrini, M. (2024). The Diagnostic Potential of Non-Invasive Tools for Oral Cancer and Precancer: A Systematic Review. Diagnostics, 14.10.3390/diagnostics14182033 ↗
7. Early detection of oral potentially malignant disorders: A review on prospective screening methods with regard to global challenges10.1007/s12663-022-01710-9 ↗
8. Dehbozorgi, R., Zangeneh, S., Khooshab, E., Nia, D.H., Hanif, H.R., Samian, P., Yousefi, M., Hashemi, F.H., Vakili, M., and Jamalimoghadam, N. (2025). The application of artificial intelligence in the field of mental health: A systematic review. BMC Psychiatry, 25.10.1186/s12888-025-06483-2 ↗
9. Balcombe, L. (2023). AI chatbots in digital mental health. Informatics, 10.10.3390/informatics10040082 ↗
10. Advancing cancer diagnosis and treatment: Integrating image analysis and AI algorithms for enhanced clinical practice10.1007/s10462-025-11117-w ↗
11. A contemporary review on chatbots, AI-powered virtual conversational agents, ChatGPT: Applications, open challenges and future research directions10.1016/j.cosrev.2024.100632 ↗
12. Beyond clicks and downloads: A call for a more comprehensive approach to measuring mobile-health app engagement10.1192/bjo.2020.72 ↗
13. Li, M., Jiang, Y., Zhang, Y., and Zhu, H. (2023). Medical image analysis using deep learning algorithms. Front. Public Health, 11.10.3389/fpubh.2023.1273253 ↗
14. Minutolo, A., Damiano, E., De Pietro, G., Fujita, H., and Esposito, M. (2022). A conversational agent for querying Italian Patient Information Leaflets and improving health literacy. Comput. Biol. Med., 141.10.1016/j.compbiomed.2021.105004 ↗
15. A guide to deep learning in healthcare10.1038/s41591-018-0316-z ↗
16. Natural language processing: State of the art, current trends and challenges10.1007/s11042-022-13428-4 ↗
17. Artificial intelligence–based chatbots for promoting health behavioral changes: Systematic review10.2196/40789 ↗
18. Bansal, S. (2024, July 08). Oral Cancer (Lips and Tongue) Images. Available online: https://www.kaggle.com/shivam17299/oral-cancer-lips-and-tongue-images.
19. Vijay, S. (2024, July 08). Oral Cancer Data Dataset. Available online: https://universe.roboflow.com/sagari-vijay/oral-cancer-data.
20. Conversational agents in healthcare: A systematic review10.1093/jamia/ocy072 ↗
21. A systematic review of artificial intelligence-powered (AI-powered) chatbot intervention for managing chronic illness10.1080/07853890.2024.2302980 ↗
22. A literature review on chatbots in healthcare domain
23. Caldarini, G., Jaf, S., and McGarry, K. (2022). A literature survey of recent advances in chatbots. Information, 13.10.3390/info13010041 ↗
24. Zhang, Z., Zhang, L., Yuan, X., Zhang, A., Xu, M., and Qian, F. (2024). A first look at gpt apps: Landscape and vulnerability. arXiv.
25. Virtual care in the health care system: A concept analysis10.1111/scs.13227 ↗
26. Healthcare ex Machina: Are conversational agents ready for prime time in oncology?
27. Mowbray, T. (2025). A Survey of Deep Learning Architectures in Modern Machine Learning Systems: From CNNs to Transformers. J. Comput. Technol. Softw., 4.
28. The Effect of Chatbots on the Security of Metadata
29. Sanchez, D.T., and Sartagoda, R.S. (2024). Security Threats and Security Testing for Chatbots. Conversational Artificial Intelligence, Wiley.10.1002/9781394200801.ch19 ↗
30. Roles, users, benefits, and limitations of chatbots in health care: Rapid review10.2196/56930 ↗
31. Warin, K., Limprasert, W., Suebnukarn, S., Jinaporntham, S., Jantana, P., and Vicharueang, S. (2022). AI-based analysis of oral lesions using novel deep convolutional neural networks for early detection of oral cancer. PLoS ONE, 17.10.1371/journal.pone.0273508 ↗
32. Chatbot for Health Care and Oncology Applications Using Artificial Intelligence and Machine Learning: Systematic Review10.2196/27850 ↗
33. Technology readiness levels: Shortcomings and improvement opportunities10.1002/sys.21533 ↗
34. Voigt, P., and Von dem Bussche, A. (2017). The EU General Data Protection Regulation (GDPR). A Practical Guide, Springer International Publishing. [1st ed.].10.1007/978-3-319-57959-7 ↗
35. Gupta, A., Goswami, P., Chaudhary, N., and Bansal, R. (2020, January 5–7). Deploying an application using google cloud platform. Proceedings of the 2020 2nd International Conference on Innovative Mechanisms for Industry Applications (ICIMIA), Bangalore, India.10.1109/ICIMIA48430.2020.9074911 ↗
36. Atienza, R. (2020). Advanced Deep Learning with TensorFlow 2 and Keras: Apply DL, GANs, VAEs, Deep RL, Unsupervised Learning, Object Detection and Segmentation, and More, Packt Publishing Ltd.
37. Jung, H., and Oh, Y. (2021, January 10–17). Towards better explanations of class activation mapping. Proceedings of the IEEE/CVF International Conference on Computer Vision, Montreal, QC, Canada.10.1109/ICCV48922.2021.00137 ↗
38. Hou, Y., Wu, Z., Cai, X., and Zhu, T. (2024). The application of improved densenet algorithm in accurate image recognition. Sci. Rep., 14.10.1038/s41598-024-58421-z ↗
39. Sharma, S., and Guleria, K. (2022, January 28–29). Deep learning models for image classification: Comparison and applications. Proceedings of the 2022 2nd International Conference on Advance Computing and Innovative Technologies in Engineering (ICACITE), Greater Noida, India.10.1109/ICACITE53722.2022.9823516 ↗
40. Efficient citrus fruit image classification via a hybrid hierarchical CNN and transfer learning framework10.1007/s11694-024-02973-1 ↗
41. Olabanji, S.O., Oladoyinbo, O.B., Asonze, C.U., Oladoyinbo, T.O., Ajayi, S.A., and Olaniyi, O.O. (2024). Effect of adopting AI to explore big data on personally identifiable information (PII) for financial and economic data transformation. SSRN.10.2139/ssrn.4739227 ↗
42. Business chatbots with deep learning technologies: State-of-the-art, taxonomies, and future research directions10.1007/s10462-024-10744-z ↗
43. Examining patient engagement in chatbot development approaches for healthy lifestyle and mental wellness interventions: Scoping review10.2196/45772 ↗
44. Harfield, S., Purcell, T., Schioldann, E., Ward, J., Pearson, O., and Azzopardi, P. (2024). Enablers and barriers to primary health care access for Indigenous adolescents: A systematic review and meta-aggregation of studies across Australia, Canada, New Zealand, and USA. BMC Health Serv. Res., 24.10.1186/s12913-024-10796-5 ↗
45. Use of artificial intelligence chatbots for cancer treatment information10.1001/jamaoncol.2023.2954 ↗