journal article·2024-07-23Open access

A Technological Framework to Support Asthma Patient Adherence Using Pictograms

Rosa Figueroa, Carla Taramasco, María Elena Lagos, Felipe Martínez, Carla Rimassa, Julio Godoy, Esteban Pino, Jean Navarrete, Jose Pinto, Gabriela Nazar, Cristhian Pérez, Daniel Herrera

Applied Sciences· Volume 14· Issue 15

Abstract

Background: Low comprehension and adherence to medical treatment among the elderly directly and negatively affect their health. Many elderly patients forget medical instructions immediately after their appointments, misunderstand them, or fail to recall them altogether. Some identified causes include the short time slots allocated for appointments in the public health system in Chile, the complex terminology used by healthcare professionals, and the stress experienced by patients during appointments. One approach to improving patients’ adherence to medical treatment is to combine written and oral instructions with graphical elements such as pictograms. However, several challenges arise due to the ambiguity of natural language and the need for pictograms to accurately represent various medication combinations, doses, and frequencies. Objective: This study introduces SIMAP (System for Integrating Medical Instructions with Pictograms), a technological framework aimed at enhancing adherence among asthma patients through the delivery of pictograms via a computational system. SIMAP utilizes a collaborative and user-centered methodology, involving health professionals and patients in the construction and validation of its components. Methods: The technological framework presented in this study is composed of three parts. The first two are medical indications and pictograms related to the treatment of the disease. Both components were developed through a comprehensive and iterative methodology that incorporates both qualitative and quantitative approaches. This methodology includes the utilization of focus groups, interviews, paper and online surveys, as well as expert validation, ensuring a robust and thorough development. The core of SIMAP is the technological component that leveraged artificial intelligence methods for natural language processing to analyze, tokenize, and associate words and their context to a set of one or more pictograms, addressing issues such as the ambiguity in the text, the cultural factor that involves many ways of expressing the same indication, and typographical errors in the indications. Results: Firstly, we successfully validated 18 clinical indications along with their respective pictograms. Some of the pictograms were redesigned based on the validation results. However, in the final validation, the comprehension percentages of the pictograms exceeded 70%. Furthermore, we developed a software called SIMAP, which translates medical indications into previously validated pictograms. Our proposed software, SIMAP, achieves a correct mapping rate of 96.69%. Conclusions: SIMAP demonstrates great potential as a technological component for supplementing medical instructions with pictograms when tested in a laboratory setting. The use of artificial intelligence for natural language processing can successfully map medical instructions, both structured and unstructured, into pictograms. This integration of textual instructions and pictograms holds promise for enhancing the comprehension and adherence of elderly patients to their medical indications, thereby improving their long-term health.
Source: crossref · Quality: baseline

Research context

OpenAlex topics: Safety Warnings and Signage · Digital Mental Health Interventions

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

Department of Electrical Engineering, Universidad de Concepción, Concepción 4070409, Chile

School of Engineering, Andres Bello University, Viña del Mar 2531015, Chile

Department of Nursing and Public Health, Universidad de Concepcion, Concepción 4070409, Chile

Faculty of Medicine, Andres Bello University, Viña del Mar 2531015, Chile

Faculty of Medicine, University of Valparaíso, Valparaíso 2340000, Chile

Department of Computer Science, Universidad de Concepción, Concepción 4070409, Chile

Department of Industrial Engineering, Universidad de Concepción, Concepción 4070409, Chile

Department of Psychology, Universidad de Concepción, Concepción 4070409, Chile

Department of Medical Education, Universidad de Concepción, Concepción 4070409, Chile

Funding

Universidad de Concepción · FONDEF · ANID (National Research and Development Agency, Chile) · National Center on Health Information Systems · Millennium Nucleus on Sociomedicine

References (32)

Show source-provided references
1. Can artificial intelligence pass the Fellowship of the Royal College of Radiologists examination? Multi-reader diagnostic accuracy study10.1136/bmj-2022-072826 ↗
2. Personalized predictions of patient outcomes during and after hospitalization using artificial intelligence10.1038/s41746-020-0249-z ↗
3. Nilsen, P., Reed, J., Nair, M., Savage, C., Macrae, C., Barlow, J., Svedberg, P., Larsson, I., Lundgren, L., and Nygren, J. (2022). Realizing the potential of artificial intelligence in healthcare: Learning from intervention, innovation, implementation and improvement sciences. Front. Health Serv., 2.10.3389/frhs.2022.961475 ↗
4. Artificial intelligence in the medical profession: Ready or not, here AI comes10.1016/j.clinsp.2022.100010 ↗
5. Pollution and health: A progress update10.1016/S2542-5196(22)00090-0 ↗
6. Sedentary Lifestyle: Overview of Updated Evidence of Potential Health Risks10.4082/kjfm.20.0165 ↗
7. The Lancet (2024, July 09). Global Burden of Disease. Global Health Metrics. Asthma-Level 3 Cause [Internet]. Available online: https://www.thelancet.com/gbd/summaries.
8. Adherence to inhaled therapies, health outcomes and costs in patients with asthma and COPD10.1016/j.rmed.2013.04.005 ↗
9. Adherence to inhalers in patients with severe asthma treated with anti-interleukin-5 biologics
10. A randomized controlled trial of patient recall after detailed written consent versus standard verbal consent in adults with routine orthopaedic trauma10.1302/2633-1462.42.BJO-2022-0148.R1 ↗
11. Merks, P., Cameron, J., Bilmin, K., Świeczkowski, D., Chmielewska-Ignatowicz, T., Harężlak, T., Białoszewska, K., Sola, K.F., Jaguszewski, M.J., and Vaillancourt, R. (2021). Medication Adherence and the Role of Pictograms in Medication Counselling of Chronic Patients: A Review. Front. Pharmacol., 12.10.3389/fphar.2021.582200 ↗
12. Ramzan, S., Iqbal, M.M., and Kalsum, T. (2022). Text-to-Image Generation Using Deep Learning. Eng. Proc., 20.10.3390/engproc2022020016 ↗
13. Ku, H., and Lee, M. (2023). TextControlGAN: Text-to-Image Synthesis with Controllable Generative Adversarial Networks. Appl. Sci., 13.10.3390/app13085098 ↗
14. A survey on generative adversarial network-based text-to-image synthesis10.1016/j.neucom.2021.04.069 ↗
15. Norré, M., Vandeghinste, V., Bouillon, P., and François, T. (2021, January 1–3). Extending a text-to-pictograph system to French and to Arasaac. Proceedings of the International Conference on Recent Advances in Natural Language Processing (RANLP 2021), Online.10.26615/978-954-452-072-4_118 ↗
16. Ben Mesmia, F., and Mouhoub, M. (2021, January 18–22). A Web-Based Communication Tool for Arabic-Speaking Newcomers to Canada. Proceedings of the 14th International Conference on Advances in Computer-Human Interactions, Nice, France.
17. Mutal, J., Bouillon, P., Norré, M., Gerlach, J., and Ormaechea-Grijalba, L. (2022;, January 12–16). A Neural Machine Translation Approach to Translate Text to Pictographs in a Medical Speech Translation System-The BabelDr Use Case. Proceedings of the 15th Biennial Conference of the Association for Machine Translation in the Americas, Orlando, FL, USA.
18. Does pictorial health information improve health behaviours and other outcomes? A systematic review protocol10.1136/bmjopen-2018-023300 ↗
19. A Physician’s Perspective on the Incorporation of Pictograms as a Supplement to Medical Instructions in Chile: A Pilot Study10.1016/j.irbm.2022.04.001 ↗
20. The effectiveness of using text and pictograms on oral rehydration, dry-mixture sachet labels10.4102/phcfm.v13i1.2646 ↗
21. Effects of Pharmaceutical Pictograms on Medication Adherence in Elderly Patients with Chronic Diseases at Primary Health Care Center in Hat Yai, Songkhla10.35755/jmedassocthai.2021.03.11948 ↗
22. Understanding medication schedules: Do pictograms help?10.1097/PTS.0000000000000241 ↗
23. Effectiveness of pictograms in patients or caregivers in healthcare settings: A systematic review10.1093/jphsr/rmab049 ↗
24. International Organization for Standardization ISO 9186-3 (2024, January 12). Graphical Symbols—Test Methods—Part 3: Method for Testing Symbol Referent Association. Available online: https://www.iso.org/standard/59882.html.
25. (2014). Graphical Symbols—Test Methods—Part 1: Method for Testing Comprehensibility (Standard No. ISO 9186-1:2014).
26. (2008). Graphical Symbols—Test Methods—Part 2: Method for Testing Perceptual Quality (Standard No. ISO 9186-2:2008).
27. (2014). Graphical Symbols—Test Methods—Part 3: Method for Testing Symbol Referent Association (Standard No. ISO 9186-3:2014).
28. Sentiment classification using N-gram inverse document frequency and automated machine learning10.1109/MS.2019.2919573 ↗
29. Ética y Jurisprudencia Administrativa de los Derechos de los Sujetos de Investigación en Pandemia (COVID-19): Función de los Comités Éticos Científicos: Chile10.4067/S0717-95022021000300785 ↗
30. Venegas, C.P.V. (2017). Desarrollo De Algoritmo Para Asociación Automática De Pictogramas a Indicaciones Médicas. [Doctoral Dissertation, Universidad de Concepción].
31. An update to SPIRIT and CONSORT reporting guidelines to enhance transparency in randomized trials10.1038/s41591-022-01989-8 ↗
32. (2024, January 14). CMEIS Recommendations for Scientific Ethical Committees (Cecs) in the Review of Research Protocols in the Context of Pandemic by COVID-19—6 June 2020. Available online: https://www.uta.cl/wp-content/uploads/2020/06/ProtocoloCECc.pdf.