journal article·2023-09-27Open access

Classification of Severe Maternal Morbidity from Electronic Health Records Written in Spanish Using Natural Language Processing

Ever A. Torres-Silva, Santiago Rúa, Andrés F. Giraldo-Forero, Maria C. Durango, José F. Flórez-Arango, Andrés Orozco-Duque

Applied Sciences· Volume 13· Issue 19

Abstract

One stepping stone for reducing the maternal mortality is to identify severe maternal morbidity (SMM) using Electronic Health Records (EHRs). We aim to develop a pipeline to represent and classify the unstructured text of maternal progress notes in eight classes according to the silver labels defined by the ICD-10 codes associated with SMM. We preprocessed the text, removing protected health information (PHI) and reducing stop words. We built different pipelines to classify the SMM by the combination of six word-embeddings schemes, three different approaches for the representation of the documents (average, clustering, and principal component analysis), and five well-known machine learning classifiers. Additionally, we implemented an algorithm for typos and misspelling adjustment based on the Levenshtein distance to the Spanish Billion Word Corpus dictionary. We analyzed 43,529 documents constructed by an average of 4.15 progress notes from 22,937 patients. The pipeline with the best performance was the one that included Word2Vec, typos and spelling adjustment, document representation by PCA, and an SVM classifier. We found that it is possible to identify conditions such as miscarriage complication or hypertensive disorders from clinical notes written in Spanish, with a true positive rate higher than 0.85. This is the first approach to classify SMM from the unstructured text contained in the maternal EHRs, which can contribute to the solution of one of the most important public health problems in the world. Future works must test other representation and classification approaches to detect the risk of SMM.
Source: crossref · Quality: baseline

Research context

OpenAlex topics: Topic Modeling · Maternal and fetal healthcare · Mental Health via Writing

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

Faculty of Engineering, Instituto Tecnológico Metropolitano, Medellín 050034, Colombia

School of Basic Sciences, Technologies and Engineering, Universidad Nacional Abierta y a Distancia, Bogota 111321, Colombia

Department of Applied Sciences, Instituto Tecnológico Metropolitano, Medellín 050034, Colombia

Population Health Sciences, Weill Cornell Medicine, New York, NY 10065, USA

Funding

Instituto Tecnológico Metropolitano · Agencia de Educación Superior de Medellín (Sapiencia) · Universidad Nacional Abierta y a Distancia · Clinica Universitaria Bolivariana, Medellín, Colombia

References (46)

Show source-provided references
1. WHO, and UNFPA (2021). Ending Preventable Maternal Mortality (EPMM): A Renewed Focus for Improving Maternal and Newborn Health and Well-Being, World Health Organization.
2. Severe maternal morbidity: Screening and review10.1016/j.ajog.2016.07.050 ↗
3. The Inevitable Application of Big Data to Health Care10.1001/jama.2013.393 ↗
4. Discovering Cohorts of Pregnant Women from Social Media for Safety Surveillance and Analysis10.2196/jmir.8164 ↗
5. Klein, A.Z., Cai, H., Weissenbacher, D., Levine, L.D., and Gonzalez-Hernandez, G. (2020). A natural language processing pipeline to advance the use of Twitter data for digital epidemiology of adverse pregnancy outcomes. J. Biomed. Inform., 112.10.1016/j.yjbinx.2020.100076 ↗
6. Improving embedded knowledge graph multi-hop question answering by introducing relational chain reasoning10.1007/s10618-022-00891-8 ↗
7. Back to common sense: Oxford dictionary descriptive knowledge augmentation for aspect-based sentiment analysis10.1016/j.ipm.2022.103260 ↗
8. Zhong, Q.Y., Karlson, E.W., Gelaye, B., Finan, S., Avillach, P., Smoller, J.W., Cai, T., and Williams, M.A. (2018). Screening pregnant women for suicidal behavior in electronic medical records: Diagnostic codes vs. clinical notes processed by natural language processing. BMC Med. Inform. Decis. Mak., 18.10.1186/s12911-018-0617-7 ↗
9. Use of natural language processing in electronic medical records to identify pregnant women with suicidal behavior: Towards a solution to the complex classification problem10.1007/s10654-018-0470-0 ↗
10. Ayre, K., Bittar, A., Kam, J., Verma, S., Howard, L.M., and Dutta, R. (2021). Developing a Natural Language Processing tool to identify perinatal self-harm in electronic healthcare records. PLoS ONE, 16.10.1371/journal.pone.0253809 ↗
11. Machine learning approaches for extracting stage from pathology reports in prostate cancer
12. Discriminant document embeddings with an extreme learning machine for classifying clinical narratives10.1016/j.neucom.2017.01.117 ↗
13. Atchison, A., Pinto, G., Woodward, A., Stevens, E., Dixon, D., and Linstead, E. (2021, January 13–16). Classifying Challenging Behaviors in Autism Spectrum Disorder with Word Embeddings. Proceedings of the 2021 20th IEEE International Conference on Machine Learning and Applications (ICMLA), Virtual.10.1109/ICMLA52953.2021.00215 ↗
14. Structuring clinical text with AI: Old versus new natural language processing techniques evaluated on eight common cardiovascular diseases10.1016/j.patter.2021.100289 ↗
15. Looking for low vision: Predicting visual prognosis by fusing structured and free-text data from electronic health records10.1016/j.ijmedinf.2021.104678 ↗
16. Development of a Pipeline for Adverse Drug Reaction Identification in Clinical Notes: Word Embedding Models and String Matching10.2196/31063 ↗
17. Application of machine learning and word embeddings in the classification of cancer diagnosis using patient anamnesis10.1109/ACCESS.2020.3000075 ↗
18. Machine learning and natural language processing (NLP) approach to predict early progression to first-line treatment in real-world hormone receptor-positive (HR+)/HER2-negative advanced breast cancer patients10.1016/j.ejca.2020.11.030 ↗
19. ICD-10 coding of Spanish electronic discharge summaries: An extreme classification problem10.1109/ACCESS.2020.2997241 ↗
20. Automatic International Classification of Diseases coding system: Deep contextualized language model with rule-based approaches10.2196/37557 ↗
21. Severe acute maternal morbidity: A pilot study of a definition for a near-miss10.1111/j.1471-0528.1998.tb10262.x ↗
22. Incidence and predictors of severe obstetric morbidity: Case-control study10.1136/bmj.322.7294.1089 ↗
23. De Salud INS, I.N. (2023). Protocolo de Vigilancia de Salud Pública—Morbilidad Materna Extrema. Boletin SIVIGILA, 743, Available online: https://www.ins.gov.co/buscador-eventos/Paginas/Vista-Boletin-Epidemilogico.aspx.
24. (2022, June 10). Gobierno Nacional Republica de Colombia Ley Estatutaria 1581 De 2012, Available online: https://www.funcionpublica.gov.co/eva/gestornormativo/norma.php?i=49981.
25. De Científicos de Datos (UCD) Departamento Nacional de Planeación (2022, November 11). ConTexto—Librería de Procesamiento y Análisis de Textos v0.2.0. Available online: https://github.com/ucd-dnp/ConTexto.
26. Al-Rfou, R., Perozzi, B., and Skiena, S. (2013, January 8–9). Polyglot: Distributed word representations for multilingual NLP. Proceedings of the CoNLL 2013—17th Conference on Computational Natural Language Learning, Sofia, Bulgaria.
27. Cardellino, C. (2022, February 06). Spanish Billion Words Corpus and Embeddings. Available online: https://crscardellino.ar/SBWCE/.
28. Khattak, F.K., Jeblee, S., Pou-Prom, C., Abdalla, M., Meaney, C., and Rudzicz, F. (2019). A survey of word embeddings for clinical text. J. Biomed. Inform., 100.10.1016/j.yjbinx.2019.100057 ↗
29. Lauren, P., Qu, G., Zhang, F., and Lendasse, A. (2016, January 24–29). Clinical narrative classification using discriminant word embeddings with elm. Proceedings of the 2016 International Joint Conference on Neural Networks (IJCNN), Vancouver, BC, Canada.10.1109/IJCNN.2016.7727570 ↗
30. Predicting of anaphylaxis in big data EMR by exploring machine learning approaches10.1016/j.jbi.2018.09.012 ↗
31. Scikit-learn: Machine learning in Python
32. Gutiérrez-Fandiño, A., Armengol-Estapé, J., Pàmies, M., Llop-Palao, J., Silveira-Ocampo, J., Carrino, C.P., Gonzalez-Agirre, A., Armentano-Oller, C., Rodriguez-Penagos, C., and Villegas, M. (2021). Maria: Spanish language models. arXiv.
33. Beltagy, I., Peters, M.E., and Cohan, A. (2020). Longformer: The long-document transformer. arXiv.
34. Using lexical disambiguation and named-entity recognition to improve spelling correction in the electronic patient record10.1016/S0933-3657(03)00052-6 ↗
35. Xuan, L., Zhigang, C., and Fan, Y. (2013, January 26–28). Exploring of clustering algorithm on class-imbalanced data. Proceedings of the 2013 8th International Conference on Computer Science & Education, Colombo, Sri Lanka.
36. Minimum information about clinical artificial intelligence modeling: The MI-CLAIM checklist10.1038/s41591-020-1041-y ↗
37. A comparison of word embeddings for the biomedical natural language processing10.1016/j.jbi.2018.09.008 ↗
38. Gladkova, A., and Drozd, A. (2016, January 7–12). Intrinsic evaluations of word embeddings: What can we do better?. Proceedings of the 1st Workshop on Evaluating Vector-Space Representations for NLP, Berlin, Germany.10.18653/v1/W16-2507 ↗
39. A survey of pre-processing techniques to improve short-text quality: A case study on hate speech detection on twitter10.1007/s11042-020-10082-6 ↗
40. Workman, T.E., Shao, Y., Divita, G., and Zeng-Treitler, Q. (2019). An efficient prototype method to identify and correct misspellings in clinical text. BMC Res. Notes, 12.10.1186/s13104-019-4073-y ↗
41. Kowsari, K., Jafari Meimandi, K., Heidarysafa, M., Mendu, S., Barnes, L., and Brown, D. (2019). Text classification algorithms: A survey. Information, 10.10.3390/info10040150 ↗
42. Yogarajan, V. (2022). Domain-Specific Language Models for Multi-Label Classification of Medical Text. [Ph.D. Thesis, The University of Waikato].
43. Ensembling classical machine learning and deep learning approaches for morbidity identification from clinical notes10.1109/ACCESS.2020.3043221 ↗
44. Analysis of root causes of problems affecting the quality of hospital administrative data: A systematic review and Ishikawa diagram10.1016/j.ijmedinf.2021.104584 ↗
45. Accuracy and Completeness of Clinical Coding Using ICD-10 for Ambulatory Visits
46. Data-driven modeling of pregnancy-related complications10.1016/j.molmed.2021.01.007 ↗