Relation Extraction in Spanish Medical Texts Using Deep Learning Techniques for Medical Knowledge Representation
Source abstract
Abstract
The extraction of relationships in natural language processing (NLP) is a task that consists of identifying interactions between entities within a text. This approach facilitates comprehension of context and meaning. In the medical field, this is of particular significance due to the substantial volume of information contained in scientific articles. This paper explores various training strategies for medical relationship extraction using large pre-trained language models. The findings indicate significant variations in performance between models trained with general domain data and those specialized in the medical domain. Furthermore, a methodology is proposed that utilizes language models for relation extraction with hyperparameter optimization techniques. This approach uses a triplet-based system. It provides a framework for the organization of relationships between entities and facilitates the development of medical knowledge graphs in the Spanish language. The training process was conducted using a dataset constructed and validated by medical experts. The dataset under consideration focused on relationships between entities, including anatomy, medications, and diseases. The final model demonstrated an 85.9% accuracy rate in the relationship classification task, thereby substantiating the efficacy of the proposed approach.
Source: crossref · Quality: baseline
Research context
OpenAlex topics: Topic Modeling · Biomedical Text Mining and Ontologies · Natural Language Processing Techniques
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
Affiliations
Computer Engineering, Autonomous University of the State of Mexico, Texcoco 56259, Mexico
Systems Department, Autonomous Metropolitan University, Azcapotzalco, Mexico City 02200, Mexico
References (33)
Show source-provided references
1. A survey of named entity recognition and classification10.1075/li.30.1.03nad ↗
2. Bach, N., and Badaskar, S. (2025, October 18). A Review of Relation Extraction. Available online: https://nguyenbh.github.io/publication/bach-badaskar-2007/bach-badaskar-2007.pdf.
3. Padilla Cuevas, J., Reyes-Ortiz, J.A., Cuevas-Rasgado, A.D., Mora-Gutiérrez, R.A., and Bravo, M. (2024). MédicoBERT: A Medical Language Model for Spanish Natural Language Processing Tasks with a Question-Answering Application Using Hyperparameter Optimization. Appl. Sci., 14.10.3390/app14167031 ↗
4. A Tutorial on Leveraging Knowledge Graphs for Web Search
5. Yin, B., Sun, Y., and Wang, Y. (2020, January 11–14). Entity relation extraction method based on fusion of multiple information and attention mechanism. Proceedings of the 2020 IEEE 6th International Conference on Computer and Communications (ICCC), Chengdu, China.10.1109/ICCC51575.2020.9344960 ↗
6. Wang, X., Sun, Y., Chen, C., and Cui, J. (2022, January 23–25). A relation extraction model based on BERT model in the financial regulation field. Proceedings of the 2022 2nd International Conference on Computer Science, Electronic Information Engineering and Intelligent Control Technology (CEI), Nanjing, China.10.1109/CEI57409.2022.9950087 ↗
7. Framewise phoneme classification with bidirectional LSTM and other neural network architectures10.1016/j.neunet.2005.06.042 ↗
8. BioBERT: A pre-trained biomedical language representation model for biomedical text mining10.1093/bioinformatics/btz682 ↗
9. Jia, Y., Wang, H., Yuan, Z., Zhu, L., and Xiang, Z.L. (2024). Biomedical relation extraction method based on ensemble learning and attention mechanism. BMC Bioinform., 25.10.1186/s12859-024-05951-y ↗
10. Luo, L., Lai, P.T., Wei, C.H., Arighi, C.N., and Lu, Z. (2022). BioRED: A rich biomedical relation extraction dataset. Briefings Bioinform., 23.10.1093/bib/bbac282 ↗
11. Disparities in Dermatology AI Performance on a Diverse, Curated Clinical Image Set10.1126/sciadv.abq6147 ↗
12. A comprehensive dataset of protein-protein interactions and ligand binding pockets for advancing drug discovery10.1038/s41597-024-03233-z ↗
13. ChemProt: A disease chemical biology database10.1093/nar/gkq906 ↗
14. Campillos-Llanos, L. (2019, January 1). First steps towards building a medical lexicon for Spanish with linguistic and semantic information. Proceedings of the 18th BioNLP Workshop and Shared Task, Florence, Italy.10.18653/v1/W19-5017 ↗
15. Ben Abacha, A., and Zweigenbaum, P. (2011). Automatic extraction of semantic relations between medical entities: A rule based approach. J. Biomed. Semant., 2.10.1186/2041-1480-2-S5-S4 ↗
16. Extracting biomedical entity relations using biological interaction knowledge10.1007/s12539-021-00425-8 ↗
17. Relation extraction between medical entities using deep learning approach10.31449/inf.v45i3.3056 ↗
18. A hierarchical convolutional model for biomedical relation extraction10.1016/j.ipm.2023.103560 ↗
19. Serrano C., J.E., and Martínez-Santos, J.C. (2018). Support Vector Machines for Semantic Relation Extraction in Spanish Language. Advances in Computing, Springer.10.1007/978-3-319-98998-3 ↗
20. Tsatsaronis, G., Balikas, G., Malakasiotis, P., Partalas, I., Zschunke, M., Alvers, M.R., Weissenborn, D., Krithara, A., Petridis, S., and Polychronopoulos, D. (2015). An overview of the BIOASQ large-scale biomedical semantic indexing and question answering competition. BMC Bioinform., 16.10.1186/s12859-015-0564-6 ↗
21. Rodriguez-Penagos, C., Nentidis, A., Gonzalez-Agirre, A., Asensio, A., Armengol-Estapé, J., Krithara, A., Villegas, M., Paliouras, G., and Krallinger, M. (2020, January 8–11). Overview of MESINESP8, a Spanish Medical Semantic Indexing Task within BioASQ 2020. Proceedings of the 8th BioASQ Workshop A Challenge on Large-Scale Biomedical Semantic Indexing and Question Answering, Brooklyn, NY, USA.
22. BIREME, PAHO, and WHO (2025). Health Sciences Descriptors: DeCS [Internet], WHO. [2025th ed.]. Updated 2025 March 28.
23. Biblioteca Virtual en Salud (BVS) (2025). Portal de la Biblioteca Virtual en Salud [Internet], 2025, WHO.
24. Generation of Feature Vectors for Identifying Medical Entities in Spanish
25. Ramshaw, L., and Marcus, M. (1995, January 30). Text chunking using transformation-based learning. Proceedings of the Third Workshop on Very Large Corpora, Cambridge, MA, USA.
26. Distributional structure10.1080/00437956.1954.11659520 ↗
27. García-Robledo, G.A., Reyes-Ortiz, J.A., Bravo, M., and Cuevas Rasgado, A.D. (2025, October 18). MedRel_Spanish (Version 1). Available online: https://zenodo.org/records/15320867.
28. Devlin, J., Chang, M.W., Lee, K., and Toutanova, K. (2019). BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding. arXiv.
29. Wikipedia Contributors (2025, August 24). EnglishWikipedia, 2025. Available online: https://en.wikipedia.org/wiki/English_Wikipedia.
30. Zhu, Y., Kiros, R., Zemel, R., Salakhutdinov, R., Urtasun, R., Torralba, A., and Fidler, S. (2015, January 7–13). Aligning books and movies: Towards story-like visual explanations by watching movies and reading books. Proceedings of the IEEE International Conference on Computer Vision (ICCV), Santiago, Chile.10.1109/ICCV.2015.11 ↗
31. Krallinger, M., Armengol-Estapé, J., De Gibert, O., Carrino, C.P., Gonzalez-Agirre, A., Gutiérrez-Fandiño, A., and Villegas, M. (2025, October 18). Spanish Biomedical Crawled Corpus. Available online: https://zenodo.org/records/4561971.
32. Wang, L.L., Lo, K., Chandrasekhar, Y., Reas, R., Yang, J., Burdick, D., Eide, D., Funk, K., Katsis, Y., and Kinney, R. (2020). CORD-19: The Covid-19 Open Research Dataset. arXiv.
33. El Ministerio de Energía, Turismo y Agenda Digital (2018). Plan de Impulso de las Tecnologías del Lenguaje, El Ministerio de Energía, Turismo y Agenda Digital.