journal article·2022-11-24Open access

Biomedical Text NER Tagging Tool with Web Interface for Generating BERT-Based Fine-Tuning Dataset

Yeon-Ji Park, Min-a Lee, Geun-Je Yang, Soo Jun Park, Chae-Bong Sohn

Applied Sciences· Volume 12· Issue 23

Abstract

In this paper, a tagging tool is developed to streamline the process of locating tags for each term and manually selecting the target term. It directly extracts the terms to be tagged from sentences and displays it to the user. It also increases tagging efficiency by allowing users to reflect candidate categories in untagged terms. It is based on annotations automatically generated using machine learning. Subsequently, this architecture is fine-tuned using Bidirectional Encoder Representations from Transformers (BERT) to enable the tagging of terms that cannot be captured using Named-Entity Recognition (NER). The tagged text data extracted using the proposed tagging tool can be used as an additional training dataset. The tagging tool, which receives and saves new NE annotation input online, is added to the NER and RE web interfaces using BERT. Annotation information downloaded by the user includes the category (e.g., diseases, genes/proteins) and the list of words associated to the named entity selected by the user. The results reveal that the RE and NER results are improved using the proposed web service by collecting more NE annotation data and fine-tuning the model using generated datasets. Our application programming interfaces and demonstrations are available to the public at via the website link provided in this paper.
Source: crossref · Quality: baseline

Research context

OpenAlex topics: Biomedical Text Mining and Ontologies · Topic Modeling · Semantic Web and Ontologies

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

Department of Electronics and Communications Engineering, Kwangwoon University, Seoul 01897, Republic of Korea

Welfare & Medical ICT Research Department, Electronics and Telecommunications Research Institute, Daejeon 34129, Republic of Korea

Funding

National Research Foundation of Korea (NRF)

References (36)

Show source-provided references
1. Ayush, S., Simmons, M., and Lu, Z. (2016). Text mining genotype-phenotype relationships from biomedical literature for database curation and precision medicine. PLoS Comput. Biol., 12.10.1371/journal.pcbi.1005017 ↗
2. On expert curation and scalability: UniProtKB/Swiss-Prot as a case study10.1093/bioinformatics/btx439 ↗
3. Text-mining-assisted biocuration workflows in Argo10.1093/database/bau070 ↗
4. Assisting manual literature curation for protein–protein interactions using BioQRator10.1093/database/bau067 ↗
5. Egas: A collaborative and interactive document curation platform10.1093/database/bau048 ↗
6. EXTRACT: Interactive extraction of environment metadata and term suggestion for metagenomic sample annotation10.1093/database/baw005 ↗
7. MyMiner: A web application for computer-assisted biocuration and text annotation10.1093/bioinformatics/bts435 ↗
8. Rinaldi, F., Clematide, S., Marques, H., Ellendorff, T., Romacker, M., and Rodriguez-Esteban, R. (2014). OntoGene web services for biomedical text mining. BMC Bioinform., 15.10.1186/1471-2105-15-S14-S6 ↗
9. PubTator: A web-based text mining tool for assisting biocuration10.1093/nar/gkt441 ↗
10. tagtog: Interactive and text-mining-assisted annotation of gene mentions in PLOS full-text articles10.1093/database/bau033 ↗
11. Argo: An integrative, interactive, text mining-based workbench supporting curation10.1093/database/bas010 ↗
12. BioAnnote: A software platform for annotating biomedical documents with application in medical learning environments10.1016/j.cmpb.2013.03.007 ↗
13. GATE Teamware: A web-based, collaborative text annotation framework10.1007/s10579-013-9215-6 ↗
14. Marky: A tool supporting annotation consistency in multi-user and iterative document annotation projects10.1016/j.cmpb.2014.11.005 ↗
15. Pérez-Pérez, M., Glez-Peña, D., Fdez-Riverola, F., and Lourenço, A. (2014). Marky: A lightweight web tracking tool for document annotation. 8th International Conference on Practical Applications of Computational Biology & Bioinformatics (PACBB 2014), Springer.10.1007/978-3-319-07581-5_32 ↗
16. Hans-Michael, M., Kenny, E.E., and Sternberg, P.W. (2004). Textpresso: An ontology-based information retrieval and extraction system for biological literature. PLoS Biol., 2.10.1371/journal.pbio.0020309 ↗
17. Textpresso Central: A customizable platform for searching, text mining, viewing, and curating biomedical literature10.1186/s12859-018-2103-8 ↗
18. Frédérique, S. In Proceedings of the Demonstrations at the 13th Conference of the European Chapter of the Association for Computational Linguistics, Avignon, France, 23–27 April 2012.
19. What makes a gene name? Named entity recognition in the biomedical literature10.1093/bib/6.4.357 ↗
20. Biomedical named entity recognition: A survey of machine-learning tools
21. Chemical named entities recognition: A review on approaches and applications10.1186/1758-2946-6-17 ↗
22. NCBI disease corpus: A resource for disease name recognition and concept normalization10.1016/j.jbi.2013.12.006 ↗
23. ezTag: Tagging biomedical concepts via interactive learning10.1093/nar/gky428 ↗
24. TeamTat: A collaborative text annotation tool10.1093/nar/gkaa333 ↗
25. BioBERT: A pre-trained biomedical language representation model for biomedical text mining10.1093/bioinformatics/btz682 ↗
26. GNormPlus: An integrative approach for tagging genes, gene families, and protein domains10.1155/2015/918710 ↗
27. tmVar 2.0: Integrating genomic variant information from literature with dbSNP and ClinVar for precision medicine10.1093/bioinformatics/btx541 ↗
28. TaggerOne: Joint named entity recognition and normalization with semi-Markov Models10.1093/bioinformatics/btw343 ↗
29. Database resources of the national center for biotechnology information10.1093/nar/gkm1000 ↗
30. Devlin, J., Chang, M.W., Lee, K., and Toutanova, K. (2018). Bert: Pre-training of deep bidirectional transformers for language understanding. arXiv.
31. Attention is all you need
32. Overview of BioCreative II gene mention recognition10.1186/gb-2008-9-s2-s2 ↗
33. Extraction of relations between genes and diseases from text and large-scale data analysis: Implications for translational research10.1186/s12859-015-0472-9 ↗
34. Sachan, D.S., Xie, P., Sachan, M., and Xing, E.P. (2018). Effective use of bidirectional language modeling for transfer learning in biomedical named entity recognition. Machine Learning for Healthcare Conference, PMLR.
35. Collabonet: Collaboration of deep neural networks for biomedical named entity recognition10.1186/s12859-019-2813-6 ↗
36. Deep learning with word embeddings improves biomedical named entity recognition10.1093/bioinformatics/btx228 ↗