Named Entity Recognition in Online Medical Consultation Using Deep Learning
Source abstract
Abstract
Named entity recognition in online medical consultation aims to address the challenge of identifying various types of medical entities within complex and unstructured social text in the context of online medical consultations. This can provide important data support for constructing more powerful online medical consultation knowledge graphs and improving virtual intelligent health assistants. A dataset of 26 medical entity types for named entity recognition for online medical consultations is first constructed. Then, a novel approach for deep named entity recognition in the medical field based on the fusion context mechanism is proposed. This approach captures enhanced local and global contextual semantic representations of online medical consultation text while simultaneously modeling high- and low-order feature interactions between local and global contexts, thereby effectively improving the sequence labeling performance. The experimental results show that the proposed approach can effectively identify 26 medical entity types with an average F1 score of 85.47%, outperforming the state-of-the-art (SOTA) method. The practical significance of this study lies in improving the efficiency and performance of domain-specific knowledge extraction in online medical consultation, supporting the development of virtual intelligent health assistants based on large language models and enabling real-time intelligent medical decision-making, thereby helping patients and their caregivers access common medical information more promptly.
Source: crossref · Quality: baseline
Research context
OpenAlex topics: Topic Modeling · Natural Language Processing Techniques · Data Quality and Management
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
Affiliations
School of Safety Science and Engineering, Civil Aviation University of China, Tianjin 300300, China
School of Computer Science and Technology, Civil Aviation University of China, Tianjin 300300, China
Funding
National Natural Science Foundation of China · Supporting Fund of the National Natural Science Foundation of China
References (40)
Show source-provided references
1. Wen, G., Chen, H., Li, H., Hu, Y., Li, Y., and Wang, C. (2020). Cross Domains Adversarial Learning for Chinese Named Entity Recognition for Online Medical Consultation. J. Biomed. Inform., 112.10.1016/j.jbi.2020.103608 ↗
2. Knowledge sharing in online health communities: A social exchange theory perspective10.1016/j.im.2016.02.001 ↗
3. A medical question answering system using large language models and knowledge graphs10.1002/int.22955 ↗
4. Yang, H., and Gao, H. (2018). Toward sustainable virtualized healthcare: Extracting medical entities from Chinese online health consultations using deep neural networks. Sustainability, 10.10.3390/su10093292 ↗
5. Sudat, S.E., Robinson, S.C., Mudiganti, S., Mani, A., and Pressman, A.R. (2021). Mind the Clinical-Analytic Gap: Electronic Health Records and COVID-19 Pandemic Response. J. Biomed. Inform., 116.10.1016/j.jbi.2021.103715 ↗
6. An Entity Recognition Model Based on Deep Learning Fusion of Text Feature10.1016/j.ipm.2021.102841 ↗
7. Lybarger, K., Ostendorf, M., Thompson, M., and Yetisgen, M. (2021). Extracting COVID-19 Diagnoses and Symptoms from Clinical Text: A New Annotated Corpus and Neural Event Extraction Framework. J. Biomed. Inform., 117.10.1016/j.jbi.2021.103761 ↗
8. Sun, Z., Li, X., Sun, X., Meng, Y., Ao, X., He, Q., Wu, F., and Li, J. (2021). Chinesebert: Chinese pretraining enhanced by glyph and pinyin information. arXiv.10.18653/v1/2021.acl-long.161 ↗
9. Fully-Connected LSTM-CRF on Medical Concept Extraction10.1007/s13042-020-01087-6 ↗
10. Zeng, Q.T., Goryachev, S., Weiss, S., Sordo, M., Murphy, S.N., and Lazarus, R. (2006). Extracting Principal Diagnosis, Co-Morbidity and Smoking Status for Asthma Research: Evaluation of a Natural Language Processing System. BMC Med. Inform. Decis. Mak., 6.10.1186/1472-6947-6-30 ↗
11. Detecting Gene Symbols and Names in Biological Texts A First Step Toward Pertinent Information Extraction
12. Settles, B. (2004, January 28–29). Biomedical named entity recognition using conditional random fields and rich feature sets. Proceedings of the International Joint Workshop on Natural Language Processing in Biomedicine and Its Applications, Geneva, Switzerland.10.3115/1567594.1567618 ↗
13. Bikel, D.M., Miller, S., Schwartz, R., and Weischedel, R. (April, January 31). Nymble: A high-performance learning name-finder. Proceedings of the Fifth Conference on Applied Natural Language Processing, Washington, DC, USA.
14. Strubell, E., Verga, P., Belanger, D., and McCallum, A. (2017). Fast and accurate entity recognition with iterated dilated convolutions. arXiv.10.18653/v1/D17-1283 ↗
15. Huang, Z., Xu, W., and Yu, K. (2015). Bidirectional LSTM-CRF models for sequence tagging. arXiv.
16. Ling, W., Luís, T., Marujo, L., Astudillo, R.F., Amir, S., Dyer, C., Black, A.W., and Trancoso, I. (2015). Finding function in form: Compositional character models for open vocabulary word representation. arXiv.10.18653/v1/D15-1176 ↗
17. Mikolov, T., Sutskever, I., Chen, K., Corrado, G., and Dean, J. (2013, January 12–15). Distributed representations of words and phrases and their compositionality. Proceedings of the 26th International Conference on Neural Information Processing Systems, Sydney, NSW, Australia.
18. Lample, G., Ballesteros, M., Subramanian, S., Kawakami, K., and Dyer, C. (2016, January 12–17). Neural Architectures for Named Entity Recognition. Proceedings of the 2016 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, San Diego, CA, USA.10.18653/v1/N16-1030 ↗
19. Biomedical named entity recognition with CNN-BLSTM-CRF
20. Shahmukhi named entity recognition by using contextualized word embeddings10.1016/j.eswa.2023.120489 ↗
21. Liu, Q., Zhang, L., Ren, G., and Zou, B. (2023). Research on named entity recognition of Traditional Chinese Medicine chest discomfort cases incorporating domain vocabulary features. Comput. Biol. Med., 166.10.1016/j.compbiomed.2023.107466 ↗
22. Exploiting global contextual information for document-level named entity recognition10.1016/j.knosys.2023.111266 ↗
23. Ceptner: Contrastive learning enhanced prototypical network for two-stage few-shot named entity recognition10.1016/j.knosys.2024.111730 ↗
24. Uncertainty-Aware Contrastive Learning for semi-supervised named entity recognition10.1016/j.knosys.2024.111762 ↗
25. Xu, C., Shen, K., and Sun, H. (2023). Supplementary features of BiLSTM for enhanced sequence labeling. arXiv.
26. Vaswani, A., Shazeer, N., Parmar, N., Uszkoreit, J., Jones, L., Gomez, A.N., Kaiser, Ł., and Polosukhin, I. (2017, January 4–9). Attention is all you need. Proceedings of the 31st Conference on Neural Information Processing Systems (NIPS 2017), Long Beach, CA, USA.
27. Few-Shot Relation Extraction via the Entity Feature Enhancement and Attention-Based Prototypical Network10.1155/2023/1186977 ↗
28. Guo, H., Tang, R., Ye, Y., Li, Z., and He, X. (2017). DeepFM: A factorization-machine based neural network for CTR prediction. arXiv.10.24963/ijcai.2017/239 ↗
29. Wei, T., Qi, J., He, S., and Sun, S. (2021). Masked Conditional Random Fields for Sequence Labeling. arXiv.10.18653/v1/2021.naacl-main.163 ↗
30. A novel neural network model fusion approach for improving medical named entity recognition in online health expert question-answering services10.1016/j.eswa.2023.119880 ↗
31. Chen, W., Li, Z., Fang, H., Yao, Q., Zhong, C., Hao, J., Zhang, Q., Huang, X., Peng, J., and Wei, Z. (2023). A benchmark for automatic medical consultation system: Frameworks, tasks and datasets. Bioinformatics, 39.10.1093/bioinformatics/btac817 ↗
32. Medical name entity recognition based on lexical enhancement and global pointer
33. Leveraging Transfer Learning and Label Optimization for Enhanced Traditional Chinese Medicine Ner Performance
34. An MRC and adaptive positive-unlabeled learning framework for incompletely labeled named entity recognition10.1002/int.23015 ↗
35. Zhu, Z., Zhao, Q., Li, J., Ge, Y., Ding, X., Gu, T., Zou, J., Lv, S., Wang, S., and Yang, J.-J. (2024). Comparative Analysis of Large Language Models in Chinese Medical Named Entity Recognition. Bioengineering, 11.10.3390/bioengineering11100982 ↗
36. Chinese mineral named entity recognition based on BERT model10.1016/j.eswa.2022.117727 ↗
37. A Chinese named entity recognition method for landslide geological disasters based on deep learning10.1016/j.engappai.2024.109537 ↗
38. Medical entity recognition and knowledge map relationship analysis of Chinese EMRs based on improved BiLSTM-CRF10.1016/j.compeleceng.2023.108709 ↗
39. Ontonotes release 4.0. LDC2011T03, Philadelphia, Penn.: Linguistic Data Consortium
40. Peng, N., and Dredze, M. (2015, January 17–21). Named entity recognition for chinese social media with jointly trained embeddings. Proceedings of the 2015 Conference on Empirical Methods in Natural Language Processing, Lisbon, Portugal.10.18653/v1/D15-1064 ↗