A U-Shaped Network-Based Grid Tagging Model for Chinese Named Entity Recognition
Source abstract
Abstract
Chinese named entity recognition (CNER) has received widespread attention as an important task of Chinese information extraction. Most previous research has focused on individually studying flat CNER, overlapped CNER, or discontinuous CNER. However, a unified CNER is often needed in real-world scenarios. Recent studies have shown that grid tagging-based methods based on character-pair relationship classification hold great potential for achieving unified NER. Nevertheless, how to enrich Chinese character-pair grid representations and capture deeper dependencies between character pairs to improve entity recognition performance remains an unresolved challenge. In this study, we enhance the character-pair grid representation by incorporating both local and global information. Significantly, we introduce a new approach by considering the character-pair grid representation matrix as a specialized image, converting the classification of character-pair relationships into a pixel-level semantic segmentation task. We devise a U-shaped network to extract multi-scale and deeper semantic information from the grid image, allowing for a more comprehensive understanding of associative features between character pairs. This approach leads to improved accuracy in predicting their relationships, ultimately enhancing entity recognition performance. We conducted experiments on two public CNER datasets in the biomedical domain, namely CMeEE-V2 and Diakg. The results demonstrate the effectiveness of our approach, which achieves F1-score improvements of 7.29 percentage points and 1.64 percentage points compared to the current state-of-the-art (SOTA) models, respectively.
Source: openalex_inverted_index · Quality: baseline
Research context
OpenAlex topics: Topic Modeling · Natural Language Processing Techniques · Biomedical Text Mining and Ontologies
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
References (45)
Show source-provided references
1. A survey on deep learning for named entity recognition10.1109/TKDE.2020.2981314 ↗
2. Arabic named entity recognition: A BERT-BGRU approach
3. Chinese named entity recognition: The state of the art10.1016/j.neucom.2021.10.101 ↗
4. Unify the usage of lexicon in Chinese named entity recognition
5. Y. Zhang and J. Yang, “Chinese NER using lattice LSTM,” arXiv preprint arXiv:1805.02023, 2018.10.18653/v1/P18-1144 ↗
6. S. Wu, X. Song, Z. Feng, and X. J. Wu, “NFLAT: Non-flat-lattice transformer for Chinese named entity recognition,” arXiv preprint arXiv:2205.05832, 2022.
7. LADA-Trans-NER: Adaptive efficient transformer for Chinese named entity recognition using lexicon-attention and data-augmentation
8. Y. Gu et al., “Delving deep into regularity: A simple but effective method for Chinese named entity recognition,” arXiv preprint arXiv:2204.05544, 2022.10.18653/v1/2022.findings-naacl.143 ↗
9. Unified named entity recognition as word-word relation classification
10. J. Su et al., “Global pointer: Novel efficient span-based approach for named entity recognition,” arXiv preprint arXiv:2208.03054, 2022.
11. H. Yan, Y. Sun, X. Li, and X. Qiu, “An embarrassingly easy but strong baseline for nested named entity recognition,” arXiv preprint arXiv:2208.04534, 2022.10.18653/v1/2023.acl-short.123 ↗
12. Chinese cyber threat intelligence named entity recognition via RoBERTa-wwm-RDCNN-CRF
13. A federated named entity recognition model with explicit relation for power grid
14. Building a pediatric medical corpus: Word segmentation and named entity annotation
15. Chang · Knowledge Graph and Semantic Computing · 2021 · 6 · 308
16. TOE: A grid-tagging discontinuous NER model enhanced by embedding tag/word relations and more fine-grained tags10.1109/TASLP.2022.3221009 ↗
17. Z. Huang, W. Xu, and K. Yu, “Bidirectional LSTM-CRF models for sequence tagging,” arXiv preprint arXiv:1508.01991, 2015.
18. Z. Yuan et al., “Fusing heterogeneous factors with triaffine mechanism for nested named entity recognition,” arXiv preprint arXiv:2110.07480, 2021.10.18653/v1/2022.findings-acl.250 ↗
19. X. Li et al., “FLAT: Chinese NER using flat-lattice transformer,” arXiv preprint arXiv:2004.11795, 2020.10.18653/v1/2020.acl-main.611 ↗
20. S. Wu, X. Song, and Z. Feng, “MECT: Multi-metadata embedding based cross-transformer for Chinese named entity recognition,” arXiv preprint arXiv:2107.05418, 2021.10.18653/v1/2021.acl-long.121 ↗
21. J. Yu, B. Bohnet, and M. Poesio, “Named entity recognition as dependency parsing,” arXiv preprint arXiv:2005.07150, 2020.10.18653/v1/2020.acl-main.577 ↗
22. E. Zhu, Y. Liu, and J. Li, “Deep span representations for named entity recognition,” arXiv preprint arXiv:2210.04182, 2022.10.18653/v1/2023.findings-acl.672 ↗
23. U-net: Convolutional networks for biomedical image segmentation
24. U-net and its variants for medical image segmentation: A review of theory and applications10.1109/ACCESS.2021.3086020 ↗
25. Q. Liu et al., “Incomplete utterance rewriting as semantic segmentation,” arXiv preprint arXiv:2009.13166, 2020.10.18653/v1/2020.emnlp-main.227 ↗
26. N. Zhang et al., “Document-level relation extraction as semantic segmentation,” arXiv preprint arXiv:2106.03618, 2021.
27. R. Ma et al., “Simplify the usage of lexicon in Chinese NER,” arXiv preprint arXiv:1908.05969, 2019.10.18653/v1/2020.acl-main.528 ↗
28. Y. Wang et al., “TPLinker: Single-stage joint extraction of entities and relations through token pair linking,” arXiv preprint arXiv:2010.13415, 2020.10.18653/v1/2020.coling-main.138 ↗
29. Z. Wu et al., “Grid tagging scheme for aspect-oriented fine-grained opinion extraction,” arXiv preprint arXiv:2010.04640, 2020.10.18653/v1/2020.findings-emnlp.234 ↗
30. Joint multimodal entity-relation extraction based on edge-enhanced graph alignment network and word-pair relation tagging
31. J. Devlin et al., “BERT: Pre-training of deep bidirectional transformers for language understanding,” arXiv preprint arXiv:1810.04805, 2018.
32. G. Lample et al., “Neural architectures for named entity recognition,” arXiv preprint arXiv:1603.01360, 2016.10.18653/v1/N16-1030 ↗
33. Z. Dai et al., “Transformer-XL: Attentive language models beyond a fixed-length context,” arXiv preprint arXiv:1901.02860, 2019.10.18653/v1/P19-1285 ↗
34. Attention is all you need
35. J. Su, “Conditional text generation based on conditional layer normalization,” (in Chinese), 2019. Accessed: Mar. 27, 2024. [Online]. Available: https://spaces.ac.cn/archives/7124
36. Semi-open information extraction
37. Y. Wang et al., “Discontinuous named entity recognition as maximal clique discovery,” arXiv preprint arXiv:2106.00218, 2021.
38. A joint model for entity boundary detection and entity span recognition
39. T. Dozat and C. D. Manning, “Deep biaffine attention for neural dependency parsing,” arXiv preprint arXiv:1611.01734, 2016.
40. Y. Yao et al., “DocRED: A large-scale document-level relation extraction dataset,” arXiv preprint arXiv:1906.06127, 2019.10.18653/v1/P19-1074 ↗
41. CBAM: Convolutional block attention module
42. S. Zagoruyko and N. Komodakis, “Paying more attention to attention: Improving the performance of convolutional neural networks via attention transfer,” arXiv preprint arXiv:1612.03928, 2016.
43. Deep residual learning for image recognition
44. MRN: A locally and globally mention-based reasoning network for document-level relation extraction
45. T. Mikolov et al., “Efficient estimation of word representations in vector space,” arXiv preprint arXiv:1301.3781, 2013.