A Chinese Named Entity Recognition Method for News Domain Based on Transfer Learning and Word Embeddings
Source abstract
Abstract
Named Entity Recognition (NER) is vital in natural language processing for the analysis of news texts, as it accurately identifies entities such as locations, persons, and organizations, which is crucial for applications like news summarization and event tracking. However, NER in the news domain faces challenges due to insufficient annotated data, complex entity structures, and strong context dependencies. To address these issues, we propose a new Chinese-named entity recognition method that integrates transfer learning with word embeddings. Our approach leverages the ERNIE pre-trained model for transfer learning and obtaining general language representations and incorporates the Soft-lexicon word embedding technique to handle varied entity structures. This dual-strategy enhances the model’s understanding of context and boosts its ability to process complex texts. Experimental results show that our method achieves an F1 score of 94.72% on a news dataset, surpassing baseline methods by 3%–4%, thereby confirming its effectiveness for Chinese-named entity recognition in the news domain.
Source: openalex_inverted_index · Quality: baseline
Research context
OpenAlex topics: Topic Modeling · Natural Language Processing Techniques · Advanced Text Analysis Techniques
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
References (37)
Show source-provided references
1. A named entity recognition method for political news
2. News named entity recognition and sentiment classification based on attention-based bi-directional long short-term memory neural network and conditional random field
3. Named entity recognition of news texts in ten ASEAN countries
4. Research on fine-grained named-entity-recognition method for public-opinion texts in northeast Asia
5. Chinese NER using dynamic meta-embeddings10.1109/ACCESS.2019.2916816 ↗
6. Character embedding method for Chinese named entity recognition
7. Adversarial transfer learning for Chinese named entity recognition with self-attention mechanism
8. Long short-term memory neural networks for Chinese word segmentation
9. End-to-end sequence labeling via bi-directional LSTM-CNNs-CRF
10. Medical name entity recognition based on Bi-LSTM-CRF and attention mechanism
11. Chinese NER using lattice LSTM
12. An encoding strategy based word-character LSTM for Chinese NER
13. Neural Chinese named entity recognition via CNN-LSTM-CRF and joint training with word segmentation
14. XLNet: generalized autoregressive pretraining for language understanding
15. ERNIE: enhanced language representation with informative entities
16. CNN-based Chinese NER with lexicon rethinking
17. Chinese named entity recognition based on CNN-head transformer encoder
18. Chinese named entity recognition method based on BERT embedding
19. CAN-NER: convolutional attention network for chinese named entity recognition
20. Yan H, Deng B, Li X, Qiu X. TENER: adapting transformer encoder for named entity recognition. arXiv:1911.04474.2019.
21. FLAT: chinese NER using flat-lattice transformer
22. Neural architectures for named entity recognition
23. Named entity recognition for Chinese EMR with RoBERTa-WWM-BiLSTM-CRF
24. Chinese named entity recognition based on BERT and lexicon enhancement
25. Lexicon enhanced Chinese named entity recognition with pointer network10.1007/s00521-022-07287-1 ↗
26. BERT: pre-training of deep bidirectional transformers for language understanding
27. Sun Y, Wang S, Feng S, Ding S, Pang C, Shang J, et al. Ernie 3.0: large-scale knowledge enhanced pre-training for language understanding and generation. arXiv:2104.02137. 2021.
28. An ERNIE-based joint model for Chinese named entity recognition10.3390/app10165711 ↗
29. A Chinese named entity recognition method for small-scale dataset based on lexicon and unlabeled data10.1007/s11042-022-13377-y ↗
30. Enhanced Chinese named entity recognition with multi-granularity BERT adapter and efficient global pointer10.1007/s40747-024-01383-6 ↗
31. Research on an improved extraction method for three elements of disaster news
32. News timeline mining and presentation based on machine reading comprehension
33. Recognition of named entity in Chinese resume based on ALBERT
34. Named entity recognition model based on k-best viterbi decoupling knowledge distillation
35. Multi-feature Chinese named entity recognition
36. Named entity recognition in medical domain combined with knowledge graph
37. A named entity recognition model based on lis domain knowledge