journal article·2024Open access

SciCN: A Scientific Dataset for Chinese Named Entity Recognition

Jing Yang, Bin Ji, Shasha Li, Jun Ma, Jie Yu

Computers, Materials & Continua· Volume 78· Issue 3

Abstract

Named entity recognition (NER) is a fundamental task of information extraction (IE), and it has attracted considerable research attention in recent years. The abundant annotated English NER datasets have significantly promoted the NER research in the English field. By contrast, much fewer efforts are made to the Chinese NER research, especially in the scientific domain, due to the scarcity of Chinese NER datasets. To alleviate this problem, we present a Chinese scientific NER dataset–SciCN, which contains entity annotations of titles and abstracts derived from 3,500 scientific papers. We manually annotate a total of 62,059 entities, and these entities are classified into six types. Compared to English scientific NER datasets, SciCN has a larger scale and is more diverse, for it not only contains more paper abstracts but these abstracts are derived from more research fields. To investigate the properties of SciCN and provide baselines for future research, we adapt a number of previous state-of-the-art Chinese NER models to evaluate SciCN. Experimental results show that SciCN is more challenging than other Chinese NER datasets. In addition, previous studies have proven the effectiveness of using lexicons to enhance Chinese NER models. Motivated by this fact, we provide a scientific domain-specific lexicon. Validation results demonstrate that our lexicon delivers better performance gains than lexicons of other domains. We hope that the SciCN dataset and the lexicon will enable us to benchmark the NER task regarding the Chinese scientific domain and make progress for future research. The dataset and lexicon are available at: .
Source: openalex_inverted_index · Quality: baseline

Research context

OpenAlex topics: Topic Modeling · Data Quality and Management · Natural Language Processing Techniques

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

References (36)

Show source-provided references
1. Extracting a knowledge base of mechanisms from COVID-19 papers
2. S2ORC: The semantic scholar open research corpus
3. Generating scientific claims for zero-shot scientific fact checking
4. Pubmed 200k RCT: A dataset for sequential sentence classification in medical abstracts
5. A search engine for discovery of scientific challenges and directions
6. Bursting scientific filter bubbles: Boosting innovation via novel author discovery
7. Semeval 2017 task 10: Scienceie-extracting keyphrases and relations from scientific publications
8. TDMSci: A specialized corpus for scientific literature entity tagging of tasks datasets and metrics
9. A general framework for information extraction using dynamic span graphs
10. SciBERT: A pretrained language model for scientific text
11. BioBERT: A pre-trained biomedical language representation model for biomedical text mining10.1093/bioinformatics/btz682 ↗
12. The third international Chinese language processing bake-off: Word segmentation and named entity recognition
13. A survey of noise reduction methods for distant supervision
14. Named entity recognition for Chinese social media with jointly trained embeddings
15. Chinese NER using lattice LSTM
16. The importance of domain-specific expertise in training customized named entity recognition models
17. Annotation cost-sensitive deep active learning with limited data (student abstract)
18. A dataset for inter-sentence relation extraction using distant supervision
19. Multi-criteria-based active learning for named entity recognition
20. Freebase: A collaboratively created graph database for structuring human knowledge
21. Alpacatag: An active learning-based crowd annotation framework for sequence tagging
22. A web survey on the use of active learning to support annotation of text data
23. Reducing wrong labels in distant supervision for relation extraction
24. Semeval-2018 task 7: Semantic relation extraction and classification in scientific papers
25. Simplify the usage of lexicon in Chinese NER
26. Attention is all you need
27. Flat: Chinese NER using flat lattice transformer
28. MECT: Multi-metadata embedding based cross-transformer for Chinese named entity recognition
29. Adversarial learning for Chinese NER from crowd annotations
30. YEDDA: A lightweight collaborative text span annotation tool
31. A coefficient of agreement for nominal scales10.1177/001316446002000104 ↗
32. BERT: Pre-training of deep bidirectional transformers for language understanding
33. Z. Huang, W. Xu and K. Yu, “Bidirectional LSTM-CRF models for sequence tagging,” arXiv preprint arXiv:1508.01991, 2015. 10.48550/arXiv.1508.01991
34. Pre-training with whole word masking for Chinese BERT10.1109/TASLP.2021.3124365 ↗
35. Software framework for topic modelling with large corpora
36. Distributed representations of words and phrases and their compositionality