Domain-Specific NER for Fluorinated Materials: A Hybrid Approach with Adversarial Training and Dynamic Contextual Embeddings
Source abstract
Abstract
In the research and production of fluorinated materials, large volumes of unstructured textual data are generated, characterized by high heterogeneity and fragmentation. These issues hinder systematic knowledge integration and efficient utilization. Constructing a knowledge graph for fluorinated materials processing is essential for enabling structured knowledge management and intelligent applications. Among its core components, Named Entity Recognition (NER) plays an essential role, as its accuracy directly impacts relation extraction and semantic modeling, which ultimately affects the knowledge graph construction for fluorinated materials. However, NER in this domain faces challenges such as fuzzy entity boundaries, inconsistent terminology, and a lack of high-quality annotated corpora. To address these problems, (i) We first construct a domain-specific NER dataset by combining manual annotation with an improved Easy Data Augmentation (EDA) strategy; (ii) Secondly, we propose a novel model, RRC-ADV, which integrates RoBERTa-wwm for dynamic contextual word representation, adversarial training to improve robustness against boundary ambiguity, and a Residual BiLSTM (ResBiLSTM) to enhance sequential feature modeling. Further, a Conditional Random Field (CRF) layer is incorporated for globally optimized label prediction. Experimental results demonstrate that RRC-ADV achieves an average F1 score of 89.23% on the self-constructed dataset, significantly outperforming baseline models. The model exhibits strong robustness and adaptability within the domain of fluorinated materials. Our work enhances the accuracy of NER in the fluorinated materials processing domain and paves the way for downstream tasks such as relation extraction in knowledge graph construction.
Source: openalex_inverted_index · Quality: baseline
Research context
OpenAlex topics: Geophysical Methods and Applications · Anomaly Detection Techniques and Applications · Adversarial Robustness in Machine Learning
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
References (34)
Show source-provided references
1. Recent advances in fluorinated polymers: synthesis and diverse applications10.1007/s11426-023-1831-8 ↗
2. A survey on knowledge graphs: representation, acquisition, and applications10.1109/TNNLS.2021.3070843 ↗
3. Compound knowledge graph-enabled AI assistant for accelerated materials discovery10.1007/s40192-022-00286-z ↗
4. A recommendation model of rice fertilization using knowledge graph and case-based reasoning10.1016/j.compag.2024.108751 ↗
5. Incorporating multi-perspective information into reinforcement learning to address multi-hop knowledge graph question answering10.1016/j.eswa.2024.124652 ↗
6. A review: knowledge reasoning over knowledge graph10.1016/j.eswa.2019.112948 ↗
7. Liu Y, Ott M, Goyal N, Du J, Joshi M, Chen D, et al. RoBERTa: a robustly optimized bert pretraining approach. arXiv:1907.11692. 2019.
8. Yasunaga M, Kasai J, Radev D. Robust multilingual part-of-speech tagging via adversarial training. arXiv:1711.04903v2. 2018.10.18653/v1/N18-1089 ↗
9. A residual BiLSTM model for named entity recognition10.1109/ACCESS.2020.3046253 ↗
10. Message understanding conference-6: a brief history
11. Efficient support vector classifiers for named entity recognition
12. An introduction to hidden Markov models10.1109/MASSP.1986.1165342 ↗
13. Maximum entropy Markov models for information extraction and segmentation
14. Lafferty J, McCallum A, Pereira F. Conditional random fields: probabilistic models for segmenting and labeling sequence data [Internet]. [cited 2025 Jul 21]. Available from: https://repository.upenn.edu/handle/20.500.14332/6188.
15. A survey on deep learning for named entity recognition10.1109/TKDE.2020.2981314 ↗
16. Backpropagation applied to handwritten zip code recognition10.1162/neco.1989.1.4.541 ↗
17. Cho K, Van Merriënboer B, Gulcehre C, Bahdanau D, Bougares F, Schwenk H, et al. Learning phrase representations using RNN encoder-decoder for statistical machine translation. arXiv:1406.1078v3. 2014.10.3115/v1/D14-1179 ↗
18. Long short-term memory10.1162/neco.1997.9.8.1735 ↗
19. Huang Z, Xu W, Yu K. Bidirectional LSTM-CRF models for sequence tagging. arXiv:1508.01991v1. 2015.
20. Ma X, Hovy E. End-to-end sequence labeling via bi-directional LSTM-CNNs-CRF. arXiv:1603.01354v5. 2016.10.18653/v1/P16-1101 ↗
21. The extraction method of knowledge entities and relationships of landscape plants based on ALBERT model
22. Named entity recognition using BERT BiLSTM CRF for Chinese electronic health records
23. Chinese mineral named entity recognition based on BERT model10.1016/j.eswa.2022.117727 ↗
24. Chithrananda S, Grand G, Ramsundar B. ChemBERTa: large-scale self-supervised pretraining for molecular property prediction. arXiv:2010.09885v2. 2020.
25. Research on the Chinese named-entity-relation-extraction method for crop diseases based on BERT10.3390/agronomy12092130 ↗
26. Material calculation collaborates with grain morphology knowledge graph for material properties prediction
27. Automating materials exploration with a semantic knowledge graph for Li-ion battery cathodes10.1002/adfm.202201437 ↗
28. Dai X, Adel H. An analysis of simple data augmentation for named entity recognition. arXiv:2010.11683v1. 2020.10.18653/v1/2020.coling-main.343 ↗
29. Wei J, Zou K. EDA: easy data augmentation techniques for boosting performance on text classification tasks. arXiv:1901.11196v2. 2019.10.18653/v1/D19-1670 ↗
30. Bilateral feature fusion with hexagonal attention for robust saliency detection under uncertain environments10.1016/j.inffus.2025.103165 ↗
31. Efficient deepfake detection via layer-frozen assisted dual attention network for consumer imaging devices10.1109/TCE.2024.3476477 ↗
32. Goodfellow IJ, Shlens J, Szegedy C. Explaining and harnessing adversarial examples. arXiv:1412.6572v3. 2015.
33. Miyato T, Dai AM, Goodfellow I. Adversarial training methods for semi-supervised text classification. arXiv:1605.07725v4. 2021.
34. Madry A, Makelov A, Schmidt L, Tsipras D, Vladu A. Towards deep learning models resistant to adversarial attacks. arXiv:1706.06083v4. 2019.