Domain-Specific Knowledge Graph for Quality Engineering of Continuous Casting: Joint Extraction-Based Construction and Adversarial Training Enhanced Alignment
Source abstract
Abstract
The intelligent development of continuous casting quality engineering is an essential step for the efficient production of high-quality billets. However, there are many quality defects that require strong expertise for handling. In order to reduce reliance on expert experience and improve the intelligent management level of billet quality knowledge, we focus on constructing a Domain-Specific Knowledge Graph (DSKG) for the quality engineering of continuous casting. To achieve joint extraction of billet quality defects entity and relation, we propose a Self-Attention Partition and Recombination Model (SAPRM). SAPRM divides domain-specific sentences into three parts: entity-related, relation-related, and shared features, which are specifically for Named Entity Recognition (NER) and Relation Extraction (RE) tasks. Furthermore, for issues of entity ambiguity and repetition in triples, we propose a semi-supervised incremental learning method for knowledge alignment, where we leverage adversarial training to enhance the performance of knowledge alignment. In the experiment, in the knowledge extraction part, the NER and RE precision of our model achieved 86.7% and 79.48%, respectively. RE precision improved by 20.83% compared to the baseline with sequence labeling method. Additionally, in the knowledge alignment part, the precision of our model reached 99.29%, representing a 1.42% improvement over baseline methods. Consequently, the proposed model with the partition mechanism can effectively extract domain knowledge, cand the semi-supervised method can take advantage of unlabeled triples. Our method can adapt the domain features and construct a high-quality knowledge graph for the quality engineering of continuous casting, providing an efficient solution for billet defect issues.
Source: crossref · Quality: baseline
Research context
OpenAlex topics: Topic Modeling · Natural Language Processing Techniques · Software Engineering Research
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
Affiliations
Shaanxi Joint Laboratory of Artificial Intelligence, School of Software Engineering, Xi’an Jiaotong University, Xi’an 710049, China
China National Heavy Machinery Research Institute Co., Ltd., Xi’an 710016, China
Funding
Shaanxi Province Innovation Capacity Support Plan
References (37)
Show source-provided references
1. Model identification and control of electromagnetic actuation in continuous casting process with improved quality10.1109/JAS.2023.123027 ↗
2. Review on modeling and simulation of continuous casting10.1002/srin.201700312 ↗
3. Domain-specific knowledge graphs: A survey10.1016/j.jnca.2021.103076 ↗
4. Li, Y. (2022). Research on Some Problems of Power Equipment Defect Text Mining and Application Based on Knowledge Graph. [Master’s Thesis, Zhejiang University].
5. Building a knowledge graph to enable precision medicine10.1038/s41597-023-01960-3 ↗
6. Yang, Z., Huang, Y., and Feng, J. (2023). Learning to leverage high-order medical knowledge graph for joint entity and relation extraction. Findings of the Association for Computational Linguistics: ACL 2023, Association for Computational Linguistics.10.18653/v1/2023.findings-acl.575 ↗
7. Joint biomedical entity and relation extraction based on feature filter table labeling10.1109/ACCESS.2023.3331504 ↗
8. Ye, D., Lin, Y., Li, P., and Sun, M. (2022, January 22–27). Packed Levitated Marker for Entity and Relation Extraction. Proceedings of the 60th Annual Meeting of the Association for Computational Linguistics, (Volume 1: Long Papers), Dublin, Ireland.10.18653/v1/2022.acl-long.337 ↗
9. Yan, Z., Yang, S., Liu, W., and Tu, K. (2023, January 6–10). Joint Entity and Relation Extraction with Span Pruning and Hypergraph Neural Networks. Proceedings of the 2023 Conference on Empirical Methods in Natural Language Processing, Singapore.10.18653/v1/2023.emnlp-main.467 ↗
10. Li, Z., Fu, L., Wang, X., Zhang, H., and Zhou, C. (2022, January 22–27). RFBFN: A relation-first blank filling network for joint relational triple extraction. Proceedings of the 60th Annual Meeting of the Association for Computational Linguistics: Student Research Workshop, Dublin, Ireland.10.18653/v1/2022.acl-srw.2 ↗
11. Zheng, H., Wen, R., Chen, X., Yang, Y., Zhang, Y., Zhang, Z., Zhang, N., Qin, B., Ming, X., and Zheng, Y. (2021, January 1–6). PRGC: Potential Relation and Global Correspondence Based Joint Relational Triple Extraction. Proceedings of the 59th Annual Meeting of the Association for Computational Linguistics and the 11th International Joint Conference on Natural Language Processing (Volume 1: Long Papers), Online.10.18653/v1/2021.acl-long.486 ↗
12. Lu, Y., Liu, Q., Dai, D., Xiao, X., Lin, H., Han, X., Sun, L., and Wu, H. (2022, January 22–27). Unified Structure Generation for Universal Information Extraction. Proceedings of the 60th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), Dublin, Ireland.10.18653/v1/2022.acl-long.395 ↗
13. Ngo, N., Min, B., and Nguyen, T. (2022). Unsupervised domain adaptation for joint information extraction. Findings of the Association for Computational Linguistics: EMNLP 2022, Association for Computational Linguistics.10.18653/v1/2022.findings-emnlp.434 ↗
14. Van Nguyen, M., Min, B., Dernoncourt, F., and Nguyen, T. (2022, January 7–11). Learning cross-task dependencies for joint extraction of entities, events, event arguments, and relations. Proceedings of the 2022 Conference on Empirical Methods in Natural Language Processing, Abu Dhabi, United Arab Emirates.10.18653/v1/2022.emnlp-main.634 ↗
15. Li, Y., Xue, B., Zhang, R., and Zou, L. (2023, January 9–14). AtTGen: Attribute tree generation for real-world attribute joint extraction. Proceedings of the 61st Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), Toronto, ON, Canada.10.18653/v1/2023.acl-long.119 ↗
16. Zhang, R., Li, Y., and Zou, L. (2023, January 9–14). A novel table-to-graph generation approach for document-level joint entity and relation extraction. Proceedings of the 61st Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), Toronto, ON, Canada.10.18653/v1/2023.acl-long.607 ↗
17. Cross-Lingual entity alignment model based on the similarities of entity descriptions and knowledge embeddings
18. Zhou, L. (2024). Research on Intelligent Diagnosis and Maintenance Decision Method of Train Control On-Board Equipment in High-speed Railway. [Ph.D. Thesis, Lanzhou Jiaotong University].
19. Jiang, T., Bu, C., Zhu, Y., and Wu, X. (2019, January 26–30). Two-Stage Entity Alignment: Combining Hybrid Knowledge Graph Embedding with Similarity-Based Relation Alignment. Proceedings of the Pacific Rim International Conference on Artificial Intelligence, Yanuca Island, Fiji.10.1007/978-3-030-29908-8_13 ↗
20. Dettmers, T., Minervini, P., Stenetorp, P., and Riedel, S. (2018, January 2–7). Convolutional 2d knowledge graph embeddings. Proceedings of the AAAI Conference on Artificial Intelligence, New Orleans, LA, USA.10.1609/aaai.v32i1.11573 ↗
21. Construction and application of bolt and nut pair knowledge graph based on GGNN
22. Improving attention network to realize joint extraction for the construction of equipment knowledge graph10.1016/j.engappai.2023.106723 ↗
23. The construction of knowledge graphs in the aviation assembly domain based on a joint knowledge extraction model10.1109/ACCESS.2023.3254132 ↗
24. A distributed joint extraction framework for sedimentological entities and relations with federated learning10.1016/j.eswa.2022.119216 ↗
25. Devlin, J., Chang, M.-W., Lee, K., and Toutanova, K. (2019, January 2–7). Bert: Pre-training of deep bidirectional transformers for language understanding. Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long and Short Papers), Minneapolis, MN, USA.
26. Li, L., Ma, R., Guo, Q., Xue, X., and Qiu, X. (2020, January 16–20). BERT-ATTACK: Adversarial Attack Against BERT Using BERT. Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing (EMNLP), Online.10.18653/v1/2020.emnlp-main.500 ↗
27. Wang, Y., Yu, B., Zhang, Y., Liu, T., Zhu, H., and Sun, L. (2020, January 8–13). TPLinker: Single-stage Joint Extraction of Entities and Relations Through Token Pair Linking. Proceedings of the 28th International Conference on Computational Linguistics, Barcelona, Spain.10.18653/v1/2020.coling-main.138 ↗
28. Theodoropoulos, C., and Moens, M.-F. (2023, January 4–8). An information extraction study: Take in mind the tokenization!. Proceedings of the Conference of the European Society for Fuzzy Logic and Technology, Palma, Spain.10.1007/978-3-031-39965-7_49 ↗
29. Ma, Y., Hiraoka, T., and Okazaki, N. (2022, January 27). Joint entity and relation extraction based on table labeling using convolutional neural networks. Proceedings of the Sixth Workshop on Structured Prediction for NLP, Dublin, Ireland.10.18653/v1/2022.spnlp-1.2 ↗
30. Beltagy, I., Lo, K., and Cohan, A. (2019, January 3–7). SciBERT: A Pretrained Language Model for Scientific Text. Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing (EMNLP-IJCNLP), Hong Kong, China.10.18653/v1/D19-1371 ↗
31. Wang, J., and Lu, W. (2020, January 16–20). Two are Better than One: Joint Entity and Relation Extraction with Table-Sequence Encoders. Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing (EMNLP), Online.10.18653/v1/2020.emnlp-main.133 ↗
32. Eberts, M., and Ulges, A. (2020). Span-based joint entity and relation extraction with transformer pre-training. ECAI 2020, IOS Press.10.3233/FAIA200321 ↗
33. Wei, Z., Su, J., Wang, Y., Tian, Y., and Chang, Y. (2020, January 5–10). A Novel Cascade Binary Tagging Framework for Relational Triple Extraction. Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics, Online.10.18653/v1/2020.acl-main.136 ↗
34. Wang, Y., Sun, C., Wu, Y., Yan, J., Gao, P., and Xie, G. (2020, January 16–20). Pre-training entity relation encoder with intra-span and inter-span information. Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing (EMNLP), Online.10.18653/v1/2020.emnlp-main.132 ↗
35. Zhong, Z., and Chen, D. (2021, January 6–11). A Frustratingly Easy Approach for Entity and Relation Extraction. Proceedings of the 2021 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Online.10.18653/v1/2021.naacl-main.5 ↗
36. Beyond BERT: Exploring the Efficacy of RoBERTa and ALBERT in Supervised Multiclass Text Classification
37. Sun, Y., Wang, S., Li, Y., Feng, S., Tian, H., Wu, H., and Wang, H. (2020, January 7–12). Ernie 2.0: A continual pre-training framework for language understanding. Proceedings of the AAAI Conference on Artificial Intelligence, New York, NY, USA.10.1609/aaai.v34i05.6428 ↗