journal article·2025Open access

Label-Guided Scientific Abstract Generation with a Siamese Network Using Knowledge Graphs

Haotong Wang, Yves Lepage

Computers, Materials & Continua· Volume 83· Issue 3

Abstract

Knowledge graphs convey precise semantic information that can be effectively interpreted by neural networks, and generating descriptive text based on these graphs places significant emphasis on content consistency. However, knowledge graphs are inadequate for providing additional linguistic features such as paragraph structure and expressive modes, making it challenging to ensure content coherence in generating text that spans multiple sentences. This lack of coherence can further compromise the overall consistency of the content within a paragraph. In this work, we present the generation of scientific abstracts by leveraging knowledge graphs, with a focus on enhancing both content consistency and coherence. In particular, we construct the ACL Abstract Graph Dataset (ACL-AGD) which pairs knowledge graphs with text, incorporating sentence labels to guide text structure and diverse expressions. We then implement a Siamese network to complement and concretize the entities and relations based on paragraph structure by accomplishing two tasks: graph-to-text generation and entity alignment. Extensive experiments demonstrate that the logical paragraphs generated by our method exhibit entities with a uniform position distribution and appropriate frequency. In terms of content, our method accurately represents the information encoded in the knowledge graph, prevents the generation of irrelevant content, and achieves coherent and non-redundant adjacent sentences, even with a shared knowledge graph.
Source: openalex_inverted_index · Quality: baseline

Research context

OpenAlex topics: Semantic Web and Ontologies · Advanced Text Analysis Techniques · Biomedical Text Mining and Ontologies

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

References (40)

Show source-provided references
1. Jourdan · 13th International Workshop on Bibliometric-enhanced Information Retrieval (BIR 2023). Vol. 3617 of CEUR Workshop Proceedings · 2023 · 22
2. Benites · Digital writing technologies in higher education · 2023 · 27910.1007/978-3-031-36033-6_18 ↗
3. Automatic summarization of scientific articles: a survey10.1016/j.jksuci.2020.04.020 ↗
4. A deep learning classifier for sentence classification in biomedical and computer science abstracts10.1007/s00521-019-04334-2 ↗
5. A survey of knowledge-enhanced text generation10.1145/3512467 ↗
6. An attention-based representation learning model for multiple relational knowledge graph10.1111/exsy.13234 ↗
7. Ke · Findings of the association for computational linguistics: ACL-IJCNLP 2021 · 2021 · 2526
8. KGPT: knowledge-grounded pre-training for data-to-text generation
9. Colas · Proceedings of the 29th international conference on computational linguistics · 2022 · 5755
10. Improving text-to-text pre-trained models for the graph-to-text task
11. Investigating pretrained language models for graph-to-text generation
12. Text-to-text pre-training for data-to-text tasks
13. A survey on siamese network: methodologies, applications, and opportunities10.1109/TAI.2022.3207112 ↗
14. Lewis · Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics · 2020 · 787110.18653/v1/2020.acl-main.703 ↗
15. Exploring the limits of transfer learning with a unified text-to-text transformer
16. Scaling instruction-finetuned language models
17. Abstractive summarization: an overview of the state of the art10.1016/j.eswa.2018.12.011 ↗
18. Ito · Proceedings of the 12th International Conference on Natural Language Generation · 2019 · 4010.18653/v1/W19-8606 ↗
19. PaperRobot: incremental draft generation of scientific ideas
20. A survey on knowledge graphs: representation, acquisition, and applications10.1109/TNNLS.2021.3070843 ↗
21. Text generation from knowledge graphs with graph transformers
22. Multi-task identification of entities, relations, and coreference for scientific knowledge graph construction
23. A frustratingly easy approach for entity and relation extraction
24. Nouri · Proceedings of the 2022 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies · 2022 · 2532
25. Suzgun · Proceedings of the 2022 Conference on Empirical Methods in Natural Language Processing · 2022 · 219510.18653/v1/2022.emnlp-main.141 ↗
26. Toward meaningful notions of similarity in NLP embedding models10.1007/s00799-018-0237-y ↗
27. A comprehensive survey of entity alignment for knowledge graphs10.1016/j.aiopen.2021.02.002 ↗
28. Kang · Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing (EMNLP) · 2020 · 653310.18653/v1/2020.emnlp-main.529 ↗
29. Schopf · Proceedings of the 14th International Conference on Recent Advances in Natural Language Processing · 2023 · 103410.26615/978-954-452-092-2_111 ↗
30. Modeling graph structure via relative position for text generation from knowledge graphs
31. Yuan · Proceedings of the 14th International Conference on Recent Advances in Natural Language Processing · 2023 · 125610.26615/978-954-452-092-2_133 ↗
32. Papineni · Proceedings of the 40th Annual Meeting of the Association for Computational Linguistics · 2002 · 311
33. Banerjee · Proceedings of the ACL Workshop on Intrinsic and Extrinsic Evaluation Measures for Machine Translation and/or Summarization · 2005 · 65
34. Popović · Proceedings of the Tenth Workshop on Statistical Machine Translation · 2015 · 39210.18653/v1/W15-3049 ↗
35. Lin · Text Summarization Branches Out · 2004 · 74
36. BERTScore: evaluating text generation with BERT
37. Reimers · Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing (EMNLP-IJCNLP) · 2019 · 3982
38. Typicality of lexical bundles in different sections of scientific articles
39. A review of knowledge reasoning based on neural network
40. Rezayi · Proceedings of the 2021 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies · 2021 · 2767