journal article·2025-04-01Open access

A Knowledge and Semantic Fusion Method for Automatic Geometry Problem Understanding

Ying Wang, Wei Zhou, Yongsheng Rao, Hao Guan

Applied Sciences· Volume 15· Issue 7

Abstract

Geometry problem understanding (GPU) is a fundamental task in machine intelligence for problem-solving, requiring more accurate and complete information extraction than general natural language understanding tasks. This paper proposes a knowledge and semantic fusion method to achieve high-quality, interpretable, and scalable GPU. It extracts text-level and knowledge-level entities and relationships from problem texts and transforms them into a semantic knowledge graph. First, a dual-layer semantic-enhanced knowledge ontology model (SGKO) tailored for the geometry domain is constructed. By separating the ontology and data layers and combining the strengths of both the knowledge system type ontology and the semantic network type ontology, it enables bidirectional association between conceptual-level knowledge and object-level textual data. Second, a dynamically generated modular relationship matching template is introduced, which is decomposed into reusable atomic components and dynamically assembled through knowledge base queries, significantly reducing template quantity while enhancing adaptability to complex text structures. Additionally, a state-machine-based semantic information extraction model (IDIM-T) is designed that achieves efficient and interpretable semantic extraction through categorized relationship description types. This is combined with a rule-based method (IDIM-K) to complete knowledge-level entity relationship extraction. To validate the method, a dataset was constructed from authoritative sources, including past middle school exam questions, textbooks, and exercise books, covering unary, binary, and ternary relationships, as well as single-clause, cross-clause, and multi-relationship conjunction expressions. Experiments on 230 problems with complex relational descriptions showed that the proposed method achieved fully accurate two-level relationship parsing for 91.87% of the problems. Compared with four baseline methods (sentence template-based, Bi-LSTM-based, Transformer-based, and S2-based), the method achieved the highest F1 score (0.974) for 1832 relationships, outperforming the highest F1 score (0.900) of the baselines.
Source: crossref · Quality: baseline

Research context

OpenAlex topics: Semantic Web and Ontologies · Rough Sets and Fuzzy Logic · Data Mining Algorithms and Applications

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

School of Cyberspace Security, Software Engineering Institute of Guangzhou, Guangzhou 510006, China

Institute of Computing Science and Technology, Guangzhou University, Guangzhou 510006, China

Funding

National Natural Science Foundation of China · the Guangzhou Academician and Expert Workstation

References (62)

Show source-provided references
1. Huang, L., Yu, X., and He, B. (2022, January 18–20). A Novel Geometry Problem Understanding Method Based on Uniform Vectorized Syntax-Semantics Model. Proceedings of the 2022 International Conference on Intelligent Education and Intelligent Research (IEIR), Wuhan, China.10.1109/IEIR56323.2022.10050038 ↗
2. Seo, M., Hajishirzi, H., Farhadi, A., Etzioni, O., and Malcolm, C. (2015, January 17–21). Solving Geometry Problems: Combining Text and Diagram Interpretation. Proceedings of the 2015 Conference on Empirical Methods in Natural Language Processing, Lisbon, Portugal.10.18653/v1/D15-1171 ↗
3. A Review of Methods for Automatic Understanding of Natural Language Mathematical Problems10.1007/s10462-009-9110-0 ↗
4. LIM-G: Learner-Initiating Instruction Model Based on Cognitive Knowledge for Geometry Word Problem Comprehension10.1016/j.compedu.2005.03.009 ↗
5. A Knowledge Graph Method for Hazardous Chemical Management: Ontology Design and Entity Identification10.1016/j.neucom.2020.10.095 ↗
6. Knowledge Graph for Identifying Geological Disasters by Integrating Computer Vision with Ontology10.1007/s12583-022-1641-1 ↗
7. An Ontology-Based Method of Knowledge Modelling for Remanufacturing Process Planning10.1016/j.jclepro.2020.120952 ↗
8. Chang, D.S., Cho, G.H., and Choi, Y.S. (April, January 30). Ontology-Based Knowledge Model for Human-Robot Interactive Services. Proceedings of the 35th Annual ACM Symposium on Applied Computing, Brno, Czech Republic.
9. The Knowledge Graph as the Default Data Model for Learning on Heterogeneous Knowledge10.3233/DS-170007 ↗
10. A Schema-Driven Synthetic Knowledge Graph Generation Approach With Extended Graph Differential Dependencies (GDDxs)10.1109/ACCESS.2020.3048186 ↗
11. Huang, L., Zhao, Y., Wang, B., Zhang, D., Zhang, R., Das, S., and Giunchiglia, F. (2021). Property-Based Semantic Similarity Criteria to Evaluate the Overlaps of Schemas. Algorithms, 14.10.3390/a14080241 ↗
12. Sharma, C., and Sinha, R. (2019, January 2–5). A Schema-First Formalism for Labeled Property Graph Databases: Enabling Structured Data Loading and Analytics. Proceedings of the 6th IEEE/ACM International Conference on Big Data Computing, Applications and Technologies (BDCAT), Auckland, New Zealand.10.1145/3365109.3368782 ↗
13. Gene Ontology Consortium (2019). The Gene Ontology Resource: 20 Years and Still GOing Strong. Nucleic Acids Res., 47, D330–D338.10.1093/nar/gky1055 ↗
14. The Unified Medical Language System (UMLS): Integrating Biomedical Terminology10.1093/nar/gkh061 ↗
15. (2024, January 01). The Ontology of GeoNames Data Set. Available online: https://download.geonames.org/export/dump/.
16. Portele, C. (2007). OpenGIS® Geography Markup Language (GML) Encoding Standard, Open Geospatial Consortium. Available online: https://www.ogc.org/standard/gml/.
17. CIDOC CRM (2024, January 01). Conceptual Reference Model. Available online: https://cidoc-crm.org.
18. Ho, Q.T., Le, N.Q.K., and Ou, Y.Y. (2021). FAD-BERT: Improved Prediction of FAD Binding Sites Using Pre-Training of Deep Bidirectional Transformers. Comput. Biol. Med., 131.10.1016/j.compbiomed.2021.104258 ↗
19. Vaswani, A. (2017, January 4–9). Attention Is All You Need. Proceedings of the Advances in Neural Information Processing Systems (NeurIPS 2017), Long Beach, CA, USA.
20. Solving Olympiad Geometry Without Human Demonstrations10.1038/s41586-023-06747-5 ↗
21. Chervonyi, Y., Trinh, T.H., and Olšák, M. (2025). Gold-Medalist Performance in Solving Olympiad Geometry with AlphaGeometry2. arXiv.
22. (2024). Team Gemini. Gemini 1.5: Unlocking Multimodal Understanding Across Millions of Tokens of Context. arXiv.
23. Zhu, N., Zhang, X., and Huang, Q. (2024). FGeo-Parser: Autoformalization and Solution of Plane Geometric Problems. Symmetry, 17.10.3390/sym17010008 ↗
24. Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformer
25. Chen, J., Li, T., and Qin, J. (2022, January 7–11). UniGeo: Unifying Geometry Logical Reasoning via Reformulating Mathematical Expression. Proceedings of the 2022 Conference on Empirical Methods in Natural Language Processing (EMNLP), Abu Dhabi, United Arab Emirates.10.18653/v1/2022.emnlp-main.218 ↗
26. Cho, J., Lei, J., and Tan, H. (2021, January 18–24). Unifying Vision-and-Language Tasks via Text Generation. Proceedings of the 38th International Conference on Machine Learning (ICML 2021), Virtual Event.
27. Zhang, M.L., Yin, F., and Liu, C.L. (2023, January 19–25). A Multi-Modal Neural Geometric Solver with Textual Clauses Parsed from Diagram. Proceedings of the 32nd International Joint Conference on Artificial Intelligence (IJCAI 2023), Macao, China.10.24963/ijcai.2023/376 ↗
28. Solving Geometry Problems via Feature Learning and Contrastive Learning of Multimodal Data. CMES-Comput
29. He, Z., and Zhong, X. (2023, January 15–17). A Precise Text-to-Diagram Generation Method for Elementary Geometry. Proceedings of the 2023 20th International Computer Conference on Wavelet Active Media Technology and Information Processing (ICCWAMTIP), Chengdu, China.
30. Wang, J., Zhang, T., and Yu, H. (2025). MagicGeo: Training-Free Text-Guided Geometric Diagram Generation. arXiv.
31. Zhang, C., Song, J., and Li, S. (2024). Proposing and Solving Olympiad Geometry with Guided Tree Search. arXiv.
32. Chen, J., Tang, J., and Qin, J. (2021). GeoQA: A Geometric Question Answering Benchmark Towards Multimodal Numerical Reasoning. Findings of the Association for Computational Linguistics, Proceedings of the ACL-IJCNLP 2021, Bangkok, Thailand, 1–6 August 2021, Association for Computational Linguistics.10.18653/v1/2021.findings-acl.46 ↗
33. Learning to Forget: Continual Prediction with LSTM10.1162/089976600300015015 ↗
34. Cao, J., and Xiao, J. (2022, January 12–17). An Augmented Benchmark Dataset for Geometric Question Answering Through Dual Parallel Text Encoding. Proceedings of the 29th International Conference on Computational Linguistics, Gyeongju, Republic of Korea.
35. Liu, Y., Ott, M., and Goyal, N. (2020, January 5–10). Roberta: A Robustly Optimized BERT Pretraining Approach. Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics (ACL 2020), Online.
36. Zhou, W., Xu, R., and Guan, H. (2022, January 2–4). Research on Geometry Problem Text Understanding Based on Bidirectional LSTM-CRF. Proceedings of the 2022 9th International Conference on Digital Home (ICDH), Guangzhou, China.10.1109/ICDH57206.2022.00026 ↗
37. Huang, Z., Xu, W., and Yu, K. (2015, January 17–21). Bidirectional LSTM-CRF Models for Sequence Tagging. Proceedings of the 2015 Conference on Empirical Methods in Natural Language Processing (EMNLP 2015), Lisbon, Portugal.
38. Tsai, S., Liang, C.C., and Wang, H.M. (2021). Sequence to General Tree: Knowledge-Guided Geometry Word Problem Solving. arXiv.10.18653/v1/2021.acl-short.121 ↗
39. Chung, J., Gulcehre, C., and Cho, K. (2014, January 12). Empirical Evaluation of Gated Recurrent Neural Networks on Sequence Modeling. Proceedings of the NIPS 2014 Workshop on Deep Learning, Montreal, QC, Canada.
40. Usage of Stacked Long Short-Term Memory for Recognition of 3D Analytic Geometry Elements10.5220/0010898900003116 ↗
41. A Deep Stacked Bidirectional LSTM (SBiLSTM) Model for Petroleum Production Forecasting10.1016/j.procs.2023.01.248 ↗
42. Xiao, T., Liu, J., and Huang, Z. (2024, January 3–9). Learning to Solve Geometry Problems via Simulating Human Dual-Reasoning Process. Proceedings of the 33rd International Joint Conference on Artificial Intelligence (IJCAI 2024), Jeju Island, Republic of Korea.
43. Automatic Understanding and Formalization of Plane Geometry Proving Problems in Natural Language: A Supervised Approach10.1142/S0218213019400037 ↗
44. Yu, W., Wang, M., and Wang, X. (2021, January 6–14). GEORE: A Relation Extraction Dataset for Chinese Geometry Problems. Proceedings of the 35th Conference on Neural Information Processing Systems (NeurIPS 2021) Workshop on Math AI for Education (MATHAI4ED), Virtual Event.
45. Xing, S., Xiang, C., and Han, Y. (2024). GePBench: Evaluating Fundamental Geometric Perception for Multimodal Large Language Models. arXiv.
46. Lu, P., Gong, R., and Jiang, S. (2021). Inter-GPS: Interpretable Geometry Problem Solving with Formal Language and Symbolic Reasoning. arXiv.10.18653/v1/2021.acl-long.528 ↗
47. Peng, S., Fu, D., and Liang, Y. (2023). Geodrl: A Self-Learning Framework for Geometry Problem Solving Using Reinforcement Learning in Deductive Reasoning. Findings of the Association for Computational Linguistics, Proceedings of the ACL 2023, Toronto, Canada, 9–14 July 2023, Association for Computational Linguistics.10.18653/v1/2023.findings-acl.850 ↗
48. Mukherjee, A., Garain, U., and Nasipuri, M. (2007, January 13–15). On Construction of a GeometryNet. Proceedings of the 25th IASTED International Multi-Conference on Artificial Intelligence and Applications, Innsbruck, Austria.
49. Using Restricted Natural Language for Geometric Construction10.4028/www.scientific.net/AMM.145.465 ↗
50. Drawing Dynamic Geometry Figures Online with Natural Language for Junior High School Geometry
51. Research for Facing the Natural Language of the Geometry Drawing
52. Automatic Understanding and Formalization of Natural Language Geometry Problems Using Syntax-Semantics Models
53. Gan, W., Yu, X., and Sun, C. (2018). Understanding Plane Geometry Problems by Integrating Relations Extracted from Text and Diagram. Image and Video Technology, Proceedings of the 8th Pacific-Rim Symposium, PSIVT 2017, Wuhan, China, 20–24 November 2017, Springer International Publishing.10.1007/978-3-319-75786-5_30 ↗
54. Automatically Proving Plane Geometry Theorems Stated by Text and Diagram10.1142/S0218001419400032 ↗
55. Yu, X., Geng, Y., and Feng, Z. (2021, January 5–8). Solving Solid Geometric Calculation Problems in Text. Proceedings of the 2021 IEEE International Conference on Engineering, Technology & Education (TALE), Wuhan, China.10.1109/TALE52509.2021.9678751 ↗
56. An End-to-End Algorithm for Solving Circuit Problems10.1142/S0218001419400044 ↗
57. Yu, X., Gan, W., and Wang, M. (2017, January 5–7). Understanding Explicit Arithmetic Word Problems and Explicit Plane Geometry Problems Using Syntax-Semantics Models. Proceedings of the 2017 International Conference on Asian Language Processing (IALP), Singapore.10.1109/IALP.2017.8300590 ↗
58. A Relation Based Algorithm for Solving Direct Current Circuit Problems10.1007/s10489-020-01667-7 ↗
59. Solving Arithmetic Word Problems by Synergizing Syntax-Semantics Extractor for Explicit Relations and Neural Network Miner for Implicit Relations10.1007/s40747-022-00828-0 ↗
60. Lyu, X., and Yu, X. (2021, January 5–8). Solving Explicit Arithmetic Word Problems via Using Vectorized Syntax-Semantics Model. Proceedings of the 2021 IEEE International Conference on Engineering, Technology & Education (TALE), Wuhan, China.10.1109/TALE52509.2021.9678714 ↗
61. Solving Algebraic Problems with Geometry Diagrams Using Syntax-Semantics Diagram Understanding
62. Wei, Z., Su, J., and Wang, Y. (2020, January 5–10). A Novel Cascade Binary Tagging Framework for Relational Triple Extraction. Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics (ACL 2020), Online.10.18653/v1/2020.acl-main.136 ↗