Bridging Text and Knowledge: Explainable AI for Knowledge Graph Classification and Concept Map-Based Semantic Domain Discovery with OBOE Framework
Source abstract
Abstract
Explainable Artificial Intelligence (XAI) has primarily focused on explaining model predictions, yet a critical gap remains in explaining semantic structure discovery within knowledge graphs derived from concept maps (CMs). This study extends the OBOE (explanatiOns Based On concEpts) framework to address a fundamentally different problem, explainable domain discovery in knowledge graphs (KGs) classification, moving beyond supervised classification to unsupervised structural explanation. Our approach integrates Knowledge Graph Embeddings (KGEs), clustering algorithms, and Large Language Models (LLMs) in a novel triple role—generating structural explanations, verifying hallucinations, and enabling large-scale evaluation. Concept–relation–concept triples are embedded through KGEs and clustered using hierarchical and spectral methods to reveal semantic domains, with QualIT-inspired LLM prompting via Chain-of-Thought reasoning. Evaluation across three corpora (Amazon, BBC News, and Reuters) demonstrated robust classification with mean per-class errors of 0.1, 0.147, and 0.142, and LogLoss values of 0.236, 0.342, and 0.395, discovering 92 semantic domains across 17 topics. Hierarchical clustering achieved superior performance (mean 3.78/5) with higher relevance, while spectral clustering offered better coverage (3.51/5) through more compact structures. By bridging traditional clustering with LLM-based explanation and evaluation, this work establishes a new XAI paradigm for knowledge organization contexts where understanding semantic graph structure is as critical as classification accuracy.
Source: crossref · Quality: baseline
Research context
OpenAlex topics: Advanced Graph Neural Networks · Explainable Artificial Intelligence (XAI) · Machine Learning in Healthcare
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
Affiliations
Department of Information Technology, CEU San Pablo University, 28668 Madrid, Spain
Department of Artificial Intelligence, Polytechnic University of Madrid, 28660 Madrid, Spain
Spanish Ministry of Education, Vocational Training and Sports, 28014 Madrid, Spain
EY AI Center of Excellence, EY Europe West Technology, 28003 Madrid, Spain
References (73)
Show source-provided references
1. Peeking inside the Black-Box: A Survey on Explainable Artificial Intelligence (XAI)
2. Explainable Artificial Intelligence (XAI): Concepts, Taxonomies, Opportunities and Challenges toward Responsible AI10.1016/j.inffus.2019.12.012 ↗
3. Explainable Artificial Intelligence: Objectives, Stakeholders, and Future Research Opportunities10.1080/10580530.2020.1849465 ↗
4. Danilevsky, M., Qian, K., Aharonov, R., Katsis, Y., Kawas, B., and Sen, P. (2020). A Survey of the State of Explainable AI for Natural Language Processing. arXiv.10.18653/v1/2020.aacl-main.46 ↗
5. Ribeiro, M.T., Singh, S., and Guestrin, C. (2016, January 13–17). “Why Should I Trust You?”: Explaining the Predictions of Any Classifier. Proceedings of the 22nd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining—KDD ’16, San Francisco, CA, USA.10.1145/2939672.2939778 ↗
6. Lundberg, S., and Lee, S.-I. (2017). A Unified Approach to Interpreting Model Predictions. Adv. Neural Inf. Process. Syst., 30.
7. Goldberg, Y., Kozareva, Z., and Zhang, Y. (2022, January 7–11). ClinicalT5: A Generative Language Model for Clinical Text. Proceedings of the Findings of the Association for Computational Linguistics: EMNLP 2022, Abu Dhabi, United Arab Emirates.
8. Wu, T., Ribeiro, M., Heer, J., and Singh, S. (2021, January 2–11). Polyjuice: Generating Counterfactuals for Explaining Predictions in NLP. Proceedings of the ACL, Austin, TX, USA.10.18653/v1/2021.acl-long.523 ↗
9. The Theory Underlying Concept Maps and How to Construct Them
10. Castillo, O., Melin, P., and Kacprzyk, J. (2020). Automated Ontology Extraction from Unstructured Texts Using Deep Learning. Intuitionistic and Type-2 Fuzzy Logic Enhancements in Neural and Optimization Algorithms: Theory and Applications, Springer International Publishing.
11. Knowledge Graphs
12. Aberer, K., Choi, K.-S., Noy, N., Allemang, D., Lee, K.-I., Nixon, L., Golbeck, J., Mika, P., Maynard, D., and Mizoguchi, R. (2007). DBpedia: A Nucleus for a Web of Open Data. Semantic Web, Springer.10.1007/978-3-540-76298-0 ↗
13. Suchanek, F.M., Kasneci, G., and Weikum, G. (2007, January 8–12). Yago: A Core of Semantic Knowledge. Proceedings of the 16th International Conference on World Wide Web, Banff, AB, Canada.10.1145/1242572.1242667 ↗
14. Constructing a Focused Taxonomy from a Document Collection
15. Concept Map Construction from Text Documents Using Affinity Propagation10.1177/0165551513494645 ↗
16. Bilal, A., Ebert, D., and Lin, B. (2025). LLMs for Explainable AI: A Comprehensive Survey 2025. arXiv.
17. Cambria, E., Malandri, L., Mercorio, F., Nobani, N., and Seveso, A. (2024). XAI Meets LLMs: A Survey of the Relation between Explainable AI and Large Language Models. arXiv.
18. Graham, Y., and Purver, M. (2024, January 17–22). Contextualized Topic Coherence Metrics. Proceedings of the Findings of the Association for Computational Linguistics: EACL 2024, St. Julian’s, Malta.
19. Bhaduri, S., Kapoor, S., Gil, A., Mittal, A., and Mulkar, R. (2024). Qualitative Insights Tool (QualIT): LLM Enhanced Topic Modeling. arXiv.
20. From Anecdotal Evidence to Quantitative Evaluation Methods: A Systematic Review on Evaluating Explainable AI 202210.1145/3583558 ↗
21. Del Águila Escobar, R., Suárez-Figueroa, M.d.C., and Fernández-López, M. (Int. J. Interact. Multimed. Artif. Intell., 2022). OBOE: An Explainable Text Classification Framework, Int. J. Interact. Multimed. Artif. Intell., in press.
22. Ribeiro, M.T., Singh, S., and Guestrin, C. (2018, January 2–7). Anchors: High-Precision Model-Agnostic Explanations. Proceedings of the AAAI Conference on Artificial Intelligence, New Orleans, LA, USA.10.1609/aaai.v32i1.11491 ↗
23. Mehta, H., and Passi, K. (2022). Social Media Hate Speech Detection Using Explainable Artificial Intelligence (XAI). Algorithms, 15.10.3390/a15080291 ↗
24. Explainable Identification of Dementia from Transcripts Using Transformer Networks10.1109/JBHI.2022.3172479 ↗
25. Liu, H., Yin, Q., and Wang, W.Y. (August, January 28). Towards Explainable NLP: A Generative Explanation Framework for Text Classification. Proceedings of the 57th Annual Meeting of the Association for Computational Linguistics, Florence, Italy.
26. MARTA: Leveraging Human Rationales for Explainable Text Classification
27. Karen Simonyan, A.Z. (2014, January 14–16). Andrea Vedaldi Deep Inside Convolutional Networks: Visualising Image Classification Models and Saliency Maps. Proceedings of the Workshop at International Conference on Learning Representations, Banff, AB, Canada.
28. Reverse Engineering the Neural Networks for Rule Extraction in Classification Problems10.1007/s11063-011-9207-8 ↗
29. Bologna, G. (2019). A Simple Convolutional Neural Network with Rule Extraction. Appl. Sci., 9.10.3390/app9122411 ↗
30. Explainability for Large Language Models: A Survey10.1145/3639372 ↗
31. Lecue, F. (2018). Semantic Web Journal, IOS Press.
32. Knowledge Graph-Based Rich and Confidentiality Preserving Explainable Artificial Intelligence (XAI)10.1016/j.inffus.2021.11.015 ↗
33. Flisar, J., and Podgorelec, V. (2018, January 25–27). Document Enrichment Using Dbpedia Ontology for Short Text Classification. Proceedings of the 8th International Conference on Web Intelligence, Mining and Semantics, Novi Sad, Serbia.10.1145/3227609.3227649 ↗
34. Using Entities in Knowledge Graph Hierarchies to Classify Sensitive Information10.1007/978-3-031-13643-6_10 ↗
35. Can Good Concept Mappers Be Good Problem Solvers in Science?10.1080/0144341920120203 ↗
36. Aguiar, C., Zouaq, A., and Cury, D. (2016, January 5–9). Automatic Construction of Concept Maps from Texts. Proceedings of the 7th International Conference on Concept Mapping, Tallinn, Estonia.
37. A Comprehensive Text Analysis of Lecture Slides to Generate Concept Maps10.1016/j.compedu.2017.08.001 ↗
38. Falke, T., and Gurevych, I. (2019, January 2–7). Fast Concept Mention Grouping for Concept Map-Based Multi-Document Summarization. Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long and Short Papers), Minneapolis, MN, USA.10.18653/v1/N19-1074 ↗
39. Research on a New Automatic Generation Algorithm of Concept Map Based on Text Analysis and Association Rules Mining10.1007/s12652-018-0934-9 ↗
40. Burges, C.J., Bottou, L., Welling, M., Ghahramani, Z., and Weinberger, K.Q. (2013). Translating Embeddings for Modeling Multi-Relational Data. Advances in Neural Information Processing Systems, Curran Associates, Inc.
41. Wang, C., Nulty, P., and Lillis, D. (2021, January 23–24). A Comparative Study on Word Embeddings in Deep Learning for Text Classification. Proceedings of the 4th International Conference on Natural Language Processing and Information Retrieval, Toronto, ON, Canada.10.1145/3443279.3443304 ↗
42. Zero-Shot Text Classification via Knowledge Graph Embedding for Social Media Data10.1109/JIOT.2021.3093065 ↗
43. Ennajari, H., Bouguila, N., and Bentahar, J. (2022, January 28–30). Knowledge-Enhanced Spherical Representation Learning for Text Classification. Proceedings of the 2022 SIAM international conference on data mining (SDM), Alexandria, WV, USA.10.1137/1.9781611977172.72 ↗
44. explAIner: A Visual Analytics Framework for Interactive and Explainable Machine Learning
45. Mahoney, C.J., Zhang, J., Huber-Fliflet, N., Gronvall, P., and Zhao, H. (2019). A Framework for Explainable Text Classification in Legal Document Review. 2019 IEEE International Conference on Big Data (Big Data), IEEE Xplore.10.1109/BigData47090.2019.9005659 ↗
46. Baldoni, M., and Bandini, S. (2021). SeXAI: A Semantic Explainable Artificial Intelligence Framework. AIxIA 2020—Advances in Artificial Intelligence, Springer International Publishing.10.1007/978-3-030-77091-4 ↗
47. Billi, M. (2023). Hybrid Symbolic–LLM Explanations in Legal Text Classification. arXiv.
48. Bhattacharjee, A., Moraffah, R., Garland, J., and Liu, H. (2024, January 15–18). Zero-shot LLM-guided Counterfactual Generation: A Case Study on NLP Model Evaluation. Proceedings of the IEEE International Conference on Big Data, Washington, DC, USA.10.1109/BigData62323.2024.10825537 ↗
49. Hong, D., Wang, T., and Baek, S. (2023). ProtoryNet: Prototype Trajectories for Interpretable Text Classification. J. Mach. Learn. Res., 24.
50. Wei, B., and Zhu, Z. (2023, January 9–14). ProtoLens: Advancing Prototype Learning for Fine-Grained Interpretability in Text Classification. Proceedings of the 63rd Annual Meeting of the Association for Computational Linguistics, Toronto, ON, Canada.
51. Zhang, D., Sen, C., Thadajarassiri, J., Hartvigsen, T., Kong, X., and Rundensteiner, E. (2021). Human-like Explanation for Text Classification with Limited Attention Supervision. 2021 IEEE International Conference on Big Data (Big Data), IEEE Xplore.10.1109/BigData52589.2021.9671444 ↗
52. Chrysostomou, G., and Aletras, N. (2021, January 7–11). Improving Attention-Based Explanations with Task Scaling (TaSc). Proceedings of the 2021 Conference on Empirical Methods in Natural Language Processing (EMNLP), Punta Cana, Dominican Republic.
53. Zhao, Z., and Vydiswaran, V.G.V. (2021, January 1–6). LIREx: Label-Specific Rationale Generation for Multi-Label Classification. Proceedings of the 59th Annual Meeting of the Association for Computational Linguistics (ACL), Bangkok, Thailand.
54. Ribeiro, M. (2024). SLIME: Statistical and Linguistic Insights for Model Explanation. arXiv.
55. Rahulamathavan, Y. (2023). PLEX: Perturbation-Free Local Explanations for Transformer-Based Classifiers. arXiv.
56. McAuley, J., Targett, C., Shi, Q., and van den Hengel, A. (2015). Image-Based Recommendations on Styles and Substitutes. arXiv.10.1145/2766462.2767755 ↗
57. Greene, D., and Cunningham, P. (2006, January 25–29). Practical Solutions to the Problem of Diagonal Dominance in Kernel Document Clustering. Proceedings of the 23rd International Conference on Machine Learning, Pittsburgh, PA, USA.10.1145/1143844.1143892 ↗
58. RCV1: A New Benchmark Collection for Text Categorization Research
59. Fellbaum, C. (1998). WordNet: An Electronic Lexical Database, MIT Press. Language, Speech, and Communication.10.7551/mitpress/7287.001.0001 ↗
60. Mendes, P.N., Jakob, M., García-Silva, A., and Bizer, C. (2011). DBpedia Spotlight: Shedding Light on the Web of Documents. Proceedings of the 7th International Conference on Semantic Systems—I-Semantics ’11, ACM Press.10.1145/2063518.2063519 ↗
61. Latent Dirichlet Allocation
62. Nguyen, D.Q., Nguyen, T.D., Nguyen, D.Q., and Phung, D. (2018, January 1–6). A Novel Embedding Model for Knowledge Base Completion Based on Convolutional Neural Network. Proceedings of the 16th Annual Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (NAACL-HLT), New Orleans, LA, USA.10.18653/v1/N18-2053 ↗
63. Complex Embeddings for Simple Link Prediction
64. Yang, B., Yih, S.W., He, X., Gao, J., and Deng, L. (2015, January 7–9). Embedding Entities and Relations for Learning and Inference in Knowledge Bases. Proceedings of the International Conference on Learning Representations 2015, San Diego, CA, USA.
65. Chen, T., and Guestrin, C. (2016, January 13–17). XGBoost: A Scalable Tree Boosting System. Proceedings of the 22nd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, San Francisco, CA, USA.10.1145/2939672.2939785 ↗
66. Silhouettes: A Graphical Aid to the Interpretation and Validation of Cluster Analysis10.1016/0377-0427(87)90125-7 ↗
67. Ke, G., Meng, Q., Finley, T., Wang, T., Chen, W., Ma, W., Ye, Q., and Liu, T.-Y. (2017, January 4–9). LightGBM: A Highly Efficient Gradient Boosting Decision Tree. Proceedings of the Advances in Neural Information Processing Systems (NeurIPS 2017), Long Beach, CA, USA.
68. Prokhorenkova, L., Gusev, G., Vorobev, A., Dorogush, A.V., and Gulin, A. (2018, January 3–8). CatBoost: Unbiased Boosting with Categorical Features. Proceedings of the Advances in Neural Information Processing Systems (NeurIPS 2018), Montréal, QC, Canada.
69. Newman, D., Lau, J.H., Grieser, K., and Baldwin, T. (2010, January 2–4). Automatic Evaluation of Topic Coherence. Proceedings of the Human Language Technologies: The 2010 Annual Conference of the North American Chapter of the Association for Computational Linguistics, Los Angeles, CA, USA.
70. Aletras, N., and Stevenson, M. (2013, January 19–22). Evaluating Topic Coherence Using Distributional Semantics. Proceedings of the 10th International Conference on Computational Semantics (IWCS 2013), Potsdam, Germany.
71. Röder, M., Both, A., and Hinneburg, A. (2015, January 2–6). Exploring the Space of Topic Coherence Measures. Proceedings of the Eighth ACM International Conference on Web Search and Data Mining, Shanghai, China.10.1145/2684822.2685324 ↗
72. Gourgoulias, K., Ghalyan, N., Labonne, M., Satsangi, Y., Moran, S., and Sabelja, J. (2023). Estimating Class Separability of Text Embeddings with Persistent Homology. arXiv.
73. Quantifying the Separability of Data Classes in Neural Networks10.1016/j.neunet.2021.03.035 ↗