journal article·2026-07-03Open access

Structure–semantic dual-alignment benchmarking of large language model capability on ancient oracle bone inscriptions

Kelvin K. L. Wong, Jie Tu, Shitong Jiang, Bin Tang, Yi Xiao, Francesco Vigliarolo, Colin Rhodes

Abstract

Abstract Although general Multimodal Large Language Models (MLLMs) benchmarks are prevalent, systematic evaluation for oracle bone inscriptions remains underdeveloped. Oracle bone glyph, as cultural heritage artifacts, present severe degradation, stylistic variation, and cross-tablet heterogeneity, posing challenges to evaluating multifaceted MLLM capabilities. To address this, we propose the Dual-Alignment Oracle Character Reasoning Benchmark (DAOCR-Bench), which evaluates structural perception, semantic grounding, reconstruction, and consistency judgment across four competency levels. Experiments on 18 MLLMs reveal substantial performance differences under standardized and degraded oracle bone conditions, with GPT-4o achieving the highest comprehensive score in our evaluation. This benchmark provides a standardized framework for oracle bone analysis and advances computational paleography.
Source: crossref · Quality: baseline

Research context

OpenAlex topics: Image Processing and 3D Reconstruction · Language and cultural evolution · Natural Language Processing Techniques

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

References

Reference metadata was not supplied for this record.