AI Learns to Recognize Ancient Chinese Characters It Has Never Seen Before

A team of researchers at the Beijing Institute of Technology has shown that artificial intelligence can retrieve the later historical forms of ancient Chinese characters it has never encountered during training, provided the models are given explicit information about how the graphic structures of those characters relate to one another. The study, published in npj Heritage Science, tackles one of the most stubborn problems in digital paleography: a single character identity can persist across thousands of years while its written form mutates dramatically from the incised oracle-bone script of the Shang dynasty through bronze inscriptions to the scripts of the Spring and Autumn and Warring States periods. A machine learning system trained only on images tends to treat each visual variant as a separate object, and it collapses when asked to link a form it has never seen to the identity it truly belongs to.

The researchers framed the challenge as a retrieval problem rather than a classification problem. Instead of asking a model to assign a label from a fixed list, they asked it to rank candidate images so that images belonging to the same character identity, even from different historical stages, rise to the top of the list. Performance was measured with mean reciprocal rank, a metric that rewards systems for placing the correct match near the top of their rankings. Crucially, the evaluation used a whole-identity protocol: in each of five cross-validation folds, every image of a test identity was excluded not only from training and validation but also from descriptor standardization and model selection. This means the models were genuinely tested on identities wholly absent from every stage of the learning pipeline, a far stricter standard than the image-level splits that dominate much of computer vision research.

Building a trustworthy dataset was itself a major undertaking. The team derived eighty candidate relations describing how graphic forms connect across historical stages from metadata, and then submitted those candidates to independent review by five specialists. Only relations that survived expert scrutiny were kept, yielding a curated corpus of sixty-four character identities represented by 9,540 quality-controlled images spanning oracle-bone, bronze, Spring and Autumn, and Warring States scripts. This expert-in-the-loop filtering matters because noisy or speculative relations would teach a model the wrong structural lessons. By grounding the relational information in specialist consensus, the researchers ensured that the signal their models learned reflected genuine paleographic continuity rather than artifacts of automated metadata extraction.

The experimental design compared three increasingly informed approaches. The baseline used DINOv2, a self-supervised vision transformer pretrained on natural images, in frozen form, meaning its weights were not adjusted to the ancient scripts. Such general-purpose models extract powerful generic visual features, and DINOv2 alone achieved an identity-macro mean reciprocal rank of 0.469, a surprisingly strong result for imagery as distant from natural photographs as incised bone and cast bronze. Supervised contrastive learning, which trains the network to pull images of the same identity together and push images of different identities apart, improved the score to 0.554. The decisive gain, however, came from augmenting the learned features with explicit structural knowledge.

That structural knowledge took the form of twenty-four image-derived descriptors capturing relational graphic structure: measurements of topology, skeleton organization, component arrangement, and the geometric relationships among strokes and parts. When these descriptors were combined with the contrastively learned features, the mean reciprocal rank rose to 0.591, an improvement of 0.0369 over the contrastive baseline, with a 95 percent confidence interval of 0.0199 to 0.0540. The confidence interval excludes zero, indicating that the gain is statistically reliable rather than a fluke of a particular data split. In practical terms, the descriptors gave the models a vocabulary for talking about how a character is built, and that vocabulary transferred across the visual upheavals of script evolution.

An analysis of which descriptors carried the most transferable signal produced one of the study’s most interesting findings. Topology and skeleton organization, the coarse properties describing how many connected components a character has and how its structural backbone is arranged, contributed more to cross-stage retrieval than fine-grained surface details. This aligns with how paleographers themselves reason: when a character’s strokes are reshaped, elongated, or stylized over centuries, the underlying skeletal plan and topological organization often persist even as the surface appearance transforms. The machine results thus echo human expert intuition, suggesting that the relational structure encoded in these descriptors captures something real about the diachronic stability of character identity.

The implications extend beyond Chinese paleography. Many cultural heritage domains face analogous problems, from tracking iconographic motifs across centuries of manuscript illumination to linking ceramic fragments from different excavation layers. The study demonstrates a general recipe: pair modern self-supervised visual representations with expertly vetted relational metadata and interpretable structural descriptors, then evaluate under whole-identity exclusion so that reported performance reflects genuine generalization to unseen categories. The finding that a frozen, off-the-shelf model like DINOv2 already performs respectably on such alien imagery also suggests that heritage researchers need not always train large models from scratch; the leverage lies in the structured knowledge layered on top.

The authors are careful to draw a firm boundary around what their system does not do. The results, they emphasize, do not constitute automated decipherment. Retrieving the later forms of a known character identity is not the same as reading an undeciphered script, and the researchers explicitly position the work as evidence-surfacing support for expert palaeographic judgment rather than a replacement for it. In this framing, the model functions as a scholarly assistant: given an unfamiliar form, it surfaces ranked candidates and the structural relationships that connect them, giving specialists a starting point for analysis. The final interpretive act, deciding what a character means and how its history should be read, remains a human one. This division of labor reflects a mature understanding of where machine learning can reliably contribute to the humanities.

The study also stands out for its methodological hygiene. The five-fold whole-identity evaluation, the independent five-specialist review of candidate relations, the quality control applied to all 9,540 images, and the reporting of confidence intervals around the key performance difference collectively set a high bar for reproducibility in computational heritage research. The work received no external funding, and the authors report no competing interests. Released as open access with supplementary data and software available, the study invites other teams to test whether relational graphic structure delivers similar gains for other writing traditions, from Egyptian hieroglyphs to Linear B, where forms also evolve while identities persist. For a field where every newly legible character can reshape historical understanding, tools that reliably surface structural evidence across millennia are a meaningful step forward.

Subject of Research: Machine learning retrieval of unseen ancient Chinese character identities using relational graphic structure

Article Title: Relational graphic structure supports diachronic retrieval of wholly unseen ancient Chinese character identities

Article References: Yang, Y., Qi, Y., Yang, S., Lin, Z., Zhang, L., & Zhou, Y. (2026). Relational graphic structure supports diachronic retrieval of wholly unseen ancient Chinese character identities. npj Heritage Science. https://doi.org/10.1038/s40494-026-03044-y

Image Credits: AI Generated

DOI: 10.1038/s40494-026-03044-y

Keywords: ancient Chinese characters, paleography, machine learning, DINOv2, contrastive learning, oracle-bone script, bronze inscriptions, character retrieval, digital heritage, structural descriptors, cross-validation, npj Heritage Science