The central problem the team confronted is subtle but profound. Existing deep learning models for image restoration are remarkably good at filling in missing pixels and smoothing out damage, but they treat a mural like any other photograph. They optimize for pixel-level similarity and structural resemblance, and they have no concept of what a celestial musician’s halo should look like, how a lotus mandala’s symmetry ought to unfold, or why the spatial hierarchy of a Buddhist scene places certain figures above others. The result is often a technically plausible image that, to an art historian’s eye, feels symbolically hollow or even culturally wrong.

GECST addresses this by embedding cultural knowledge directly into the machine learning pipeline. The framework operates in four stages. First, a preprocessing phase cleans the degraded input: Gaussian filtering removes noise and crack artifacts, histogram equalization stretches the tonal range of unevenly faded regions, and Sobel gradient operators trace the structural contours of figures, ornaments, and calligraphic lines that must be preserved. Next, a hierarchical multi-scale convolutional encoder extracts features at multiple levels of detail, capturing fine brushstroke textures at small scales and the sweeping symmetry of entire compositions at large scales. These features are stacked into a multidimensional vector that serves as the raw material for reconstruction.

The third stage is where the magic happens. A generative adversarial network, built around an augmented U-Net generator and a PatchGAN discriminator, fills in missing or faded regions. In a standard GAN, the generator produces images and the discriminator tries to tell fakes from real samples, forcing the generator toward increasingly convincing outputs. GECST adds a crucial twist: graph-guided cultural constraints are injected into the training loop, penalizing outputs that violate three classical composition principles: symmetry preservation, spatial hierarchy consistency, and motif balance. The total loss function combines adversarial, perceptual, style-consistency, and cultural fidelity terms, with the cultural fidelity loss explicitly decomposed into these three components. In effect, the generator is not merely learning what Dunhuang murals look like; it is learning the grammar of how they were composed.

Finally, a refinement stage polishes the output. Linear tone mapping corrects centuries of pigment fading while keeping colors within historically plausible Dunhuang palettes. Unsharp masking enhances fine details such as halo outlines and architectural edges, with the sharpening factor carefully tuned to avoid artificial halos. The blended final image balances the generative creativity of the GAN with the stabilizing corrections of post-processing, producing museum-quality digital restorations.

The team evaluated GECST on the Dunhuang Grottoes Painting Dataset and Benchmark, derived from high-resolution scans in the Digital Dunhuang repository managed by the Dunhuang Academy. The dataset spans 3,000 images across five representative mural categories, including Flying Apsara panels, lotus mandalas, and Buddhist sutra friezes. Because real murals cannot be damaged for testing, the researchers simulated deterioration using crack patterns, noise, color fading, and occlusion masks that mimic natural degradation. The model was trained on an NVIDIA RTX 4090 GPU in roughly 6.4 hours over 100 epochs, and inference takes just 0.12 seconds per 512 by 512 pixel image, fast enough to process entire grotto collections in parallel.

The quantitative results are striking. GECST achieved a peak signal-to-noise ratio of 33.82 dB and a structural similarity index of 0.956, both higher than the structure-guided inpainting network SGDIN, the classification framework EICF, and the multimodal retrieval system DFMVS used as baselines under identical training conditions. Its Fréchet Inception Distance, which measures how closely generated images match the statistical distribution of real ones, came in at 16.84, the lowest among all tested methods, indicating the most visually realistic outputs. Color differences measured in Delta E units were also the smallest, meaning restored palettes hewed closest to the verified reference scans. Bootstrapped confidence intervals and paired statistical tests with Holm-Bonferroni corrections confirmed the improvements were significant at the 0.05 level.

Perhaps most telling were the human judgments. Five experts in Dunhuang art and mural conservation independently scored GECST restorations on a five-point scale, yielding an overall cultural authenticity rating of 4.81 out of 5, with historical style fidelity scoring highest at 4.85. A separate panel of thirty non-expert viewers rated the outputs highest on visual realism and aesthetic appeal in blind pairwise comparisons. An ablation study confirmed the design logic: removing the graph-guided cultural constraints produced the largest drop in performance, demonstrating that the cultural rules, not just the generative machinery, drive the system’s success.

The researchers are candid about limitations. The cultural constraints are tailored to Dunhuang’s specific artistic canon, so applying GECST to other heritage traditions would require redesigning those rules. Training relied on simulated degradation, which may not fully capture the complexity of real-world decay, and restored colors reflect high-quality digital scans rather than guaranteed historical accuracy. Severe structural damage and artistic styles absent from the training data remain challenging. Future work will target automated damage detection, broader mural datasets spanning more historical periods, prompt-based incorporation of textual and historical context, and integration of attention-enhanced diffusion models for finer texture coherence.

Even with those caveats, the work signals a meaningful shift in how technology can serve cultural heritage. Rather than treating restoration as a purely computational problem of pixel prediction, GECST demonstrates that algorithms can be taught to respect the compositional wisdom of ancient artists, bridging the gap between automated digital tools and historically aware conservation. The restored images are intended for digital archives, education, conservation planning, and creative reinterpretation, offering a scalable, non-invasive way to ensure that even as the physical walls of Mogao continue to crumble, the visual culture they embody endures in vivid, culturally faithful digital form.

Subject of Research: AI-based restoration of Dunhuang murals using generative adversarial networks and cultural composition constraints

Article Title: A visual design method for Dunhuang murals based on deep learning and graphical algorithms

Article References: Zhang, S., & Guo, Y. (2026). A visual design method for Dunhuang murals based on deep learning and graphical algorithms. Discover Artificial Intelligence, 6(1), Article 1194. https://doi.org/10.1007/s44163-026-02064-8

Image Credits: AI Generated

DOI: 10.1007/s44163-026-02064-8

Keywords: Dunhuang murals, generative adversarial networks, cultural heritage, deep learning, image restoration, style transfer, Mogao Grottoes, computer vision, digital preservation, graph algorithms, Silk Road art, GAN

The researcher behind the study, Xiaofan He of the College of Art and Design at Jiangsu University of Technology, identified a persistent gap in existing cultural virtual display systems: computer vision pipelines that classify heritage images rarely consider how their outputs could guide navigation, while path planning methods in human-computer interaction seldom exploit high-precision classification to personalize tours. Existing systems either achieve accurate classification but offer interaction paths unrelated to visitor interests, or provide smooth experiences built on coarse content labels. The new work closes that loop by feeding classification results directly into the cost function of a path planner.

The classification engine is built on a Graph Capsule Neural Network, or CapsGNN, a hybrid of capsule networks and graph neural networks. Capsule networks, unlike conventional convolutional neural networks, represent features as vectors whose length encodes the probability that a feature exists and whose orientation encodes its pose, such as rotation, scale, and deformation. This matters for Yi textiles, which are full of rotationally symmetric, repeating units and nonlinear deformations. Standard CNN pooling discards precise spatial position information, so the same pattern viewed at different angles is easily misclassified. Capsules, routed through a dynamic routing algorithm, can recognize what the study calls different poses of the same type.

The key architectural modification replaces the pose matrix in the original CapsGNN with a Graph Convolutional Network (GCN). The pose matrix parameterization in standard CapsGNN struggles to exploit adjacency information when processing graph structures, making it hard to capture the spatial relationships between repeating units in fabric patterns. GCNs, by contrast, explicitly aggregate neighbor node features through Laplacian smoothing operations, integrating low-level capsules into higher-level representations via neighborhood-weighted aggregation. An attention mechanism further refines the weighting of capsule information. The resulting CapsGNN-GCN model passes Yi fabric images through input, initial capsule, hierarchical capsule, and class capsule layers, where low-level capsules cluster into high-level capsules that map to specific pattern categories.

To train and test the model, the study assembled a dataset of 3,086 Yi fabric images collected online, from books, and through field photography, spanning five labeled categories: 700 abstract geometric images, 570 fire patterns, 460 horn patterns, 610 bracken patterns, and 746 other traditional patterns. Data augmentation through brightness adjustment, rotation, horizontal flipping, random cropping, and scaling expanded each category to 4,500 images, all resized to 300 by 300 pixels. Under five-fold cross-validation, CapsGNN-GCN reached a training accuracy of 96.8 percent and an F1 score of 0.93. Ablation tests confirmed the contribution of each module: removing the GNN module dropped training accuracy to 83.4 percent, removing GCN lowered it to 87.6 percent, and removing both collapsed test accuracy to 70.5 percent.

Head-to-head comparisons against ResNet50 V2, EfficientNet B0, and a GCN-CNN baseline showed the improved model winning every category. In the Abstract Geometry class, CapsGNN-GCN achieved 96.6 percent accuracy with only 10 misclassifications, while the Sheep’s Horn Pattern and Other Traditional Patterns categories reached 95.7 and 95.5 percent respectively. ResNet50 V2 managed only 87.6 percent on fire patterns, and EfficientNet B0 topped out at 95.5 percent on abstract geometry. Paired t-tests confirmed the differences were statistically significant at p less than 0.01. Notably, when evaluated on the original unaugmented test set, the model’s accuracy fell by only 0.6 percentage points, to 91.7 percent, indicating the augmentation had not inflated performance. The few failures clustered in texture-similar regions between fire and ram’s horn patterns and between fern and abstract geometry designs, accounting for just 0.7 percent of the test set.

The second half of the system tackles how visitors move through virtual heritage spaces. Using oblique photography and 3D modeling software integrated into Unreal Engine 4, the study reconstructed a village in Liangshan as a navigable virtual scene, gridded into a 100 by 60 cell raster over an 800 by 1,000 meter area. The team then modified the classic A* pathfinding algorithm, which combines best-first search heuristics with Dijkstra-style guarantees of shortest paths, by adding three user experience constraints to its heuristic function: landmark salience, user movement trajectory overlap, and user preference. Landmark salience combines visual contrast with semantic importance ratings from three cultural experts, diffused across the grid with a Gaussian kernel. Trajectory overlap was computed from the free-exploration walking paths of 30 users, and preference grids were linked to the classification model’s pattern labels, scored on a five-point Likert scale. A cubic uniform B-spline curve then smooths the raw grid path to reduce sharp turns.

Across six start-end pairs connecting key village nodes such as the center, entrance, sacrificial site, handicraft workshop, viewing platform, and cultural square, the improved algorithm produced an average total path length of 523.7 plus or minus 42.9 meters, roughly 6.3 to 9.6 percent shorter than simulated annealing and dynamic window approach baselines. The average number of turns fell to 13.7 plus or minus 2.2, the average turning angle dropped to 6.5 plus or minus 0.6 degrees, a 30 to 40 percent reduction in corner severity, and the average computation time was 15.3 plus or minus 1.9 seconds, well below the 19.5 seconds of traditional A* and the 25.4 seconds of DWA. Sensitivity analysis showed satisfaction scores changed by no more than 0.3 points on a five-point scale when weights were perturbed, indicating the algorithm is robust to weight selection.

Human trials with 50 participants, randomized between the new system and a non-interactive static display platform, demonstrated substantial gains in experience quality. Task completion averaged five minutes with a system response time of 0.5 seconds, immersion scored 4.2 on the Slater Immersion Scale, satisfaction reached 4.5 on a five-point Likert scale, and the operation error rate was just 3 percent. Independent samples t-tests showed the immersion and satisfaction differences were significant at p less than 0.001 with large effect sizes. A second experiment with 30 participants from diverse cultural backgrounds found that knowledge of Yi culture increased by 25 percent after using the system, with pre-test scores rising from 24 to 30 points, compared with a 10 percent gain for the traditional platform, and the cultural identity score reached 4.3.

The study’s broader significance lies in its methodological transferability. The quantification of landmark salience relies only on visual contrast and expert semantic scoring, the trajectory overlap grid can be generated from exploration data in any virtual environment, and the preference grid links directly to any classification model with a label-to-preference mapping, meaning the framework could extend to museums, educational platforms, and other heritage sites with spatial navigation needs. The author acknowledges limitations: the experiments covered only Yi fabric images and one virtual village scene, and adaptability to other cultural elements remains unverified. Future work aims to expand the method to other heritage types and optimize real-time feedback, but the demonstration that human-computer interaction factors can be quantitatively embedded in a path planning cost function marks a concrete step toward virtual heritage systems that do not just display culture, but anticipate what visitors want to see.

Subject of Research: A virtual display experience system for Yi cultural heritage that integrates CapsGNN-based fabric image classification with user-experience-driven A* path planning in a virtual village

Article Title: Virtual display experience design for Yi cultural heritage using CapsGNN and user experience

Article References: He, X. (2026). Virtual display experience design for Yi cultural heritage using CapsGNN and user experience. Discover Artificial Intelligence, 6(1), Article 1193. https://doi.org/10.1007/s44163-026-02017-1

Image Credits: AI Generated

DOI: 10.1007/s44163-026-02017-1

Keywords: CapsGNN, graph capsule neural network, Yi culture, cultural heritage, virtual reality, image classification, path planning, A* algorithm, user experience, Unreal Engine, digital preservation, Liangshan

The study, published in npj Heritage Science, takes five traditional villages in Guangdong Province as its case studies. These settlements share the characteristics that make manual inspection so difficult: complex spatial layouts, dense clusters of traditional buildings, narrow lanes that resist ground-based survey, and locations remote enough that they rarely attract the public attention or funding streams that urban monuments receive. When inspection is slow, repairs are delayed, and delayed repairs accelerate decay in a feedback loop that has already erased so much of China’s rural built heritage.

The team’s answer begins in the air. Using unmanned aerial vehicles equipped with visible-light cameras, they acquired a total of 12,762 images over the five villages. These were not casual snapshots but systematically collected photographs designed for photogrammetry, the technique of reconstructing three-dimensional geometry from overlapping two-dimensional images. Processed together, the images yield high-precision spatial digital archives: detailed orthophoto maps and three-dimensional models that record the state of every visible roof, wall, and courtyard at the moment of capture. Such archives serve a dual purpose. They are preservation documents in their own right, preserving a measurable record of structures that may not survive, and they are the raw material for automated condition assessment.

On top of that digital foundation sits the deep learning component. The researchers trained an object detection model based on the YOLOv8 architecture, a family of convolutional neural networks designed to identify and localize objects in images in a single pass. To teach the model what roof damage looks like in traditional Guangdong villages, the team assembled a training dataset of 41,213 annotated instances, each one a labeled example of damage or a feature of interest drawn from the drone imagery. Annotation at that scale is laborious work, but it is what allows a neural network to distinguish, say, a missing tile or a collapsed roof section from the ordinary textures of aged clay and weathered timber.

The performance figures reported in the paper are notable. The YOLOv8-based model achieved an overall mean average precision at an intersection-over-union threshold of 0.5, abbreviated mAP50, of 0.832. In practical terms, mean average precision combines how accurately the model detects damaged regions with how precisely it draws the bounding boxes around them; a value above 0.8 indicates that the system correctly identifies the large majority of damage instances while keeping false alarms at a manageable level. For heritage managers deciding where to send repair crews, that balance matters enormously, because every false positive wastes a site visit and every false negative is a building left to decay.

Speed is the other half of the story. The researchers validated their trained model on ultra-high-resolution digital orthophoto maps, known as DOMs, and on aerial video footage captured over the villages. Across these validation runs, the model averaged an inference time of 5.77 milliseconds per frame. That figure means the system can process aerial video essentially in real time, scanning continuous footage from a drone flight and flagging damage as it appears, rather than requiring hours of offline computation. Combined with the orthophoto analysis, it allows an entire village to be surveyed from the air in a fraction of the time a ground-based inspection would demand.

The technical logic of the workflow is straightforward to describe but demanding to execute. Photogrammetry converts the 12,762 overlapping drone images into georeferenced orthophotos and three-dimensional models, ensuring that every detected damage instance can be tied to a real-world location on a specific building. The deep learning model then sweeps across these products, drawing bounding boxes around damage and classifying it. Because the orthophotos are georeferenced, the output is not just a list of detections but a map of where repairs are needed, which is precisely the information a maintenance program requires to prioritize its limited budget.

Why roofs? In traditional village architecture, the roof is both the most vulnerable element and the most informative one. Tile slippage, ridge failure, and structural sagging are visible from above in ways that foundation problems are not, and roof damage is often the first sign that a building has passed from routine aging into active decline. A system that can detect roof damage across an entire settlement gives conservators an early-warning capability that manual inspection, constrained by narrow lanes, dense building clusters, and limited personnel, has never been able to provide at village scale.

The implications reach well beyond Guangdong. The authors frame their work as a response to a global problem: rural cultural heritage sites worldwide are losing maintenance attention as populations shift to cities, and the buildings most at risk are often those in the most remote locations. A workflow that requires only a consumer-grade drone, a photogrammetry pipeline, and a trained detection model could be adapted to other regions and other architectural traditions, provided that local training data is annotated to teach the model the specific damage patterns of each building type. The open-access publication of the study, under a Creative Commons Attribution 4.0 license, lowers the barrier for other teams to build on the approach.

There is also a quieter, more poignant dimension to the work. Every orthophoto and three-dimensional model in the digital archive is a record of a settlement as it stood on the day of the flight. For villages that ultimately cannot be saved, those archives become the definitive documentation of what was lost, available to researchers, descendants, and future reconstruction efforts. For villages that can be saved, the same data directs repairs to the buildings that need them most. Either way, the combination of 12,762 drone images, 41,213 annotated training instances, a detection model running at 5.77 milliseconds per frame, and a mean average precision of 0.832 represents a genuine shift in how the world’s most endangered rural heritage can be watched over, one flight and one frame at a time.

Subject of Research: UAV photogrammetry and deep learning for digital preservation and automated roof damage detection in Guangdong traditional villages

Article Title: Digital preservation and automated roof damage detection for traditional village heritage in Guangdong using UAV photogrammetry and deep learning

Article References: Zhu, Z., Hsieh, C.-M., Liu, X., Li, X., Zhong, Z., & Chen, Z. (2026). Digital preservation and automated roof damage detection for traditional village heritage in Guangdong using UAV photogrammetry and deep learning. npj Heritage Science. https://doi.org/10.1038/s40494-026-03055-9

Image Credits: AI Generated

DOI: 10.1038/s40494-026-03055-9

Keywords: UAV photogrammetry, deep learning, YOLOv8, roof damage detection, traditional villages, cultural heritage, Guangdong, digital preservation, orthophoto maps, heritage conservation, object detection, rural settlements

The study was conducted across Southwest Nigeria, the homeland of the Yoruba people and one of the country’s six geopolitical zones. The region spans roughly 114,271 square kilometres and encompasses six states, 137 local government areas, and an extraordinary concentration of heritage resources, including the Osun-Osogbo Sacred Grove, a UNESCO World Heritage Site, alongside numerous sites on Nigeria’s UNESCO Tentative List. The researchers focused on four states, Lagos, Osun, Oyo, and Ondo, examining four museums and four heritage sites, among them the Old Iga Idunganran Palace in Lagos, the Old Palace of the Deji of Akure, and the Alaafin of Oyo Palace. The John Randle Centre for Yoruba Culture and History in Lagos was included as the region’s flagship digital museum, providing a rare point of comparison with the conventional, largely analogue practices that dominate the National Commission for Museums and Monuments institutions.

Methodologically, the research combined qualitative and quantitative approaches. Structured interviews were conducted with twenty-four participants, including digital heritage experts, museum professionals, and visitors, while questionnaires based on key performance indicators for digital heritage were distributed to a stratified random sample of 340 stakeholders drawn from museum staff, ICOMOS members, ICT personnel, and site visitors. A 70 percent response rate yielded 238 completed questionnaires, which were analysed using the Statistical Package for the Social Sciences. Respondents rated statements on a Likert scale, allowing the researchers to map where consensus existed and where it fractured. The strongest agreement, with the lowest mean score of 1.4747, concerned the belief that digitisation significantly improves the conservation of cultural heritage resources, a signal of what the authors describe as institutional optimism despite low actual adoption.

That optimism, however, collides with a sobering structural reality. Every single respondent, 100 percent, agreed that considerable obstacles stand in the way of technology adoption. The barriers cluster into three interlinked dimensions identified by the researchers: low institutional readiness, evidenced by inadequate funding, bureaucratic bottlenecks, and the absence of intellectual property policies; low technological capacity, reflected in unreliable electricity, poor internet connectivity, a shortage of skilled personnel, and concerns over digital format obsolescence; and what the authors call conditional social acceptance, in which communities are willing to engage with digitisation only if it respects cultural authenticity, custodial rights, and local languages. Government funding, respondents noted, is often insufficient even for the day-to-day running of museums, leaving nothing for digital equipment or training.

The interviews brought these abstractions to life. One respondent described how the delay in implementing digital technologies hinders the ability to conserve and showcase cultural assets, while another pointed to the lack of digital infrastructure and technical expertise as a major barrier requiring external support. Others highlighted the convoluted administrative processes and red tape associated with government approval procedures, and the practical impossibility of cloud-based archiving or virtual tours without reliable power and connectivity. Intellectual property concerns proved especially acute: respondents feared that sacred artifacts, once placed online, could be copied, misused, or misrepresented, and the absence of clear guidelines on who owns digitised communal heritage creates legal uncertainty that discourages both institutions and communities from digitising at all.

Against this backdrop, the John Randle Centre stands out as a telling exception. It was the only institution in the study singled out as exemplifying the potential of digital preservation, and the researchers interpret its success as evidence of what becomes possible when funding, political will, and technical partnership converge. Its status as an outlier, they argue, highlights the unevenness of digital readiness across the region: while one institution can showcase advanced digitisation, most remain anchored in conventional methods due to constrained resources and risk-averse institutional cultures. A small minority of respondents, about 5 percent, defended a cautious ‘watch and learn’ approach, arguing that states should wait until proven, locally adaptable models demonstrate tangible benefits before committing scarce resources.

The benefits of digitisation, where it has been attempted, are not in dispute among most stakeholders. Seventy-five percent of respondents affirmed that digital technologies improve accessibility, documentation, public engagement, disaster recovery, social identity, and community empowerment. Digital access can bypass geographical barriers in a region where physical infrastructure and transport are often poor, reaching remote communities, people with mobility challenges, and diaspora audiences who cannot visit sites in person. Digital documentation enables more efficient inventorying, conservation planning, and risk management, compensating for weak manual record-keeping systems. Perhaps most compelling is the disaster recovery function: digital backups serve as a form of insurance against flooding, urban encroachment, and insecurity, threats that are particularly salient in Nigeria, where institutional readiness for emergency response remains low.

Yet a significant minority, 25 percent of respondents, raised concerns that digitisation could erode cultural authenticity. They argued that digital versions might dissuade tourists from visiting physical sites, diminishing the economic benefits that fund preservation, and that intangible cultural experiences, the rituals, performances, and embodied practices that give heritage its meaning, simply cannot be replicated on a screen. Some questioned whether institutions currently possess the technological capacity to maintain digital files over the long term, given persistent power and infrastructure challenges, noting that without proper maintenance, digital archives are vulnerable to corruption, loss, or obsolescence. These concerns, the researchers stress, do not amount to a rejection of technology but rather a demand that digitisation complement, rather than replace, lived heritage experience, for example by using virtual previews to drive physical visits.

The study’s theoretical grounding in the UNESCO Charter on the Preservation of Digital Heritage reinforces this balanced framing. The Charter recognises digital heritage as an integral component of humanity’s cultural legacy that requires deliberate preservation strategies to address technological obsolescence, maintain authenticity, and ensure long-term accessibility. Contemporary scholarship cited by the authors similarly advocates participatory and culturally sensitive approaches, including co-design platforms, crowdsourced documentation, and culturally responsive digital curation frameworks that reflect local values and knowledge systems. The Nigerian findings suggest that sustainable digitisation in resource-constrained settings cannot depend on high-cost imported models but requires a frugal, hybrid, community-anchored framework in which traditional custodians act as co-creators of the digital archive.

The authors close with concrete recommendations: a comprehensive national digital heritage strategy developed in consultation with stakeholders, dedicated government funding, capacity-building programmes for heritage professionals, partnerships among government, private sector, and international organisations, and incentive schemes such as tax credits or grants to mobilise private investment. For other developing countries facing similar constraints, the study distils three lessons: participatory co-design ensures authenticity and community ownership; low-cost, offline-capable tools and local-language content are more viable than infrastructure-heavy solutions; and clear policy on data sovereignty and community intellectual property is a prerequisite for trust. Whether Nigeria’s extraordinary heritage, from the bronzes of Benin to the terracottas of Nok and the sacred groves of Osogbo, can be secured for future generations may depend on how quickly those lessons are put into practice.

Subject of Research: Digital technology adoption for cultural heritage preservation in Southwest Nigeria

Article Title: Assessment of digital technology adoption for cultural heritage preservation in Southwestern Nigeria

Article References: Ale, T. A., Ayeni, D. A., Ayoola, H. A., & Ale, T. O. (2026). Assessment of digital technology adoption for cultural heritage preservation in Southwestern Nigeria. Discover Global Society, 4(1), Article 269. https://doi.org/10.1007/s44282-026-00585-2

Image Credits: AI Generated

DOI: 10.1007/s44282-026-00585-2

Keywords: cultural heritage, digital preservation, digitisation, Nigeria, museums, UNESCO, Yoruba, heritage management, ICT, cultural authenticity, disaster recovery, developing countries

The research, published in npj Heritage Science, introduces a model called SPMTNet, a structural-prior-guided multi-task framework for recognizing cropped Tangut character images. The work was led by Xueyan Wang of the School of Information Engineering at Ningxia University, together with Jun Zhao of Ningxia University’s School of Economics and Management, Ruixiang Yan of the College of Intelligence and Computing at Tianjin University, and Xiangqian Peng of the Academy of Xixia Studies at Ningxia University. The collaboration itself is telling: it pairs computer scientists with specialists from an academy devoted to the study of the Xixia, reflecting a growing trend in which heritage science projects bring domain experts and machine learning researchers to the same table. The paper was supported by the Major Program for Rare and Unique Studies Teams of the National Social Science Fund of China, under a project devoted to surveying and building a database of Xia translations of Chinese classical texts.

Why is Tangut so hard for machines to read? The authors identify several interlocking obstacles. First, the characters are structurally complex, often composed of multiple components arranged in tight spatial configurations. Second, many glyphs are highly similar: two characters may share nearly the same overall contour while differing only in the identity or placement of one component, much as the Latin letters a and o differ by a small internal detail, but with far higher stakes for meaning. Third, the data available for training follows a long-tailed distribution, meaning that a handful of characters appear constantly across manuscripts while thousands of others are rare, so a recognition system trained naively will become excellent at common characters and poor at the rare ones that often carry the most historical interest. Finally, annotated data is limited; creating ground-truth labels for ancient scripts requires scarce expert labor, which caps how large training datasets can grow.

Existing automatic recognition methods, the researchers note, have mostly relied on holistic appearance, treating each character image as an undivided visual pattern and learning to match overall shapes. That strategy works reasonably well when characters are visually distinct, but it struggles precisely where the hardest cases live: characters with similar contours but different internal component arrangements. A model that only memorizes what a character looks like as a whole has no principled way to notice that the left-hand component changed while the right-hand one stayed the same. The insight behind SPMTNet is that this weakness can be fixed by supplying the network with a structural prior, an explicit expectation about how Tangut characters are composed, so that the model learns to reason about parts and their spatial relationships rather than relying on gross visual similarity alone.

To make such structural learning possible, the team first had to build the right kind of data. They constructed a new dataset called XiXiaDB, a multi-source collection that contains not only whole-character images but also component annotations and explicit character-component correspondences. That last element is crucial. It means that for each character in the dataset, the system knows which components make it up and how they are arranged, giving the neural network a supervised signal about internal structure rather than just a final label. Multi-source collection also matters for real-world robustness: manuscripts scanned from different collections, written by different hands, or reproduced under different imaging conditions vary in ways that can silently break a model trained on a single homogeneous source. By drawing from multiple sources, XiXiaDB allows the researchers to test whether their method generalizes across the kinds of variation that actual digitization projects encounter.

Architecturally, SPMTNet pursues two complementary strategies. The first is multi-task learning: alongside the main task of identifying the whole character, the framework is trained on component composition and spatial relation learning, subsidiary tasks that force the network’s internal representations to encode which components are present and where they sit relative to one another. In effect, the model is asked to explain the anatomy of each character, and that anatomical understanding feeds back into better whole-character discrimination. The second strategy is a dedicated module the authors call Residual Spatial-Channel Attention, or RSCA. Attention mechanisms of this kind let a network dynamically emphasize the most informative parts of an image: the spatial dimension of RSCA highlights where in the glyph the discriminative detail lies, while the channel dimension highlights which feature types matter. Because the module is residual, it refines existing features rather than replacing them, strengthening the local cues, such as a single distinguishing stroke or component, that separate near-twin characters.

The experimental results bear out the design. On both XiXiaDB and a second benchmark called CharSample, SPMTNet outperformed representative baseline methods, with the largest gains appearing exactly where the problem is hardest: among highly similar characters and in long-tailed categories, where rare characters would otherwise be misclassified or ignored. The authors also conducted cross-source evaluations, training and testing across different data sources within Tangut character recognition, and found that the framework remained robust to source variations. That robustness is more than a technical nicety. Digitization campaigns for historical manuscripts inevitably mix material from multiple archives and imaging campaigns, and a recognition system that only works on one source’s images would require costly retraining for every new collection. A model that holds its accuracy across sources can be deployed more broadly and more cheaply.

The broader significance of the work lies in what automatic recognition unlocks for scholarship. Once characters in manuscript images can be identified reliably at scale, the resulting transcriptions become searchable text, enabling philologists to trace word usage across corpora, compare multiple copies of translated texts, and spot previously unnoticed variants. This matters especially for the Xixia corpus, which includes a remarkable body of translations of Chinese classical and Buddhist texts; systematic comparison of the Tangut versions against their Chinese sources is a major avenue of research, and the funding project behind this study is explicitly aimed at building a comprehensive database of such translations. Machine assistance does not replace expert decipherment, but it can multiply the amount of material a scholar can examine, converting years of manual lookup into hours of verification.

The approach may also travel beyond Tangut. Many historical writing systems, from Egyptian hieroglyphs to Mayan glyphs to various scripts of Central and East Asia, share the same structural logic: characters composed of meaningful parts arranged in space, with visual similarity between distinct signs and skewed frequency distributions in surviving documents. A framework that explicitly models component composition and spatial relations, supported by datasets that record character-component correspondences, offers a template that other endangered-script projects could adapt, provided comparable structural annotations can be produced. The paper, published open access under a Creative Commons license, was received in May 2026, accepted in September 2026, and published on October 1, 2026, carrying the DOI 10.1038/s40494-026-03012-6. As the authors and their funders continue building out the Xixia textual database, the quiet work of teaching machines to parse the anatomy of a medieval script may prove to be one of the more consequential collaborations between artificial intelligence and the humanities, turning a dead empire’s dense, beautiful characters into data that living scholars can search, compare, and finally read at scale.

Subject of Research: Structural-prior-guided deep learning for automatic recognition of Tangut characters in historical manuscript digitization

Article Title: Structural-prior-guided Tangut character recognition for digital preservation of historical manuscripts

Article References: Wang, X., Zhao, J., Yan, R., & Peng, X. (2026). Structural-prior-guided Tangut character recognition for digital preservation of historical manuscripts. npj Heritage Science. https://doi.org/10.1038/s40494-026-03012-6

Image Credits: AI Generated

DOI: 10.1038/s40494-026-03012-6

Keywords: Tangut script, Xixia, character recognition, deep learning, multi-task learning, attention mechanism, digital preservation, heritage science, manuscript digitization, XiXiaDB, long-tailed distribution, structural priors

The problem the researchers set out to solve is deceptively narrow but technically profound. Super-resolution—the task of reconstructing a high-resolution image from a degraded, low-resolution one—has been a staple of computer vision research for years. General-purpose models can sharpen photographs of faces, landscapes, and printed text with impressive results. Ancient inscriptions, however, break these models in a specific and revealing way. When a neural network trained on natural images confronts a weathered Chinese character, it does not know which broken fragments belong together. The result is what the authors call a semantic-visual imbalance: the restored image may look superficially plausible, but the network invents spurious topological connections between stroke fragments, fusing separate strokes or bridging unrelated components until the character becomes illegible to any reader who knows the script.

This failure mode matters because inscriptions are not merely pictures. They are text, and their value lies in legibility. A restoration that produces a beautiful but unreadable character has failed at the only task that counts. Conversely, a restoration that simply guesses what the character should be risks fabricating history—substituting the model’s expectation for the stone’s actual evidence. The tension between visual authenticity and semantic legibility is the central technical challenge of the field, and it is the tension that SteleSR is explicitly engineered to resolve.

The team’s approach unfolds in two layers. The first is a data problem: there are no paired examples of pristine inscriptions and their weathered counterparts, because the pristine originals no longer exist. To train a super-resolution model, researchers need input-output pairs, so the team built one synthetically. But synthetic noise—random blur, pixelation, or abrasion applied by an algorithm—bears little resemblance to the slow, structured damage of real weathering, and models trained on unrealistic degradation generalize poorly to actual stele photographs. To bridge this gap between synthetic noise and real-world damage, the researchers propose a progressive paradigm built on what they describe as LLM-driven structural decoupling and LVM-guided style injection. In essence, a large language model contributes knowledge of how characters are structurally composed—which strokes and components belong to which glyph—while a large vision model contributes knowledge of what weathered stone actually looks like, injecting realistic degradation styles into the training pipeline.

The second layer is the SteleSR framework itself, which is designed not as a single monolithic model but as a set of plug-in objectives that can be integrated into diverse super-resolution backbones. Two losses carry most of the weight. The first is an Edge-aware loss, which constrains the model to preserve and sharpen the true structural contours of carved strokes rather than blurring them into mush or hallucinating connections. The second is a Text Prior loss, which injects semantic knowledge of the script itself, encouraging the network to produce characters that are not just sharp but structurally coherent as writing. Because these objectives are backbone-agnostic, they can be attached to whichever super-resolution architecture a lab already uses, improving it without requiring a rebuild from scratch.

The evaluation strategy reflects the same dual concern with appearance and meaning. Rather than relying solely on standard image-similarity metrics, which are notorious for rewarding blurry but statistically safe outputs, the team assessed their results across both semantic and structural metrics—measuring whether restored characters remain recognizable as valid glyphs and whether their stroke topology survives reconstruction. Across these evaluations, SteleSR consistently enhanced the performance of the various underlying models it was attached to, suggesting that the framework’s gains come from the injected priors rather than from any single architectural trick. The authors position this as a pioneering standard for high-fidelity digital preservation of historical artifacts, and the code and data have been released openly on GitHub, lowering the barrier for museums, conservators, and other research groups to adopt and extend the method.

The broader significance of the work lies in what it says about how AI should handle cultural heritage. The dominant paradigm in generative vision is to produce plausible images, but plausibility is a dangerous objective when the subject is historical evidence. A generative model asked to restore a damaged inscription will happily invent a complete character, because complete characters are what its training data suggest a damaged character should become. SteleSR’s design philosophy pushes in the opposite direction: the semantic priors it injects are meant to guide reconstruction toward structural coherence without overriding what the stone actually preserves. The distinction is subtle but crucial—a restoration should recover what time has obscured, not what the model wishes were there.

There is also a methodological lesson in the two-layer design. The field of real-world super-resolution has long struggled with the domain gap between laboratory degradation models and the messy damage of actual photographs. By using large language models to reason about character structure and large vision models to model realistic degradation, the researchers demonstrate a template that could transfer to other heritage domains: weathered manuscripts, eroded rock art, faded frescoes, and corroded metal inscriptions all share the same fundamental problem of paired-data scarcity and domain-specific damage patterns. Related work in the same journal—including diffusion-based restoration of Huashan rock art and VLM-based degradation prior learning—suggests a rapidly converging research frontier in which foundation models supply the domain knowledge that small, task-specific networks lack.

The practical stakes are considerable. China alone holds an enormous corpus of stele inscriptions spanning more than two millennia, many of them deteriorating in open air or in underfunded storage. Digital photography campaigns have captured these artifacts, but low-resolution or degraded scans limit both scholarly reading and public engagement. A universal restoration framework that runs on existing super-resolution backbones means institutions do not need cutting-edge infrastructure to participate; they need only the released code, their own photographs, and the computational means to fine-tune. High-fidelity digital surrogates also serve conservation directly, providing a record of current condition against which future degradation can be measured, and enabling virtual access that reduces physical handling of fragile originals.

None of this replaces the epigrapher’s trained eye or the philologist’s knowledge of the script. What SteleSR offers is an instrument—a way of making weathered text legible enough for experts to read, while keeping the machine’s imagination on a leash. The study was partially supported by the National Language Commission of China, the National Natural Science Foundation of China, the Blue Project of Jiangsu Province, and the Top-level Talents Support Program of Yangzhou University, and it appears in an open-access journal, consistent with the team’s decision to release code and data publicly. As environmental pressure on stone heritage accelerates, tools that bridge the gap between what pixels show and what characters mean may determine how much of the carved record survives—not in stone, but in the digital commons where the next generation of readers will encounter it.

Subject of Research: AI-based super-resolution restoration of weathered ancient stele inscriptions

Article Title: Bridging the semantic-visual gap: a universal super-resolution framework for ancient stele inscriptions

Article References: Qiang, J., Hou, W., Zhu, Y., Yuan, Y., Zhao, X., & Wang, X. (2026). Bridging the semantic-visual gap: a universal super-resolution framework for ancient stele inscriptions. npj Heritage Science. https://doi.org/10.1038/s40494-026-03024-2

Image Credits: AI Generated

DOI: 10.1038/s40494-026-03024-2

Keywords: super-resolution, stele inscriptions, cultural heritage, deep learning, digital preservation, computer vision, large language models, epigraphy, image restoration, npj Heritage Science, semantic legibility, SteleSR

The study, published in the journal Discover Informatics, examined eight Ghanaian universities with operational institutional repositories, including the University of Ghana, Kwame Nkrumah University of Science and Technology, the University of Cape Coast, the University of Education Winneba, the University for Development Studies, Ashesi University, the Ghana Institute of Journalism, and the University of Professional Studies Accra. Led by De-Graft Johnson Dei and Karim Awudu, the research team surveyed 120 respondents drawn from ICT personnel, repository managers, academic librarians, systems librarians, and faculty members, then followed up with in-depth interviews with twelve senior experts. The design was a sequential explanatory mixed-methods approach, meaning the survey results shaped the questions asked in later interviews, and the two strands of evidence were triangulated during interpretation.

The headline finding is sobering. Forty percent of respondents said their institutions had no digital rights management mechanism in place at all. Access control was the most commonly implemented practice, appearing at 44.2 percent of institutions, while advanced techniques such as digital watermarking and encryption were implemented at only 9.2 percent. Usage tracking, copyright auditing, and automated licensing enforcement were similarly rare. Interview participants described repositories that upload content without defined rights policies, verify permissions manually, and have no idea who downloads what or where it ends up. One participant at the University for Development Studies put it bluntly: access matters more than protection. Another observed that if content is on the internet, people assume it is free to use, a presumption that puts author rights at risk.

Against this backdrop, blockchain technology has been proposed as a transformative tool. A blockchain is a distributed ledger in which transactions are recorded in cryptographically verified, time-stamped blocks linked to their predecessors, maintained across a network of nodes rather than a single central authority. Because no single party controls the record, entries cannot be quietly altered, and every change leaves a permanent, auditable trail. For digital rights management, this architecture offers several distinct functions: authorship verification through immutable timestamps and digital signatures, provenance tracking across the scholarly lifecycle, content integrity through cryptographic verification, and automated rights enforcement through smart contracts, which are self-executing programs that apply licensing terms without continuous administrative intervention.

The researchers grounded their analysis in two complementary theoretical lenses. The Technology-Organization-Environment framework, developed by Tornatzky and Fleischer, examines how technological features, organizational capacity, and environmental conditions such as national policy shape whether institutions adopt an innovation. Diffusion of Innovations theory, articulated by Everett Rogers, explains how individual stakeholders perceive new ideas through the attributes of relative advantage, compatibility, complexity, trialability, and observability. Together, the frameworks allowed the team to assess both the structural readiness of Ghanaian universities and the attitudes of the people who would actually operate blockchain-enabled systems.

Awareness of blockchain turned out to be uneven. Overall, 62.5 percent of respondents had heard of the technology, but mean perceived understanding was low at 2.31 on a five-point scale. ICT personnel were far ahead, with 86.7 percent awareness and a mean understanding score of 3.82, while faculty members lagged at 33.3 percent awareness and a mean of 1.74. Interviews revealed persistent conceptual confusion, with some participants equating blockchain entirely with Bitcoin and others describing it as futuristic but unproven in a library context. Several respondents expressed a genuine appetite for training, noting that interest exists but workshops and webinars do not. According to Diffusion of Innovations theory, these conditions mark an early adoption stage characterized by low observability and high perceived complexity, yet also a latent receptiveness that targeted demonstration could convert into adoption.

Institutional readiness fared worse. The overall preparedness score was 2.25, rated as poor, and only 18.3 percent of respondents believed their infrastructure could support blockchain. A striking 81.7 percent said their digital library strategies made no mention of the technology. Funding was the dominant constraint, cited by 74.2 percent, followed by technical complexity at 74.2 percent, shortage of qualified staff at 72.5 percent, and absence of legal and regulatory frameworks at 68.3 percent. Participants described server capacity too limited to host current systems, ICT plans with no blockchain reference whatsoever, and donor projects that fund basic digital libraries but not cutting-edge infrastructure. In northern Ghana, unreliable internet and electricity compounded the problem, cited by 54.2 percent of respondents.

Yet the appetite for blockchain’s benefits was remarkably strong. Tamper-proof authorship verification topped the list, endorsed by 78.3 percent of respondents with a mean rating of 4.21, followed by improved content authenticity and integrity at 74.2 percent and transparent audit trails at 71.7 percent. Smart contract automation of copyright enforcement drew support from 66.7 percent, blockchain timestamping from 61.7 percent, and decentralized data control from 63.3 percent. Librarians interviewed for the study described repeated incidents of downloaded content being renamed and shared without credit, and saw in blockchain a way to safeguard the uniqueness of their researchers’ work. Others noted that precise access tracking could transform impact monitoring, and that smart contracts could enforce Creative Commons licenses without manual policing.

On strategy, stakeholders favored cautious, low-risk pathways. Staff training and capacity building was the most endorsed approach at 79.2 percent, followed by pilot blockchain repository modules at 76.7 percent and phased implementation at 74.2 percent. Open-source platforms such as Hyperledger attracted 72.5 percent support, reflecting a preference for affordable, flexible tools over commercial systems. Multidisciplinary task forces spanning librarians, attorneys, and IT professionals, donor and government funding, and regional consortia all received strong ratings, while alignment with national education policy goals ranked lowest at 60.8 percent, exposing a strategic disconnect between institutional action and frameworks set by the Ministry of Education and the Ghana Tertiary Education Commission.

The study concludes that blockchain-enabled digital rights management in Ghanaian repositories is a promising but still emerging innovation, transformative in potential yet constrained by infrastructure, funding, expertise, and policy. The authors recommend phased implementation, pilot projects beginning perhaps with postgraduate theses, open-source tools, interdisciplinary collaboration, and sustained investment in digital infrastructure and human capacity. They also caution that the findings rest on self-reported perceptions from eight universities and do not evaluate operational blockchain systems, leaving room for future work on prototypes, longitudinal adoption studies, and integration with technologies such as big data analytics and large language models. For now, the message is clear: Ghana’s repositories hold valuable scholarship that is largely unprotected, and while blockchain is no silver bullet, stakeholders across the country’s universities are ready to explore whether a decentralized ledger can finally give their research the trust and security it deserves.

Subject of Research: Blockchain adoption for digital rights management in Ghanaian university institutional repositories

Article Title: Evaluating blockchain adoption for digital rights management in institutional repositories

Article References: Johnson Dei, D.-G., & Awudu, K. (2026). Evaluating blockchain adoption for digital rights management in institutional repositories. Discover Informatics, 1(1), Article 5. https://doi.org/10.1007/s44564-026-00008-z

Image Credits: AI Generated

DOI: 10.1007/s44564-026-00008-z

Keywords: blockchain technology, digital rights management, institutional repositories, Ghana, higher education, scholarly communication, smart contracts, copyright protection, digital preservation, open access, TOE framework, Diffusion of Innovations