AI Learns to Read Kurdish News Stance with Just 2,174 Articles

Researchers in Sulaimani, in the Kurdistan Region of Iraq, have built the first trained stance-detection models and empirical benchmark for Sorani Kurdish news, one of the most widely spoken varieties of Kurdish yet long absent from the map of modern natural language processing. Their study, published in the International Journal of Data Science and Analytics, shows how far careful data engineering and efficient fine-tuning of a language model can go when a language has almost no annotated data to learn from. The work was carried out by Hawar Hussein Yaba of the Kurdistan Technical Institute together with Rebwar M. Nabi and Rebaz M. Nabi of Sulaimani Polytechnic University and the Raparin Technical and Vocational Institute.

Stance detection is the task of automatically determining whether a piece of text is in favor of, against, or neutral toward a target such as a political claim, a public figure, or a news event. It is a cornerstone technology for studying misinformation, polarized discourse, and the shape of public debate online. For high-resource languages like English, mature models and large benchmark datasets exist, and recent research has pushed toward multimodal and zero-shot approaches. For Sorani Kurdish, however, the authors report that no trained stance-detection model or benchmark had previously been published at all, despite the recent release of a small annotated dataset known as the Bochun Kurdish Stance Detection Dataset. That mismatch between an available resource and any applied modeling is the gap the new study set out to close.

The starting point was a public dataset of 2,174 annotated Sorani news articles, hosted on Mendeley Data. That number is tiny by the standards of modern machine learning, where models routinely train on tens of thousands or millions of labeled examples. Worse, the dataset suffered from severe class imbalance, meaning the three stance categories were far from equally represented, a condition that notoriously causes classifiers to ignore minority classes and inflate their apparent accuracy. The team therefore framed their central question as how to build reliable stance detectors under both extreme data scarcity and skewed label distributions.

Their answer combined two lines of attack. The first was a contextual data augmentation pipeline that expanded the training corpus into a strictly filtered, class-balanced set. At its heart lies masked-token substitution powered by KuBERT, a BERT language model pre-trained specifically for central Kurdish. In this technique, words in training sentences are replaced with a mask token, and the language model predicts plausible substitutes that fit the surrounding context, generating new sentences that stay grammatically and semantically close to the originals. This is a low-resource adaptation of contextual augmentation, an approach introduced at NAACL in 2018, and the team paired it with controlled oversampling so that each stance class contributed a balanced share of training examples. Crucially, the augmentation was subjected to strict filtering, and human Kurdish-language annotators validated a sample of the generated text to confirm that the procedure preserved the original labels, an assumption the authors say underpins the entire approach.

The second line of attack was the fine-tuning strategy itself. Rather than training models from scratch, the researchers adapted KuBERT, the Kurdish BERT model released in 2024, under three distinct regimes. Full-parameter updating adjusts every weight in the network and typically demands the most compute and memory. Low-rank adaptation, or LoRA, freezes the base weights and instead learns small low-rank matrices injected into the transformer’s layers, cutting the number of trainable parameters dramatically. QLoRA goes a step further by quantizing the frozen base model to 4-bit precision before applying LoRA, a configuration popularized by the 2023 QLoRA paper for efficient fine-tuning of large language models. Comparing these three strategies on the same data provided a rare empirical head-to-head in a genuinely low-resource setting.

Evaluation methodology received as much attention as the models themselves. The team ran all experiments across five random seeds, a safeguard against the luck of any single training run, and scored everything on a held-out test set drawn exclusively from real, unaugmented articles. This distinction matters: evaluating on synthetic text can silently leak the very patterns augmentation introduces, so testing only on genuine journalism gives a more honest picture of real-world performance. Macro-averaged F1 served as the primary metric because it weights each stance class equally and thus exposes failure on minority classes, with accuracy, weighted F1, the Matthews Correlation Coefficient, and Cohen’s kappa reported alongside it. MCC, in particular, is prized for giving a truthful single number even when class distributions are unbalanced.

The results tell a clear story about why task-specific adaptation matters. A zero-shot KuBERT baseline, applied to stance detection without any fine-tuning, scored a macro F1 of roughly 0.20 with an MCC near negative 0.03, meaning it performed barely better than random guessing. After fine-tuning on the original, imbalanced dataset, models reached a macro F1 of around 0.48 with an MCC of about 0.24, more than doubling the baseline and confirming that domain adaptation is essential even when data is scarce. But the most striking gains appeared on the class-balanced augmented condition, evaluated under a corrected, leakage-free protocol. There, the best configuration, KuBERT fine-tuned with QLoRA, achieved a mean macro F1 of 0.58 and an MCC of 0.37 across seeds, with the strongest single run reaching a macro F1 of 0.60.

Perhaps the most instructive finding came from the per-class and ablation analysis, which disentangled where the improvement actually came from. The authors report that most of the gain was driven by correcting class imbalance rather than by the diversity of augmented examples alone. In other words, balancing the classes was the dominant lever, with contextual augmentation contributing as the mechanism that made balancing possible without exhausting the real data. This nuance carries a practical lesson for anyone building classifiers on small, skewed datasets in low-resource languages: the expensive machinery of augmentation and parameter-efficient fine-tuning pays off most when paired with a disciplined focus on label distribution and honest evaluation.

The choice of QLoRA as the winning configuration also has practical implications beyond accuracy. Because QLoRA trains only tiny adapter modules on top of a 4-bit quantized base model, it slashes memory requirements, putting fine-tuning of pretrained language models within reach of research groups without access to large-scale computing infrastructure. For language communities outside the technological mainstream, that accessibility may prove as consequential as the benchmark numbers themselves. The team’s augmentation pipeline, fine-tuning scripts, model configuration files, and per-seed evaluation results are available from the corresponding author on reasonable request, and the underlying Bochun dataset is public, lowering the barrier for follow-up work.

The broader significance of the study lies in what it demonstrates for the roughly tens of millions of Sorani speakers whose media landscape has been effectively invisible to computational text analysis. Reliable stance detection could enable systematic study of how misinformation spreads through Kurdish news and social media, inform fact-checking efforts, and support media-monitoring tools tuned to the region’s discourse. The authors are explicit that their contribution is a first competitive baseline rather than a solved problem: a macro F1 of 0.58, while a substantial step above chance, still leaves considerable room for improvement, and future work will likely explore larger corpora, additional architectures, and zero-shot techniques now emerging for stance detection more broadly. But as a proof of concept, the study shows that a small annotated dataset, a Kurdish language model, and a leakage-free, class-aware evaluation protocol can together close a meaningful portion of the gap between low-resource languages and the cutting edge of natural language understanding.

Subject of Research: Stance detection for low-resource Sorani Kurdish news using data augmentation and parameter-efficient fine-tuning of a Kurdish BERT model

Article Title: Towards robust stance detection: data augmentation, model fine-tuning, and empirical benchmarking

Article References: Yaba, H. H., Nabi, R. M., & Nabi, R. M. (2026). Towards robust stance detection: data augmentation, model fine-tuning, and empirical benchmarking. International Journal of Data Science and Analytics, 22(1), Article 310. https://doi.org/10.1007/s41060-026-01266-8

Image Credits: AI Generated

DOI: 10.1007/s41060-026-01266-8

Keywords: stance detection, Sorani Kurdish, KuBERT, data augmentation, QLoRA, LoRA, fine-tuning, low-resource languages, natural language processing, class imbalance, macro F1, benchmarking