Custom Fine-Tuned Transformer Outperforms GPT-4 at Spotting Indian Fake News

Fake news has become one of the most corrosive byproducts of the social media era, eroding public trust, distorting democratic debate, and overwhelming fact-checkers who cannot keep pace with the sheer volume of fabricated content circulating online. In India, where hundreds of millions of users consume news through messaging apps and social platforms in multiple languages, the problem is particularly acute. Now, a team of researchers from Yenepoya Institute of Technology, KIIT Deemed to be University, DRIEMS University, and Nitte University reports in the International Journal of Machine Learning and Cybernetics that a carefully customized and fine-tuned transformer language model can outperform both classical machine learning pipelines and some of the world’s most powerful large language models at detecting fabricated Indian news articles.

The study, led by Manish Prajapati and supervised by Santos Kumar Baliarsingh, addresses a persistent weakness in automated misinformation detection: most existing systems were built on English-language corpora drawn from Western news ecosystems, and they struggle to capture the contextual and semantic patterns that characterize deceptive content in Indian digital media. Traditional machine learning approaches such as logistic regression, Naïve Bayes, and random forests rely on shallow statistical features, while recurrent architectures like LSTM and GRU networks, though better at modeling sequences, still fall short when it comes to understanding the subtle linguistic cues that separate genuine reporting from fabrication.

At the heart of the new framework is a customized Bidirectional Encoder Representations from Transformers, or BERT, architecture. Transformers process text through self-attention mechanisms, which allow the model to weigh the relationships between every word in a document simultaneously rather than reading it in a fixed order. This bidirectional attention means the model can detect, for example, when a sensational headline is contradicted by the body of an article, or when emotionally charged language appears in contexts where neutral reporting would be expected. The researchers applied domain-adaptive fine-tuning, adjusting the pretrained model’s internal representations to the specific vocabulary, phrasing, and rhetorical conventions of Indian news content, which differs markedly from the text distributions the original model was trained on.

A crucial ingredient in the work is data. The team assembled a large-scale benchmark dataset of 71,898 Indian news articles by combining multiple publicly available sources of both real and fake news, spanning politics, governance, social issues, and misinformation-related content. Dataset quality is often the bottleneck in misinformation research, since labels are frequently noisy or inconsistent. To tackle this, the researchers built an annotation pipeline that combines large language model assistance with human verification. An LLM performs an initial pass over the articles, flagging likely labels, and human annotators then verify the results, a hybrid approach designed to combine the speed of automation with the judgment of expert reviewers.

Before training, the corpus underwent advanced preprocessing, including text normalization, tokenization, and the generation of contextual embeddings. These steps convert raw news text into numerical representations that preserve meaning and context, giving the model a cleaner and more informative signal to learn from. The data was then split using a stratified train-validation-test strategy, which ensures that the proportion of real and fake articles remains consistent across each subset, a methodological safeguard that prevents the model from being evaluated on an unrepresentative sample.

The benchmarking exercise was unusually comprehensive. The custom BERT framework was pitted against classical machine learning models, deep learning baselines including LSTM and GRU networks, pretrained BERT variants, and prompt-based classification using GPT-3.5 and GPT-4. The results were striking: the fine-tuned framework achieved superior performance across accuracy, precision, recall, F1-score, and ROC-AUC, the standard metrics for classification quality. Perhaps most notably, it beat the general-purpose large language models despite their enormous scale, a finding that reinforces a growing consensus in the field: a smaller model fine-tuned on domain-specific data can outperform a much larger model that relies only on prompting.

The reasons are technical as much as practical. Prompt-based classification asks a general-purpose model to apply knowledge it acquired during broad pretraining, without ever updating its weights for the task at hand. Fine-tuning, by contrast, adjusts the model’s parameters directly on labeled examples from the target domain, teaching it the idiosyncratic markers of deception in Indian news, from particular narrative structures to characteristic vocabulary shifts. The custom framework also maintains computational efficiency and scalability, meaning it can plausibly be deployed for real-time monitoring rather than confined to laboratory experiments, an important consideration when misinformation spreads within minutes of publication.

Beyond raw accuracy, the researchers invested in interpretability, one of the most pressing concerns in applying artificial intelligence to content moderation. Using attention visualization, they examined which parts of a news article the model focused on when making its decision. The analysis revealed that the model latches onto misinformation-related linguistic patterns and contextual dependencies, effectively learning to highlight the textual signals most associated with fabrication. This kind of transparency matters because a detector that simply outputs a verdict without explanation is difficult for fact-checkers, platforms, or regulators to trust or audit. By exposing its reasoning traces, the framework becomes a tool that human reviewers can interrogate rather than a black box they must take on faith.

The implications extend well beyond India. Misinformation researchers have long noted that detection systems trained on one linguistic or cultural context transfer poorly to another, and the new study offers a template for building locally adapted detectors: assemble a large, domain-relevant, carefully verified dataset, fine-tune a transformer architecture on it, and validate against a broad range of baselines including frontier LLMs. The authors suggest the framework could support real-time misinformation monitoring and fact-checking applications in Indian digital media environments, where the speed and scale of viral falsehoods routinely outstrip human capacity. The study received no external funding and was conducted independently by the research team.

Challenges remain. Fake news evolves constantly as bad actors adapt their tactics, and any deployed detector will need continual retraining to keep pace. The dataset, while large, reflects the sources available at the time of construction, and the authors note that the underlying data is available from the corresponding author upon reasonable request. Still, the work marks a meaningful step toward practical, scalable misinformation defense: evidence that thoughtfully customized transformer models, paired with rigorous data curation and human oversight, can deliver both the accuracy and the efficiency needed to fight fake news where it spreads fastest.

Subject of Research: Fine-tuned transformer language models for detecting fake news in Indian digital media

Article Title: A Deployed Custom Fine-tuned Transformer Language Model Framework for Indian Fake News Detection

Article References: Prajapati, M., Baliarsingh, S. K., Sahoo, S. S., Das, S., Revankar, P. K., & Pinto, J. P. (2026). A Deployed Custom Fine-tuned Transformer Language Model Framework for Indian Fake News Detection. International Journal of Machine Learning and Cybernetics, 17(10), Article 469. https://doi.org/10.1007/s13042-026-03289-w

Image Credits: AI Generated

DOI: 10.1007/s13042-026-03289-w

Keywords: fake news detection, transformer models, BERT, large language models, GPT-4, natural language processing, misinformation, text classification, fine-tuning, India, machine learning, attention mechanisms