Small Qualitative Evaluations Offer a Fix for AI’s Foundation Paradox

Large language models have become astonishingly versatile, but the tools we use to measure their abilities have not kept pace. A new study published in Neural Computing and Applications argues that the very advances making foundation models broadly useful are also pushing them into specialized, context-dependent applications that existing evaluation methods cannot adequately assess. The researchers, led by Michael Simeone of Arizona State University, call this mismatch the foundation paradox: as general-purpose models grow more capable, user demand expands into domains where only qualitative, domain-grounded assessment can capture performance with sufficient fidelity. Their proposed remedy is deceptively simple, a framework they call small qualitative evaluations, or SQEs, which brings structured human judgment back to the center of AI testing.

The problem the team identifies sits in the middle of the evaluation spectrum. At one end are well-bounded, closed-form tasks, such as multiple-choice medical exams or legal benchmark suites like MEDQA and LEXGLUE, where correctness is specified in advance and scored at scale. At the other end are highly professionalized expert domains, where validation rests on formal standards and regulatory norms. Between these poles lies a growing class of intermediate, situational, and interdisciplinary queries that are neither reducible to fixed answers nor stabilized by consensus authority. Recent polling shows that activities such as targeted information searches and idea generation rank among the top uses of generative AI, and categories like medical advice and legal document drafting have expanded sharply between 2024 and 2025, meaning models are increasingly treated as entry points into specialized knowledge once mediated by professionals.

To illustrate the gap, the authors contrast two kinds of questions. A prompt asking a model to diagnose a 45-year-old man with chest pain and ST-segment elevation can be scored against an established clinical benchmark. But asking how traditional Ayurvedic practices should inform post-heart-attack rehabilitation in rural India demands cultural nuance, historical knowledge, and interdisciplinary synthesis that no fixed test set can capture. Similarly, predicting wheat yields under a two-degree temperature rise can be checked against a crop model, while designing a community heat-action plan for an oasis town facing desertification, with local cultural practices and resource constraints in mind, requires open-ended, scenario-based judgment. Climate adaptation, the study argues, is precisely such a domain: inherently interdisciplinary, regionally contingent, and short on the codified corpora that make medical and legal benchmarking feasible.

The team’s answer draws on the traditions of qualitative data analysis. SQEs are streamlined, rubric-based assessments of limited sets of open-ended responses, conducted by trained human coders. The word qualitative here does not mean unstructured or subjective; evaluative categories are developed through engagement with research literature and theoretical frameworks, and responses are scored against transparent, analytically grounded criteria. The word small refers to a design principle borrowed from the qualitative methodologist Johnny Saldaña’s notion of code parsimony: rubric dimensions should be added only when they designate a salient area of performance that matters to the stated use case. Sparse code sets prioritize interpretability, inter-rater reliability, and transparency, allowing small teams without dedicated evaluation infrastructure to produce defensible assessments.

As a demonstration, the researchers built the Desert Language Model Evaluation Framework, or DLEF, a rubric for evaluating open-ended guidance on extreme heat adaptation, developed from materials produced by Arizona State University’s Knowledge Exchange for Resilience. The framework consists of 35 prompts derived from seven core heat-related questions, each with four location-specific variations across Scottsdale, Phoenix, Guadalupe, and Flagstaff, Arizona, covering topics such as heat stroke diagnosis, home weatherization, air conditioning failures, outdoor worker safety, and public transportation. Each prompt was submitted to GPT-4o ten times, yielding 350 location-based responses and 100 medical responses per condition, collected with automated Selenium scripts in November 2024. Textual consistency was measured using TF-IDF vectorization and cosine similarity, and response quality was scored across five dimensions: Place-Based Fit, General Fit and Feasibility, Executive Path, Uncertainty and Intellectual Humility, and Affect and Emotional Intelligence.

The human validation results were revealing. Two trained coders independently scored a sample of 70 items, and inter-rater reliability, measured with quadratic-weighted Cohen’s kappa, was strongest for the adaptation-relevant dimensions: Place-Based Fit reached 0.91, Executive Path 0.66, and General Fit and Feasibility 0.56, while Uncertainty and Humility (0.24) and Affect and Emotional Intelligence (0.28) fell well short of acceptable thresholds. Mixed-effects models reinforced the pattern, with Place-Based Fit showing the strongest systematic variation tied to prompt characteristics. Substantively, GPT-4o showed surface-level sensitivity to place, often naming a city when given, but limited ability to translate location into genuinely tailored advice. Prompts anchored in low-desert localities such as Scottsdale, Phoenix, and Guadalupe scored higher than those for high-desert Flagstaff, and prompts with no location specified performed worst, a pattern consistent with the distribution of the model’s training data. Apartment prompts received lower feasibility ratings than single-family or mobile homes, reflecting limited attention to the user’s actual control over infrastructure.

The study then asked whether a human-validated SQE could be replicated by automated LLM-as-judge scoring. Four open-weight models, Llama 3.1 8B, Qwen 8B, GPT-OSS 20B, and Mistral 26B, were deployed locally at temperature zero and asked to score the same 70 items under eight prompt variants that systematically varied expert versus nonexpert framing and the type of anchor examples provided. No single configuration achieved acceptable agreement, defined as kappa of at least 0.60, across all five dimensions. Place-Based Fit was the sole dimension approaching reliable replication, with GPT-OSS 20B under the nonexpert condition with human-grounded anchors reaching a mean human-agent kappa of 0.772, equivalent to 85 percent of the human-human baseline. Executive Path never exceeded 30 percent of human agreement under any model or variant. Crucially, the correlation between human inter-rater reliability and best automated agreement across dimensions was significant (Pearson r = 0.686, p = 0.005), suggesting that how consistently humans can apply a rubric predicts whether machines can replicate it.

To understand why, the team turned to mechanistic interpretability. Using the National Deep Inference Fabric and the NNsight library, they extracted last-layer hidden states from Llama 3.1 8B and 70B at the token immediately preceding score generation and trained linear probes to predict human consensus scores. For Place-Based Fit, where human agreement was high, probe accuracy was also high, and principal component analysis revealed a visible score-level gradient along the first principal component in the 70B model, indicating that the construct was geometrically organized in the model’s representations in a way consistent with human judgment. Strikingly, at the 8B scale the probe kappa of 0.713 exceeded the model’s own output agreement with human raters, suggesting the model internally represented place-sensitivity better than its scores reflected, a distinction that matters because it points to prompt design or calibration fixes rather than a need for a bigger model.

The Uncertainty and Humility dimension told a cautionary counter-story. Probe kappa exceeded the human-human baseline under all conditions, reaching 0.588 for the 70B model against a human kappa of just 0.244. Yet per-rater analysis showed that this apparent alignment was partly an artifact of averaging divergent rater scores toward the middle of the scale, a phenomenon the authors link to what recent work calls the consistency-bias paradox: high internal consistency in an AI judge does not guarantee valid measurement. When a model produces more consistent scores than humans on a dimension where humans disagree, it has more likely converged on its own interpretation of the construct than faithfully operationalized the codebook’s intent. High automated agreement on a poorly operationalized dimension, the authors argue, is a validity concern rather than evidence of scalability.

The broader implication is that human inter-rater reliability should function not merely as a quality check on a rubric but as a prior estimate of whether automated replication is feasible at all. Dimensions defined by observable, surface-detectable features of text are candidates for automation at sufficient model scale, while dimensions requiring inferential judgment about tone, structure, or epistemic stance remain dependent on human coding. The authors propose a five-stage workflow of rubric development, human calibration, automation screening, scaled deployment, and periodic revalidation, and they caution that prompt configurations validated for one model family may not transfer to another even at the same parameter count. SQEs are not a replacement for large-scale benchmarks or professional panel adjudication, but they offer a principled, repeatable strategy for the dynamic, contested, and interdisciplinary settings where AI systems are increasingly deployed, and where, as the foundation paradox makes clear, the consequences of untested guidance may be greatest.

Subject of Research: Evaluation of large language model performance in open-ended, interdisciplinary domains using small qualitative, human-in-the-loop assessment frameworks

Article Title: Performance within the foundation paradox: the case for small qualitative evaluations

Article References: Simeone, M., Hyatt, J., Bienenstock, E. J., Babu, R., & Solis, P. (2026). Performance within the foundation paradox: the case for small qualitative evaluations. Neural Computing and Applications, 38(19), Article 777. https://doi.org/10.1007/s00521-026-12328-0

Image Credits: AI Generated

DOI: 10.1007/s00521-026-12328-0

Keywords: large language models, model evaluation, small qualitative evaluations, inter-rater reliability, LLM-as-judge, mechanistic interpretability, climate adaptation, extreme heat, qualitative data analysis, foundation models, benchmarking, GPT-4o