The study, published in the journal Large-scale Assessments in Education, drew on the German National Educational Panel Study, a long-running effort that follows children’s competence development across the life span. The researchers, led by Jana Welling of the Leibniz Institute for Educational Trajectories, analyzed reading and mathematics assessments administered in Grades 2 and 4, with 1,512 children participating in the second-grade assessments and 1,470 in the fourth-grade versions. Because the tests were administered on tablets or computers, every response came with a precise timestamp, allowing the team to reconstruct exactly how long each child spent on each item.

Rapid guessing matters because large-scale assessments are typically low-stakes: nothing happens to a child’s grades, placement, or future based on the outcome. Expectancy-value theory suggests that when a task carries no personal consequence, motivation to invest effort can collapse. The demands-capacity model adds a second dimension, proposing that effort depends on the match between what an item demands and the cognitive resources a test-taker is willing and able to deploy. When either willingness or capacity falls short, disengaged responding emerges—and in its most extreme form, responses arrive at implausibly high speed with accuracy near chance level.

Among adolescents and adults, this is no small problem. A 2022 meta-analysis found that roughly 7 percent of responses in low-stakes assessments are rapid guesses, and about 28 percent of examinees rapid-guess at least once. Worse, uncorrected proficiency estimates are biased downward by an average of 0.13 standard deviations. But children, the researchers reasoned, may be a different story. Young children tend to be overconfident in their abilities, which could boost their expectancy of success and keep them engaged. At the same time, their shorter attention spans could work in the opposite direction, making long tests feel more demanding and pushing them toward disengagement.

To detect rapid guessing, the team used response-time thresholds: any answer delivered faster than a cutoff was flagged as a guess and scored as missing. Because no single threshold method works for every test design, the researchers compared several approaches. For the reading tests and the fourth-grade mathematics test, they applied normative threshold methods, defining the cutoff as 10 or 20 percent of the average response time for each item. For the second-grade mathematics test—where items were read aloud via pre-recorded audio and children could not answer before the audio finished—they used visual inspection methods based on the shape of the response-time distribution and on how accuracy changes with speed. Thresholds were then validated by checking whether flagged responses showed chance-level accuracy and near-zero correlation with overall test scores.

The headline result: rapid guessing was scarce. In second-grade reading, 3.3 percent of responses were classified as rapid guesses; in second-grade mathematics, just 0.8 percent. By fourth grade, the rates fell even lower, to 0.5 percent in reading and 0.4 percent in mathematics. Contrary to the researchers’ hypothesis, disengagement did not increase between Grades 2 and 4—in the reading domain, it actually declined. The authors suggest that the fourth-grade reading test may simply have been too easy for most children, since easier items tend to elicit less rapid guessing, and that the real rise in disengagement documented in earlier studies typically emerges around puberty rather than in early elementary school.

Who rapid-guesses? Across all four assessments, only one characteristic reliably predicted the behavior: proficiency. Less proficient children were consistently more likely to fire off quick answers than their higher-performing peers, echoing patterns well established in older samples. A one-unit increase in estimated ability raised the probability of engaged responding by between 0.52 and 1.96 percentage points depending on the assessment. Notably, gender and parental socioeconomic status—both of which have been linked to test-taking effort in adolescent and adult studies—showed no significant effects. Descriptively, boys and children without a university-educated parent did guess somewhat more often, but these differences were too small and inconsistent to reach statistical significance, suggesting that the social gradients in test engagement familiar from older populations may simply not have taken hold yet in eight- and ten-year-olds.

The most consequential finding concerns what rapid guessing does to the numbers that policymakers actually use. The researchers compared estimates of ability differences between girls and boys, and between children of low and high parental socioeconomic status, computed once from the raw data and once from data in which rapid guesses had been scored as missing. The differences were essentially zero. Whether the team examined the modest gender gap in fourth-grade reading, the male advantage in mathematics, or the substantial socioeconomic gaps present in every domain, accounting for rapid guessing shifted the estimates by at most 0.01 standard deviations, well within the bootstrap confidence intervals. In other words, even the small amount of guessing observed did not distort subgroup comparisons in any meaningful way.

Why doesn’t a behavior that biases average scores elsewhere leave group comparisons untouched? The authors point to two mechanisms. First, when most test-takers are engaged, the handful of rapid guesses carries little statistical weight. Second, rapid guessing is strongly tied to low proficiency—and because less proficient respondents have a low probability of answering correctly even when trying, a random guess changes little. For a bias in group comparisons to emerge, the groups would need to differ substantially in their guessing rates, which appears to be rare in practice, particularly among children.

The study carries practical weight for the assessment community. It suggests that the alarming disengagement rates documented in adolescent samples cannot simply be projected downward onto younger children, and that large-scale assessments involving elementary schoolers may be more robust than critics fear. But the authors caution against complacency. Prevalence varied considerably between assessments even within the same children, pointing to the strong influence of test design, time limits, item presentation, and proctoring conditions—and a lack of rapid guessing does not guarantee full engagement, since children may express disengagement in other ways, such as omissions or slow, effortful guessing. The team also notes that no single threshold method fits every test, and that the rarity of the behavior itself makes its predictors statistically hard to pin down. Future work, they argue, should examine broader forms of disengagement, test model-based identification approaches in child samples, and experimentally vary assessment settings. For now, though, the message is clear: the youngest test-takers, by and large, are still trying.

Subject of Research: Rapid guessing behavior and test-taking engagement among elementary school children in large-scale educational assessments

Article Title: Prevalence, predictors, and consequences of rapid guessing among children in elementary school

Article References: Welling, J., Fischer, L., Thums, K., & Gnambs, T. (2026). Prevalence, predictors, and consequences of rapid guessing among children in elementary school. Large-scale Assessments in Education, 14(1), Article 51. https://doi.org/10.1186/s40536-026-00319-5

Image Credits: AI Generated

DOI: 10.1186/s40536-026-00319-5

Keywords: rapid guessing, test-taking engagement, elementary school, large-scale assessment, response times, psychometrics, educational measurement, reading assessment, mathematics assessment, socioeconomic status, test validity, National Educational Panel Study

The research, conducted by Assistant Professor Shingo Nahatame of the Institute of Human Sciences at the University of Tsukuba and Associate Professor Tomoko Ogiso of the Faculty of Education at the University of Toyama, was published in the journal Reading & Writing. The study set out to address a central concern in English language education: how to evaluate the difficulty of the texts used in educational materials and language assessments. Traditionally, researchers have relied on objective measures of text difficulty grounded in linguistic features, including characteristics of words and sentences. Yet learners can differ substantially in how difficult they perceive the very same text to be, and understanding that gap matters for anyone who selects, writes, or assesses reading material.

To examine the relationship between objective and subjective text difficulty, the researchers designed a study with two complementary strands. First, they evaluated the objective difficulty of 30 English reading passages spanning a broad range of difficulty levels. Objective difficulty was assessed in two ways: using established readability measures based on linguistic characteristics, and using an evaluation method based on a large language model, reflecting the growing role of artificial intelligence tools in text analysis. This dual approach allowed the team to compare how well both traditional formula-based indices and modern computational methods captured the demands each passage placed on readers.

The second strand of the study turned to the readers themselves. Forty-one undergraduate and graduate students whose first language was Japanese read the same 30 passages and rated the difficulty of each one on a nine-point scale. These ratings provided a direct window into subjective difficulty—the felt experience of struggling with, or sailing through, a text. Because all participants read all passages, the design made it possible to compare, passage by passage and reader by reader, how objective estimates lined up with personal perceptions.

The analyses revealed a strong relationship between objective and subjective difficulty. Passages rated as more difficult by objective measures were also perceived as more difficult by readers. In other words, the traditional intuition behind readability formulas holds up: texts with longer sentences, rarer words, and more complex linguistic characteristics genuinely do feel harder to read, at least on average. The large language model–based evaluation method, likewise, produced difficulty estimates that corresponded with readers’ perceptions, suggesting that computational approaches can serve as viable complements to conventional readability indices.

But the study did not stop at ratings. The researchers also recorded participants’ eye movements as they read, adding a process-level measure of reading behavior to the product-level measures of text features and subjective judgments. Eye-tracking has long been used in reading research because the eyes provide a moment-by-moment record of cognitive effort: fixations lengthen when processing is demanding, and readers skip words that are easy to identify. In this study, objective and subjective difficulty measures were both associated with eye-movement patterns during reading. More difficult texts tended to be read more slowly, and readers skipped fewer words when reading them. The convergence is striking: three independent sources of evidence—linguistic formulas, learner judgments, and real-time gaze behavior—all pointed in the same direction.

The most novel finding, however, concerned the discrepancy between the two kinds of difficulty. The researchers found that the extent to which an individual reader’s rating differed from the group’s average rating for the same passage provided additional information for explaining eye-movement behavior beyond what could be accounted for by text-level difficulty measures alone. In practical terms, if a particular student found a passage harder than their peers did, that deviation was reflected in the way their eyes moved through the text, even after the general difficulty of the passage had been taken into account. Subjective difficulty, in other words, is not simply a noisy version of objective difficulty—it carries unique, reader-specific signal.

These findings indicate that objective measures of text difficulty and subjective perceptions of learners generally correspond closely but are not identical. Objective measures are useful for characterizing the general difficulty of a text, and they remain an efficient tool for grading passages, leveling curricula, and calibrating assessments across large populations. But subjective evaluations provide additional insight into how individual learners experience and process the same text. A readability score describes the passage; a learner’s rating describes the encounter between the passage and a particular mind. The study suggests that both perspectives are needed to build a complete picture of reading difficulty.

The implications reach into several corners of language education. For teachers and materials developers, the results support a two-step approach: objective measures can be used to shortlist texts at an appropriate general level, while learner feedback can then be used to fine-tune selections for specific students or classes. For researchers, the demonstration that rating deviations predict eye-movement behavior opens the door to more personalized models of second-language reading, in which individual differences in perception are treated as meaningful data rather than measurement error. The work also speaks to the growing interest in using large language models for text evaluation, showing that such tools can align with human perceptions while still leaving room for individual variability.

More broadly, the study is a reminder that difficulty is not a property of a text alone, nor of a reader alone, but of the interaction between them. The 30 passages, 41 readers, nine-point ratings, and recorded eye movements together paint a technically grounded picture of that interaction: strong average correspondence between formulas and feelings, reliable links between both and the microstructure of gaze, and a persistent, informative residue of individual difference. As English language education moves toward more personalized approaches to reading support, the message from Tsukuba and Toyama is clear—measure the text, but also listen to the reader, because the two are related, yet not the same.

Subject of Research: The relationship between objective and subjective text difficulty in second-language English reading and its link to eye-movement behavior

Article Title: Subjective and objective difficulty of English texts are related—but not the same

Article References: Subjective and objective difficulty of English texts are related—but not the same. (n.d.). Original publication

Image Credits: AI Generated

DOI: Not provided

Keywords: text difficulty, readability, second-language reading, eye-tracking, English language education, large language models, reading assessment, subjective perception, University of Tsukuba, Reading & Writing, L2 learners, reading materials