Massive New Test Measures How Chinese Children’s Vocabulary Grows Across Nine Grades

Vocabulary is the bedrock of every skill a reader eventually acquires, and for the first time researchers have built a rigorously validated tool that tracks how native Chinese-speaking children’s word knowledge expands from the first year of primary school through the last year of junior secondary school. The new instrument, called the Chinese Vocabulary Levels Test, or C-VLT, was developed by Biao Zeng, Youxiang Jiang, and Hongbo Wen and described in the journal Behavior Research Methods. Unlike earlier Chinese vocabulary measures, which were designed mostly for adult learners of Chinese as a second language, the C-VLT targets the population that has been hardest to assess: schoolchildren in Grades 1 through 9 who are still building their lexicon in real time.

The design of the test rests on a developmental vocabulary list rather than the frequency-based word lists that dominate second-language testing. This choice matters because Chinese literacy acquisition does not unfold the way alphabetic literacy does. Chinese children must learn thousands of distinct characters, each composed of strokes and radicals, and words are typically written with combinations of those characters. A word list built specifically around what children are expected to learn at each stage of compulsory education gives the test a developmental logic: the words sampled for a Grade 1 subtest are those a first grader should plausibly be mastering, while the words in the Grade 9 subtest reflect the far larger lexicon expected of a student about to enter senior secondary school.

Structurally, the C-VLT consists of four subtests, each matched to a different band of grade levels. This staged architecture allows teachers and researchers to place a student’s receptive vocabulary knowledge, meaning the words a child can recognize and understand when encountered in print, along a developmental continuum. Receptive knowledge is deliberately the target here. Distinguishing what learners can recognize from what they can actively produce has long been a central theme in vocabulary research, and the authors designed the C-VLT to interpret scores specifically as indicators of recognition-based receptive knowledge and stage-based vocabulary mastery, not as measures of writing or speaking ability.

The empirical scale of the validation study is one of its most striking features. Using probability proportional to size sampling, a survey method that gives larger schools a proportionally greater chance of selection so the sample mirrors the population, the team recruited 16 schools across four counties, spanning both urban and rural settings. In total, 10,460 students sat the test. Samples of this magnitude are rare in vocabulary assessment research, where validation studies often rely on a few hundred participants, and they give the psychometric findings unusual stability.

The analysis combined two complementary statistical traditions. Classical test theory, the older framework, evaluates tests through indices such as reliability coefficients and item difficulty proportions computed directly on observed scores. Item response theory, the more modern approach, models the probability that a test-taker of a given ability answers a given item correctly, producing estimates of each item’s difficulty and discrimination along a common ability scale. When the researchers applied both frameworks to the C-VLT data, the results pointed in the same direction: the items showed reasonable difficulty and discrimination, and all four subtests demonstrated high reliability in the classical sense.

A particularly important finding concerns fairness. The team tested every item for differential item functioning, a statistical procedure that checks whether an item behaves differently for test-takers of equal ability who belong to different groups, for example students in different regions or school types. An item with differential item functioning is biased: it advantages one group over another for reasons unrelated to the construct being measured. In the C-VLT, no items showed such effects, which the authors interpret as evidence of high item quality and satisfactory test fairness across the diverse sample of schools.

Measurement precision was evaluated through item response theory information curves and their associated standard errors. In item response theory, the information function describes how accurately a test measures ability at different points on the ability scale, and the standard error of measurement is inversely related to that information. For the C-VLT, the information curves and standard errors indicated good measurement precision for most students, meaning the test distinguishes ability differences reliably across the broad middle of the distribution rather than only at its extremes. That property is essential for a test intended to be used diagnostically with ordinary classrooms rather than only with exceptional or struggling readers.

Validity evidence came from three converging sources. Evidence based on test content showed that the items genuinely sampled the vocabulary children are expected to learn at each educational stage, drawing on the developmental word list that anchors the instrument. Evidence based on internal structure confirmed that the relationships among items and subtests matched the intended design. Most compellingly, the test showed theoretically expected relations to educational stage and word frequency: item difficulty generally increased as word frequency decreased and as educational stage increased. In other words, rarer words were harder, and words targeted at later grades were harder than words targeted at earlier grades, exactly the pattern a valid developmental vocabulary measure should display.

The significance of this work extends beyond Chinese classrooms. Vocabulary size is one of the strongest known predictors of reading comprehension, listening comprehension, and academic achievement, and meta-analytic work on reading in Chinese has confirmed that vocabulary plays a central role alongside decoding in that writing system as well. Yet until now, researchers studying native Chinese-speaking children have lacked a levels-based instrument comparable to the Vocabulary Levels Test tradition in English, which partitions vocabulary knowledge into frequency or stage bands and estimates mastery within each band. Existing Chinese tools, such as quick character-based proficiency checks or tests built for second-language learners of Chinese, were not designed to capture the stage-by-stage growth of a child’s first-language lexicon.

The C-VLT fills that gap with unusual transparency. The test data, materials, and all source code have been deposited in an openly accessible repository on the Open Science Framework, allowing other researchers to scrutinize the psychometric analyses, adapt the instrument, or build new versions. The study was approved by the institutional review board of the Collaborative Innovation Center of Assessment for Basic Education Quality at Beijing Normal University, and all participants gave oral informed consent. Funded through China’s STI 2030 Major Projects program and university research grants, the project demonstrates how large-scale sampling, dual psychometric frameworks, and open materials can be combined to produce an assessment whose scores are not only reliable but genuinely interpretable as a map of how vocabulary knowledge grows, year by year, across the nine years of compulsory schooling.

Subject of Research: Development and validation of a Chinese Vocabulary Levels Test for assessing receptive vocabulary knowledge in primary and secondary school learners

Article Title: C-VLT: A reliable Chinese Vocabulary Levels Test for primary and secondary school learners

Article References: Zeng, B., Jiang, Y., & Wen, H. (2026). C-VLT: A reliable Chinese Vocabulary Levels Test for primary and secondary school learners. Behavior Research Methods, 58(11), Article 312. https://doi.org/10.3758/s13428-026-03166-y

Image Credits: AI Generated

DOI: 10.3758/s13428-026-03166-y

Keywords: vocabulary assessment, Chinese language, psychometrics, item response theory, classical test theory, receptive vocabulary, test validity, language education, literacy development, differential item functioning, Behavior Research Methods, schoolchildren