The core problem the authors identify is deceptively simple. Classical test theory, the statistical backbone of most reliability work in psychology, assumes that an observed score is the sum of a stable true score and random error. Four assumptions underpin the resulting reliability coefficients: true score and error must be additive, independent, and random, and the true score must not change between repeated measurements. In practice, these assumptions are routinely violated by practice and habituation effects — the well-documented tendency of participants to improve on cognitive and coordinative tasks simply by repeating them, without any intervention in between. When the retest score is systematically better than the test score, the parallel-readings assumption collapses, and with it the interpretability of the reliability coefficient.

The scale of the problem is striking. Habituation effects have been documented across a wide range of standard instruments, including the Stroop test, the Eriksen flanker task, the Simon task, the Digit Symbol Substitution Test, the Wechsler Memory Scale, and the Halstead-Reitan neuropsychological battery. The largest gains typically appear between the first two testing sessions, with progressively flatter improvement curves as participants grow familiar with the task. Long-term learning can even persist for years: performance on the Wechsler Adult Intelligence Scale and the Wechsler Memory Scale has been shown to be affected by task exposure that occurred months or years earlier. In one series of experiments cited in the paper, trial-to-trial random errors in neurocognitive tests started as high as 6 to 43 percent and only stabilized below 5 percent in reaction tasks after several days of repeated testing.

What makes this especially dangerous is that the field’s favorite reliability statistics can look excellent while hiding serious problems. The intraclass correlation coefficient (ICC) and Cronbach’s alpha summarize the ratio of true-score variance to observed variance, but they cannot distinguish between different sources of measurement error. The authors point to published examples where an ICC of 0.9 or higher — conventionally rated as excellent — coexisted with a mean absolute test–retest error of 20 percent and maximum individual errors approaching 90 percent. A high correlation between two measurements says nothing about how close those measurements actually are to each other on the original scale, which is what clinicians and experimenters usually need to know.

The classical remedy for this blind spot is the Bland–Altman analysis, introduced in 1986, which plots the difference between two measurements against their mean. The average difference reveals systematic bias, while the 95 percent limits of agreement — the mean difference plus or minus 1.96 standard deviations — describe the expected range of random scatter. But the authors argue that Bland–Altman analyses, as commonly used, suffer from a critical limitation: the limits of agreement are purely descriptive. They describe where the data fell, but they say nothing about whether that amount of error is acceptable for the scientific or clinical question at hand. Bland and Altman themselves noted in the original 1986 paper that acceptable limits should ideally be defined in advance to aid interpretation — advice that has largely been ignored in practice.

There is a second, subtler flaw. Standard limits of agreement are drawn as parallel horizontal lines on the Bland–Altman plot, which implicitly assumes that the absolute size of measurement error is constant across the whole range of measured values. In many empirical domains, however, the scatter grows as the measured value grows — a phenomenon known as heteroscedasticity. Parallel limits therefore tolerate a disproportionately large percentage error for small measurement values while being overly strict for large ones. A limit of ±1 degree might be trivial for a mean of 180 degrees but catastrophic for a mean of 0.5 degrees, as an example from visual-vertical perception research in stroke patients illustrates.

The new R application addresses both problems with a concept the authors call limits of acceptance, or LoAcc. Unlike limits of agreement, which are computed from the data after the fact, limits of acceptance are defined a priori by the researcher as a proportional threshold — for example, 5 percent of each participant’s mean test–retest value. Because the acceptable band scales with the magnitude of the measurement, the resulting boundaries fan out across the Bland–Altman plot rather than running parallel, correctly accommodating heteroscedastic data. A test–retest difference is classified as acceptable only if it falls within the proportional band for that individual. The app then color-codes the results: green if the systematic bias is non-significant and at least 95 percent of observations fall within the acceptance limits, red if either criterion fails.

The software itself is a Shiny app that automates the entire test–retest evaluation workflow. Users upload an Excel file in wide format, with a participant identifier in the first column and measurement pairs in consecutive columns; the app can also be used for validity studies against a gold standard or for inter-rater objectivity analyses. It then computes the full battery of reliability metrics — all six ICC variants with 95 percent confidence intervals, Cronbach’s alpha, the standard error of measurement, the minimal detectable change, the coefficient of variation, the mean absolute error, and the mean absolute percentage error — alongside a paired-samples t-test for systematic bias and publication-ready Bland–Altman plots. Users can set the acceptance threshold per variable pair, specify measurement units, and export results tables and figures automatically. The code is openly available via the Open Science Framework.

To demonstrate the tool, the authors simulated Stroop test data across four consecutive testing days with 100 virtual participants, using a 5 percent acceptance threshold calibrated to the error level observed after four days of habituation in their earlier empirical work. The progression is instructive. Between days 1 and 2, mean performance rose significantly and 86 of 100 observations fell within the acceptance limits — both criteria failed, and the plot lit up red. Between days 2 and 3, the systematic bias had largely vanished, but random scatter remained too high, with 88 of 100 observations inside the limits. Only between days 3 and 4 did the data satisfy the criterion: no significant bias, 97 of 100 observations within the limits, and the mean absolute error shrinking from 0.828 seconds to 0.479 seconds. Applied to a real dataset from a choice reaction task tested twice daily over five days, the app showed the same convergence, and also revealed a near-threshold case at a 10 percent limit where a single data point sitting exactly on the boundary tipped the classification — a reminder, the authors note, that such judgments should consider the magnitude of the deviation rather than being treated as purely binary.

The broader message is a call for transparency that resonates far beyond cognitive psychology. The authors argue that expected intervention-induced changes from previous studies can serve as a rational anchor for setting acceptance limits: a 10 percent measurement error might be tolerable if an intervention is expected to change the outcome by 100 percent, but it is unacceptable if the expected effect is only 10 percent. They acknowledge that no universal guideline exists for what counts as acceptable, and that the 5 and 10 percent thresholds used in their examples are illustrative rather than prescriptive. Still, by forcing researchers to state their tolerance for error in advance and by separating systematic from random error — since a valid ICC interpretation requires the absence of systematic bias — the tool turns habituation from an invisible confound into a measurable, plottable, and ultimately controllable quantity. For a field increasingly worried about the reproducibility of its measurements, knowing exactly how much habituation is enough may prove to be one of the most practical questions psychology has finally learned to answer.

Subject of Research: Test–retest reliability, habituation effects, and agreement analysis in behavioral and neurocognitive research

Article Title: How much habituation is enough? An R application for ad hoc content-related limits of acceptance in behavioral research

Article References: Warneke, K., Siegel, S. D., Afonso, J., Herbsleb, M., & Wallot, S. (2026). How much habituation is enough? An R application for ad hoc content-related limits of acceptance in behavioral research. Behavior Research Methods, 58(11), Article 307. https://doi.org/10.3758/s13428-026-03170-2

Image Credits: AI Generated

DOI: 10.3758/s13428-026-03170-2

Keywords: habituation, practice effects, test–retest reliability, Bland–Altman analysis, limits of agreement, limits of acceptance, intraclass correlation coefficient, Cronbach's alpha, measurement error, R software, psychometrics, neurocognitive testing

The research, conducted at Cleland Wildlife Park in South Australia, was led by scientists from the University of Adelaide and published in the journal Veterinary Medicine and Science. The team set out to fill a substantial knowledge gap. While enrichment studies in reptiles have grown steadily, direct handling by humans—an increasingly common practice in zoos and wildlife parks worldwide—has remained largely unstudied, particularly in snakes.

Three individual snakes were observed over several weeks: two children’s pythons and one woma python. All three were experienced animals, regularly used in the park’s education sessions prior to the study. Each snake was housed individually in a temperature-controlled enclosure with appropriate heating, lighting, hides, branches, and water. Staff led handling sessions in which snakes were held by trained education officers, and visitors could touch the caudal body with an open palm under supervision.

To capture a detailed picture of snake behaviour, the researchers installed time-lapse cameras outside each enclosure, recording 10-second clips at 5-minute intervals for 10 hours each day. The footage was then coded using a purpose-built ethogram adapted from established reptile behavioural studies. Sixteen distinct behaviours were grouped into four functional classes: active, inactive, abnormal, and out of sight. Behaviours considered potentially stress-related included freezing, window striking, boundary contact, rapid body movement, and tail flicking.

The researchers compared behaviour across two dimensions: handling days versus non-handling days, and the hours immediately before versus the hours immediately after a handling session. They analysed the data using Friedman’s two-way ANOVA by ranks, a non-parametric statistical test suited to repeated measures with non-normal distributions.

The results were striking. After handling events, the snakes showed a significant increase in inactive behaviour and a significant decrease in out-of-sight behaviour, suggesting they were more visible and resting calmly in view. On handling days compared to non-handling days, abnormal behaviours—particularly boundary contact, a behaviour associated with escape motivation—decreased significantly. Active and abnormal behaviours showed no significant change in the pre- versus post-handling comparison.

Taken together, these findings indicate that regular, staff-led handling had little to no negative welfare impact on the snakes studied. The authors suggest that the snakes may have habituated to handling over time, a process broadly defined as decreased responding after repeated exposure to a stimulus. In some zoo species, human interaction has even been shown to act as a form of environmental enrichment, and the reduced escape-motivated behaviour observed here hints that handling may be a neutral or potentially enriching experience for habituated individuals.

However, the researchers urge caution. The study involved only three snakes across two species, a small sample size typical of zoo welfare research but one that limits statistical power and generalisability. Observations were restricted to daytime hours, potentially missing nocturnal behaviours. The study also relied exclusively on behavioural indicators, without physiological measures of stress, and the snakes were moved from controlled enclosures to ambient handling environments where temperature and lighting differences could have influenced their behaviour independently of handling itself.

The findings also contrast with studies of other reptiles, such as tuataras and tortoises, where direct visitor handling has been shown to negatively impact welfare. The authors suggest these differences may reflect species-typical traits, handling protocols, husbandry conditions, and methodological variations between studies. Notably, the snakes in this study had long histories of regular handling, meaning the results may not apply to snakes unaccustomed to such interactions.

The research team hopes this study will encourage more rigorous welfare assessment for reptiles, a group that has long been overlooked in favour of mammals and birds. They advocate for combining behavioural ethograms with physiological indicators, behavioural diversity measures, and enclosure use variability to build a more complete picture of captive snake well-being. As animal interaction programs continue to grow in popularity, the study provides a valuable first step towards evidence-based handling practices—moving beyond anecdote and folklore towards a scientific understanding of what these remarkable animals actually experience when they are placed in human hands.

Beyond the immediate findings, the study contributes to a broader scientific conversation about how welfare should be defined and measured in reptiles, an animal class whose biology differs profoundly from the mammals and birds in which most welfare science was originally developed. Snakes lack limbs, rely heavily on chemical and thermal cues rather than vision, and express many of their most informative behaviours through posture, tongue flicking, and subtle changes in movement patterns. This means that conventional welfare indicators developed for mammals, such as facial expressions, vocalisations, or social withdrawal, are largely inapplicable, forcing researchers to build assessment tools from the ground up around reptile-specific behavioural repertoires.

The concept of behavioural diversity has become increasingly important in this context. Rather than tracking the frequency of any single behaviour, diversity measures capture the variety and evenness of behaviours an animal displays over time. A healthy captive animal typically shows a richer and more balanced behavioural profile, whereas chronic stress tends to compress behaviour into a narrow repertoire dominated by inactivity or repetitive actions. Incorporating such metrics alongside the ethogram used in this study could strengthen future work by distinguishing between simple habituation to handling and genuine positive engagement with the environment.

Habituation itself deserves careful consideration in zoo contexts. The decreased responding observed after repeated exposure to a stimulus is often framed as beneficial, reducing stress during necessary procedures such as veterinary examinations or transport. Yet the underlying mechanisms matter. Reduced responsiveness could reflect a calm, secure animal, or it could mask a state in which the animal has simply ceased responding because escape is impossible, sometimes described as a form of learned helplessness. Behavioural data alone cannot always separate these possibilities, which is why the study’s authors emphasise the need for physiological corroboration.

Physiological stress markers for reptiles remain less standardised than for endotherms. Corticosterone, the primary glucocorticoid in reptiles, can be measured in blood, faeces, saliva, and even shed skin, offering non-invasive or minimally invasive sampling routes. However, baseline concentrations vary widely with season, reproductive status, body temperature, and time of day in ectothermic species, complicating interpretation. Ectothermy itself introduces a methodological challenge the authors acknowledge: because snakes depend on ambient heat to regulate body temperature, moving them between the climate-controlled education centre and a different handling environment could alter activity levels through thermal effects alone, independent of any psychological response to human contact.

The python species involved bring their own biological context. Children’s pythons and woma pythons are Australian species with generally docile reputations and long histories in education and captive husbandry. Woma pythons, in particular, are known for relatively calm temperaments and inquisitive behaviour, which may predispose them to tolerate, or even benefit from, structured interaction. Species differences of this kind are central to explaining why the present results diverge from findings in tuataras and tortoises, where visitor handling produced measurable harm. Reptile taxa occupy vastly different ecological niches, and a protocol appropriate for one lineage cannot be assumed safe for another.

The timing of observations also carries relevance for snake welfare. Snakes are predominantly crepuscular or nocturnal, and many species, including several pythons, are most active outside daylight hours. By restricting recording to 10 daytime hours, the study may have captured rest periods rather than peak activity, potentially understating the full behavioural consequences of handling sessions. Future studies could extend monitoring into evening and overnight windows using infrared recording, providing a round-the-clock picture of how handling events ripple through an individual’s daily activity budget.

The irregular scheduling of handling sessions in this study was methodologically useful, since predictable routines could themselves shape anticipatory behaviour. Nevertheless, anticipatory responses in snakes remain poorly characterised. Whether these animals can learn to associate cues preceding handling with the event, and whether such anticipation produces positive or negative affective states, represents an open question for comparative cognition research with reptiles.

Scale is a persistent constraint in zoo-based welfare research. Facilities typically house few individuals of any given species, limiting statistical power, and animals cannot ethically be subjected to adverse conditions simply to generate contrast. This makes multi-zoo collaborations and accumulating replication across institutions especially valuable. Longitudinal designs that follow individuals across years, rather than weeks, would also help determine whether the apparent neutrality of handling persists as animals age, and whether subtle costs accumulate over hundreds of sessions.

Finally, the study carries practical implications for the hundreds of facilities worldwide that feature snakes in education programs. Documenting that regularly handled, well-housed pythons showed reduced escape-motivated behaviour on handling days supports a cautious but evidence-based case that such programs need not compromise welfare when conducted by trained staff with appropriate pre-handling screening, such as excluding animals in shed or recently fed. At the same time, the findings apply only to habituated individuals within carefully managed conditions, and institutions should not extrapolate them to novel animals, alternative taxa, or less controlled contact formats without dedicated assessment.

Subject of Research: Behavioural welfare effects of human handling practices on captive zoo snakes

Article Title: Behavioural Welfare Implications of Human Handling Practices in Zoo Snakes

Article References: Behavioural Welfare Implications of Human Handling Practices in Zoo Snakes. (n.d.). https://doi.org/10.1002/vms3.71218

Image Credits: AI Generated

DOI: 10.1002/vms3.71218

Keywords: zoo snakes, animal welfare, animal-visitor interactions, handling, pythons, reptile behaviour, stress behaviours, ethogram, habituation, environmental enrichment, captive reptiles, Cleland Wildlife Park