<?xml version="1.0" encoding="UTF-8"?><rss version="2.0"
	xmlns:content="http://purl.org/rss/1.0/modules/content/"
	xmlns:wfw="http://wellformedweb.org/CommentAPI/"
	xmlns:dc="http://purl.org/dc/elements/1.1/"
	xmlns:atom="http://www.w3.org/2005/Atom"
	xmlns:sy="http://purl.org/rss/1.0/modules/syndication/"
	xmlns:slash="http://purl.org/rss/1.0/modules/slash/"
	>

<channel>
	<title>psychological methods &#8211; Science</title>
	<atom:link href="https://scienmag.com/tag/psychological-methods/feed/" rel="self" type="application/rss+xml" />
	<link>https://scienmag.com</link>
	<description></description>
	<lastBuildDate>Fri, 02 Oct 2026 18:02:22 +0000</lastBuildDate>
	<language>en-US</language>
	<sy:updatePeriod>
	hourly	</sy:updatePeriod>
	<sy:updateFrequency>
	1	</sy:updateFrequency>
	<generator>https://wordpress.org/?v=7.1.2</generator>

<image>
	<url>https://scienmag.com/wp-content/uploads/2024/07/cropped-scienmag_ico-32x32.jpg</url>
	<title>psychological methods &#8211; Science</title>
	<link>https://scienmag.com</link>
	<width>32</width>
	<height>32</height>
</image> 
<site xmlns="com-wordpress:feed-additions:1">73899611</site>	<item>
		<title>Why Psychologists Should Stop Treating Percentages Like Normal Data</title>
		<link>https://scienmag.com/why-psychologists-should-stop-treating-percentages-like-normal-data/</link>
		
		<dc:creator><![CDATA[Glenn Wilkins]]></dc:creator>
		<pubDate>Fri, 02 Oct 2026 18:02:22 +0000</pubDate>
				<category><![CDATA[Psychology & Psychiatry]]></category>
		<category><![CDATA[Bayesian beta regression]]></category>
		<category><![CDATA[Bayesian inference]]></category>
		<category><![CDATA[Behavior Research Methods]]></category>
		<category><![CDATA[beta regression]]></category>
		<category><![CDATA[bounded data analysis]]></category>
		<category><![CDATA[brms]]></category>
		<category><![CDATA[common errors in psychological statistics]]></category>
		<category><![CDATA[data distortion in psychological research]]></category>
		<category><![CDATA[improving accuracy of percentage data analysis]]></category>
		<category><![CDATA[issues with classical statistical methods]]></category>
		<category><![CDATA[learning and memory]]></category>
		<category><![CDATA[percentage data in psychology]]></category>
		<category><![CDATA[proportion data]]></category>
		<category><![CDATA[proportions and rates in social sciences]]></category>
		<category><![CDATA[psychological data analysis]]></category>
		<category><![CDATA[psychological methods]]></category>
		<category><![CDATA[quantitative psychology]]></category>
		<category><![CDATA[R tutorial]]></category>
		<category><![CDATA[scale-bound data in psychology]]></category>
		<category><![CDATA[Stan]]></category>
		<category><![CDATA[statistical best practices for bounded outcomes]]></category>
		<category><![CDATA[statistical modeling in psychology]]></category>
		<category><![CDATA[statistics]]></category>
		<category><![CDATA[zero-inflated models]]></category>
		<guid isPermaLink="false">https://scienmag.com/?p=228811</guid>

					<description><![CDATA[A new tutorial in Behavior Research Methods shows psychologists how Bayesian beta regression can fix the widespread misuse of normal-based models on bounded proportion data.]]></description>
										<content:encoded><![CDATA[<p>Every day, psychologists and social scientists quietly commit a statistical error so common that most of them never notice it. Whenever a researcher analyzes a proportion, a percentage, a rate, or a score on a bounded rating scale using the standard tools of classical statistics, they are asking a model built for unbounded data to describe quantities that simply cannot go below zero or above one. A new tutorial published in Behavior Research Methods by Jason Geller of Boston College, Robert Kubinec of Texas A&amp;M University, Chelsea M. Parlett Pelleriti of Chapman University, and Matti Vuorre of Tilburg University argues that this mismatch is more than a technical quibble. It can distort estimates, obscure real effects, and mislead conclusions, and the authors offer a practical, code-rich remedy: Bayesian beta regression, a modeling framework designed from the ground up for data that live between fixed boundaries.</p>
<p>The problem begins with the data themselves. Psychology is full of outcomes that are naturally constrained. Accuracy on a memory test is a proportion of correct responses. Confidence ratings on a slider scale fall between two endpoints. The share of time a participant spends looking at a stimulus, the fraction of items recalled, the percentage of conspiracy beliefs reduced after an intervention — all of these quantities are bounded. Yet the workhorse tools of the field, from ordinary least squares regression to the t test and analysis of variance, assume that outcomes are drawn from a normal distribution, which stretches infinitely in both directions. When researchers feed bounded data into these models, the model can, in principle, predict values below zero or above one, and the resulting estimates of means, variances, and effects can become warped, especially when data pile up near the boundaries.</p>
<p>Historically, researchers have tried to work around this with transformations. Square root and arcsine transformations, some dating back to the 1930s, were devised to make proportions behave more like normally distributed variables. But the tutorial&#8217;s authors, following a long line of statistical literature, argue that these fixes are clumsy and increasingly unnecessary. The beta distribution, a flexible family of probability distributions defined precisely on the interval from zero to one, offers a principled alternative. Depending on its two shape parameters, the beta distribution can be symmetric, skewed toward either boundary, U-shaped, or nearly uniform, which makes it remarkably well suited to the messy reality of proportion data in the behavioral sciences.</p>
<p>Beta regression, first formalized for rates and proportions in 2004 by Ferrari and Cribari-Neto, extends this idea into a full modeling framework analogous to the generalized linear models that revolutionized the analysis of counts and binary outcomes. Instead of modeling the mean of a normal distribution, beta regression models the mean of a beta-distributed outcome, typically through a link function such as the logit, which maps the bounded interval onto the unbroken real line. A second parameter governs the precision, or how tightly the data cluster around the mean, and that precision itself can depend on predictors. This means the model can capture not only how the average outcome changes with an experimental manipulation but also how the spread of outcomes changes, a capability that classical models simply lack.</p>
<p>The tutorial&#8217;s centerpiece is a worked example drawn from the psychological literature on learning and memory, specifically studies of how instructor fluency shapes perceptions of learning. In these experiments, participants watch lectures delivered either fluently or disfluently and then judge how much they learned, alongside measures of actual learning. The outcome of interest is a proportion, making it a textbook case for beta regression. The authors walk readers through fitting a Bayesian beta regression model in R using the brms package, which provides a high-level interface to the Stan probabilistic programming language while retaining the familiar formula syntax of standard R functions such as lm. For researchers trained in conventional regression, the transition is deliberately gentle: the model is specified with the same kind of formula, but the underlying machinery samples from posterior distributions rather than computing single point estimates.</p>
<p>The Bayesian framing is not incidental. The authors explain that with sufficiently weak, uniform priors, Bayesian estimation of a beta regression reproduces the maximum likelihood estimates one would obtain in a frequentist analysis, so the choice of framework is less about producing different numbers and more about the inferential machinery surrounding them. Bayesian posterior distributions yield direct statements about plausible parameter values, uncertainty intervals that behave intuitively, and a coherent way to incorporate prior knowledge. The authors also address a common objection head-on: yes, Bayesian computation is slower, but modern engines are efficient, brms supports parallelization for large datasets, and in explanatory research the priority is specifying the right model, not shaving seconds off the computation.</p>
<p>Interpretation is where many applied researchers stumble, and the tutorial devotes careful attention to it. Coefficients in a beta regression live on the logit scale, which is notoriously opaque. The authors therefore demonstrate how to translate results back onto the response scale — the familiar territory of predicted proportions — using the marginaleffects and easystats packages. Rather than reporting a raw coefficient, researchers can compute predicted proportions for each condition, differences between them, and uncertainty around those predictions, producing quantities that read like plain English: participants in one condition recalled, on average, a proportion of X, while those in another recalled Y. The authors frame models as prediction machines, echoing a broader movement in quantitative psychology to convert confusing coefficients into clear, interpretable quantities.</p>
<p>Real data rarely cooperate perfectly, and the tutorial confronts the messiest feature of bounded outcomes: exact zeros and ones. The beta distribution assigns zero probability to the boundary points themselves, so observations sitting precisely at zero or one require special handling. The authors introduce zero-inflated and zero-one-inflated beta models, which add a separate process generating boundary observations, and they note that some methodologists prefer the term hurdle model for the same reason. In their example data, a single observation equals exactly one, and they show how a zero-one-inflated beta model can accommodate it. They also present the ordered beta regression model developed by Kubinec, a parsimonious alternative that handles continuous data with both lower and upper bounds, including boundary values, within a single framework, and they point readers to newer options such as the beta-gate model and extended-support beta regression for continuous processes near the boundaries.</p>
<p>Model comparison and checking receive their due as well. The tutorial demonstrates leave-one-out cross-validation, implemented through the loo function in brms, which lets researchers compare competing beta models on out-of-sample predictive accuracy. Convergence of the Markov chain Monte Carlo sampler is assessed with modern diagnostics, and the authors emphasize robust summaries of posterior distributions. For researchers who prefer a frequentist framework, an appendix shows how to fit equivalent beta models with the glmmTMB package, making the tutorial accessible regardless of statistical philosophy. The entire workflow was written in R with Quarto, and the authors used the rix package with the Nix ecosystem to snapshot not just the R packages but the full system dependencies, so that anyone can reproduce the exact computational environment from the archived materials.</p>
<p>The stakes extend well beyond one subfield. Proportions and bounded scales appear across the sciences, from ecological studies quantifying ecosystem vulnerability to phonetics research on categorical speech perception to ecological momentary assessments of substance use. As Bayesian methods continue their rapid rise in psychology, propelled by the open science movement, tutorials like this one lower the barrier to adopting tools that match the data rather than forcing data to match the tools. All code, data, and materials are openly archived on Zenodo and GitHub, and the authors assume only basic familiarity with regression and R. For a discipline increasingly alert to the fragility of its statistical practices, the message is simple: when your outcome lives between zero and one, model it that way, and the beta distribution — flexible, principled, and now thoroughly documented — is waiting to do the job properly.</p>
<p><strong>Subject of Research:</strong> Bayesian beta regression for analyzing bounded proportion outcomes in psychological research</p>
<p><strong>Article Title:</strong> A beta way: A tutorial on Bayesian beta regression for psychological research</p>
<p><strong>Article References:</strong> Geller, J., Kubinec, R., Pelleriti, C. M. P., &amp; Vuorre, M. (2026). A beta way: A tutorial on Bayesian beta regression for psychological research. <em>Behavior Research Methods, 58</em>(11), Article 309. <a href="https://doi.org/10.3758/s13428-026-03106-w" rel="noopener noreferrer">https://doi.org/10.3758/s13428-026-03106-w</a></p>
<p><strong>Image Credits:</strong> AI Generated</p>
<p><strong>DOI:</strong> <a href="https://doi.org/10.3758/s13428-026-03106-w" rel="noopener noreferrer">10.3758/s13428-026-03106-w</a></p>
<p><strong>Keywords:</strong> beta regression, Bayesian inference, psychological methods, proportion data, brms, Stan, R tutorial, Behavior Research Methods, statistics, learning and memory, zero-inflated models, quantitative psychology</p>
]]></content:encoded>
					
		
		
		<post-id xmlns="com-wordpress:feed-additions:1">228811</post-id>	</item>
		<item>
		<title>When Nothing Changes: The Hidden Statistical Trap of Non-Varying Individuals in Daily-Life Research</title>
		<link>https://scienmag.com/when-nothing-changes-the-hidden-statistical-trap-of-non-varying-individuals-in-daily-life-research/</link>
		
		<dc:creator><![CDATA[Glenn Wilkins]]></dc:creator>
		<pubDate>Thu, 01 Oct 2026 14:39:18 +0000</pubDate>
				<category><![CDATA[Psychology & Psychiatry]]></category>
		<category><![CDATA[autoregressive models]]></category>
		<category><![CDATA[Behavior Research Methods]]></category>
		<category><![CDATA[challenges in modeling stress and mood fluctuations]]></category>
		<category><![CDATA[cross-lagged effects]]></category>
		<category><![CDATA[daily stress]]></category>
		<category><![CDATA[dynamic structural equation modeling]]></category>
		<category><![CDATA[ecological momentary assessment]]></category>
		<category><![CDATA[effects of unchanging data points on psychological dynamics]]></category>
		<category><![CDATA[experience sampling methodology]]></category>
		<category><![CDATA[impact of non-varying participants on data analysis]]></category>
		<category><![CDATA[intensive longitudinal data]]></category>
		<category><![CDATA[longitudinal research in psychology]]></category>
		<category><![CDATA[measurement invariance in longitudinal studies]]></category>
		<category><![CDATA[multilevel autoregressive models]]></category>
		<category><![CDATA[non-varying individuals]]></category>
		<category><![CDATA[parameter bias]]></category>
		<category><![CDATA[participant variability in intensive longitudinal studies]]></category>
		<category><![CDATA[psychological methods]]></category>
		<category><![CDATA[real-time psychological data collection]]></category>
		<category><![CDATA[simulation study]]></category>
		<category><![CDATA[stable trait measurement issues]]></category>
		<category><![CDATA[statistical biases in daily-life research]]></category>
		<category><![CDATA[within-person variability]]></category>
		<guid isPermaLink="false">https://scienmag.com/?p=223306</guid>

					<description><![CDATA[A new simulation study shows that participants whose scores never change can systematically bias autoregressive and cross-lagged estimates in intensive longitudinal research, and offers clear rules for when to exclude them and how to interpret the results.]]></description>
										<content:encoded><![CDATA[<p>Intensive longitudinal research has transformed psychology over the past two decades. Instead of measuring people once and drawing conclusions about stable traits, researchers now ping participants on their phones dozens of times a day, tracking how stress, mood, sleep, and symptoms rise and fall in real time. These bursts of data feed powerful statistical tools, most notably dynamic structural equation models and multilevel autoregressive models, which estimate how each person&#8217;s state at one moment predicts their own state at the next. But a new study published in Behavior Research Methods by Xiaohui Luo, Yueqin Hu, and Hongyun Liu of Beijing Normal University exposes a blind spot that has quietly contaminated this booming literature: some participants simply do not vary at all, and including them in the analysis can systematically distort the very dynamics researchers are trying to measure.</p>
<p>The problem sounds deceptively simple. In any experience sampling study, a proportion of participants will report exactly the same score on a given construct across every measurement occasion. Someone might rate their daily stress as a three on a scale, every single day, for weeks. The authors call these cases non-varying individuals, meaning that their observed scores on certain state constructs remain constant over the study period. Crucially, the researchers emphasize that this label does not imply such people are inherently incapable of change; it describes an observed pattern in the data, which may reflect genuine stability, restricted circumstances, or response habits such as repeatedly choosing the same scale point. Whatever the cause, the statistical consequences are far from trivial.</p>
<p>Luo and colleagues begin with a motivating example drawn from daily stress research, using measures of daily stressors of the kind captured by instruments such as the Daily Inventory of Stressful Events. When they included non-varying individuals in a univariate autoregressive model, the substantive conclusions changed. Autoregressive parameters, which describe how strongly a person&#8217;s stress today depends on their stress yesterday, are the backbone of this modeling tradition. A high autoregressive effect suggests a sluggish system that carries perturbations forward, while a low one suggests rapid recovery. The demonstration showed that the simple act of keeping zero-variability participants in the sample could flip what researchers would report about how stress propagates over time.</p>
<p>To understand why, it helps to consider what a constant time series does to an autoregressive estimate. For an individual whose scores never change, the model sees a perfectly predictable series: yesterday&#8217;s value fully determines today&#8217;s. Depending on how the model handles such cases, these flat trajectories can pull estimated dynamics toward extreme values. The team&#8217;s first simulation study, focused on univariate processes, confirmed the mechanism: as the proportion of non-varying individuals in a sample increased, the autoregressive estimates showed a systematic upward bias. In other words, the population would appear more self-predictive, more inertial, than it truly is, purely because some members contributed flat lines rather than genuine fluctuations.</p>
<p>The second simulation extended the investigation to bivariate processes, where researchers estimate not only how a variable predicts itself over time but also how one variable, say stress, predicts another, say negative affect, at the next occasion. These cross-lagged effects fuel countless claims about emotional reactivity, mutual influence between partners, and feedback loops between symptoms. Here the findings were subtler and arguably more alarming. The average, fixed-effect cross-lagged estimates could look accurate on the surface, giving analysts false confidence. Yet beneath that apparent accuracy, the person-specific cross-lagged effects were systematically distorted, with some individuals&#8217; effects overestimated and others underestimated. A researcher examining individual differences in emotional dynamics, or trying to identify who is most reactive, could be badly misled.</p>
<p>Within the widely used Gaussian autoregressive modeling framework, the authors arrive at a clear practical recommendation: estimate dynamic parameters using a subsample that excludes non-varying individuals. This is not a call to discard participants as defective, but a recognition that a flat observed series carries no information about temporal dynamics and can actively inject bias into estimates pooled across people. The recommendation echoes a broader movement in the methodological literature, which has recently scrutinized related data pathologies in intensive longitudinal designs, including floor effects that compress scores against scale minima and zero inflation that floods datasets with identical values. Non-varying individuals represent a distinct and previously understudied facet of this family of problems.</p>
<p>Importantly, the study does not stop at a blanket rule. Luo, Hu, and Liu delineate when subsample estimates can be interpreted as approximations to the full population, and when they should instead be read as describing only the subsample population. Their simulations indicate that in bivariate processes, once the proportion of non-varying individuals reaches around ten percent or more, the dynamics estimated from the varying subsample can no longer be safely generalized to everyone who was recruited. Below that threshold, the subsample estimates serve as reasonable approximations of the whole; beyond it, researchers must be explicit that their conclusions apply to the subset of people whose states actually fluctuated. This distinction matters for fields such as affective science, where claims about population-level emotional dynamics rest on samples that may contain substantial pockets of stability.</p>
<p>The implications ripple across the many domains that have embraced within-person modeling. Researchers have documented intraindividual variability in pain, sleep, perceived stress, affect in older versus younger adults, state academic self-concept among students, and daily sense of purpose, and meta-analytic work on ecological momentary assessment shows the method now spans virtually every corner of psychology. Some of this literature has already grappled with variability itself as a substantive quantity, asking what predicts within-person variance in applied constructs and whether traits like neuroticism relate to emotional instability. The new findings add a methodological caution to that substantive conversation: before interpreting variability, or dynamics, researchers should first examine each individual&#8217;s within-person variability and account for those who show none.</p>
<p>The authors also situate their work within a rapidly maturing methodological ecosystem. Dynamic structural equation models, Bayesian multilevel approaches, and related frameworks have made person-specific dynamics routinely estimable, and open resources such as databases of openly available experience sampling datasets are flooding the field with intensive longitudinal data. As data volume grows, so does the chance that non-varying individuals slip through automated pipelines unnoticed. The study&#8217;s data and code have been made openly available on the Open Science Framework, allowing applied researchers to reproduce the simulations and apply the recommended screening procedures to their own projects. The work was supported by the National Natural Science Foundation of China, and the authors report no conflicts of interest.</p>
<p>For the practicing scientist, the takeaway is a short checklist with long consequences. Screen every participant&#8217;s time series for zero observed variability before fitting dynamic models. Report how many individuals were excluded and why. Interpret autoregressive and cross-lagged estimates from the varying subsample as population approximations only when the excluded fraction is small, and as subsample descriptions when it approaches or exceeds roughly ten percent in bivariate settings. And resist the temptation to treat flat responders as noise to be quietly absorbed; as this study demonstrates, their inclusion can inflate autoregressive estimates and silently scramble person-specific cross-lagged effects even while group averages look pristine. In a research culture increasingly built on the promise of capturing life as it actually unfolds, the people whose numbers never move turn out to be among the most consequential figures in the dataset, precisely because of the stillness they bring to it.</p>
<p><strong>Subject of Research:</strong> Statistical handling of non-varying individuals in within-person dynamic modeling of intensive longitudinal data</p>
<p><strong>Article Title:</strong> Examining within-person variability of each individual: How should we deal with non-varying individuals?</p>
<p><strong>Article References:</strong> Luo, X., Hu, Y., &amp; Liu, H. (2026). Examining within-person variability of each individual: How should we deal with non-varying individuals?. <em>Behavior Research Methods, 58</em>(10), Article 285. <a href="https://doi.org/10.3758/s13428-026-03171-1" rel="noopener noreferrer">https://doi.org/10.3758/s13428-026-03171-1</a></p>
<p><strong>Image Credits:</strong> AI Generated</p>
<p><strong>DOI:</strong> <a href="https://doi.org/10.3758/s13428-026-03171-1" rel="noopener noreferrer">10.3758/s13428-026-03171-1</a></p>
<p><strong>Keywords:</strong> within-person variability, intensive longitudinal data, autoregressive models, cross-lagged effects, dynamic structural equation modeling, ecological momentary assessment, non-varying individuals, simulation study, daily stress, parameter bias, Behavior Research Methods, psychological methods</p>
]]></content:encoded>
					
		
		
		<post-id xmlns="com-wordpress:feed-additions:1">223306</post-id>	</item>
		<item>
		<title>Pay Per Beep: Simple Incentive Tweaks Can Boost Experience Sampling Data Without Hurting Quality</title>
		<link>https://scienmag.com/pay-per-beep-simple-incentive-tweaks-can-boost-experience-sampling-data-without-hurting-quality/</link>
		
		<dc:creator><![CDATA[Glenn Wilkins]]></dc:creator>
		<pubDate>Wed, 23 Sep 2026 23:23:36 +0000</pubDate>
				<category><![CDATA[Psychology & Psychiatry]]></category>
		<category><![CDATA[burden]]></category>
		<category><![CDATA[careless responding]]></category>
		<category><![CDATA[compliance]]></category>
		<category><![CDATA[data quality]]></category>
		<category><![CDATA[data quality in behavioral research]]></category>
		<category><![CDATA[ecological momentary assessment]]></category>
		<category><![CDATA[effect of monetary incentives on data completeness]]></category>
		<category><![CDATA[experience sampling]]></category>
		<category><![CDATA[experience sampling incentives]]></category>
		<category><![CDATA[experimental design in psychological research]]></category>
		<category><![CDATA[impact of payment methods on data quality]]></category>
		<category><![CDATA[incentives]]></category>
		<category><![CDATA[influence of incentive structures on survey response]]></category>
		<category><![CDATA[intensive longitudinal data]]></category>
		<category><![CDATA[KU Leuven study on experiment participation]]></category>
		<category><![CDATA[methodology for improving experience sampling compliance]]></category>
		<category><![CDATA[participant engagement in experience sampling]]></category>
		<category><![CDATA[participant payment]]></category>
		<category><![CDATA[personalized feedback]]></category>
		<category><![CDATA[personalized feedback in survey participation]]></category>
		<category><![CDATA[psychological methods]]></category>
		<category><![CDATA[real-time mood and behavior tracking]]></category>
		<category><![CDATA[smartphone survey response rates]]></category>
		<category><![CDATA[survey methodology]]></category>
		<guid isPermaLink="false">https://scienmag.com/?p=211190</guid>

					<description><![CDATA[A randomized experiment with 192 students found that paying participants per beep increased compliance in a 14-day experience sampling study without reducing data quality, while personalized feedback offered no measurable advantage over a flat payment.]]></description>
										<content:encoded><![CDATA[<p>Every beep of a smartphone survey is a small negotiation between science and daily life. Experience sampling — the method psychologists use to capture thoughts, moods, and behaviors in real time by pinging participants repeatedly throughout the day — lives or dies on whether people actually answer. A missed beep is not just an empty cell in a spreadsheet; it is a lost snapshot of someone&#8217;s lived experience, and enough lost snapshots can quietly erode the foundations of a study. Now a team of researchers at KU Leuven in Belgium has put one of the field&#8217;s most practical design questions under the experimental microscope: does the way you pay participants change how much data they give you, and how good that data is?</p>
<p>The study, published in the journal Behavior Research Methods, was led by Milla Pihlajamäki together with Ginette Lafit, Olivia J. Kirtley, Inez Myin-Germeys, and Gudrun Eisele. The team recruited 192 students and randomly assigned 64 of them to each of three incentive conditions. The first group received a fixed payment for taking part, the standard arrangement in most experience sampling research. The second group received the same fixed payment plus personalized feedback, a summary of the data they had contributed, on the theory that seeing one&#8217;s own psychological patterns might motivate more careful responding. The third group was paid per beep, earning money incrementally with every completed prompt, a structure that mirrors the piece-rate logic of behavioral economics rather than a flat salary model.</p>
<p>The protocol itself was demanding by design. For fourteen consecutive days, participants received nine prompts — or beeps — per day on their smartphones, producing up to 126 measurement moments per person and roughly 24,000 potential data points across the sample. This intensity is precisely what makes experience sampling so scientifically valuable and so operationally fragile. Unlike a one-off questionnaire, an intensive longitudinal design asks people to interrupt whatever they are doing — in a lecture, at dinner, with friends — to report on their inner states. Compliance, in this context, is not a given; it is an achievement that must be engineered through careful protocol design, and incentives are one of the most powerful levers available.</p>
<p>What makes the study methodologically notable is that the researchers did not stop at counting completed surveys. They systematically distinguished between data quantity and data quality, treating the two as separable outcomes that incentives might influence in different directions. Quantity was straightforward: compliance rates, or the proportion of beeps answered, and how that proportion changed over the two-week study period. Quality required more nuance. The team screened for careless responding — the phenomenon where participants click through items without genuine attention — and examined whether the temporal dynamics of such responses shifted across the study, alongside retrospective measures of participant burden and experience.</p>
<p>Careless responding matters because its consequences are surprisingly severe. As the methodological literature has repeatedly shown, even a modest proportion of inattentive respondents can distort correlations, inflate or deflate reliability estimates, and lead analysts astray in ways that are hard to detect after the fact. In experience sampling data, the problem is compounded by the sheer number of measurement moments and the fatigue that accumulates as the days wear on. A participant might respond attentively on day one and slide into patterned, mechanical answers by day ten. The Leuven team, drawing on their own prior work on the temporal dynamics of careless responding, built this dimension directly into the analysis, using analyses of variance and multilevel linear and logistic regression models to test whether incentive structure affected not only average behavior but its trajectory over time.</p>
<p>The headline finding is refreshingly clean: payment per beep increased compliance rates compared with the other two conditions, and that was essentially where the differences ended. The incremental payment scheme did not make participants answer more carelessly, did not change their reported burden, and did not alter their retrospective experience of the study in measurable ways. Personalized feedback, meanwhile — despite its intuitive appeal and growing popularity in mobile health and self-tracking applications — produced no measurable advantage over a plain fixed payment on any of the outcomes examined. The feedback condition neither boosted compliance nor improved the quality of responses, a null result that carries real practical weight for researchers weighing the added complexity of generating individualized reports against any assumed motivational payoff.</p>
<p>The finding that pay-per-beep worked without degrading quality is worth unpacking, because incentives in psychology have a complicated reputation. Classic motivation research has documented cases where external rewards crowd out intrinsic motivation or encourage gaming of the reward structure. In an experience sampling context, one might have worried that paying per beep would incentivize rapid, low-effort completion — quantity at the expense of quality. Recent related work on game-based rewards in experience sampling found exactly that pattern: gamification increased data quantity but reduced data quality. The Leuven results suggest that a straightforward monetary increment per completed beep does not carry the same risk, at least not in a motivated student population completing a two-week protocol.</p>
<p>The authors&#8217; recommendation follows directly from the evidence: for motivated samples such as students, use payment per beep to boost data quantity. This is not a trivial prescription. Compliance in intensive longitudinal research varies enormously across populations and study designs, with meta-analyses reporting widely different completion rates depending on the sample, the burden of the protocol, and the population under study. Clinical populations, adolescents, and people experiencing acute distress often show lower compliance, and every percentage point of missing data constrains the statistical models that researchers use to extract meaning from these datasets. Multilevel time-series analyses, network models of psychological dynamics, and idiographic prediction approaches all benefit directly from denser, more complete measurement streams.</p>
<p>There are, of course, boundaries to the conclusion. The study was conducted in a student sample, a population that is generally well-motivated, digitally fluent, and accustomed to participating in research. Whether payment per beep would deliver the same benefit — and remain free of quality costs — in harder-to-reach populations, longer protocols, or studies measuring stigmatized behaviors remains an open question. The reward magnitudes involved were also specific to this context; the psychology of incremental incentives plausibly depends on the size of each increment relative to the total payment. And burden, while measured, was assessed retrospectively and through momentary reports within a demanding 14-day design; incentive effects on the lived experience of participation might differ in studies with different rhythms and demands.</p>
<p>Still, the study exemplifies a broader and welcome shift in psychological methods research: treating study design choices — payment schemes, feedback provision, sampling frequency, questionnaire length — as empirical questions rather than conventions inherited from previous studies. The team post-registered their study, documented every deviation transparently, and made all materials and analysis code openly available on the Open Science Framework, with data accessible through a secure checkout system. In a field increasingly aware that methodological decisions ripple through every downstream finding, knowing that a simple per-beep payment can fill in more of the data grid without compromising what fills those cells is exactly the kind of actionable, evidence-based guidance that turns methodological debate into better science.</p>
<p><strong>Subject of Research:</strong> Effects of incentive type on data quantity and quality in experience sampling research</p>
<p><strong>Article Title:</strong> The effect of incentive type on data quality and quantity in an experience sampling study in a student population</p>
<p><strong>Article References:</strong> Pihlajamäki, M., Lafit, G., Kirtley, O. J., Myin-Germeys, I., &amp; Eisele, G. (2026). The effect of incentive type on data quality and quantity in an experience sampling study in a student population. <em>Behavior Research Methods, 58</em>(11), Article 300. <a href="https://doi.org/10.3758/s13428-026-03164-0" rel="noopener noreferrer">https://doi.org/10.3758/s13428-026-03164-0</a></p>
<p><strong>Image Credits:</strong> AI Generated</p>
<p><strong>DOI:</strong> <a href="https://doi.org/10.3758/s13428-026-03164-0" rel="noopener noreferrer">10.3758/s13428-026-03164-0</a></p>
<p><strong>Keywords:</strong> experience sampling, ecological momentary assessment, incentives, compliance, data quality, careless responding, survey methodology, participant payment, personalized feedback, intensive longitudinal data, burden, psychological methods</p>
]]></content:encoded>
					
		
		
		<post-id xmlns="com-wordpress:feed-additions:1">211190</post-id>	</item>
	</channel>
</rss>
