<?xml version="1.0" encoding="UTF-8"?><rss version="2.0"
	xmlns:content="http://purl.org/rss/1.0/modules/content/"
	xmlns:wfw="http://wellformedweb.org/CommentAPI/"
	xmlns:dc="http://purl.org/dc/elements/1.1/"
	xmlns:atom="http://www.w3.org/2005/Atom"
	xmlns:sy="http://purl.org/rss/1.0/modules/syndication/"
	xmlns:slash="http://purl.org/rss/1.0/modules/slash/"
	>

<channel>
	<title>variance decomposition &#8211; Science</title>
	<atom:link href="https://scienmag.com/tag/variance-decomposition/feed/" rel="self" type="application/rss+xml" />
	<link>https://scienmag.com</link>
	<description></description>
	<lastBuildDate>Fri, 02 Oct 2026 09:05:12 +0000</lastBuildDate>
	<language>en-US</language>
	<sy:updatePeriod>
	hourly	</sy:updatePeriod>
	<sy:updateFrequency>
	1	</sy:updateFrequency>
	<generator>https://wordpress.org/?v=7.1.2</generator>

<image>
	<url>https://scienmag.com/wp-content/uploads/2024/07/cropped-scienmag_ico-32x32.jpg</url>
	<title>variance decomposition &#8211; Science</title>
	<link>https://scienmag.com</link>
	<width>32</width>
	<height>32</height>
</image> 
<site xmlns="com-wordpress:feed-additions:1">73899611</site>	<item>
		<title>New Browser Tool Turns Regression Math Into Something You Can Actually See</title>
		<link>https://scienmag.com/new-browser-tool-turns-regression-math-into-something-you-can-actually-see/</link>
		
		<dc:creator><![CDATA[Denise Maddox]]></dc:creator>
		<pubDate>Fri, 02 Oct 2026 09:05:12 +0000</pubDate>
				<category><![CDATA[Technology and Engineering]]></category>
		<category><![CDATA[confidence intervals]]></category>
		<category><![CDATA[D3.js]]></category>
		<category><![CDATA[data visualization]]></category>
		<category><![CDATA[educational tools for data science students]]></category>
		<category><![CDATA[enhancing understanding of confidence intervals]]></category>
		<category><![CDATA[geometric interpretation of linear regression]]></category>
		<category><![CDATA[interactive learning]]></category>
		<category><![CDATA[interactive statistical software for learning regression]]></category>
		<category><![CDATA[limitations of traditional statistical software]]></category>
		<category><![CDATA[linear regression]]></category>
		<category><![CDATA[open-source data science tools]]></category>
		<category><![CDATA[open-source software]]></category>
		<category><![CDATA[R-squared]]></category>
		<category><![CDATA[real-time regression visualization in web browsers]]></category>
		<category><![CDATA[regression analysis visualization]]></category>
		<category><![CDATA[regression coefficient interpretation]]></category>
		<category><![CDATA[regression diagnostics and error decomposition]]></category>
		<category><![CDATA[residual diagnostics]]></category>
		<category><![CDATA[sampling variability]]></category>
		<category><![CDATA[sampling-based interval exploration]]></category>
		<category><![CDATA[statistics education]]></category>
		<category><![CDATA[variance decomposition]]></category>
		<category><![CDATA[visualization of statistical concepts]]></category>
		<category><![CDATA[web application]]></category>
		<guid isPermaLink="false">https://scienmag.com/?p=226742</guid>

					<description><![CDATA[A new open-source web application called RegVis makes the geometry of linear regression and the meaning of confidence intervals directly visible through interactive, real-time visualization.]]></description>
										<content:encoded><![CDATA[<p>Linear regression is one of the most widely taught and widely used methods in all of statistics, data science, and machine learning, yet the mathematics at its core has long remained stubbornly invisible. Students learn to compute a coefficient of determination, R², from a formula, and they learn that confidence intervals should contain a true parameter a certain percentage of the time, but the geometric and probabilistic meaning behind those numbers rarely becomes tangible. A new open-source software package called RegVis, described in the journal SoftwareX by Uzair Ahmad and Hamna Uzair, aims to change that by turning the abstract machinery of regression into something users can watch, poke, and dismantle in real time, directly inside a web browser.</p>
<p>The motivation for the tool stems from a persistent gap in how statistical software presents regression. According to the authors, mainstream packages such as SPSS, Minitab, Tableau, and JMP present regression results through disconnected numerical tables and static plots, obscuring the geometric relationships that are essential for deep conceptual understanding. A systematic survey of ten widely used systems conducted by the developers found that none of them provides geometric error decomposition or sampling-based interval exploration, while coordinated diagnostic views appear only in limited or partial form in a small number of systems. RegVis was built specifically to close those three gaps within a single, installation-free web application.</p>
<p>The first and perhaps most striking feature is the geometric decomposition of variance. For every data point, RegVis draws a red translucent square whose side length equals the absolute residual, the distance between the observed value and the fitted value predicted by the regression line. It also draws a blue translucent square whose side length equals the distance between the observed value and the mean of the response. The aggregate area of all red squares corresponds to the sum of squared errors, SSE, while the aggregate area of all blue squares corresponds to the total sum of squares, TSS. The identity R² = 1 − SSE/TSS, usually presented as an abstract algebraic formula, thus becomes a visible contrast between two fields of colored area. When a user drags a point or adds an outlier, the squares animate smoothly, and the shift in the ratio of red to blue area makes the change in explained variance perceptually apparent rather than merely calculable.</p>
<p>The developers are careful to note that this area-based rendering is intended as a conceptual aid rather than a precise measurement instrument. Research in graphical perception going back to the classic work of Cleveland and McGill shows that area encodings are less accurate than position or length for exact quantitative comparison. RegVis embraces this limitation deliberately: the squares are meant to convey a holistic, intuitive sense of how total variance splits into explained and unexplained components, while the exact numeric value of R² remains available in a live readout at all times. Users can toggle each layer independently and limit the maximum number of displayed squares to reduce visual clutter, supporting a progressive disclosure approach that starts with a simple scatterplot and builds toward the full decomposition.</p>
<p>The second major innovation tackles one of the most misunderstood concepts in statistics: the confidence interval. Studies have shown that even professional researchers harbor robust misinterpretations of what a confidence interval actually means. RegVis addresses this with an interactive sampling demonstration. Clicking the Sample button draws a random subsample of a user-configured proportion from the current dataset, fits a least-squares line to that subset, and overlays the result as a persistent semi-transparent grey trace. Each click produces a fresh, independent sample, and the accumulating cloud of grey lines gives learners a visceral sense of sampling variability. The displayed confidence band, computed once from the complete dataset, serves as the reference against which the repeated sample lines can be judged.</p>
<p>Because the dataset is treated as a finite population, the behavior of the containment rate follows finite-population sampling theory rather than the textbook infinite-population ideal. A grey trace counts as contained only if it lies within the confidence band at every value of x. As the sampling fraction increases, sampling variance shrinks through the finite-population correction, and containment rises monotonically toward certainty at 100 percent, where the subsample coincides with the population. To make this relationship observable rather than merely asserted, a Simulate function draws 100 independent samples at each of eleven sampling fractions from 0 to 100 percent, fits a line to each, and plots the resulting containment rate against the sampling fraction. In one illustrative workflow described in the paper, a 50-point dataset at the 95 percent confidence level produced a curve rising from roughly 10 percent containment at a 10 percent sampling fraction to full containment at 100 percent.</p>
<p>Underlying both features is a coordinated three-view architecture designed around Shneiderman&#8217;s direct-manipulation principle. The primary scatterplot displays the data, the red regression line, the toggleable error squares, adjustable confidence and prediction intervals, and a live regression equation with R² and sample size. A residuals-versus-fitted-values panel reveals heteroscedasticity as cone-shaped patterns, non-linearity as systematic curves, and outliers as extreme vertical displacements. A Q-Q plot maps empirical residual quantiles against theoretical normal quantiles, exposing heavy tails, skewness, and individual aberrant points. Hovering over any observation in any view triggers synchronized highlighting across all three panels, allowing users to trace a single data point through data space, error space, and distributional space simultaneously. Clicking anywhere adds a point; clicking an existing point removes it; and every such action triggers the full pipeline of data update, statistical recalculation, and rendering across all three views.</p>
<p>That pipeline is fast. The developers instrumented each architectural layer with performance timers and ran 30 repetitions at six dataset sizes across Microsoft Edge, Firefox, and Chrome on a 12-core Windows desktop. The computation layer, which recalculates least-squares coefficients, residuals, SSE, TSS, R², and interval bounds from scratch after every change, stayed below 1.2 milliseconds on average across all tested conditions. End-to-end latency rose gradually from under 2.3 milliseconds at ten points to a maximum of 17.93 milliseconds at 1,000 points in Firefox, comfortably below the roughly 100-millisecond threshold at which interactions are typically perceived as instantaneous. Rendering dominates the total, contributing an order of magnitude more time than computation even at the largest tested size, and the authors note that performance was not evaluated beyond 1,000 points. A benchmark script ships with the repository so that others can verify or extend the measurements.</p>
<p>The system is implemented entirely in client-side JavaScript using D3.js version 7, with HTML5 and CSS3, and requires no server-side installation; it can be deployed as a static file on any web host or opened directly from a local filesystem. The choice of D3.js over higher-level charting libraries was deliberate, since the custom geometric error squares, the sampling accumulation overlay, and the synchronized cross-view highlighting all demand low-level control over SVG elements that pre-built statistical libraries do not expose. The software is released under the MIT license on GitHub, includes a guided five-step tutorial covering dataset construction, variance decomposition, interval sampling, and diagnostic coordination, and supports CSV import and export with basic validation for reproducibility.</p>
<p>An exploratory usability assessment with eighteen expert participants, each holding at least one graduate-level statistics course, yielded a mean System Usability Scale score of 79.2 with a standard deviation of 12.8, a figure the authors describe as indicating high perceived usability, though they caution that the study lacked a controlled baseline and formal hypothesis testing. The developers also disclose that Ahmad is the founder of SpimeLab Inc., which hosts the platform, while stating that the reported results were developed independently of commercial considerations. Looking forward, the design principles of geometric correspondence, observable sampling, and coordinated multi-view interaction are described as general enough to extend to multiple regression, generalized linear models, ANOVA, and cross-validation. For now, RegVis positions itself as the first comprehensive visual environment in which regression mathematics is not merely calculable but directly observable, one clickable point at a time.</p>
<p><strong>Subject of Research:</strong> Interactive web-based visualization of linear regression analysis, variance decomposition, and confidence interval sampling for statistics education</p>
<p><strong>Article Title:</strong> RegVis: An interactive web-based visualization system for linear regression analysis and diagnostics</p>
<p><strong>Article References:</strong> Ahmad, U., &amp; Uzair, H. (2026). RegVis: An interactive web-based visualization system for linear regression analysis and diagnostics. <em>SoftwareX, 36</em>, Article 103045. <a href="https://doi.org/10.1016/j.softx.2026.103045" rel="noopener noreferrer">https://doi.org/10.1016/j.softx.2026.103045</a></p>
<p><strong>Image Credits:</strong> AI Generated</p>
<p><strong>DOI:</strong> <a href="https://doi.org/10.1016/j.softx.2026.103045" rel="noopener noreferrer">10.1016/j.softx.2026.103045</a></p>
<p><strong>Keywords:</strong> linear regression, data visualization, statistics education, confidence intervals, D3.js, variance decomposition, open-source software, residual diagnostics, interactive learning, R-squared, sampling variability, web application</p>
]]></content:encoded>
					
		
		
		<post-id xmlns="com-wordpress:feed-additions:1">226742</post-id>	</item>
		<item>
		<title>A Statistical Rethink Suggests Judges May Not Be &#8216;Liberated&#8217; the Way Criminologists Thought</title>
		<link>https://scienmag.com/a-statistical-rethink-suggests-judges-may-not-be-liberated-the-way-criminologists-thought/</link>
		
		<dc:creator><![CDATA[Courtney Benton]]></dc:creator>
		<pubDate>Wed, 30 Sep 2026 18:20:52 +0000</pubDate>
				<category><![CDATA[Social Science]]></category>
		<category><![CDATA[bias in jury and judge decisions]]></category>
		<category><![CDATA[case severity]]></category>
		<category><![CDATA[case severity and sentencing discretion]]></category>
		<category><![CDATA[criminology]]></category>
		<category><![CDATA[criminology sentencing research]]></category>
		<category><![CDATA[dominance analysis]]></category>
		<category><![CDATA[empirical testing of sentencing hypotheses]]></category>
		<category><![CDATA[extralegal factors]]></category>
		<category><![CDATA[extralegal factors in sentencing]]></category>
		<category><![CDATA[federal courts]]></category>
		<category><![CDATA[impact of defendant characteristics on sentencing]]></category>
		<category><![CDATA[judicial decision-making biases]]></category>
		<category><![CDATA[judicial discretion]]></category>
		<category><![CDATA[liberation hypothesis]]></category>
		<category><![CDATA[racial disparity]]></category>
		<category><![CDATA[reevaluation of sentencing theories]]></category>
		<category><![CDATA[regression analysis in criminology studies]]></category>
		<category><![CDATA[role of stereotypes in criminal justice]]></category>
		<category><![CDATA[sentencing]]></category>
		<category><![CDATA[Shapley values]]></category>
		<category><![CDATA[statistical analysis in criminal justice]]></category>
		<category><![CDATA[United States Sentencing Commission]]></category>
		<category><![CDATA[variance decomposition]]></category>
		<guid isPermaLink="false">https://scienmag.com/?p=218006</guid>

					<description><![CDATA[A new study argues that criminologists have been testing the liberation hypothesis with regression effects when the theory actually concerns how much extralegal factors contribute to explained variance in sentencing.]]></description>
										<content:encoded><![CDATA[<p>For six decades, criminologists have leaned on a deceptively simple idea to explain why some defendants receive harsher punishment than others for similar crimes. The liberation hypothesis, first articulated by Harry Kalven and Hans Zeisel in their landmark 1966 study The American Jury, holds that when evidence against a defendant is ambiguous or the case is less serious, judges and juries are freed from the constraints of the facts and can drift toward sentiment, stereotypes, and personal bias. In sentencing research, the theory has been extended to argue that as case severity falls and discretionary restrictions loosen, court actors become liberated to weigh extralegal characteristics such as a defendant&#8217;s race, ethnicity, sex, or citizenship status. A new study published in the American Journal of Criminal Justice by Bryan Holmes and Shayna R. Arrigo of Florida State University&#8217;s College of Criminology and Criminal Justice now argues that the field has been testing that idea with the wrong statistical question, and that the difference matters for whether the theory holds up at all.</p>
<p>The standard approach to testing the liberation hypothesis has been regression-based. Researchers build statistical models of sentencing outcomes, include measures of case severity, and test whether the effect of race or sex on punishment grows stronger as severity weakens, typically through interaction terms. If the coefficient linking defendant race to sentence length is larger in low-severity cases than in high-severity cases, the finding is taken as evidence of liberation. Holmes and Arrigo do not dispute that these coefficients answer a real question. They simply point out that it is not the question Kalven and Zeisel asked. The original theory was about what explains disagreement, not merely about how large a particular effect happens to be in one setting compared with another.</p>
<p>The distinction the authors draw is between effects and contributions. A regression coefficient can tell us, for example, that the odds of a judge-jury disagreement are twice as high when a defendant appears sympathetic than when the defendant does not. What it cannot tell us is how much of the overall variation in disagreements is actually accounted for by sympathy compared with the strength of the evidence. Two variables can have identical coefficients yet contribute very different shares of explained variance, depending on how much they vary and how they correlate with everything else in the model. Effect size and explanatory power are related but distinct quantities, and a theory about the sources of judicial discretion, the authors contend, is fundamentally a theory about explanatory power.</p>
<p>To capture that second quantity, Holmes and Arrigo turn to variance decomposition, a family of techniques borrowed from economics, psychology, and statistics that partition a model&#8217;s explained variance among its predictors. The study employs two such methods. Dominance analysis, adapted for logistic regression, determines the relative importance of predictors in the decision to incarcerate by comparing each variable&#8217;s contribution across all possible reorderings of the model. Shapley value decomposition, rooted in cooperative game theory, assigns each predictor its average marginal contribution to the model&#8217;s R-squared across every possible subset of predictors. These approaches are computationally demanding. With 26 variables, a complete Shapley decomposition would require estimating more than 67 million submodels, a burden the authors managed by computing individual contributions for key independent variables while grouping control variables.</p>
<p>The empirical setting is the federal sentencing system, using data from the United States Sentencing Commission. The authors exploit a structural feature of the federal guidelines: the sentencing table&#8217;s zones, labeled A through D, which impose progressively tighter constraints on judicial discretion as case severity rises. Zone A cases, the least serious, permit probation and give judges wide latitude, with incarceration imposed roughly 43 percent of the time. Zone D cases are so severe that imprisonment is essentially mandatory, with incarceration rates near 96 percent. By estimating separate models within each zone, the researchers create a natural severity spectrum across which to compare both the effects and the contributions of extralegal factors, sidestepping the interpretive distortions that arise when predicted probabilities are transformed through the nonlinear sigmoid function at very different base rates.</p>
<p>The results deliver the study&#8217;s central punchline. When the authors ran conventional regression tests, asking whether the effect of race, ethnicity, sex, or citizenship on sentencing outcomes was moderated by case severity, the pattern expected under the liberation hypothesis was largely absent. But when they decomposed the variance, asking whether the contribution of extralegal factors to explained variation in sentencing grew as severity declined, evidence consistent with liberation emerged. In other words, the two inquiries, which many researchers have treated as interchangeable, produce different answers, and only the variance-based inquiry finds support for the theory. A variable&#8217;s coefficient can stay flat across the severity spectrum even as its share of explained variance shifts substantially, because contributions depend on the full covariance structure of the model, not on any single slope.</p>
<p>The technical choices behind this finding deserve attention in their own right. The authors restricted their sentence-length models to cases receiving prison time, noting that coding non-prison sentences as zero months would create heterogeneous masses at zero across zones, conflating the incarceration decision with the length decision and corrupting comparisons between zones. They also declined to include a Heckman selection correction in the length models because the correction term was substantively collinear with legally relevant variables such as pre-sentence detention, a problem documented in prior methodological work. All models were interpreted on a common log-odds scale rather than as predicted probabilities, precisely because the sigmoid transformation would compress marginal effects differently in low-incarceration Zone A than in near-certain-incarceration Zone D, undermining interpretive consistency.</p>
<p>What does this mean for our understanding of American courts? If the liberation hypothesis survives only under the contribution framing, then the mechanism Kalven and Zeisel described, in which doubts about evidence free decision-makers to follow sentiment, is best understood as a claim about what drives variation in punishment, not about how much any demographic characteristic changes the average sentence. That reframing has practical consequences. A small coefficient for race in a low-severity zone could still reflect a meaningful share of the discretion exercised in those cases, while a statistically significant interaction term might reflect little explained variance at all. Policymakers seeking to rein in unwarranted disparity would therefore want to know not just whether disparities exist in lenient cases, but how much of the discretionary variation those disparities actually occupy.</p>
<p>The study also carries a broader methodological message for criminology and the social sciences generally. Regression coefficients have long been the default currency of quantitative testing, and interaction terms the default tool for moderation. Holmes and Arrigo join a growing literature, including recent work applying variance decomposition to inequality of opportunity, arguing that relative importance analysis should supplement rather than replace conventional regression. Their demonstration that a classic criminological theory changes its empirical verdict depending on which question is asked is a vivid case study in why the choice of statistical lens is itself a theoretical commitment. As sentencing researchers continue to debate when and whether race, sex, and citizenship shape punishment, the liberation hypothesis may need to be re-litigated, this time in the currency of explained variance.</p>
<p><strong>Subject of Research:</strong> Testing the liberation hypothesis in federal sentencing using variance decomposition methods</p>
<p><strong>Article Title:</strong> Using Variance Decomposition to Test Criminal Justice Theory: A Redeliberation of the Liberation Hypothesis</p>
<p><strong>Article References:</strong> Holmes, B., &amp; Arrigo, S. R. (2026). Using Variance Decomposition to Test Criminal Justice Theory: A Redeliberation of the Liberation Hypothesis. <em>American Journal of Criminal Justice</em>. <a href="https://doi.org/10.1007/s12103-026-09950-y" rel="noopener noreferrer">https://doi.org/10.1007/s12103-026-09950-y</a></p>
<p><strong>Image Credits:</strong> AI Generated</p>
<p><strong>DOI:</strong> <a href="https://doi.org/10.1007/s12103-026-09950-y" rel="noopener noreferrer">10.1007/s12103-026-09950-y</a></p>
<p><strong>Keywords:</strong> liberation hypothesis, sentencing, variance decomposition, Shapley values, dominance analysis, federal courts, racial disparity, judicial discretion, criminology, United States Sentencing Commission, case severity, extralegal factors</p>
]]></content:encoded>
					
		
		
		<post-id xmlns="com-wordpress:feed-additions:1">218006</post-id>	</item>
	</channel>
</rss>
