<?xml version="1.0" encoding="UTF-8"?><rss version="2.0"
	xmlns:content="http://purl.org/rss/1.0/modules/content/"
	xmlns:wfw="http://wellformedweb.org/CommentAPI/"
	xmlns:dc="http://purl.org/dc/elements/1.1/"
	xmlns:atom="http://www.w3.org/2005/Atom"
	xmlns:sy="http://purl.org/rss/1.0/modules/syndication/"
	xmlns:slash="http://purl.org/rss/1.0/modules/slash/"
	>

<channel>
	<title>Student-t likelihood &#8211; Science</title>
	<atom:link href="https://scienmag.com/tag/student-t-likelihood/feed/" rel="self" type="application/rss+xml" />
	<link>https://scienmag.com</link>
	<description></description>
	<lastBuildDate>Fri, 09 Oct 2026 05:13:04 +0000</lastBuildDate>
	<language>en-US</language>
	<sy:updatePeriod>
	hourly	</sy:updatePeriod>
	<sy:updateFrequency>
	1	</sy:updateFrequency>
	<generator>https://wordpress.org/?v=7.1.3</generator>

<image>
	<url>https://scienmag.com/wp-content/uploads/2024/07/cropped-scienmag_ico-32x32.jpg</url>
	<title>Student-t likelihood &#8211; Science</title>
	<link>https://scienmag.com</link>
	<width>32</width>
	<height>32</height>
</image> 
<site xmlns="com-wordpress:feed-additions:1">73899611</site>	<item>
		<title>Hidden Maps of Thirst: Bayesian Model Reveals Bogotá&#8217;s Water Use Defies Simple Explanation</title>
		<link>https://scienmag.com/hidden-maps-of-thirst-bayesian-model-reveals-bogotas-water-use-defies-simple-explanation/</link>
		
		<dc:creator><![CDATA[Violet Maxwell]]></dc:creator>
		<pubDate>Fri, 09 Oct 2026 05:13:04 +0000</pubDate>
				<category><![CDATA[Earth Science]]></category>
		<category><![CDATA[Bayesian modeling]]></category>
		<category><![CDATA[Bogotá]]></category>
		<category><![CDATA[climate]]></category>
		<category><![CDATA[PLOS Water]]></category>
		<category><![CDATA[sensitivity analysis]]></category>
		<category><![CDATA[space-time interaction]]></category>
		<category><![CDATA[spatial heterogeneity]]></category>
		<category><![CDATA[spatio-temporal analysis]]></category>
		<category><![CDATA[Student-t likelihood]]></category>
		<category><![CDATA[urban water consumption]]></category>
		<category><![CDATA[urban water demand patterns still show significant local variations?]]></category>
		<category><![CDATA[WAIC]]></category>
		<category><![CDATA[water management]]></category>
		<guid isPermaLink="false">https://scienmag.com/?p=251957</guid>

					<description><![CDATA[A Bayesian spatio-temporal analysis of Bogotá's 2019–2024 water consumption reveals that locality-level demand follows spatially heterogeneous dynamics that simple city-wide models cannot capture.]]></description>
										<content:encoded><![CDATA[<p>Water is the most local of all urban resources. It arrives through pipes that snake beneath specific streets, fills tanks on particular rooftops, and drains from taps in individual kitchens. Yet when city officials and researchers model how much water a metropolis consumes, they often reach for city-wide averages: how much rain fell this month, what the temperature was, how incomes and tariffs shifted across the whole urban fabric. A new study of Bogotá, Colombia, argues that this habit of averaging may be quietly blinding water managers to the true structure of demand. By applying fully Bayesian spatio-temporal models to locality-level consumption data from 2019 through 2024, researchers Danna Lesley Cruz-Reyes and Daniel Leonardo Ramírez Orozco have shown that the city&#8217;s sixteen or so localities do not simply rise and fall together in response to shared forces. Each one carries its own temporal signature, and that heterogeneity is strong enough to transform the statistical picture entirely.</p>
<p>The study, published in PLOS Water, set out with a deceptively simple question. If you adjust water consumption in every locality for the same city-wide drivers—climate swings, socioeconomic trends, the shared shocks of a period that included a global pandemic and severe drought stress—do the localities then behave as statistical clones of one another, differing only by a fixed offset? The additive model the authors built first assumes exactly that. It allows each locality to sit higher or lower than the city average, capturing a static spatial ranking, but it forces every locality to follow the same temporal trajectory once common covariates are accounted for. In a city as geographically and socially layered as Bogotá, where highland neighborhoods, dense commercial cores, and sprawling southern districts experience water very differently, that assumption was always going to be under strain.</p>
<p>To test it rigorously, the researchers turned to the machinery of modern Bayesian inference. Rather than producing a single best-fit line, Bayesian models express uncertainty as full posterior distributions over every parameter, which makes them well suited to the noisy, short, and irregularly structured data that characterize municipal water records. The authors fitted models to monthly consumption at the locality level across six years, a period long enough to span dramatic climatic and social disruption but short enough that data-hungry methods must be handled with care. The additive specification adjusted for common temporal dynamics and city-wide climatic and socioeconomic time series, then asked how much spatial structure remained in the residuals.</p>
<p>The answer came from a formal sensitivity analysis, and it was unambiguous. When the researchers added a structured space–time interaction—a term that lets each locality&#8217;s deviation from the common trajectory evolve over time, borrowing strength from neighboring localities through spatially correlated priors—the improvement in model fit was enormous. The Widely Applicable Information Criterion, a standard Bayesian measure of predictive fit that penalizes complexity, dropped from 2502.7 in the additive model to 604.0 in the interaction model. The Deviance Information Criterion fell in parallel, from 2500.5 to 333.9. In the vocabulary of statistical modeling, gaps of this magnitude are not marginal refinements; they signal that the simpler model is missing something fundamental about how the data are generated. Locality deviations, the authors conclude, are not adequately represented as constant throughout the study period.</p>
<p>What does that mean in practical terms? Imagine two neighborhoods that consumed similar volumes of water in 2019. Under the additive model, they would be expected to track each other through the pandemic lockdowns, the rationing anxieties, and the shifting rainfall patterns of the following years, differing only by a fixed amount. The interaction model says otherwise: the same shared events landed differently in different places, and those differential responses are themselves spatially organized. Neighborhoods that are geographically close tend to deviate from the city-wide pattern in similar ways, a signature consistent with localized infrastructure, microclimates, settlement histories, and social composition shaping how water demand responds to stress. The spatial structure is not a static backdrop but an active, evolving dimension of consumption.</p>
<p>The study also confronted a subtler statistical hazard: heavy tails. Water consumption data, like many environmental and socioeconomic series, occasionally produce extreme observations—a billing anomaly, a meter failure, a localized crisis—that a normal distribution treats as vanishingly rare. The researchers therefore compared their Gaussian models against versions using a Student-t likelihood, which has heavier tails and down-weights extreme observations. The posterior mean degrees of freedom told the story: around 3.02 in the additive model and 2.60 in the interaction model. Values this low, well below the roughly 30 of a Gaussian distribution, indicate genuinely heavy residual tails—outliers are a real feature of these data, not a modeling artifact. The Student-t likelihood was not a paranoid precaution; it was describing something true about Bogotá&#8217;s water records.</p>
<p>Yet here the study delivers one of its most interesting and technically consequential findings. Despite the evidence for heavy tails, the Gaussian interaction model retained substantially better information criteria than its Student-t counterpart. That apparent paradox—acknowledging fat-tailed errors yet preferring the thinner-tailed model—reflects the way information criteria balance fit against effective complexity. The Student-t likelihood, with its additional flexibility, appears to absorb structure that the interaction term would otherwise capture, blurring the space–time signal the researchers most wanted to isolate. When the authors compared the principal spatial main effects estimated under the two likelihoods, they found a correlation of 0.975. In other words, the overall spatial ordering of localities—which places consume more, which consume less—is remarkably robust to the choice of error distribution, even as the finer temporal dynamics are sensitive to it.</p>
<p>That robustness matters for anyone hoping to act on these results. A water utility deciding where to target conservation campaigns, where to prioritize leak detection, or how to design tariff structures needs to trust the spatial ranking of demand. The near-perfect correlation across likelihoods suggests that ranking is solid ground. But a utility trying to forecast how a specific district will respond to the next drought, or to evaluate whether an intervention changed behavior in one locality but not its neighbors, needs the space–time interaction. The additive model, however convenient, would systematically misattribute those differential dynamics, potentially crediting or blaming city-wide policies for changes that were in fact deeply local.</p>
<p>The methodological lesson radiates well beyond Bogotá. Cities across Latin America and the wider global South face similar conditions: administratively defined zones of uneven size and character, consumption records of moderate length, and climatic pressures—like the multi-year rainfall deficits that have strained Andean reservoirs in recent years—that do not fall uniformly across the urban landscape. The Bayesian framework used here offers a template because it handles short series gracefully, quantifies uncertainty honestly, and makes its assumptions explicit and testable. The sensitivity analysis is the crucial move. Rather than asserting a single model, the authors demonstrated that their central conclusion—spatially heterogeneous temporal dynamics—survives a deliberate stress test of its core assumptions, from the error distribution to the structure of the interaction term.</p>
<p>There is also a quieter, more civic implication. When consumption is modeled as a single city-wide curve, the localities that deviate most—those that conserve aggressively under stress, or those that cannot—become statistical noise. The space–time interaction model makes those deviations visible and locatable, turning them into evidence. In a period when Bogotá and many other cities are confronting the reality that water infrastructure, climate, and inequality intersect block by block, that visibility is not an academic luxury. It is the difference between managing a city as an abstraction and managing it as the mosaic of places it actually is. The maps hidden inside Bogotá&#8217;s water bills, this study shows, were always there; it took a model willing to let space and time talk to each other to reveal them.</p>
<p><strong>Subject of Research:</strong> Bayesian spatio-temporal modeling of locality-level urban water consumption in Bogotá, Colombia</p>
<p><strong>Article Title:</strong> Spatial structure in urban water consumption: A Bayesian space-time analysis of Bogotá (2019–2024)</p>
<p><strong>Article References:</strong> Cruz-Reyes, D. L., &amp; Ramírez Orozco, D. L. (2026). Spatial structure in urban water consumption: A Bayesian space-time analysis of Bogotá (2019–2024). <em>PLOS Water, 5</em>(9), e0000512. <a href="https://doi.org/10.1371/journal.pwat.0000512" rel="noopener noreferrer">https://doi.org/10.1371/journal.pwat.0000512</a></p>
<p><strong>Image Credits:</strong> AI Generated</p>
<p><strong>DOI:</strong> <a href="https://doi.org/10.1371/journal.pwat.0000512" rel="noopener noreferrer">10.1371/journal.pwat.0000512</a></p>
<p><strong>Keywords:</strong> urban water consumption, Bogotá, Bayesian modeling, spatio-temporal analysis, PLOS Water, space-time interaction, Student-t likelihood, WAIC, water management, spatial heterogeneity, climate, sensitivity analysis</p>
]]></content:encoded>
					
		
		
		<post-id xmlns="com-wordpress:feed-additions:1">251957</post-id>	</item>
		<item>
		<title>One Outlier Can Break Gaussian Process Training, New Study Shows</title>
		<link>https://scienmag.com/one-outlier-can-break-gaussian-process-training-new-study-shows/</link>
		
		<dc:creator><![CDATA[Denise Maddox]]></dc:creator>
		<pubDate>Fri, 02 Oct 2026 06:43:55 +0000</pubDate>
				<category><![CDATA[Technology and Engineering]]></category>
		<category><![CDATA[Bayesian inference]]></category>
		<category><![CDATA[Bayesian models in machine learning]]></category>
		<category><![CDATA[effects of data anomalies on Bayesian models]]></category>
		<category><![CDATA[Gaussian process fragility]]></category>
		<category><![CDATA[Gaussian process training vulnerabilities]]></category>
		<category><![CDATA[Gaussian processes]]></category>
		<category><![CDATA[Huber loss]]></category>
		<category><![CDATA[hyperparameter estimation]]></category>
		<category><![CDATA[hyperparameter sensitivity in Gaussian processes]]></category>
		<category><![CDATA[influence functions]]></category>
		<category><![CDATA[kernel function impact on model stability]]></category>
		<category><![CDATA[kernel methods]]></category>
		<category><![CDATA[M-estimation]]></category>
		<category><![CDATA[Machine learning]]></category>
		<category><![CDATA[machine learning model reliability]]></category>
		<category><![CDATA[marginal likelihood]]></category>
		<category><![CDATA[marginal likelihood optimization issues]]></category>
		<category><![CDATA[mathematical limitations of Gaussian processes]]></category>
		<category><![CDATA[outlier influence on Gaussian process training]]></category>
		<category><![CDATA[outliers]]></category>
		<category><![CDATA[robust statistics]]></category>
		<category><![CDATA[robustness of Gaussian process models]]></category>
		<category><![CDATA[Student-t likelihood]]></category>
		<category><![CDATA[uncertainty quantification in Gaussian processes]]></category>
		<guid isPermaLink="false">https://scienmag.com/?p=226238</guid>

					<description><![CDATA[A new theoretical study proves that standard Gaussian process hyperparameter estimation has an unbounded influence function, meaning a single outlier can arbitrarily distort kernel parameters, and identifies heavy-tailed likelihoods and curvature-preserving robust losses as the fix.]]></description>
										<content:encoded><![CDATA[<p>Gaussian processes have quietly become one of the most trusted tools in modern machine learning. From robotics to geostatistics to the emulation of expensive computer simulations, these Bayesian models deliver not just predictions but honest measures of uncertainty, which is precisely why engineers and scientists rely on them when the cost of being confidently wrong is high. Yet a new theoretical study published in the International Journal of Data Science and Analytics by Akash Sedai and Francesca Medda of University College London delivers an uncomfortable finding: the standard way of training Gaussian processes is fundamentally fragile, and the fragility is not a glitch that better software can fix. It is baked into the mathematics itself.</p>
<p>The heart of Gaussian process training lies in its hyperparameters, the knobs that define how the model believes data points relate to one another. A kernel function encodes assumptions about smoothness, correlation length, signal strength and noise level, and these quantities are typically learned by maximizing the marginal likelihood, a quantity that balances how well the model fits the data against how complex it becomes. For decades this procedure has been regarded as statistically principled and, under ideal Gaussian assumptions, it genuinely is. What Sedai and Medda show, however, is that the estimators produced by this procedure possess what statisticians call an unbounded influence function, a formal certificate that a single extreme observation can exert arbitrarily large leverage on the fitted kernel parameters.</p>
<p>The influence function is a classic concept from robust statistics, introduced by Frank Hampel in the 1970s as a diagnostic for measuring how much an infinitesimal speck of contamination at any point in the data distribution shifts an estimator. If the influence function is bounded, no single observation can dominate the result no matter how extreme it is. If it is unbounded, a lone outlier can drag the estimate anywhere. The authors adapt this framework to the Gaussian process setting with a subtle twist: because the joint log marginal likelihood couples all observations through the kernel covariance matrix, it does not decompose into a sum of independent per-point terms the way classical M-estimators do. Their solution is a leave-one-in contamination construction, in which the perturbation is represented by the predictive log-likelihood of an added data point conditional on the observed sample.</p>
<p>From this construction they derive a closed-form expression for the influence function of the hyperparameter estimator, factoring it into two interpretable pieces: the global curvature of the objective, captured by the Hessian of the log marginal likelihood, and a local score contribution from the contaminated point. That local score depends on the residual between the contaminated response and the model&#8217;s predictive mean, on the predictive variance at the contaminated input, and on where the input sits relative to the observed design. When the input lies far from the training data, the kernel coupling weakens and the geometric influence attenuates, though variance-related parameters such as signal and noise variance remain affected even then.</p>
<p>The central result is stark. Under the standard Gaussian likelihood, the contamination score grows quadratically in the magnitude of the response, so the influence function diverges as the outlier&#8217;s value tends toward infinity. The authors prove this formally in a proposition requiring only mild regularity conditions, and they show that the conclusion is automatic whenever the model includes a signal variance or noise variance parameter, which virtually every practical Gaussian process does. They further demonstrate that the result survives log-parameterizations and automatic relevance determination kernels, closing the escape hatches that practitioners might hope would soften the blow. In Hampel&#8217;s terminology, maximum likelihood training of Gaussian processes is nonrobust by construction.</p>
<p>Crucially, the paper does not stop at diagnosis. The authors extend the influence function framework to the robust alternatives that have long circulated in the Gaussian process literature, including heavy-tailed likelihoods such as the Student-t and Laplace distributions, and robustified objectives built on the Huber loss and its smooth cousin, the Pseudo-Huber or Charbonnier loss. For each case they establish the conditions under which the influence function becomes bounded. The unifying principle is elegant: if the derivative of the pointwise loss with respect to the mean prediction remains bounded over all residuals, then the contamination score is bounded, and so is the influence function, provided the local curvature of the objective stays finite and nonsingular. This connects Gaussian process training directly to the classical theory of M-estimation, recasting it as a kernelized, probabilistic analogue of robust regression.</p>
<p>The empirical validation is unusually thorough. The authors first verify that their analytic influence function matches an independent automatic-differentiation implementation to machine precision, that it is insensitive to the small ridge regularization used for numerical conditioning, and that it reproduces the true first-order response of the optimizer to small data perturbations as measured by finite differences. On a synthetic one-dimensional benchmark with two hundred points, they then compare Gaussian, Student-t, Huber and Pseudo-Huber training under single-point stress tests and controlled contamination. The scatter of per-point influence norms against whitened residuals tells the story visually: the Gaussian fit reaches large influence values at modest residual sizes, while Huber and Pseudo-Huber accommodate residuals several times larger within a comparable influence range, with Student-t sitting in between.</p>
<p>Perhaps the most surprising empirical finding concerns curvature. Clipping the score function, as Huber does, turns out to be necessary but not sufficient for stable hyperparameter behaviour. Because Huber&#8217;s score is flat in the tail, contaminated points contribute no data curvature to the Hessian, and with enough contamination the smallest eigenvalue of the curvature matrix can collapse toward zero or below, destabilizing the local solve and sometimes amplifying influence beyond even the Gaussian fit. The Student-t likelihood, whose score redescends toward zero while retaining curvature, preserved positive curvature in every contaminated run and produced the smallest hyperparameter drift, whereas Huber and Pseudo-Huber lost positive curvature in most runs. The lesson is that robustness depends on both suppressing the direct pull of outliers and maintaining a well-conditioned training objective.</p>
<p>The practical implications ripple outward. In experiments on real datasets including Kin8nm and superconductivity data, the authors show that robust objectives cost essentially nothing when the Gaussian model is appropriate, matching point accuracy and calibrated coverage after a single variance calibration. When contamination or heavy tails appear, however, the Gaussian fit degrades fastest, compensating by inflating its noise estimate and widening its intervals, while Student-t and Pseudo-Huber keep hyperparameters stable and uncertainty honest. The authors also verify that their influence analysis carries over to sparse variational Gaussian processes, the scalable variant used with large datasets, finding that the analytic influence function closely predicts the optimizer&#8217;s actual movement.</p>
<p>For a field that increasingly deploys Gaussian processes in safety-critical emulation, environmental modelling and Bayesian optimization, the message is hard to ignore. The fragility of marginal-likelihood training is a structural property of the estimator, not an artefact of finite precision or poor implementation, and it can be measured, predicted and repaired. Sedai and Medda&#8217;s work gives practitioners both the warning and the toolkit: check the influence structure of your fitted model, prefer heavy-tailed likelihoods when outliers are plausible, and remember that a bounded score alone will not save you if the curvature of your objective quietly disappears. Robustness, it turns out, is a two-part bargain, and Gaussian process training has only recently learned to sign it.</p>
<p><strong>Subject of Research:</strong> Robustness analysis of Gaussian process hyperparameter estimation using influence functions</p>
<p><strong>Article Title:</strong> Influence functions for Gaussian process hyperparameter estimation</p>
<p><strong>Article References:</strong> Sedai, A., &amp; Medda, F. (2026). Influence functions for Gaussian process hyperparameter estimation. <em>International Journal of Data Science and Analytics, 22</em>(1), Article 316. <a href="https://doi.org/10.1007/s41060-026-01285-5" rel="noopener noreferrer">https://doi.org/10.1007/s41060-026-01285-5</a></p>
<p><strong>Image Credits:</strong> AI Generated</p>
<p><strong>DOI:</strong> <a href="https://doi.org/10.1007/s41060-026-01285-5" rel="noopener noreferrer">10.1007/s41060-026-01285-5</a></p>
<p><strong>Keywords:</strong> Gaussian processes, influence functions, hyperparameter estimation, robust statistics, marginal likelihood, outliers, Student-t likelihood, Huber loss, M-estimation, Bayesian inference, kernel methods, machine learning</p>
]]></content:encoded>
					
		
		
		<post-id xmlns="com-wordpress:feed-additions:1">226238</post-id>	</item>
	</channel>
</rss>
