<?xml version="1.0" encoding="UTF-8"?><rss version="2.0"
	xmlns:content="http://purl.org/rss/1.0/modules/content/"
	xmlns:wfw="http://wellformedweb.org/CommentAPI/"
	xmlns:dc="http://purl.org/dc/elements/1.1/"
	xmlns:atom="http://www.w3.org/2005/Atom"
	xmlns:sy="http://purl.org/rss/1.0/modules/syndication/"
	xmlns:slash="http://purl.org/rss/1.0/modules/slash/"
	>

<channel>
	<title>beta distribution &#8211; Science</title>
	<atom:link href="https://scienmag.com/tag/beta-distribution/feed/" rel="self" type="application/rss+xml" />
	<link>https://scienmag.com</link>
	<description></description>
	<lastBuildDate>Mon, 05 Oct 2026 14:00:27 +0000</lastBuildDate>
	<language>en-US</language>
	<sy:updatePeriod>
	hourly	</sy:updatePeriod>
	<sy:updateFrequency>
	1	</sy:updateFrequency>
	<generator>https://wordpress.org/?v=7.1.3</generator>

<image>
	<url>https://scienmag.com/wp-content/uploads/2024/07/cropped-scienmag_ico-32x32.jpg</url>
	<title>beta distribution &#8211; Science</title>
	<link>https://scienmag.com</link>
	<width>32</width>
	<height>32</height>
</image> 
<site xmlns="com-wordpress:feed-additions:1">73899611</site>	<item>
		<title>Sharper Shots, Better Numbers: Imaging Method Tames Variance in Crop Disease Estimates</title>
		<link>https://scienmag.com/sharper-shots-better-numbers-imaging-method-tames-variance-in-crop-disease-estimates/</link>
		
		<dc:creator><![CDATA[Alan Morgan]]></dc:creator>
		<pubDate>Mon, 05 Oct 2026 14:00:27 +0000</pubDate>
				<category><![CDATA[Agriculture]]></category>
		<category><![CDATA[beta distribution]]></category>
		<category><![CDATA[brown rust]]></category>
		<category><![CDATA[digital imaging in agriculture]]></category>
		<category><![CDATA[disease severity]]></category>
		<category><![CDATA[disease severity estimation accuracy]]></category>
		<category><![CDATA[field imaging for plant diseases]]></category>
		<category><![CDATA[field phenotyping]]></category>
		<category><![CDATA[focus bracketing]]></category>
		<category><![CDATA[high-resolution crop disease phenotyping]]></category>
		<category><![CDATA[image analysis]]></category>
		<category><![CDATA[image-based plant pathogen detection]]></category>
		<category><![CDATA[objective disease measurement techniques]]></category>
		<category><![CDATA[overcoming measurement bias in crop disease evaluation]]></category>
		<category><![CDATA[plant disease imaging]]></category>
		<category><![CDATA[plant pathology]]></category>
		<category><![CDATA[precision agriculture]]></category>
		<category><![CDATA[resistance breeding diagnostics]]></category>
		<category><![CDATA[septoria tritici blotch]]></category>
		<category><![CDATA[spatial autocorrelation]]></category>
		<category><![CDATA[statistical challenges in crop health assessment]]></category>
		<category><![CDATA[statistical modeling]]></category>
		<category><![CDATA[variability in plant disease scoring]]></category>
		<category><![CDATA[visual severity rating limitations]]></category>
		<category><![CDATA[wheat breeding]]></category>
		<guid isPermaLink="false">https://scienmag.com/?p=238344</guid>

					<description><![CDATA[Researchers at ETH Zürich analyzed 16,650 high-resolution field images to show how focus bracketing, dense spatial sampling, and Beta-distribution modeling can reconcile precision and variance in plot-level estimates of wheat disease severity.]]></description>
										<content:encoded><![CDATA[<p>Plant pathologists have long faced an uncomfortable truth: the numbers they use to describe how sick a crop is are often far less reliable than they appear. Visual severity ratings, the backbone of resistance breeding and variety testing for decades, are notoriously subjective, slow, and imprecise. Two trained raters looking at the same plot can disagree substantially, and even the same rater can produce different scores on different days. Image-based phenotyping promised to fix this, but a new study from ETH Zürich reveals a hidden statistical trap that has quietly undermined many high-resolution imaging efforts in the field—and, more importantly, shows how to escape it.</p>
<p>The research, published in the journal Plant Methods by Radek Zenkl, Bruce A. McDonald, and Jonas Anderegg of the Plant Pathology Group at ETH Zürich, tackles a fundamental trade-off that arises whenever scientists point a high-resolution camera at a diseased wheat canopy. To capture the miniature diagnostic features of a pathogen—the small necrotic lesions of septoria tritici blotch or the rust-colored pustules of brown rust—a camera needs a narrow field of view and a shallow depth of field. That combination yields exquisitely precise measurements of disease on the handful of leaves in focus, but it means each image samples only a tiny sliver of the plot. And because disease is not spread evenly across a canopy, any single spot-level estimate can be wildly unrepresentative of the plot as a whole.</p>
<p>This is the precision–variance paradox at the heart of the study. A single high-resolution image delivers a measurement with almost no technical error, yet that measurement may carry enormous sampling error because it reflects only one small patch of foliage. The result is a paradox familiar to statisticians but often ignored by phenotyping engineers: perfect precision at the local scale can coexist with terrible reliability at the plot scale, which is the scale that actually matters for breeding decisions. A breeder comparing two wheat lines does not care about the disease level on one leaf; she cares about the average severity across an entire experimental plot, and the confidence she can place in that average.</p>
<p>To quantify this problem rigorously, the team assembled an unusually rich dataset. They acquired 16,650 high-resolution macro-scale images across 15 experimental plots over two consecutive days, photographing at multiple positions around each plot and at multiple heights within the canopy. The diseases under scrutiny were septoria tritici blotch, caused by the fungal pathogen Zymoseptoria tritici, and brown rust, caused by Puccinia species—two of the most economically important wheat diseases worldwide. Each image was analyzed to produce a spot-level estimate of disease severity, generating a dense grid of local measurements whose statistical properties could then be dissected.</p>
<p>The analysis focused on two key statistical properties of these local estimates: their distribution and their spatial dependence. Spatial autocorrelation—the tendency for nearby measurements to resemble each other more than distant ones—turns out to be the critical quantity. If two images taken a few centimeters apart provide essentially the same information, then photographing both adds far less value than photographing two widely separated spots. The researchers found that autocorrelation within a focal image stack, where multiple pictures are taken at slightly different focal depths of the same foliage, was comparable to the autocorrelation observed across different positions within a plot. In practical terms, the canopy&#8217;s disease heterogeneity operates at similar scales whether you move the camera laterally or shift its focal plane.</p>
<p>This finding yielded a concrete rule of thumb with immediate practical value. The team calculated that a stack of 10 images acquired with focus bracketing—the technique of automatically capturing a rapid burst of photos at successive focal depths and later merging them—contributed approximately 2.5 statistically independent observations. Strikingly, sampling at 10 separate positions around a plot delivered roughly the same effective sample size. In other words, a single camera station equipped with focus bracketing can substitute for a meaningful fraction of the walking effort that field technicians traditionally expend moving between positions. Because focus bracketing is automated on many modern cameras, it increases the sampled leaf area without any additional operator time, making it an unusually cheap precision gain.</p>
<p>But raw averaging of local estimates is not enough, and this is where the study makes its most sophisticated contribution. The authors modeled plot-level severity as a latent Beta-distributed variable. The Beta distribution is the natural statistical home for quantities bounded between zero and one, such as the proportion of leaf area affected by disease. By treating the true plot-level severity as a latent—meaning unobserved but inferable—parameter, and the spot-level image estimates as noisy draws from a Beta distribution centered on that parameter, the researchers could estimate both the mean disease severity and its associated uncertainty in a statistically coherent way. This hierarchical framing explicitly acknowledges that each image is a sample, not a census, and propagates sampling uncertainty into the final plot-level estimate.</p>
<p>The Beta-model results carried an important warning for anyone timing their phenotyping campaigns. The value of dense spatial sampling was not constant across the epidemic; it became particularly important at advanced stages of disease development. Early in an epidemic, when lesions are sparse and scattered, local estimates may be relatively homogeneous. But as the canopy fills with lesions and necrotic tissue, the spatial structure of disease becomes more complex and the variance among spot-level estimates grows. At these late stages, a sparse sampling strategy risks producing plot-level averages that are precise-looking but wrong, while dense sampling combined with an appropriate uncertainty model keeps the estimates honest. For breeders who often score plots near the end of an epidemic to maximize differentiation between resistant and susceptible lines, this timing effect is directly relevant.</p>
<p>The authors are careful about the limits of what their experiment can claim. With 15 plots and two days of imaging, the study was designed to characterize the correlation structure and demonstrate the modeling framework rather than to deliver definitive precision benchmarks. Obtaining a fully precise understanding of the autocorrelation structure, and an accurate quantification of exactly how much precision can be gained from any given number of repeated measures, will require larger experiments spanning more plots, more genotypes, and more epidemic scenarios. The effective sample size figures—2.5 independent observations per 10-image stack or per 10 positions—are best read as an initial calibration for this imaging configuration rather than a universal constant, since autocorrelation will inevitably vary with disease type, canopy architecture, and growth stage.</p>
<p>Even so, the practical message is clear and potentially transformative for field phenotyping. Combining dense spatial sampling with focus bracketing and hierarchical statistical models can substantially improve the precision of plot-level disease estimates without sacrificing throughput—the perennial bottleneck that has kept high-resolution imaging out of large breeding trials. The workflow requires no exotic hardware: a consumer-grade camera with a macro lens and automated focus bracketing, a disciplined multi-position sampling protocol, and an analysis pipeline that treats images as samples from a Beta-distributed latent variable rather than as independent ground truth. As breeding programs worldwide race to develop wheat varieties resilient to septoria tritici blotch and rust under shifting climates, the reliability of the severity numbers feeding those decisions becomes a first-order concern. This study shows that the gap between what a camera can see and what a breeder needs to know can be bridged—not by better lenses alone, but by better statistics applied to the images we already know how to take.</p>
<p><strong>Subject of Research:</strong> High-resolution image-based phenotyping for estimating plot-level wheat disease severity</p>
<p><strong>Article Title:</strong> A novel phenotyping approach for reconciling precision and variance in disease severity estimates from high-resolution imaging</p>
<p><strong>Article References:</strong> Zenkl, R., McDonald, B. A., &amp; Anderegg, J. (2026). A novel phenotyping approach for reconciling precision and variance in disease severity estimates from high-resolution imaging. <em>Plant Methods</em>. <a href="https://doi.org/10.1186/s13007-026-01593-8" rel="noopener noreferrer">https://doi.org/10.1186/s13007-026-01593-8</a></p>
<p><strong>Image Credits:</strong> AI Generated</p>
<p><strong>DOI:</strong> <a href="https://doi.org/10.1186/s13007-026-01593-8" rel="noopener noreferrer">10.1186/s13007-026-01593-8</a></p>
<p><strong>Keywords:</strong> field phenotyping, disease severity, septoria tritici blotch, brown rust, focus bracketing, spatial autocorrelation, Beta distribution, wheat breeding, plant pathology, image analysis, precision agriculture, statistical modeling</p>
]]></content:encoded>
					
		
		
		<post-id xmlns="com-wordpress:feed-additions:1">238344</post-id>	</item>
		<item>
		<title>KL Divergence and Tolerance Time Sharpen Detection of Shifting Data Streams</title>
		<link>https://scienmag.com/kl-divergence-and-tolerance-time-sharpen-detection-of-shifting-data-streams/</link>
		
		<dc:creator><![CDATA[Denise Maddox]]></dc:creator>
		<pubDate>Sat, 03 Oct 2026 20:00:19 +0000</pubDate>
				<category><![CDATA[Technology and Engineering]]></category>
		<category><![CDATA[adaptive drift detection models]]></category>
		<category><![CDATA[ADWIN]]></category>
		<category><![CDATA[beta distribution]]></category>
		<category><![CDATA[concept drift]]></category>
		<category><![CDATA[concept drift detection]]></category>
		<category><![CDATA[data streams]]></category>
		<category><![CDATA[drift detection]]></category>
		<category><![CDATA[evolving fraud detection]]></category>
		<category><![CDATA[information theory]]></category>
		<category><![CDATA[information theory in machine learning]]></category>
		<category><![CDATA[KL divergence]]></category>
		<category><![CDATA[KL divergence in streaming data]]></category>
		<category><![CDATA[Machine learning]]></category>
		<category><![CDATA[real-time concept drift monitoring]]></category>
		<category><![CDATA[SABeDM]]></category>
		<category><![CDATA[SABeDM beta distribution]]></category>
		<category><![CDATA[sensor network degradation]]></category>
		<category><![CDATA[SRP]]></category>
		<category><![CDATA[statistical change detection]]></category>
		<category><![CDATA[streaming classifier performance]]></category>
		<category><![CDATA[streaming data]]></category>
		<category><![CDATA[tolerance time]]></category>
		<category><![CDATA[tolerance time in data streams]]></category>
		<category><![CDATA[user preference shifts]]></category>
		<guid isPermaLink="false">https://scienmag.com/?p=231726</guid>

					<description><![CDATA[Researchers have enhanced the SABeDM concept drift detector with KL divergence and a tolerance time mechanism, achieving consistently higher accuracy and F1-scores than leading baselines across six streaming benchmarks.]]></description>
										<content:encoded><![CDATA[<p>Machine learning models deployed in the real world rarely enjoy the luxury of a stable environment. Fraud patterns evolve, sensor networks degrade, user preferences shift with the news cycle, and the statistical relationships a model learned yesterday can quietly dissolve overnight. Researchers call this phenomenon concept drift, and detecting it quickly and reliably is one of the central unsolved headaches of streaming data science. A new study published in Knowledge and Information Systems by Wenjun Bian, Angbera Ature, Chan Huah Yong, Shamsuddeen Rabiu and colleagues proposes a fresh answer: an enhanced drift detection framework that fuses a classic tool from information theory, Kullback–Leibler divergence, with a temporal safety valve the authors call tolerance time, all built on top of their earlier Sliding Adaptive Beta Distribution Model, known as SABeDM.</p>
<p>The core idea behind the original SABeDM was to track the behavior of a streaming classifier using a beta distribution, a flexible probabilistic description of error rates that lives naturally between zero and one. As data arrives, the model slides a window across the stream and adapts its distributional estimate of how well the learner is performing. When the picture of performance changes sharply, that is a signal that the underlying data distribution may have changed too. The approach already showed promise in earlier work, but like all window-based detectors it faced a familiar dilemma: windows that are too sensitive drown the system in false alarms caused by ordinary noise, while windows that are too forgiving let genuine drifts slip by unnoticed until accuracy has already collapsed.</p>
<p>The new framework attacks that dilemma from two directions at once. The first is information-theoretic. Rather than relying only on summary statistics of the error stream, the enhanced model, denoted SABeDM with a superscript kl, computes the Kullback–Leibler divergence between the probability distributions estimated from consecutive data windows. KL divergence, a foundational quantity in information theory, measures how many extra bits of information are lost, on average, when one distribution is used to approximate another. In practical terms, it gives the detector a single, principled number that quantifies how different the recent past looks from the present. Small divergences correspond to business as usual; large ones flag a genuine redistribution of the data. Because the measure compares full distributions rather than just means or variances, it can pick up both abrupt ruptures and subtle, gradual shifts that simpler statistics tend to smooth over.</p>
<p>The second innovation is temporal. The authors introduce tolerance time, a grace period that allows the detector to absorb minor delays and short-lived fluctuations without immediately declaring a drift. In a live data stream, brief disturbances are ubiquitous: a batch of noisy measurements, a temporary outage, a transient spike in traffic. A detector that reacts to every one of these burns computational resources and, worse, triggers unnecessary model retraining, which can itself degrade performance. Tolerance time introduces deliberate patience into the system, requiring that evidence of a distributional shift persist for a defined interval before an alarm is raised. The combination is elegant in its symmetry: KL divergence supplies sensitivity to real change, while tolerance time supplies immunity to phantom change.</p>
<p>To find out whether this dual mechanism actually delivers, the team evaluated the framework on six benchmark datasets spanning the standard menagerie of drift scenarios: SEA_a, SEA_g, MIXD, HYP, PHI and WET. These benchmarks are deliberately engineered to stress different failure modes, from sudden abrupt concept changes to gradual and incremental drifts, and the WET dataset adds a real-world, high-dimensional test case where clean theoretical behavior often falls apart. The proposed detector was pitted against a roster of state-of-the-art baselines that includes Streaming Random Patches (SRP), ADWIN, DDM and EDDM, methods that have anchored the drift detection literature for years and, in the case of ADWIN and DDM, remain default choices in many production pipelines.</p>
<p>The results were consistent and, in several cases, striking. On the SEA_a dataset, the enhanced SABeDM achieved an accuracy of 83.50 percent and an F1-score of 82.75 percent, compared with 73.68 percent and 73.87 percent respectively for SRP, the strongest competitor in that comparison. On the more complex PHI dataset, the framework reached 96.10 percent accuracy and a 96.15 percent F1-score, outperforming every baseline tested. Gains extended across precision and recall as well, indicating that the improvements were not an artifact of trading one error type for another but reflected a genuinely better-calibrated detector. The authors also report minimal detection latency, meaning the system tends to notice drift soon after it begins, which is critical because every example processed between the onset of drift and its detection is an example a deployed model may classify wrongly.</p>
<p>Perhaps the most persuasive evidence came from the real-world WET dataset, where the gap between theory-friendly benchmarks and messy practice usually narrows dramatically. There, the enhanced framework lifted the F1-score to 69.00 percent from 60.19 percent for SRP, a gain of nearly nine percentage points in a setting where such margins are rare. The authors attribute this robustness to the interplay of the two new components: KL divergence detects the fine-grained distributional texture of real data, while tolerance time prevents the noise inherent in real streams from overwhelming the detector. The framework also held up in high-dimensional settings, a known weak point for many statistical detectors whose assumptions strain as dimensionality grows.</p>
<p>The significance of the work extends beyond one benchmark table. Concept drift detection sits at the foundation of trustworthy machine learning in dynamic environments, from fraud monitoring and network intrusion detection to predictive maintenance and adaptive recommendation. When drift goes undetected, models fail silently, and the cost is measured in bad decisions rather than error bars. When detection is too twitchy, systems churn through retraining cycles and lose the stability that operators depend on. By grounding the detection decision in a rigorous information-theoretic quantity and pairing it with an explicit model of temporal tolerance, the new framework offers a principled middle path, one that other researchers can extend to related problems such as detecting recurrent concepts, distinguishing real from virtual drift, and handling drift in image and other complex data streams, areas the authors and a growing survey literature identify as open challenges.</p>
<p>There are, of course, caveats worth keeping in mind. The reported evaluations rest on six datasets, and the authors note that no new datasets were generated or analyzed beyond those used in the study, so independent replication on additional industrial streams will be the natural next test. The choice of tolerance time parameters will also matter in practice, since the right grace period likely depends on the application&#8217;s tolerance for delayed detection versus false alarms. Still, the direction is clear and the evidence is strong. As data streams grow faster and models are asked to learn continuously in environments that refuse to stand still, detectors that can both sense the faintest whisper of change and ignore the routine noise of the stream will only become more valuable. This study suggests that an old idea from information theory, applied inside an adaptive probabilistic window with a well-timed pause, may be exactly the combination the field has been waiting for.</p>
<p><strong>Subject of Research:</strong> Concept drift detection in data streams using KL divergence and tolerance time within sliding adaptive beta distribution models</p>
<p><strong>Article Title:</strong> Information-theoretic drift detection using KL divergence and tolerance time in Sliding Adaptive Beta Distribution Models</p>
<p><strong>Article References:</strong> Bian, W., Ature, A., Yong, C. H., &amp; Rabiu, S. (2026). Information-theoretic drift detection using KL divergence and tolerance time in Sliding Adaptive Beta Distribution Models. <em>Knowledge and Information Systems, 68</em>(1), Article 273. <a href="https://doi.org/10.1007/s10115-026-02893-0" rel="noopener noreferrer">https://doi.org/10.1007/s10115-026-02893-0</a></p>
<p><strong>Image Credits:</strong> AI Generated</p>
<p><strong>DOI:</strong> <a href="https://doi.org/10.1007/s10115-026-02893-0" rel="noopener noreferrer">10.1007/s10115-026-02893-0</a></p>
<p><strong>Keywords:</strong> concept drift, KL divergence, SABeDM, data streams, machine learning, beta distribution, tolerance time, drift detection, streaming data, information theory, ADWIN, SRP</p>
]]></content:encoded>
					
		
		
		<post-id xmlns="com-wordpress:feed-additions:1">231726</post-id>	</item>
	</channel>
</rss>
