<?xml version="1.0" encoding="UTF-8"?><rss version="2.0"
	xmlns:content="http://purl.org/rss/1.0/modules/content/"
	xmlns:wfw="http://wellformedweb.org/CommentAPI/"
	xmlns:dc="http://purl.org/dc/elements/1.1/"
	xmlns:atom="http://www.w3.org/2005/Atom"
	xmlns:sy="http://purl.org/rss/1.0/modules/syndication/"
	xmlns:slash="http://purl.org/rss/1.0/modules/slash/"
	>

<channel>
	<title>decision boundary &#8211; Science</title>
	<atom:link href="https://scienmag.com/tag/decision-boundary/feed/" rel="self" type="application/rss+xml" />
	<link>https://scienmag.com</link>
	<description></description>
	<lastBuildDate>Thu, 08 Oct 2026 01:41:20 +0000</lastBuildDate>
	<language>en-US</language>
	<sy:updatePeriod>
	hourly	</sy:updatePeriod>
	<sy:updateFrequency>
	1	</sy:updateFrequency>
	<generator>https://wordpress.org/?v=7.1.3</generator>

<image>
	<url>https://scienmag.com/wp-content/uploads/2024/07/cropped-scienmag_ico-32x32.jpg</url>
	<title>decision boundary &#8211; Science</title>
	<link>https://scienmag.com</link>
	<width>32</width>
	<height>32</height>
</image> 
<site xmlns="com-wordpress:feed-additions:1">73899611</site>	<item>
		<title>Smart Thresholds, Not Retraining: A Lighter Way to Keep IoT Defenses Sharp</title>
		<link>https://scienmag.com/smart-thresholds-not-retraining-a-lighter-way-to-keep-iot-defenses-sharp/</link>
		
		<dc:creator><![CDATA[Denise Maddox]]></dc:creator>
		<pubDate>Thu, 08 Oct 2026 01:41:20 +0000</pubDate>
				<category><![CDATA[Technology and Engineering]]></category>
		<category><![CDATA[adaptive thresholding]]></category>
		<category><![CDATA[adaptive thresholding in IoT devices]]></category>
		<category><![CDATA[anomaly detection]]></category>
		<category><![CDATA[concept drift]]></category>
		<category><![CDATA[control engineering in cybersecurity]]></category>
		<category><![CDATA[cybersecurity]]></category>
		<category><![CDATA[decision boundary]]></category>
		<category><![CDATA[distribution shift]]></category>
		<category><![CDATA[dynamic decision boundaries for IoT defenses]]></category>
		<category><![CDATA[edge computing]]></category>
		<category><![CDATA[feedback control]]></category>
		<category><![CDATA[feedback loop-based model calibration]]></category>
		<category><![CDATA[handling distribution shift in streaming data]]></category>
		<category><![CDATA[improving IoT device security without retraining]]></category>
		<category><![CDATA[Internet of Things]]></category>
		<category><![CDATA[intrusion detection]]></category>
		<category><![CDATA[IoT security]]></category>
		<category><![CDATA[lightweight cybersecurity solutions for IoT]]></category>
		<category><![CDATA[Machine learning]]></category>
		<category><![CDATA[machine learning for network anomaly detection]]></category>
		<category><![CDATA[model retraining vs. threshold adaptation]]></category>
		<category><![CDATA[online statistical analysis for intrusion detection]]></category>
		<category><![CDATA[real-time network traffic analysis]]></category>
		<category><![CDATA[streaming data]]></category>
		<guid isPermaLink="false">https://scienmag.com/?p=246042</guid>

					<description><![CDATA[Researchers have developed a feedback-guided framework that adapts decision thresholds instead of retraining classifiers, achieving near-equal accuracy with lower false positives, greater stability, and reduced computational cost for streaming IoT intrusion detection.]]></description>
										<content:encoded><![CDATA[<p>Every smart thermostat, industrial sensor, and connected camera in the Internet of Things is a potential doorway for attackers, and the machine-learning models guarding those doorways face a stubborn problem: network traffic never stops changing. A detector trained last month may be quietly mis-calibrated this month as devices join the network, firmware updates shift traffic patterns, and attackers evolve their tactics. The conventional responses—leaving the model frozen or retraining it continuously—each carry a cost. A new study published in Discover Artificial Intelligence proposes a third path: keep the classifier fixed and let the decision boundary itself adapt, using a feedback loop borrowed in spirit from control engineering.</p>
<p>The research, led by Hung-Cuong Nguyen of Hung Vuong University and colleagues at Le Quy Don Technical University and Thai Nguyen University of Information and Communication Technology, addresses what the authors call distribution shift in streaming intrusion detection. Their framework operates on two distinct timescales. At the fast timescale, every incoming network sample is scored using online statistical estimates of feature means and variances, updated through exponential moving averages after each prediction. At the slower timescale, two families of interpretable threshold states—feature-specific abnormality thresholds and a global abnormality gate—are updated only once per non-overlapping batch of 200 samples, using batch-averaged predictive uncertainty and a bounded drift-intensity signal.</p>
<p>The mechanics are deliberately simple. For each of four monitored numerical features, the system computes a Z-score against pre-update statistics, ensuring that a sample never normalizes itself before being judged. A feature is flagged as abnormal when its standardized score exceeds that feature&#8217;s current threshold, and the proportion of flagged features forms an abnormality ratio. If that ratio crosses the global gate threshold, the sample is diverted away from the classifier entirely and treated as suspicious. Everything else flows through a lightweight Random Forest that was trained during an initial warm-up phase and never touched again during streaming operation.</p>
<p>What makes the thresholds move is a feedback law with two opposing forces. Predictive uncertainty, measured as the normalized entropy of the classifier&#8217;s output, pushes thresholds upward: when the model is confused, the gate becomes less sensitive, preventing ambiguous traffic from triggering excessive alarms. Drift intensity, estimated by comparing a recent window of 100 abnormality ratios against a non-overlapping reference window of 300 through a Hoeffding-type tolerance, pushes thresholds downward: when the traffic distribution genuinely departs from its reference state, sensitivity increases. Both signals are clipped to the interval from zero to one, and the resulting threshold updates are themselves clipped to fixed bounds, so the maximum unconstrained one-batch change is 0.025 for a feature threshold and 0.006 for the global gate.</p>
<p>The authors are careful about what this boundedness does and does not prove. The mathematical analysis establishes that threshold states and their one-step changes remain finite, but it explicitly does not establish convergence to an optimal boundary, closed-loop stability in a formal control-theoretic sense, or robustness against an adversary who deliberately manipulates the feedback sequence. In fact, the paper identifies a genuine security limitation: sustained traffic that repeatedly produces high uncertainty without a strong distribution-change signal can drive the detector toward a less sensitive operating point until clipping intervenes. The team treats this desensitization risk as an honest caveat rather than glossing over it.</p>
<p>The experimental evaluation is unusually thorough for this class of work. The framework was tested on three public IoT intrusion-detection benchmarks—RT-IoT2022, IoTID20, and CICIoT2023—with 46,000 streaming observations per dataset processed as 230 batches, repeated across five random seeds for a total of fifteen paired runs per comparison. Against Adaptive Random Forest, the strongest baseline representing continuous model-level adaptation, the proposed method scored an overall F1 of 0.9387 versus 0.9407. That small accuracy gap of roughly 0.21 percentage points was statistically detectable, and the authors decline to claim equivalence. What the fixed-classifier approach bought instead was a lower false-positive rate of 0.0312 versus 0.0349, a 24.5 percent reduction in temporal F1 variance, and a total processing cost of 2.79 milliseconds per sample versus 4.15—a 32.7 percent reduction overall and a 64.7 percent reduction in update time.</p>
<p>Perhaps the most striking result comes from the leave-one-attack-family-out evaluation, where entire attack categories—grouped DDoS for RT-IoT2022, Mirai for IoTID20, and Spoofing for CICIoT2023—were withheld from training entirely. Here the adaptive abnormality gate achieved an F1 of 0.800 with a false-positive rate of 0.031, outperforming fixed statistical baselines such as rolling Z-score rules, median absolute deviation, and interquartile-range detectors. This matters because conventional closed-set classifiers can only assign labels they saw during training, whereas new IoT attack families emerge constantly. The gate reframes the problem: rather than forcing unknown traffic into predefined categories, it simply asks whether a sample deviates from learned statistical patterns, with sensitivity that adjusts as the stream evolves.</p>
<p>A controlled-stream analysis added a stress-test dimension, imposing a predefined distribution shift at batch 120 and tracking how each method responded. The proposed method&#8217;s threshold trajectories revealed smooth, bounded evolution driven by the uncertainty component of the feedback loop, and a criterion-based recovery measure quantified how many batches were needed for F1 to return to at least 95 percent of its pre-shift level. An ablation study disentangled the contributions of the adaptive gate, the adaptive feature thresholds, and the drift signal, showing that the full configuration achieved the best combination of F1, false-positive control, and temporal stability, while no single component dominated every metric. A sensitivity analysis over a grid of feedback coefficients confirmed that the nominal settings represent a stability-oriented operating point rather than a universally optimal choice.</p>
<p>The authors frame their contribution not as a replacement for model adaptation but as a distinct operating point in an accuracy–stability–efficiency trade-off. For resource-constrained edge devices, where GPU acceleration is unavailable and every millisecond counts, a detector that sacrifices a sliver of peak accuracy in exchange for fewer false alarms, smoother behavior over time, and dramatically lower update cost may be exactly the right bargain. The explicit threshold states also offer a form of operational transparency: an operator can inspect how gate sensitivity evolves and, when the drift detector remains silent, know that observed threshold movement is attributable to uncertainty alone. The team acknowledges the limits of this transparency—it is not causal feature explanation—and points toward future work on feature-specific feedback controllers, hybrid schemes that trigger selective model updating under sustained change, and explicit adversarial evaluation. For now, the study offers a compelling demonstration that sometimes the smartest way to adapt a defender is not to rebuild it, but to nudge the line it draws.</p>
<p><strong>Subject of Research:</strong> Feedback-guided decision-boundary adaptation for stable streaming intrusion detection in Internet of Things networks under distribution shift</p>
<p><strong>Article Title:</strong> Feedback guided decision boundary adaptation for stable IoT intrusion detection under distribution shift</p>
<p><strong>Article References:</strong> Nguyen, H.-C., Ta, T. M., Dao, N.-T., Nguyen, Q.-H., &amp; Phung, T.-N. (2026). Feedback guided decision boundary adaptation for stable IoT intrusion detection under distribution shift. <em>Discover Artificial Intelligence, 6</em>(1), Article 1394. <a href="https://doi.org/10.1007/s44163-026-02370-1" rel="noopener noreferrer">https://doi.org/10.1007/s44163-026-02370-1</a></p>
<p><strong>Image Credits:</strong> AI Generated</p>
<p><strong>DOI:</strong> <a href="https://doi.org/10.1007/s44163-026-02370-1" rel="noopener noreferrer">10.1007/s44163-026-02370-1</a></p>
<p><strong>Keywords:</strong> Internet of Things, intrusion detection, distribution shift, concept drift, adaptive thresholding, decision boundary, feedback control, machine learning, streaming data, anomaly detection, cybersecurity, edge computing</p>
]]></content:encoded>
					
		
		
		<post-id xmlns="com-wordpress:feed-additions:1">246042</post-id>	</item>
		<item>
		<title>AI Learns to Draw Decision Boundaries as Readable Equations</title>
		<link>https://scienmag.com/ai-learns-to-draw-decision-boundaries-as-readable-equations/</link>
		
		<dc:creator><![CDATA[Denise Maddox]]></dc:creator>
		<pubDate>Sat, 12 Sep 2026 15:32:40 +0000</pubDate>
				<category><![CDATA[Technology and Engineering]]></category>
		<category><![CDATA[AI transparency and explainability]]></category>
		<category><![CDATA[automated equation discovery for data classification]]></category>
		<category><![CDATA[beam search]]></category>
		<category><![CDATA[binary classification]]></category>
		<category><![CDATA[classification models with analytical formulas]]></category>
		<category><![CDATA[context-free grammar]]></category>
		<category><![CDATA[decision boundary]]></category>
		<category><![CDATA[decision boundary equations in AI]]></category>
		<category><![CDATA[decision tree simplification]]></category>
		<category><![CDATA[Equation]]></category>
		<category><![CDATA[equation discovery]]></category>
		<category><![CDATA[equation discovery in machine learning]]></category>
		<category><![CDATA[explainable AI]]></category>
		<category><![CDATA[human-readable machine learning models]]></category>
		<category><![CDATA[interpretable machine learning]]></category>
		<category><![CDATA[interpretable neural networks]]></category>
		<category><![CDATA[Machine learning]]></category>
		<category><![CDATA[machine learning model interpretability]]></category>
		<category><![CDATA[readable mathematical models in AI]]></category>
		<category><![CDATA[symbolic classification]]></category>
		<category><![CDATA[symbolic regression]]></category>
		<category><![CDATA[symbolic regression for classification]]></category>
		<category><![CDATA[transparent AI decision-making]]></category>
		<category><![CDATA[UCI datasets]]></category>
		<guid isPermaLink="false">https://scienmag.com/?p=195947</guid>

					<description><![CDATA[Researchers at Leiden University have developed EDC, a framework that discovers single readable equations defining decision boundaries, rivaling black-box classifiers while remaining fully interpretable.]]></description>
										<content:encoded><![CDATA[<p>Machine learning models are famous for their uncanny accuracy and infamous for their opacity. A random forest or a neural network can sift through thousands of patient records, financial transactions, or sensor readings and deliver a verdict in milliseconds, but when practitioners ask why the model reached its conclusion, the answer is usually buried in millions of weighted connections or hundreds of tangled decision trees. A new study published in the journal Machine Learning challenges this trade-off between power and transparency, introducing a framework that discovers a single, human-readable equation whose sign alone tells you which class a data point belongs to.</p>
<p>The method, called Equation Discovery for Classification, or EDC, was developed by Guus Toussaint and Arno Knobbe of Leiden University. It extends a research tradition that has long flourished in regression: symbolic regression, the automated search for analytical formulas that fit numerical data. Theauthors of the study point out that equation discovery has historically been applied almost exclusively to problems where the target is a continuous number, such as recovering physical laws like the relationship between the pressure, volume, and temperature of a gas. Their contribution is to redirect that machinery toward binary classification, where the goal is to separate two classes cleanly and explainably.</p>
<p>The core idea is elegantly simple in concept. Rather than learning an opaque scoring function, EDC searches for a concise mathematical expression f(x) and a threshold theta, such that a data point is assigned to the positive class whenever f(x) meets or exceeds theta. For a linear equation, this is essentially the geometry underlying logistic regression or a linear support vector machine: a hyperplane slicing the feature space into two halves. What sets EDC apart is that the search is not confined to straight lines. By allowing nonlinear building blocks such as products of features and exponential terms, the algorithm can trace curved, interaction-driven boundaries while still producing an expression short enough for a domain expert to read, critique, and even correct by hand.</p>
<p>Technically, the framework rests on two pillars: a structured search and a dedicated numerical optimizer. The search space of candidate equations is defined by a configurable context-free grammar, a design choice inherited from classic work on declarative bias in equation discovery. The grammar constrains equations to sums of simple summands, including linear terms, products of two features, and exponential expressions, each parameterized by constants. Crucially, the grammar is redundancy-aware: constructions that would produce syntactically different but semantically identical equations are pruned in advance, since, for example, subtraction between summands is unnecessary when a constant coefficient can simply be negative. Traversing this space exhaustively is impossible for all but the smallest problems, so the algorithm employs beam search, iteratively refining the most promising candidate equations level by level while keeping only a fixed number of survivors at each stage.</p>
<p>Fitting the constants inside each candidate equation proved surprisingly subtle. Although every equation in the grammar is differentiable, gradient descent performed poorly in practice, largely because of the exponential terms that pepper the search space. The authors instead adopted a tailored hill-climbing procedure that first samples a large pool of random constant configurations, then concentrates its remaining budget on refining the best ones. In a systematic comparison against off-the-shelf optimizers from the SciPy library, including Powell, Cobyqa, Cobyla, Nelder-Mead, and stochastic gradient descent, this hill climber achieved the highest mean area under the ROC curve across one hundred randomly generated test problems. Perhaps most strikingly, a simple random-sampling baseline already reached a mean AUC of 0.9974 with a budget of one thousand evaluations, revealing that the inner optimization problem is more tractable than one might fear.</p>
<p>The experiments on synthetic data produced one of the study&#8217;s most intriguing findings. When Gaussian noise was injected into datasets whose generating decision boundaries were known, EDC did not merely match the original boundary; beyond a certain noise level it outperformed it. The explanation is a phenomenon the authors describe carefully: noise pushes data points near a curved boundary across it, and concave sections of that boundary collect more stray points than they lose, causing the effective boundary embedded in the data to drift away from its original position and gradually straighten. EDC, fitting the data rather than the hidden formula, tracks this shifted, smoothed boundary, achieving higher AUC than the very equation that generated the data. As noise grew from negligible to substantial across seventeen hundred artificial datasets, even a restricted linear version of EDC eventually beat the original nonlinear boundary.</p>
<p>The framework also proved capable of reconstructing notoriously difficult structures, including XOR-like and interaction-driven boundaries, and of fitting data produced by Gaussian clusters where no explicit target equation exists at all. On these cluster-based problems, which the authors describe as closest to real-world conditions among their artificial experiments, EDC outperformed existing symbolic classification approaches while landing near state-of-the-art black-box methods such as random forests, multi-layer perceptrons, and radial-basis-function support vector machines, all of which posted mean AUC values around 0.97.</p>
<p>Real-world benchmarks reinforced the pattern. Across nine binary classification datasets from the UCI repository, spanning tasks from banknote authentication to income prediction, EDC achieved a higher AUC than every competing equation-discovery-based classifier on every dataset, and beat simple decision trees across the board. A critical distance analysis showed that random forests, neural networks, and SVMs did not statistically significantly outperform EDC, even though those black-box methods won on several datasets, particularly ionosphere and sonar, where feature-class relationships appear to lie outside EDC&#8217;s current set of building blocks. On the Adult income dataset, the discovered equation offered a vivid demonstration of interpretability in action: one term acted as a penalty on years of education only when the individual appeared as a child in the household, while an exponential term over marital status effectively functioned as an if-else statement, adding roughly 28,586 to the score for married individuals living with a spouse and a negligible 8 otherwise.</p>
<p>The method&#8217;s main weakness is computational cost. In its default configuration, with a search depth of six and a beam width of ten, EDC takes dramatically longer than the sub-second runtimes of conventional classifiers, largely because pairwise interaction terms grow quadratically with the number of features and because one-hot encoding of categorical variables inflates the feature count. The authors show, however, that the expense is largely optional. Restricting the search depth, narrowing the beam, or replacing interaction terms with simple quadratic terms produced speed-ups of up to a factor of fifty at only a marginal loss of accuracy, with no statistically significant difference in performance across the benchmark suite. The authors also note that the framework is not limited to two classes: standard one-versus-rest schemes can extend EDC to multi-class problems, with each of the resulting equations explaining when a particular class label prevails.</p>
<p>The work arrives amid a broader movement toward explainable machine learning, driven by domains such as medicine, finance, and criminal justice where decisions carry real consequences and regulators increasingly demand justification. EDC offers a principled bridge between symbolic regression and classification, delivering models that are simultaneously compact, expressive, and auditable. While it may not dethrone random forests or deep networks on raw accuracy, it demonstrates that the gap is small enough, and the interpretability dividend large enough, that equations once again deserve a seat at the machine learning table. The authors have released their code, experimental setup, and datasets openly so that the entire study can be reproduced and the grammar extended by practitioners in new domains.</p>
<p><strong>Subject of Research:</strong> Equation discovery for binary classification using interpretable symbolic decision boundaries</p>
<p><strong>Article Title:</strong> Equation Discovery for Classification: Finding Interpretable Symbolic Specifications of the Decision Boundary</p>
<p><strong>Article References:</strong> Toussaint, G., &amp; Knobbe, A. (2026). Equation Discovery for Classification: Finding Interpretable Symbolic Specifications of the Decision Boundary. <em>Machine Learning, 115</em>(9), Article 215. <a href="https://doi.org/10.1007/s10994-026-07156-1" rel="noopener noreferrer">https://doi.org/10.1007/s10994-026-07156-1</a></p>
<p><strong>Image Credits:</strong> AI Generated</p>
<p><strong>DOI:</strong> <a href="https://doi.org/10.1007/s10994-026-07156-1" rel="noopener noreferrer">10.1007/s10994-026-07156-1</a></p>
<p><strong>Keywords:</strong> equation discovery, binary classification, symbolic regression, decision boundary, interpretable machine learning, beam search, symbolic classification, explainable AI, context-free grammar, UCI datasets, machine learning, Equation</p>
]]></content:encoded>
					
		
		
		<post-id xmlns="com-wordpress:feed-additions:1">195947</post-id>	</item>
	</channel>
</rss>
