<?xml version="1.0" encoding="UTF-8"?><rss version="2.0"
	xmlns:content="http://purl.org/rss/1.0/modules/content/"
	xmlns:wfw="http://wellformedweb.org/CommentAPI/"
	xmlns:dc="http://purl.org/dc/elements/1.1/"
	xmlns:atom="http://www.w3.org/2005/Atom"
	xmlns:sy="http://purl.org/rss/1.0/modules/syndication/"
	xmlns:slash="http://purl.org/rss/1.0/modules/slash/"
	>

<channel>
	<title>deep neural networks &#8211; Science</title>
	<atom:link href="https://scienmag.com/tag/deep-neural-networks/feed/" rel="self" type="application/rss+xml" />
	<link>https://scienmag.com</link>
	<description></description>
	<lastBuildDate>Tue, 20 Oct 2026 19:07:16 +0000</lastBuildDate>
	<language>en-US</language>
	<sy:updatePeriod>
	hourly	</sy:updatePeriod>
	<sy:updateFrequency>
	1	</sy:updateFrequency>
	<generator>https://wordpress.org/?v=7.1.3</generator>

<image>
	<url>https://scienmag.com/wp-content/uploads/2024/07/cropped-scienmag_ico-32x32.jpg</url>
	<title>deep neural networks &#8211; Science</title>
	<link>https://scienmag.com</link>
	<width>32</width>
	<height>32</height>
</image> 
<site xmlns="com-wordpress:feed-additions:1">73899611</site>	<item>
		<title>Deep learning-based predictions and analysis of Norovirus dynamics using a fractional-order mathematical model</title>
		<link>https://scienmag.com/deep-learning-based-predictions-and-analysis-of-norovirus-dynamics-using-a-fractional-order-mathematical-model/</link>
		
		<dc:creator><![CDATA[Kristina Jarvis]]></dc:creator>
		<pubDate>Tue, 20 Oct 2026 19:07:16 +0000</pubDate>
				<category><![CDATA[Science News]]></category>
		<category><![CDATA[Caputo–Fabrizio fractional derivatives in epidemiology]]></category>
		<category><![CDATA[compartmental model]]></category>
		<category><![CDATA[compartmental models of viral infections]]></category>
		<category><![CDATA[computational approaches to norovirus outbreak prediction]]></category>
		<category><![CDATA[Deep]]></category>
		<category><![CDATA[deep neural networks]]></category>
		<category><![CDATA[deep neural networks for disease prediction]]></category>
		<category><![CDATA[disease-free equilibrium]]></category>
		<category><![CDATA[epidemic modeling]]></category>
		<category><![CDATA[fractional-order mathematical epidemiology]]></category>
		<category><![CDATA[fractional-order model]]></category>
		<category><![CDATA[impact of vaccination coverage on infection prevalence]]></category>
		<category><![CDATA[learning-based]]></category>
		<category><![CDATA[mathematical analysis of disease-free equilibrium]]></category>
		<category><![CDATA[memory effects in infectious disease dynamics]]></category>
		<category><![CDATA[nonlocal effects in disease transmission modeling]]></category>
		<category><![CDATA[norovirus]]></category>
		<category><![CDATA[Norovirus transmission modeling]]></category>
		<category><![CDATA[numerical simulation]]></category>
		<category><![CDATA[predictions]]></category>
		<category><![CDATA[stability analysis of infectious disease models]]></category>
		<category><![CDATA[treatment effectiveness]]></category>
		<category><![CDATA[vaccination]]></category>
		<category><![CDATA[vaccine efficacy and waning immunity]]></category>
		<guid isPermaLink="false">https://scienmag.com/?p=320900</guid>

					<description><![CDATA[A computational modeling study found that lower fractional orders increased disease-free equilibrium stability and that higher vaccination coverage and treatment effectiveness reduced predicted norovirus infection prevalence.]]></description>
										<content:encoded><![CDATA[<p>A computational study combining a fractional-order compartmental model with deep neural networks found that lower fractional orders were associated with greater stability of the model’s disease-free equilibrium, while higher vaccination coverage and treatment effectiveness produced lower predicted infection prevalence. The study examined norovirus transmission as a mathematical system rather than analyzing infections observed in a patient population.</p>
<p>The model divides the population into five epidemiological compartments: susceptible, exposed, infected, vaccinated and recovered individuals. Susceptible people enter the population at a constant recruitment rate and may become vaccinated, while protection from vaccination is represented by vaccine efficacy and may decline over time. Exposed individuals progress to the infectious compartment, and infected people either recover or experience disease-induced mortality. Natural mortality applies across the model’s compartments, and recovered individuals are assumed to have immunity against reinfection.</p>
<p>The authors replaced the classical first-order time derivatives with a Caputo–Fabrizio fractional derivative. In the mathematical formulation, this non-integer-order approach was intended to represent memory and nonlocal effects in disease transmission. The model included transmission, vaccination, waning vaccine protection, progression from exposure to infection, recovery, disease-related mortality and natural mortality as parameters affecting its predicted trajectories.</p>
<p>Fixed-point results were used to investigate whether the fractional-order model has solutions and whether those solutions are unique under specified mathematical assumptions. The existence analysis used Krasnoselskii’s fixed-point theorem, while additional contraction arguments were applied to establish uniqueness under stated conditions. The researchers also derived Ulam–Hyers stability results. These were properties of the mathematical formulation under its assumptions, not empirical observations of norovirus outbreaks.</p>
<p>For numerical simulation, the team implemented a three-step Adams–Bashforth scheme in MATLAB. Simulations were performed at different fractional orders and with varying transmission-related parameters. The reported mathematical findings indicated that the stability of the disease-free equilibrium increased as the fractional order decreased. The simulations also predicted that broad vaccination coverage and improved treatment effectiveness would substantially reduce infection prevalence. These are modeled effects rather than estimates of benefit from a vaccination or treatment program evaluated in people.</p>
<p>A feedforward deep neural network was then used to approximate the model’s five compartment trajectories over time. The network received time as its input and produced outputs for the susceptible, vaccinated, exposed, infected and recovered compartments. Its loss function incorporated the differential-equation residuals and initial conditions, allowing training without supplying an exact solution. Automatic differentiation calculated derivatives of network outputs, and the Adam optimizer was used with a reported learning rate of 10−2.</p>
<p>The network used a proposed activation function called NGNDG-AF, intended to provide nonlinear behavior while remaining smooth and responsive to small negative inputs. Models for the five compartments were trained over 1,000 epochs, and the authors applied Bayesian regularization to reduce residual error and select weights. Reported regression coefficients for the compartment-specific analyses were approximately one. The neural-network trajectories closely overlapped the corresponding fractional-order numerical solutions in the paper’s comparisons.</p>
<p>The reported mean squared errors differed among compartment and scenario combinations. Best values for the susceptible-compartment scenarios ranged from 543.8996 to 740.3281, while those for the infected-compartment scenarios ranged from 16.2253 to 45.1371. All reported networks completed 1,000 epochs without validation checks triggering early stopping, and the optimization diagnostics included finite parameter norms and sums of squared parameters. These results support the authors’ assessment that the trained networks approximated the numerical model under the tested configurations.</p>
<p>The study is limited by its reliance on mathematical simulations, selected parameter values and comparisons between computational solutions rather than validation against a documented norovirus outbreak dataset. The deep learning component acts as an approximation method for the fractional-order equations; it does not independently establish predictive performance in clinical or public-health settings. The authors proposed extending the modeling framework to spatial dynamics, stochastic effects and machine-learning-based parameter estimation, but those extensions were not evaluated in the reported work.</p>
<p><strong>Subject of Research:</strong> Fractional-order norovirus transmission modeling and neural-network approximation</p>
<p><strong>Article Title:</strong> Deep learning-based predictions and analysis of Norovirus dynamics using a fractional-order mathematical model</p>
<p><strong>Article References:</strong> Rehman, B., &amp; Ali, A. (2026). Deep learning-based predictions and analysis of Norovirus dynamics using a fractional-order mathematical model. <em>PLOS One, 21</em>(10), e0359983. <a href="https://doi.org/10.1371/journal.pone.0359983" rel="noopener noreferrer">https://doi.org/10.1371/journal.pone.0359983</a></p>
<p><strong>Image Credits:</strong> AI Generated</p>
<p><strong>DOI:</strong> <a href="https://doi.org/10.1371/journal.pone.0359983" rel="noopener noreferrer">10.1371/journal.pone.0359983</a></p>
<p><strong>Keywords:</strong> norovirus, fractional-order model, deep neural networks, epidemic modeling, compartmental model, numerical simulation, disease-free equilibrium, vaccination, treatment effectiveness, Deep, learning-based, predictions</p>
]]></content:encoded>
					
		
		
		<post-id xmlns="com-wordpress:feed-additions:1">320900</post-id>	</item>
		<item>
		<title>Pulvinar pathways as skip connections in deep neural networks for vision</title>
		<link>https://scienmag.com/pulvinar-pathways-as-skip-connections-in-deep-neural-networks-for-vision/</link>
		
		<dc:creator><![CDATA[Cassandra Pierce]]></dc:creator>
		<pubDate>Fri, 16 Oct 2026 13:41:50 +0000</pubDate>
				<category><![CDATA[Medicine]]></category>
		<category><![CDATA[Science News]]></category>
		<category><![CDATA[biological inspiration for artificial intelligence]]></category>
		<category><![CDATA[brain-inspired deep learning]]></category>
		<category><![CDATA[connections]]></category>
		<category><![CDATA[decision criterion]]></category>
		<category><![CDATA[Deep]]></category>
		<category><![CDATA[deep neural network architecture]]></category>
		<category><![CDATA[deep neural networks]]></category>
		<category><![CDATA[gain control]]></category>
		<category><![CDATA[neural basis of vision processing]]></category>
		<category><![CDATA[neural mechanisms of motion detection]]></category>
		<category><![CDATA[pathways]]></category>
		<category><![CDATA[pulvinar]]></category>
		<category><![CDATA[pulvinar as gain controller]]></category>
		<category><![CDATA[Pulvinar pathways in neural networks]]></category>
		<category><![CDATA[receptive-field properties in neural models]]></category>
		<category><![CDATA[signal detection theory]]></category>
		<category><![CDATA[skip]]></category>
		<category><![CDATA[skip connections]]></category>
		<category><![CDATA[skip connections in deep learning]]></category>
		<category><![CDATA[thalamic architecture in AI]]></category>
		<category><![CDATA[thalamic role in decision making]]></category>
		<category><![CDATA[transthalamic pathways]]></category>
		<category><![CDATA[visual cortical hierarchy]]></category>
		<category><![CDATA[visual neuroscience]]></category>
		<guid isPermaLink="false">https://scienmag.com/?p=285434</guid>

					<description><![CDATA[A biologically inspired pulvinar-like skip pathway in a convolutional vision model acts primarily as a gain controller and decision-criterion regulator rather than an accuracy booster, according to new research from the Université de Montréal.]]></description>
										<content:encoded><![CDATA[<p>Deep inside the brain&#8217;s visual system sits a structure that has long puzzled neuroscientists: the pulvinar, the largest nucleus of the human thalamus. For decades it was treated as a passive relay station, a kind of biological switchboard shuffling signals between the eyes and the cortex. Modern anatomy tells a very different story. The pulvinar receives dense, reciprocal projections from nearly every level of the visual cortical hierarchy, and its neurons show receptive-field properties comparable to those of cortical cells, including selectivity for orientation, motion direction, and global motion patterns. Now, a team at the Visual Neuroscience Laboratory of the Université de Montréal has asked a strikingly modern question: what happens computationally if you transplant this thalamic architecture into an artificial neural network? Their answer, published in Frontiers in Neuroimaging, suggests that the pulvinar is not an accuracy booster at all, but a gain controller and decision-criterion regulator, a finding that could reshape how we think about both brains and machines.</p>
<p>Narmin Zarinabadi, Christian Casanova, and Nelson Cortes built their model around an analogy that is as elegant as it is technically precise. In deep learning, skip connections allow early feature representations to directly influence deeper processing stages, improving signal propagation and stabilizing hierarchical computations. The pulvinar, as a higher-order thalamic nucleus, participates in cortico-thalamo-cortical loops that link distant cortical regions while bypassing long chains of intermediate cortical processing. The researchers formalized this correspondence by adding a long-range skip pathway to a hierarchical convolutional vision model: a learned projection from early to late feature maps, coupled with a gain-controlled gating mechanism inspired by squeeze-and-excitation designs. The pathway receives a pooled copy of activity from a mid-level, V1-like cortical layer, transforms it through a cortico-pulvinar projection, and feeds a modulatory signal back to a higher, decision-related layer, where it is combined with cortical activity through a learned fusion parameter alpha.</p>
<p>The technical details matter because they separate this mechanism from generic attention. The projected signal passes through a PulvinarGate that computes a channel-wise gating vector between zero and one, dynamically scaling the strength of the thalamic feedback based on a compressed summary of early cortical activity. When gating is disabled, the gain is fixed to unity, yielding a non-modulatory skip connection. To test whether the observed effects were specific to this pulvino-cortical design, the team implemented two controls: a squeeze-and-excitation model that applies channel-wise modulation locally within a single layer, and a projection-only skip model that preserves the structural pathway but removes all modulatory components, including the gain gate and the learned fusion parameter. This control architecture allowed the researchers to dissociate the effects of long-range information routing from those of dynamic gain modulation.</p>
<p>The first experiment used CIFAR-10, the standard benchmark of 60,000 tiny images across ten classes, to compare a purely cortical baseline with the pulvinar-augmented network. The results delivered a surprise. The pulvinar model produced only a small but statistically reliable improvement in classification accuracy, from 87.47 percent to 88.22 percent, with a moderate effect size below one on Cohen&#8217;s d. But the effects on internal representations were enormous. The gain linearity index, which measures how consistently feature magnitude scales with stimulus contrast, swung from a strongly negative value in the baseline to a robustly positive one in the pulvinar model, with an effect size of nearly 64. Representational invariance, measured as the preservation of feature-vector direction across contrast changes, rose from 0.813 to 0.991. In plain terms, the pulvinar pathway did not make the network dramatically smarter; it made its internal signals dramatically better scaled and stabilized.</p>
<p>The team then ran a controlled architectural comparison under strictly matched optimization settings, training the cortical baseline, the squeeze-and-excitation control, the projection-only skip control, and the pulvinar model with identical hyperparameters, data augmentation, and loss formulations. They also restricted comparisons to overlapping regions of the representational space defined by the invariance and gain-linearity metrics, ensuring that all models were evaluated under comparable representational conditions. Even within this matched regime, only the pulvino-cortical model translated the controlled representational profile into a systematic accuracy improvement. The baseline, simple skip, and squeeze-and-excitation models reached comparable representational values but failed to achieve the same performance. The advantage, the authors conclude, cannot be explained by optimization, generic attention, or the mere addition of a parallel pathway; it reflects a distinct interaction between long-range routing and gain modulation.</p>
<p>The second experiment probed the same architecture under sensory uncertainty. Synthetic grayscale stimuli consisted of a noisy background with a 1/f noise spectrum and, on target-present trials, a faint circular target whose contrast ranged from 0.005 to 4 percent. Target radius and background noise amplitude were systematically varied, with 1,000 stimuli generated per configuration and balanced target-present and target-absent trials. Both models were trained from scratch on identical stimuli to mimic a naive observer, and pulvinar-specific regularization terms were removed so that any observed effects would reflect the intrinsic properties of the transthalamic pathway rather than task-specific training objectives. From the full confusion matrices, the researchers computed accuracy, sensitivity, decision criterion, and false alarm rate within the framework of signal detection theory.</p>
<p>Once again, the pulvinar pathway refused to behave as a uniform enhancer. Under low background noise, both architectures performed near chance, with accuracies around 55 to 59 percent, and the pulvinar model showed only mild redistributions of detection outcomes. Under high noise with small targets, both models achieved similar accuracies near 87 to 88 percent. But in the most demanding condition, high background noise combined with large stimulus radius, the pulvinar-cortical model exhibited a significant increase in sensitivity, the signal detection measure of genuine discriminability, despite only a modest difference in overall accuracy. Crucially, this gain in sensitivity was accompanied by both increased hit rates and reduced false alarms, indicating an improvement in discriminability that cannot be attributed to a liberal shift in decision criterion. The authors suggest that pulvinar-like modulation enhances perceptual sensitivity only when global stimulus integration is required to stabilize perceptual decisions under noise.</p>
<p>Across the full stimulus space, the most prominent effect was a systematic, condition-dependent redistribution of decision outcomes rather than a uniform gain in sensitivity. In the near-threshold quadrant of small stimuli under low noise, the pulvinar model showed a selective increase in false alarms and false positives, consistent with a localized liberal shift in decision criterion under weak sensory evidence. In contrast, under conditions demanding large-scale spatial integration, the dominant effect was an increase in false negatives, indicating impaired discriminability when integration demands were high but noise was low. When responses were pooled across all conditions, the pulvinar model showed a modest but significant reduction in hit rate and sensitivity together with an increase in false negatives, while false alarm rates did not increase at the global level. The pulvinar pathway, in other words, modulates the balance between signal and noise in a stimulus-dependent manner rather than inducing indiscriminate false percepts.</p>
<p>The internal network dynamics told the same story from the inside. The researchers analyzed stimulus-evoked activity across three layers serving as functional analogs of a hierarchical visual-decision pathway: an early V1-like layer, an intermediate V4-like layer, and a late, decision-related PFC-like layer. Early and intermediate layers showed modest or minimal separation between hit and miss trials, and were similar across architectures. The strongest divergence emerged at the decision-related layer. In the cortical-only model, activity there was predominantly negative and weakly differentiated between hits and misses. In the pulvinar-cortical model, the same layer showed positive activity for hits and near-baseline activity for misses, producing a large positive hit-miss separation across noise conditions. Pulvinar-like input, the authors conclude, primarily reshapes late-stage decision-related representations, biasing them toward stable, decision-consistent activity states.</p>
<p>These findings carry implications that reach well beyond the benchmark scores. The authors propose that the pulvinar regulates how sensory evidence is weighted and converted into decisions, rather than directly enhancing task accuracy, a view consistent with predictive coding accounts in which the thalamus implements precision or gain control within cortical hierarchies. The work also connects to recent large-scale adversarial tests of consciousness theories, which indicate that prefrontal signatures associated with conscious access predominantly reflect late, task-dependent decision states rather than enhanced sensory encoding. Within this framework, the pulvinar emerges as a precision-gating structure that modulates effective connectivity across cortical levels, facilitating cortical ignition, the transition from localized sensory processing to distributed, decision-relevant cortical states, by shaping when weak or ambiguous evidence engages late-stage cortical dynamics. The authors argue that the mechanism is fundamentally distinct from standard attention modules, which reweight feature channels within a given layer; the pulvinar-inspired pathway instead modulates the effective strength of a fixed, long-range communication pathway based on a compressed summary of early activity. The study generates testable predictions: pulvinar perturbations should primarily affect gain regulation and decision criteria, with minimal impact on early sensory encoding, and effects should be strongest under uncertainty or when spatial integration is required. For neuroscientists, the work offers a computational blueprint for transthalamic gain control. For machine learning researchers, it suggests that the next generation of skip connections may need to be modulatory, gain-controlled, and biologically grounded, routing information not merely to shortcut hierarchical processing, but to regulate how representations are used to guide downstream decisions.</p>
<p><strong>Subject of Research:</strong> Neuroscience</p>
<p><strong>Article Title:</strong> Pulvinar pathways as skip connections in deep neural networks for vision</p>
<p><strong>Article References:</strong> Zarinabadi, N., Casanova, C., &amp; Cortes, N. (2026). Pulvinar pathways as skip connections in deep neural networks for vision. <em>Frontiers in Neuroimaging, 5</em>, Article 1800369. <a href="https://doi.org/10.3389/fnimg.2026.1800369" rel="noopener noreferrer">https://doi.org/10.3389/fnimg.2026.1800369</a></p>
<p><strong>Image Credits:</strong> AI Generated</p>
<p><strong>DOI:</strong> <a href="https://doi.org/10.3389/fnimg.2026.1800369" rel="noopener noreferrer">10.3389/fnimg.2026.1800369</a></p>
<p><strong>Keywords:</strong> pulvinar, deep neural networks, skip connections, gain control, decision criterion, transthalamic pathways, visual neuroscience, signal detection theory, pathways, skip, connections, deep</p>
]]></content:encoded>
					
		
		
		<post-id xmlns="com-wordpress:feed-additions:1">285434</post-id>	</item>
		<item>
		<title>FedGPA Rewires Federated Learning to Balance Shared Knowledge and Personal Touches</title>
		<link>https://scienmag.com/fedgpa-rewires-federated-learning-to-balance-shared-knowledge-and-personal-touches/</link>
		
		<dc:creator><![CDATA[Veronica Carney]]></dc:creator>
		<pubDate>Mon, 12 Oct 2026 16:32:43 +0000</pubDate>
				<category><![CDATA[Technology and Engineering]]></category>
		<category><![CDATA[adaptive weight matrix]]></category>
		<category><![CDATA[balancing shared knowledge and individual data]]></category>
		<category><![CDATA[CIFAR-10]]></category>
		<category><![CDATA[clustered federated learning]]></category>
		<category><![CDATA[data heterogeneity]]></category>
		<category><![CDATA[Data Privacy]]></category>
		<category><![CDATA[deep neural networks]]></category>
		<category><![CDATA[distributed model training]]></category>
		<category><![CDATA[federated learning]]></category>
		<category><![CDATA[federated model aggregation]]></category>
		<category><![CDATA[FedGPA framework]]></category>
		<category><![CDATA[hierarchical aggregation]]></category>
		<category><![CDATA[hierarchical neural networks]]></category>
		<category><![CDATA[layered neural network architecture]]></category>
		<category><![CDATA[Machine learning]]></category>
		<category><![CDATA[MNIST]]></category>
		<category><![CDATA[model aggregation]]></category>
		<category><![CDATA[model personalization]]></category>
		<category><![CDATA[non-IID data]]></category>
		<category><![CDATA[personalization]]></category>
		<category><![CDATA[personalized federated learning]]></category>
		<category><![CDATA[privacy-preserving machine learning]]></category>
		<guid isPermaLink="false">https://scienmag.com/?p=265315</guid>

					<description><![CDATA[A new federated learning framework called FedGPA balances global generalization and client personalization by aggregating neural network layers at different depths with an adaptive weight matrix.]]></description>
										<content:encoded><![CDATA[<p>Federated learning has long promised a way to train powerful machine learning models without ever collecting users&#8217; raw data. Instead of pooling information on a central server, the technique sends a shared model out to millions of devices—phones, hospitals, banks—and lets each one learn from its own local data before returning only parameter updates. Yet a stubborn tension has haunted the field since its inception: a single global model must serve everyone, but every participant&#8217;s data is different. A new framework called FedGPA, described in Applied Intelligence by researchers at Chongqing University of Posts and Telecommunications, proposes an unusually elegant resolution by treating a neural network not as a monolith but as a layered hierarchy in which different depths deserve different degrees of sharing.</p>
<p>The core problem the team set out to address is data heterogeneity, the phenomenon that arises when the datasets held by individual clients are not independent and identically distributed, or Non-IID. In a classic federated experiment, one hospital might see mostly elderly patients while another serves young adults; one phone user photographs landscapes while another snaps portraits of pets. When each client computes gradient updates on such skewed data and a server averages them naively, the resulting global model drifts toward the average client and serves none of them well. This statistical mismatch, sometimes called client drift, degrades accuracy and slows convergence, and it is the central obstacle that personalized federated learning methods attempt to overcome.</p>
<p>Existing approaches to personalization generally fall into a few camps. Some methods fine-tune the global model locally after training, others split each model into shared and private components, and still others cluster clients with similar data distributions so that each cluster can train its own model. The FedGPA authors argue that these strategies remain insufficient because they fail to fully account for two things at once: the impact of data heterogeneity and the hierarchical structure of features inside deep neural networks. Their framework responds by integrating four distinct model types into a single aggregation mechanism: the global model shared by all participants, clustered models that capture groups of similar clients, individual optimal models representing each client&#8217;s best personalized state, and individual local models reflecting raw local training.</p>
<p>The key insight behind FedGPA draws on a well-established finding in deep learning research: features at different layers of a convolutional network differ dramatically in transferability. Early layers detect edges, textures, and colors—patterns so universal that they transfer across almost any visual task—while deeper layers encode increasingly abstract, task-specific concepts. The researchers exploit this hierarchy directly. In their aggregation scheme, lower-layer parameters are weighted to emphasize the general, shared knowledge distilled from the global model, whereas higher-layer parameters lean toward personalized components that encode the quirks of each client&#8217;s local distribution. In effect, the network&#8217;s foundation is communal while its upper floors are privately decorated.</p>
<p>To implement this idea, FedGPA introduces an adaptive weight matrix that dynamically adjusts the contribution ratio of each source model at every layer. Rather than fixing a static blend—for example, always taking seventy percent of the global model&#8217;s early layers—the framework learns how much each of the four model types should contribute as training progresses. This adaptivity matters because the optimal balance is not constant: early in training, when the global model is still forming, clients may benefit from broad shared signals, while later rounds reward stronger personalization once the shared backbone has stabilized. A complementary hyperparameter controls the aggregation scope, letting practitioners tune precisely where along the network&#8217;s depth the emphasis shifts from generalization to personalization.</p>
<p>The clustered-model branch adds another layer of sophistication. Clustering-based federated learning, explored in prior work such as the IFCA framework and hierarchical clustering of local updates, groups clients whose data distributions resemble one another so that they can share a specialized model. FedGPA folds this intermediate level into its multi-level aggregation, so a client&#8217;s parameters draw on the global model, its cluster&#8217;s consensus, and its own local optimum simultaneously. This three-tier structure is particularly valuable in real deployments where data is neither fully homogeneous nor wildly divergent—for instance, regional hospitals that differ from each other but share national patient characteristics, or keyboards whose users fall into language communities with overlapping typing habits.</p>
<p>To verify that each component actually earns its place, the team conducted component-wise ablation studies, systematically removing individual fusion branches and measuring the effect on performance. Ablation experiments of this kind are the standard forensic tool of machine learning research: if accuracy collapses when the clustered branch is removed, the cluster level is demonstrably useful rather than decorative. The authors report that these studies validate the contribution of each fusion branch, supporting the claim that the four-way integration—global, clustered, individual optimal, and local—is what drives the framework&#8217;s gains rather than any single trick.</p>
<p>Empirically, FedGPA was evaluated on three benchmark image datasets that span a range of difficulty: MNIST, the classic dataset of handwritten digits; SVHN, the Street View House Numbers dataset drawn from real-world photographs; and CIFAR-10, a substantially harder collection of small color images across ten object categories. The results show that FedGPA outperforms existing methods across these benchmarks, suggesting that the layered aggregation strategy holds up as task difficulty increases. The choice of benchmarks is telling: MNIST tests whether the framework handles simple Non-IID splits gracefully, while CIFAR-10 probes whether the adaptive weight matrix can still find a useful balance when features are complex and client data is severely imbalanced.</p>
<p>The implications extend well beyond image classification. Federated learning underpins privacy-sensitive applications from predictive text on mobile devices to medical imaging, where prototype-based personalized approaches have already been applied to hospital data. Because FedGPA treats the generalization–personalization tradeoff as a tunable dial rather than a binary choice, it could let system designers specify how much communal knowledge a deployment should enforce—for example, maximizing shared accuracy in a standardized diagnostic task while still allowing each clinic&#8217;s model to adapt to its patient population. The framework&#8217;s reliance on standard model aggregation also means it does not require clients to exchange data, preserving the privacy guarantees that make federated learning attractive in the first place.</p>
<p>Challenges remain, as they do for all federated systems. Communication efficiency, robustness against malicious clients, and convergence guarantees under extreme heterogeneity are active research fronts, and the authors&#8217; own references survey a landscape of open problems documented across the federated learning literature. Still, FedGPA represents a notable conceptual shift: instead of asking whether a federated model should be global or personal, it asks which parts of the model deserve to be which. By aligning the aggregation strategy with the natural hierarchy of neural network features, the Chongqing team offers a template that other researchers are likely to adapt—and a reminder that sometimes the smartest way to reconcile competing goals is to give each one the layer it belongs to.</p>
<p><strong>Subject of Research:</strong> Multi-level aggregation for personalized federated learning under Non-IID data heterogeneity</p>
<p><strong>Article Title:</strong> FedGPA: a multi-level aggregation framework for federated learning with collaborative optimization of generalization and personalization</p>
<p><strong>Article References:</strong> Chen, Z., Jiang, H., Xie, D., Jin, R., &amp; Zhu, H. (2026). FedGPA: a multi-level aggregation framework for federated learning with collaborative optimization of generalization and personalization. <em>Applied Intelligence, 56</em>(15), Article 485. <a href="https://doi.org/10.1007/s10489-026-07354-3" rel="noopener noreferrer">https://doi.org/10.1007/s10489-026-07354-3</a></p>
<p><strong>Image Credits:</strong> AI Generated</p>
<p><strong>DOI:</strong> <a href="https://doi.org/10.1007/s10489-026-07354-3" rel="noopener noreferrer">10.1007/s10489-026-07354-3</a></p>
<p><strong>Keywords:</strong> federated learning, personalization, Non-IID data, hierarchical aggregation, adaptive weight matrix, machine learning, data privacy, clustered federated learning, deep neural networks, model aggregation, CIFAR-10, MNIST</p>
]]></content:encoded>
					
		
		
		<post-id xmlns="com-wordpress:feed-additions:1">265315</post-id>	</item>
		<item>
		<title>New Encryption Framework Locks AI Models Aboard Satellites With Tiered Keys and Hidden Watermarks</title>
		<link>https://scienmag.com/new-encryption-framework-locks-ai-models-aboard-satellites-with-tiered-keys-and-hidden-watermarks/</link>
		
		<dc:creator><![CDATA[Denise Maddox]]></dc:creator>
		<pubDate>Mon, 12 Oct 2026 07:04:22 +0000</pubDate>
				<category><![CDATA[Technology and Engineering]]></category>
		<category><![CDATA[access control]]></category>
		<category><![CDATA[adversarial perturbation]]></category>
		<category><![CDATA[AI model intellectual property protection]]></category>
		<category><![CDATA[cybersecurity for satellite AI]]></category>
		<category><![CDATA[Cybersecurity journal]]></category>
		<category><![CDATA[deep neural networks]]></category>
		<category><![CDATA[deep neural networks in space]]></category>
		<category><![CDATA[latent watermarking]]></category>
		<category><![CDATA[model intellectual property]]></category>
		<category><![CDATA[model protection]]></category>
		<category><![CDATA[model watermarking techniques]]></category>
		<category><![CDATA[on-orbit inference]]></category>
		<category><![CDATA[onboard neural networks]]></category>
		<category><![CDATA[ownership verification]]></category>
		<category><![CDATA[parameter encryption]]></category>
		<category><![CDATA[remote sensing]]></category>
		<category><![CDATA[remote sensing data security]]></category>
		<category><![CDATA[Satellite AI model security]]></category>
		<category><![CDATA[satellite AI security]]></category>
		<category><![CDATA[satellite data compression and encryption]]></category>
		<category><![CDATA[satellite data downlink optimization]]></category>
		<category><![CDATA[secure satellite communication]]></category>
		<category><![CDATA[tiered encryption keys]]></category>
		<category><![CDATA[watermarked AI models]]></category>
		<guid isPermaLink="false">https://scienmag.com/?p=263962</guid>

					<description><![CDATA[Researchers have unveiled STAR-OV, a framework that protects deep learning models deployed on satellites through two-stage reversible parameter encryption, tiered recovery keys, and a latent watermark for post-leakage ownership verification.]]></description>
										<content:encoded><![CDATA[<p>Artificial intelligence is rapidly migrating off Earth. As Earth-observation constellations multiply and imaging resolutions climb, satellites now generate remote sensing data at rates on the order of tens of gigabits per second, while the satellite–ground links that carry that data home typically manage only a few hundred megabits to a few gigabits per second. That widening gap has pushed researchers toward a new paradigm: instead of beaming raw imagery down for centralized processing, satellites run deep neural networks onboard and transmit only interpreted results, compressing downlink volumes to megabits per second. But this shift creates a thorny security problem. A trained model uploaded to orbit is a valuable, long-lived intellectual asset operating on physically inaccessible hardware, exposed to interception and misuse. A new framework called STAR-OV, published in the journal Cybersecurity, proposes a way to protect those models with an elegance that has caught the attention of the AI security community.</p>
<p>The research team, led by Hanwen Xu with Song Xiao, Defan Xue, and Peichao Ma, set out to solve a problem that existing protections handle poorly. Current approaches to safeguarding model intellectual property fall into two camps. Passive methods, such as model watermarking, embed hidden evidence of ownership that can be revealed after a model is stolen. Active methods, such as parameter encryption, lock the model so it cannot function without a key. Each camp alone falls short in the satellite context. Watermarks do nothing to stop unauthorized use in the first place, while most encryption schemes operate on a binary logic: the model is either fully usable or completely useless. Satellite services, however, often serve multiple stakeholders with different authorization levels, demanding something in between—a degraded but functional service tier for lower-privilege users—without retraining the model or burning scarce onboard resources.</p>
<p>STAR-OV, short for satellite-oriented trusted authorization and responsibility with stratified model encryption and ownership verifications, unifies both protection styles in a single framework. Its core trick is a two-stage, reversible perturbation of the model&#8217;s parameters. In the first stage, small, precisely directed changes are injected into a tiny subset of weights until the model&#8217;s accuracy drops to a target intermediate level, around 50 percent. In the second stage, further perturbations push accuracy down to near random guessing, rendering the model effectively unusable. Every perturbation applied along the way—its layer, its exact parameter position, and its magnitude—is recorded. Those records become the keys: a partial key that restores only the intermediate-accuracy model, and a full key that undoes all perturbations in one step, returning the network to its original trained state.</p>
<p>The mathematics behind the encryption borrows from adversarial perturbation research, but operates in parameter space rather than input space. At each iteration, the method computes the loss gradient on a small encryption dataset, selects the single weight with the largest gradient magnitude, and nudges it in the direction that most damages performance. The perturbation size is normalized by each layer&#8217;s weight range, and layer-wise clipping bounds keep modified weights inside their original minimum–maximum span, so the encrypted model&#8217;s weight statistics remain statistically indistinguishable from a clean model. The process stops automatically once the target accuracy for each stage is reached, giving the model owner explicit, predictable control over the service levels each key unlocks.</p>
<p>The efficiency numbers are striking. Across four benchmark datasets—CIFAR-10, GTSRB, Fashion-MNIST, and the UC Merced Land Use remote sensing collection—the framework modified only between 0.001 and 0.003 percent of model parameters. On UC Merced, just 66 parameters were changed in the first stage and 61 more in the second, out of more than 23 million total, a ratio of roughly 0.0004 percent. Yet those few dozen tweaks cut accuracy by more than 80 percent, dropping fully encrypted models to around 10 percent accuracy on three datasets and 13.97 percent on GTSRB, close to random guessing. Partially recovered models landed consistently near 51 to 52 percent accuracy, matching the predefined intermediate target. Because the perturbations are so sparse, the keys themselves are tiny, and decryption is a simple element-wise subtraction that imposes negligible computational overhead—critical for power- and compute-limited onboard hardware.</p>
<p>Reversibility survives real-world numerical constraints, the team reports. Under standard FP32 precision, recovery is exact. At FP16, parameter errors stay at or below the order of 10^-4 with recovered accuracy essentially identical to full precision. Even at an extreme FP8 setting, maximum parameter error remains below 6×10^-3 and accuracy loss stays under 0.3 percent. Because each restoration starts fresh from the encrypted parameters rather than accumulating modifications, numerical errors do not compound across repeated deployment cycles, making the scheme practical for long-term unattended operation.</p>
<p>The second half of the framework addresses what happens when prevention fails. After a model is fully restored to its original accuracy, a latent watermark is embedded through a parameter-fitting process on a small, deterministically selected subset of weights. Unlike conventional backdoor watermarks, which alter model behavior on trigger inputs even when inactive, this watermark stays completely dormant without its activation key: trigger samples are classified normally, and trigger accuracy sits at random-guessing levels. Only when the owner applies the secret perturbation key does the model map trigger images—clean samples bearing a small white square patch—to a designated label, while continuing to classify ordinary data correctly. Activated trigger accuracy exceeded 99 percent across all datasets, and the watermark&#8217;s detection profile under Neural Cleanse, a widely used backdoor-detection tool, closely matched that of clean models, whereas a classical backdoored model produced glaring anomalies.</p>
<p>The security evaluation is unusually thorough. Random key guessing failed across the board: forged perturbations applied to fully encrypted models yielded accuracies of 0.10 to 0.15, never approaching the 0.5 intermediate target, and similar attacks on partially recovered models stalled far below original performance. Cross-satellite key reuse—where a valid key from one deployment instance is tried on another protected copy of the same model—also failed, because each deployment is encrypted with an independently generated key while sharing a common ownership watermark. Targeted privilege-escalation attempts, including reconstruction of missing Stage-II perturbations with partial prior knowledge and gradient-guided optimization, consistently left a significant accuracy gap versus genuine key recovery. Knowledge distillation from the fully encrypted model produced students performing at random-guess levels, and distillation from the intermediate model could not reach full capability.</p>
<p>The watermark itself proved resilient against removal attempts. Fine-tuning on 20 percent of the training data for up to 100 epochs, with weight decay and frozen batch normalization layers, left activated trigger accuracy at 99 to 100 percent and degraded activated clean accuracy by at most a few tenths of a percent. Global magnitude pruning at sparsity levels up to roughly 85 percent preserved reliable watermark activation, and only when pruning exceeded 90 percent—destroying the model&#8217;s usefulness in the process—did the watermark degrade. Random guesses at the watermark key produced a clean separation from the genuine key in the accuracy-versus-trigger-response space, supporting the scheme&#8217;s unforgeability. The authors acknowledge one honest limitation: distilled surrogate models, which copy behavior rather than parameters, substantially weaken watermark transferability, a challenge shared by other parameter-level watermarking approaches.</p>
<p>What makes STAR-OV notable is less any single mechanism than the integration. Existing hierarchical selective-encryption methods can produce multiple performance levels, but the intermediate accuracies fall out implicitly from which parameter groups are decrypted; STAR-OV instead lets the owner specify a target accuracy and tolerance up front. It requires no architectural changes, no extra training stages, no dedicated hardware, and no high-frequency satellite–ground communication—only short, encrypted key transmissions. For an industry moving toward commercial model licensing in orbit, tiered Earth-observation services, and multi-stakeholder constellations, the framework offers a practical template: encrypt the model so it can circulate safely, hand out keys that match privileges, and keep a silent watermark in reserve for the day something leaks. The authors point to scalable key management for large multi-mission satellite AI systems as the next frontier, but the core message is already clear: the models now flying overhead can finally carry their own locks and their own proof of ownership.</p>
<p><strong>Subject of Research:</strong> Intellectual property protection for deep neural networks deployed on satellites using stratified parameter encryption and latent watermarking</p>
<p><strong>Article Title:</strong> Star-ov: satellite-oriented trusted authorization and responsibility with stratified model encryption and ownership verifications</p>
<p><strong>Article References:</strong> Xu, H., Xiao, S., Xue, D., &amp; Ma, P. (2026). Star-ov: satellite-oriented trusted authorization and responsibility with stratified model encryption and ownership verifications. <em>Cybersecurity, 9</em>(1), Article 236. <a href="https://doi.org/10.1186/s42400-026-00673-5" rel="noopener noreferrer">https://doi.org/10.1186/s42400-026-00673-5</a></p>
<p><strong>Image Credits:</strong> AI Generated</p>
<p><strong>DOI:</strong> <a href="https://doi.org/10.1186/s42400-026-00673-5" rel="noopener noreferrer">10.1186/s42400-026-00673-5</a></p>
<p><strong>Keywords:</strong> satellite AI security, model intellectual property, parameter encryption, latent watermarking, deep neural networks, on-orbit inference, access control, remote sensing, adversarial perturbation, ownership verification, Cybersecurity journal, model protection</p>
]]></content:encoded>
					
		
		
		<post-id xmlns="com-wordpress:feed-additions:1">263962</post-id>	</item>
		<item>
		<title>Deep Learning Sharpens Satellite Rainfall Maps for Egypt&#8217;s Arid Zones</title>
		<link>https://scienmag.com/deep-learning-sharpens-satellite-rainfall-maps-for-egypts-arid-zones/</link>
		
		<dc:creator><![CDATA[Blake Davidson]]></dc:creator>
		<pubDate>Sat, 10 Oct 2026 06:18:28 +0000</pubDate>
				<category><![CDATA[Earth Science]]></category>
		<category><![CDATA[arid climate]]></category>
		<category><![CDATA[arid zone rainfall mapping]]></category>
		<category><![CDATA[artificial neural networks for climate data]]></category>
		<category><![CDATA[bias correction]]></category>
		<category><![CDATA[CHIRPS]]></category>
		<category><![CDATA[climate data accuracy improvement]]></category>
		<category><![CDATA[deep learning for precipitation estimation]]></category>
		<category><![CDATA[deep neural networks]]></category>
		<category><![CDATA[Egypt]]></category>
		<category><![CDATA[Egypt hydrological monitoring]]></category>
		<category><![CDATA[ERA5]]></category>
		<category><![CDATA[flash flood forecasting]]></category>
		<category><![CDATA[GPM IMERG]]></category>
		<category><![CDATA[high-resolution rainfall data validation]]></category>
		<category><![CDATA[hydrological forecasting in Egypt]]></category>
		<category><![CDATA[hydrological modeling]]></category>
		<category><![CDATA[machine learning error correction in climate data]]></category>
		<category><![CDATA[quantile mapping]]></category>
		<category><![CDATA[rain gauges]]></category>
		<category><![CDATA[rainfall measurement in desert regions]]></category>
		<category><![CDATA[satellite precipitation]]></category>
		<category><![CDATA[satellite rainfall dataset evaluation]]></category>
		<category><![CDATA[Satellite rainfall datasets]]></category>
		<category><![CDATA[satellite-based precipitation products comparison]]></category>
		<guid isPermaLink="false">https://scienmag.com/?p=257666</guid>

					<description><![CDATA[A new study tested five satellite and reanalysis rainfall products against 23 Egyptian rain gauges and used deep neural networks to cut rainfall errors by up to 34 percent.]]></description>
										<content:encoded><![CDATA[<p>In one of the driest countries on Earth, knowing exactly where and when rain falls can mean the difference between a managed flash flood and a disaster. Yet Egypt&#8217;s network of rain gauges is thin, scattered, and unevenly distributed across a landscape that stretches from the Mediterranean coast to the heart of the Sahara. A new study published in Theoretical and Applied Climatology tackles this problem head-on by putting five of the world&#8217;s most widely used high-resolution rainfall datasets through a rigorous, station-by-station test across Egypt&#8217;s hydrological zones, and then applying machine learning to squeeze out their systematic errors.</p>
<p>The research, led by Mahmoud Hesham of Port Said University together with colleagues from Cairo University, evaluated daily rainfall records from 23 ground stations spanning the years 2003 to 2024. Against this observational baseline, the team compared five products: the Climate Hazards Group InfraRed Precipitation with Station Data version 2.0, known as CHIRPS; the Climate Prediction Center Morphing Technique, or CMORPH; the PERSIANN-CDR dataset built on artificial neural networks; the Global Precipitation Measurement mission&#8217;s Integrated Multi-satellite Retrievals Final Run version 07, abbreviated GPM IMERG-F V07; and ERA5, the fifth-generation atmospheric reanalysis produced by the European Centre for Medium-Range Weather Forecasts. Each of these products estimates rainfall in a fundamentally different way, blending satellite infrared and microwave sensors, gauge data, or numerical weather model output, and each carries its own characteristic strengths and blind spots.</p>
<p>The stakes are considerable. In arid regions, rainfall is rare, localized, and often violent, arriving as short-lived cloudbursts that can trigger flash floods in wadis and urban areas that were designed with little drainage capacity. Hydrological models and flood forecasting systems depend on accurate precipitation inputs, and where gauges are sparse, satellite and reanalysis products are often the only practical source of spatially continuous rainfall information. But these products were largely developed and calibrated in wetter climates, and their performance in hyper-arid environments, where the signal-to-noise ratio of rainfall detection is poor, has long been an open question.</p>
<p>The evaluation produced a nuanced picture rather than a single winner. At the daily and monthly timescales, CHIRPS V2.0 generally delivered the lowest root mean square error, suggesting that its blend of infrared satellite imagery and station data captures the day-to-day rhythm of Egyptian rainfall better than its competitors. When the analysis shifted to yearly totals and maximum yearly values, however, ERA5 and GPM IMERG-F V07 took the lead, indicating that the reanalysis model and the latest generation of the GPM mission are more reliable for long-term water resources assessment and extreme-rainfall analysis. This scale-dependence is a critical finding for practitioners: the best data source for a flash-flood early warning system may not be the best source for planning a decades-long water management strategy.</p>
<p>Event detection proved equally revealing. GPM IMERG-F V07 showed reliable rainfall-event detection across Egypt, with probability of detection values exceeding 0.45 throughout the country. The probability of detection, a standard verification metric that measures the fraction of observed rain events correctly identified, is especially important in arid lands where a missed event is often a missed flood. ERA5 also performed well in detecting rainfall events at several northern stations, where Mediterranean weather systems bring the bulk of Egypt&#8217;s modest precipitation. These results suggest that modern satellite retrievals have matured to the point where they can meaningfully supplement, and in some contexts partially substitute for, ground observations in gauge-poor regions.</p>
<p>Detecting that rain fell is only half the battle, however. The next question is how much fell, and here the raw satellite and reanalysis products carry systematic biases that can propagate into hydrological models with serious consequences. To address this, the researchers tested three bias-correction methods of increasing sophistication: linear scaling, a simple multiplicative adjustment of the mean; quantile mapping, a statistical technique that reshapes the entire distribution of estimated rainfall to match the observed distribution; and a dense neural network, a deep learning model capable of learning complex, nonlinear relationships between the estimated rainfall and the true gauge-measured amounts.</p>
<p>The neural network approach was engineered with considerable care. A feedforward dense neural network was optimized separately for each of the 23 stations, with the architecture and training regime tuned individually: the models used between 2 and 6 hidden layers, 16 to 256 neurons per layer, 150 to 300 training epochs, batch sizes ranging from 16 to 128, learning rates between 0.0005 and 0.0050, and dropout rates from 0.0 to 0.2. This station-specific optimization reflects a key insight of modern machine learning practice in the geosciences: rainfall error structures are local phenomena, shaped by topography, distance from the coast, and prevailing weather patterns, and a single global correction model would likely average away the very details that matter most.</p>
<p>The payoff was substantial. Deep-learning-based bias correction reduced error by 33 percent at the daily timescale, 22 percent at the monthly timescale, and 34 percent at the yearly timescale. These are not marginal refinements; a one-third reduction in daily rainfall error can materially change the output of flood forecasting models, which are acutely sensitive to the timing and magnitude of individual rain events. The fact that the largest relative improvement appeared at the yearly scale suggests the neural networks were particularly effective at correcting the cumulative biases that accumulate over seasons and years, precisely the errors that matter for water resources planning in a country where every drop counts.</p>
<p>Perhaps the most important conclusion of the study is a cautionary one: there is no universal best product, and bias correction is not a magic bullet. The best-performing rainfall product varied by location, hydrological zone, and temporal scale, meaning that practitioners in Egypt should select rainfall datasets based on local rainfall conditions and the intended hydrological use. Bias correction, meanwhile, should be applied carefully, because its effectiveness depends on rainfall behavior and timescale. A correction that works brilliantly for Mediterranean coastal stations may fail in the southern desert, and a method tuned for daily extremes may distort long-term averages. This echoes a growing body of literature warning that statistical correction techniques, including machine learning approaches, must be validated for the specific application at hand rather than assumed to be universally beneficial.</p>
<p>For Egypt, the practical implications are immediate. The evaluated and corrected products can serve as complementary rainfall inputs for hydrological modeling, flash-flood forecasting, extreme-rainfall analysis, and water-resources management in arid and gauge-sparse regions, not only in Egypt but across the broader belt of deserts and semi-arid lands where similar data scarcity prevails. As climate change alters rainfall patterns in the Mediterranean and North Africa, and as urban expansion places more people and infrastructure in the path of rare but devastating flash floods, the ability to extract trustworthy rainfall information from satellites, refined by machine learning, becomes an essential tool of resilience. This study provides both a practical guide for choosing among the available datasets and a demonstration that deep learning can meaningfully close the gap between what satellites see and what actually falls from the sky.</p>
<p><strong>Subject of Research:</strong> Evaluation and bias correction of satellite and reanalysis rainfall products across Egypt&#x27;s hydrological zones</p>
<p><strong>Article Title:</strong> Evaluation and bias correction of high-resolution satellite and reanalysis rainfall products across Egypt’s hydrological zones</p>
<p><strong>Article References:</strong> Hesham, M., Helmi, A. M., Elkiki, M., Hamed, Y., &amp; Selim, T. (2026). Evaluation and bias correction of high-resolution satellite and reanalysis rainfall products across Egypt’s hydrological zones. <em>Theoretical and Applied Climatology, 157</em>(9), Article 601. <a href="https://doi.org/10.1007/s00704-026-06519-x" rel="noopener noreferrer">https://doi.org/10.1007/s00704-026-06519-x</a></p>
<p><strong>Image Credits:</strong> AI Generated</p>
<p><strong>DOI:</strong> <a href="https://doi.org/10.1007/s00704-026-06519-x" rel="noopener noreferrer">10.1007/s00704-026-06519-x</a></p>
<p><strong>Keywords:</strong> satellite precipitation, bias correction, Egypt, CHIRPS, GPM IMERG, ERA5, deep neural networks, quantile mapping, flash flood forecasting, arid climate, hydrological modeling, rain gauges</p>
]]></content:encoded>
					
		
		
		<post-id xmlns="com-wordpress:feed-additions:1">257666</post-id>	</item>
		<item>
		<title>New AI Fingerprinting Method Separates Stolen Models From Innocent Lookalikes</title>
		<link>https://scienmag.com/new-ai-fingerprinting-method-separates-stolen-models-from-innocent-lookalikes/</link>
		
		<dc:creator><![CDATA[Blake Davidson]]></dc:creator>
		<pubDate>Wed, 07 Oct 2026 22:42:51 +0000</pubDate>
				<category><![CDATA[Technology and Engineering]]></category>
		<category><![CDATA[adversarial machine learning]]></category>
		<category><![CDATA[AI fingerprinting techniques]]></category>
		<category><![CDATA[AI model fingerprinting]]></category>
		<category><![CDATA[AI model security and integrity]]></category>
		<category><![CDATA[AI model watermarking methods]]></category>
		<category><![CDATA[Applied Intelligence]]></category>
		<category><![CDATA[black-box verification]]></category>
		<category><![CDATA[CIFAR-10]]></category>
		<category><![CDATA[decision difference regions]]></category>
		<category><![CDATA[deep learning model theft detection]]></category>
		<category><![CDATA[deep neural networks]]></category>
		<category><![CDATA[differentiating stolen AI models from lookalikes]]></category>
		<category><![CDATA[intellectual property protection]]></category>
		<category><![CDATA[knowledge distillation]]></category>
		<category><![CDATA[model attribution and provenance]]></category>
		<category><![CDATA[model copycat behavior identification]]></category>
		<category><![CDATA[model copyright enforcement]]></category>
		<category><![CDATA[model fingerprinting]]></category>
		<category><![CDATA[model ownership verification]]></category>
		<category><![CDATA[model stealing]]></category>
		<category><![CDATA[neural network copy detection]]></category>
		<category><![CDATA[neural network ownership verification]]></category>
		<category><![CDATA[protecting trained neural networks]]></category>
		<category><![CDATA[watermarking]]></category>
		<guid isPermaLink="false">https://scienmag.com/?p=245705</guid>

					<description><![CDATA[Researchers in China have developed a deep neural network fingerprinting method that explicitly separates stolen model copies from independently trained lookalikes using decision difference regions.]]></description>
										<content:encoded><![CDATA[<p>Deep neural networks have become some of the most valuable assets in modern technology, representing months of engineering effort, expensive compute budgets, and carefully curated training data. Yet unlike software binaries, which can be protected by conventional copyright enforcement, a trained model is notoriously difficult to police. Anyone with access to a prediction API can, in principle, distill its behavior into a copycat network, fine-tune a leaked checkpoint, or otherwise reuse the model without permission. A research team at Dalian University of Technology, working with a colleague at the Chinese Academy of Sciences, has now published a new approach to this problem in the journal Applied Intelligence, one that reframes how ownership evidence for neural networks is constructed in the first place.</p>
<p>The study, led by Tianxiang Luo with corresponding author Bo Wang, addresses a subtle but dangerous weakness in existing model fingerprinting techniques. Fingerprints are sets of test inputs whose predicted labels are expected to be preserved when a model is copied, extracted, or post-processed. If a suspect model answers the fingerprint queries the same way the owner&#8217;s model does, that is treated as evidence of theft. The catch is that independently trained models, built from scratch on similar data, can also agree on many of these inputs simply because they learned the same task. When that happens, an innocent model developer can be falsely accused of stealing someone else&#8217;s work, a risk the authors describe as leaving owners exposed to false-accusation liability.</p>
<p>Previous methods largely treated this problem with a heuristic: they searched for inputs near the source model&#8217;s decision boundary, on the assumption that only models derived from the source would inherit those boundary quirks. The new work upgrades that heuristic into an explicit optimization objective. Instead of asking whether fingerprint inputs transfer to related models, the researchers formulate fingerprint construction as a search for decision difference regions, or DDRs. These are localized areas of the input space where the source model&#8217;s decision differs sharply from the decisions of independently trained benign models. In other words, the fingerprint is designed from the outset to separate stolen copies from innocent lookalikes, rather than hoping that boundary transferability will do the job on its own.</p>
<p>Formally, the team casts DDR identification as a search problem over the input space. The goal is to find regions where the source model and a pool of independently trained models disagree in their predictions, because such disagreement zones are precisely where a copied model, which inherits the source&#8217;s internal decision structure, is most likely to side with the source rather than with the benign pool. A suspect model that matches the source&#8217;s answers inside these regions therefore provides much stronger evidence of derivation than agreement on ordinary test data. The formulation turns fingerprinting from a passive property of chosen inputs into an active, targeted construction process with a measurable separation criterion.</p>
<p>Solving this search problem efficiently is the second contribution. Exhaustively probing a high-dimensional input space to find regions where a source model diverges from a pool of benign models would be prohibitively expensive, so the authors propose two non-invasive variants that trade construction cost against verification confidence. The Fast variant performs low-cost screening, quickly identifying candidate decision difference regions without heavy computation, making it suitable for scenarios where owners need a cheap first pass or must fingerprint many models. The Selected variant applies a more demanding offline filtering stage to the candidates, retaining only the regions that satisfy stricter separation criteria, and is intended for higher-confidence verification where the consequences of a wrong accusation are severe.</p>
<p>This two-tier design gives model owners something earlier fingerprinting schemes generally lacked: a tunable dial between cost and confidence. A company deploying hundreds of models could run the Fast variant routinely to maintain baseline protection, then invoke the Selected variant when a serious dispute actually arises. Because both variants are non-invasive, they require no modification of the model itself, no embedded watermarks, and no retraining. That distinguishes the approach from watermarking techniques, which plant hidden signals inside the network&#8217;s weights or behavior and can be damaged or removed when a thief fine-tunes, prunes, or compresses the stolen model.</p>
<p>The evaluation is notably broad for this area of research. The team tested the fingerprinting scheme on CIFAR-10 and the German Traffic Sign Recognition Benchmark, using CIFAR-100 and Tiny-ImageNet as stress tests to probe how the method behaves on harder and more diverse classification tasks. The experiments spanned multiple source architectures, including the kinds of residual and convolutional networks commonly deployed in practice, and confronted the fingerprints with hard negatives, meaning independently trained models that are deliberately similar to the source, as well as with extraction attacks such as knowledge distillation and knockoff-style model stealing. This combination matters because a fingerprint that only survives easy attacks or only avoids easy false positives is of little practical value.</p>
<p>According to the published results, the DDR-based fingerprints supported ownership verification across these settings while the authors were careful to identify the limits of what their method can prove. That honesty is itself significant. Much of the literature on model protection reports headline robustness numbers without clearly delineating where the evidence would fail, which is exactly the kind of overclaiming that produces false accusations in real disputes. By giving practitioners ownership evidence with an explicit account of where the separation holds and where it does not, the Dalian team is pushing the field toward a standard more familiar from forensic science: an expert should be able to state not just a conclusion but the boundary conditions of that conclusion.</p>
<p>The stakes extend well beyond academic benchmarks. As foundation models and specialized commercial networks are increasingly offered through APIs, model extraction has become a genuine industrial espionage channel, and courts and platforms are only beginning to grapple with how ownership of a statistical artifact should be established. A false accusation against an independent developer is not a harmless error; it can trigger takedowns, contract disputes, and reputational damage. Conversely, a fingerprint that fails against a determined thief leaves the actual owner without recourse. Methods that explicitly optimize for separating these two cases, and that quantify their own reliability, are a step toward making model ownership verification evidence that could actually survive adversarial scrutiny.</p>
<p>The researchers have also released their implementation publicly, including experiment scripts, configuration files, and the model-pool specifications used in the reported experiments, hosted on GitHub under the Dalian University of Technology AI lab. That reproducibility package, combined with the use of standard public benchmarks, means other groups can independently test the DDR approach, probe its failure modes, and build on the two-variant cost-confidence trade-off. The work was supported by the National Natural Science Foundation of China and the Youth Innovation Promotion Association of the Chinese Academy of Sciences. As AI models continue to function as trade secrets in everything from medical imaging to autonomous driving, techniques like decision difference region fingerprinting suggest a future in which the question of who owns a neural network can be answered not by assertion, but by measurement, with a clearly stated margin of error.</p>
<p><strong>Subject of Research:</strong> Deep neural network model ownership verification via decision difference region fingerprinting</p>
<p><strong>Article Title:</strong> Efficient and robust DNN model fingerprint with decision difference regions identification</p>
<p><strong>Article References:</strong> Luo, T., Yang, Z., Dai, X., Wang, B., &amp; Wang, W. (2026). Efficient and robust DNN model fingerprint with decision difference regions identification. <em>Applied Intelligence, 56</em>(14), Article 405. <a href="https://doi.org/10.1007/s10489-026-07440-6" rel="noopener noreferrer">https://doi.org/10.1007/s10489-026-07440-6</a></p>
<p><strong>Image Credits:</strong> AI Generated</p>
<p><strong>DOI:</strong> <a href="https://doi.org/10.1007/s10489-026-07440-6" rel="noopener noreferrer">10.1007/s10489-026-07440-6</a></p>
<p><strong>Keywords:</strong> deep neural networks, model fingerprinting, intellectual property protection, model ownership verification, black-box verification, decision difference regions, model stealing, watermarking, CIFAR-10, knowledge distillation, adversarial machine learning, Applied Intelligence</p>
]]></content:encoded>
					
		
		
		<post-id xmlns="com-wordpress:feed-additions:1">245705</post-id>	</item>
		<item>
		<title>Hidden Fingerprints: New Method Uncovers Backdoor Targets in Compromised Neural Networks</title>
		<link>https://scienmag.com/hidden-fingerprints-new-method-uncovers-backdoor-targets-in-compromised-neural-networks/</link>
		
		<dc:creator><![CDATA[Cassandra Pierce]]></dc:creator>
		<pubDate>Mon, 05 Oct 2026 12:55:00 +0000</pubDate>
				<category><![CDATA[Technology and Engineering]]></category>
		<category><![CDATA[adversarial machine learning]]></category>
		<category><![CDATA[Applied Intelligence]]></category>
		<category><![CDATA[autonomous vehicle neural network safety]]></category>
		<category><![CDATA[backdoor attack vulnerabilities in neural networks]]></category>
		<category><![CDATA[backdoor attacks]]></category>
		<category><![CDATA[backdoor defenses]]></category>
		<category><![CDATA[class transfer pattern in poisoned neural networks]]></category>
		<category><![CDATA[combating backdoor attacks in facial recognition]]></category>
		<category><![CDATA[data poisoning]]></category>
		<category><![CDATA[deep neural networks]]></category>
		<category><![CDATA[detecting adversarial triggers in AI models]]></category>
		<category><![CDATA[hidden fingerprint analysis in deep learning]]></category>
		<category><![CDATA[K-ARM]]></category>
		<category><![CDATA[label noise]]></category>
		<category><![CDATA[methods for uncovering backdoor targets]]></category>
		<category><![CDATA[model security]]></category>
		<category><![CDATA[Neural Cleanse]]></category>
		<category><![CDATA[neural network backdoor detection]]></category>
		<category><![CDATA[neural network security and integrity]]></category>
		<category><![CDATA[statistical fingerprinting for model security]]></category>
		<category><![CDATA[training pipeline security in deep learning]]></category>
		<category><![CDATA[transition matrix]]></category>
		<category><![CDATA[trigger inversion]]></category>
		<category><![CDATA[watermark and trigger detection in AI systems]]></category>
		<guid isPermaLink="false">https://scienmag.com/?p=238076</guid>

					<description><![CDATA[Researchers have developed a transition matrix-based framework that identifies the target classes of backdoor attacks in neural networks and sharply improves existing defenses.]]></description>
										<content:encoded><![CDATA[<p>Deep neural networks now power everything from facial recognition systems to autonomous vehicles, but a quiet and dangerous threat has been lurking in their training pipelines. Known as backdoor attacks, these assaults embed invisible triggers into a model during training, so that the network behaves perfectly on ordinary inputs but flips to an attacker-chosen output the moment a specific pattern appears. A stop sign with a tiny sticker, a face with a subtle perturbation, a document with a nearly imperceptible watermark — any of these can hijack the model&#8217;s decision. A new study published in Applied Intelligence by Wenbin Jiang, Shikang Xie, Jiqiang Liu, Nan Jiang and Jian Wang, researchers at Beijing Jiaotong University and Beijing University of Technology, offers a fresh way to fight back by reading the statistical fingerprints that such attacks inevitably leave behind in a model&#8217;s predictions.</p>
<p>The core insight of the work is deceptively simple: attackers have intentions, and those intentions impose structure. When a backdoor is active, poisoned samples are systematically pushed from their true classes toward a single target class chosen by the attacker. This creates what the authors call a class transfer pattern — a measurable, recurring flow of predictions from many source classes into one destination class. While most existing defenses concentrate either on discovering the trigger itself or on unlearning the backdoor behavior, they often struggle to characterize which class the attacker actually targeted. The new framework flips the problem around: instead of hunting for the trigger first, it estimates the pattern of class-to-class prediction transfers and uses that estimate to pinpoint the target class, even when no prior knowledge of the attack exists.</p>
<p>Technically, the method builds on an idea borrowed from the study of label noise. In noisy-label learning, researchers model the probability that a true label is flipped into an incorrect one using a transition matrix — a table whose entries describe how likely each class is to be misread as every other class. The authors adapt this machinery to the backdoor setting. Because poisoned samples are a small minority of the training data, the attack-induced transfers appear as large off-diagonal entries in an otherwise diagonal-dominant matrix: a well-trained model correctly classifies most samples, so the diagonal entries, representing correct predictions, dominate, while systematic misclassifications caused by poisoning stand out as anomalous rows and columns. Estimating this matrix therefore becomes a way of exposing the attack&#8217;s geometry.</p>
<p>The estimation itself proceeds in two steps and is driven by an improved information-theoretic objective. The researchers draw on the determinant of the joint matrix between predictions and labels, a loss function known in the label-noise literature as DMI, which penalizes degenerate transition estimates. In an appendix, the team provides a formal proof bounding the gradient of this loss: using the matrix differential identity for the log-determinant and Weyl&#8217;s inequality on singular values, they show that the per-sample gradient norm is bounded by the inverse of the smallest singular value of the joint matrix. This matters because it formalizes when the estimation is stable — namely, when the diagonal clean-prediction component remains stronger than the off-diagonal attack-induced component, a condition expected to hold whenever the poisoning ratio is moderate and the model retains high clean accuracy.</p>
<p>Once the transition matrix has been estimated, the identified target class becomes a powerful lever for existing defenses. Trigger-inversion methods, such as the widely used Neural Cleanse and the K-ARM optimization approach, work by reverse-engineering the smallest perturbation that can force any input to be classified as a suspect target. The trouble is that these methods must search across every possible target class, reconstructing candidate triggers for each one — a computationally expensive process prone to false positives. By narrowing the search space to the class flagged by the transition matrix, the new framework eliminates unnecessary trigger reconstruction while preserving mitigation effectiveness. The defense knows where to look before it starts looking.</p>
<p>The experimental results are striking. Across multiple datasets and attack types, the enhanced Neural Cleanse variant achieved an average attack success rate of just 2.17 percent, while the enhanced K-ARM variant drove the figure down to 1.46 percent. The strongest baseline, by comparison, averaged an attack success rate of 3.68 percent. Crucially, these gains did not come at the cost of normal performance: the defended models maintained higher clean accuracy than the baselines, meaning legitimate users would notice no degradation in everyday behavior. The evaluation covered standard image benchmarks including CIFAR-10, CIFAR-100 and Tiny ImageNet, all publicly available datasets, and spanned a range of attack designs from classic patch-based triggers to more modern imperceptible variants.</p>
<p>The breadth of attacks considered reflects the evolving threat landscape. The study&#8217;s reference list traces the lineage of backdoor research from BadNets, the 2017 work that first identified vulnerabilities in the machine learning supply chain, through targeted data-poisoning attacks, Trojaning attacks, reflection-based natural backdoors, warping-based WaNet triggers and label-consistent attacks that try to evade detection by aligning poisoned samples with their labels. Each generation of attacks has grown stealthier, and frequency-domain analyses have shown that triggers can hide in spectral regions humans barely perceive. A defense that does not depend on the specific form of the trigger — but instead on the invariant statistical consequence of any targeted attack — is inherently more robust to this arms race.</p>
<p>That invariance is precisely what makes the approach compelling. Whether an attacker uses a visible patch, a transparent overlay, a warping field or a frequency-domain perturbation, the end goal is the same: route inputs from diverse source classes into one chosen target. The transition matrix captures this routing behavior directly. The authors&#8217; theoretical analysis reinforces the point by decomposing the joint matrix into a diagonal component, representing the model&#8217;s legitimate functionality on the majority of samples, and an off-diagonal component, where large entries signal systematic misclassification toward the attacker&#8217;s target. Under the reasonable assumption that no exact linear dependencies exist among classes, the matrix is invertible, and its spectral properties govern the reliability of the estimate.</p>
<p>The practical implications extend well beyond computer vision benchmarks. Backdoor attacks are a supply-chain problem: models downloaded from public repositories, trained by third-party contractors or fine-tuned on crowdsourced data can all carry hidden triggers. Scanning such models before deployment is becoming a standard security practice, and methods that make scanning faster and more accurate have immediate value. By telling trigger-inversion defenses which class to investigate, the transition-matrix framework could reduce the computational cost of auditing large models, an increasingly important consideration as networks grow to billions of parameters. The same reasoning may eventually extend to language models, where backdoor token unlearning has emerged as a parallel research frontier.</p>
<p>Limitations remain, as with any defense. The framework&#8217;s stability guarantee rests on the assumption that correct predictions dominate misclassifications, which could weaken under extreme poisoning ratios or attacks that spread their effect across multiple targets. The authors acknowledge that the approach assumes moderate poisoning and high clean accuracy — conditions that describe most realistic attacks but not necessarily the most aggressive adversarial scenarios. Still, the work represents a meaningful conceptual shift: treating the attack target not as a mystery to be brute-forced but as a statistical signature to be estimated. As deep learning systems take on higher-stakes roles in medicine, infrastructure and transportation, defenses that exploit the inherent structure of the attacker&#8217;s intent — rather than the specifics of any single trigger — may prove to be the durable line of protection the field has been searching for.</p>
<p><strong>Subject of Research:</strong> Backdoor attack defense in deep neural networks using class transfer matrix estimation</p>
<p><strong>Article Title:</strong> Class transfer estimation in neural networks for backdoor target identification and mitigation</p>
<p><strong>Article References:</strong> Jiang, W., Xie, S., Liu, J., Jiang, N., &amp; Wang, J. (2026). Class transfer estimation in neural networks for backdoor target identification and mitigation. <em>Applied Intelligence, 56</em>(15), Article 428. <a href="https://doi.org/10.1007/s10489-026-07470-0" rel="noopener noreferrer">https://doi.org/10.1007/s10489-026-07470-0</a></p>
<p><strong>Image Credits:</strong> AI Generated</p>
<p><strong>DOI:</strong> <a href="https://doi.org/10.1007/s10489-026-07470-0" rel="noopener noreferrer">10.1007/s10489-026-07470-0</a></p>
<p><strong>Keywords:</strong> deep neural networks, backdoor attacks, backdoor defenses, transition matrix, trigger inversion, Neural Cleanse, K-ARM, label noise, adversarial machine learning, model security, data poisoning, Applied Intelligence</p>
]]></content:encoded>
					
		
		
		<post-id xmlns="com-wordpress:feed-additions:1">238076</post-id>	</item>
		<item>
		<title>AI Ensemble Learns to Predict Which Satellites Are Truly About to Collide</title>
		<link>https://scienmag.com/ai-ensemble-learns-to-predict-which-satellites-are-truly-about-to-collide/</link>
		
		<dc:creator><![CDATA[Blake Davidson]]></dc:creator>
		<pubDate>Sun, 04 Oct 2026 11:31:35 +0000</pubDate>
				<category><![CDATA[Technology and Engineering]]></category>
		<category><![CDATA[AI-driven space situational awareness]]></category>
		<category><![CDATA[Artificial intelligence in space debris tracking]]></category>
		<category><![CDATA[calibration]]></category>
		<category><![CDATA[conjunction data messages]]></category>
		<category><![CDATA[deep neural networks]]></category>
		<category><![CDATA[ensemble learning]]></category>
		<category><![CDATA[Ensemble machine learning for space safety]]></category>
		<category><![CDATA[ESA collision avoidance challenge]]></category>
		<category><![CDATA[gradient boosting]]></category>
		<category><![CDATA[Low Earth Orbit]]></category>
		<category><![CDATA[Low Earth orbit debris monitoring]]></category>
		<category><![CDATA[Monte Carlo simulation]]></category>
		<category><![CDATA[Monte Carlo simulation in satellite collision risk assessment]]></category>
		<category><![CDATA[Predictive analytics for satellite safety]]></category>
		<category><![CDATA[probabilistic forecasting]]></category>
		<category><![CDATA[satellite collision prediction]]></category>
		<category><![CDATA[satellite collision risk]]></category>
		<category><![CDATA[Satellite conjunction alert filtering]]></category>
		<category><![CDATA[Space agency collision warning systems]]></category>
		<category><![CDATA[space debris]]></category>
		<category><![CDATA[Space debris collision risk prediction methods]]></category>
		<category><![CDATA[Space traffic management and collision avoidance]]></category>
		<category><![CDATA[Spacecraft collision mitigation strategies]]></category>
		<category><![CDATA[stacked generalization]]></category>
		<guid isPermaLink="false">https://scienmag.com/?p=234778</guid>

					<description><![CDATA[A hybrid Monte Carlo and ensemble machine learning framework achieves an F2 score of 0.808 and AUC-ROC of 0.981 on ESA's satellite collision avoidance benchmark while keeping its probabilistic forecasts well calibrated.]]></description>
										<content:encoded><![CDATA[<p>Low Earth orbit is becoming a crowded place. Tens of thousands of tracked objects, from functioning satellites to fragments of decades-old rocket bodies, sweep around the planet at speeds approaching eight kilometers per second, and every close pass between two of them is a potential catastrophe. Each day, the United States Space Force&#8217;s 18th Space Control Squadron issues Conjunction Data Messages, or CDMs, warning satellite operators that two objects are predicted to come uncomfortably close. The overwhelming majority of these warnings lead to nothing: the objects miss by kilometers. But the handful that matter can destroy a spacecraft, trigger a cloud of debris, and set off a cascade that endangers everything in the same orbital shell. Deciding which alerts deserve a costly avoidance maneuver has long been one of the most consequential judgment calls in space operations, and a new study published in Applied Intelligence argues that a carefully engineered hybrid of Monte Carlo simulation and ensemble machine learning can make that call with unprecedented reliability.</p>
<p>The research, led by Meriem Ouari of the National School of Artificial Intelligence in Algiers together with colleagues Fella Manel Zerrouki, Seif Eddine Bouziane, and Amel Gacem of the Algerian Space Agency, tackles a problem that has quietly frustrated both statisticians and operators for years. Conjunction data is brutally imbalanced. Out of hundreds of thousands of recorded close approaches, only a tiny fraction ever evolve into genuinely dangerous encounters, and the probability values reported in CDMs cluster heavily at the numerical detection floor, a floor so low that it effectively means the screening system could not distinguish the risk from zero. Machine learning models trained naively on such data learn to predict the boring answer, that nothing will happen, and they achieve impressive-looking accuracy while missing precisely the events that justify firing thrusters. The Algerian team&#8217;s framework is designed from the ground up to defeat that failure mode.</p>
<p>At the heart of the approach lies a probabilistic modeling layer built on Monte Carlo methods, a family of techniques that resolve uncertainty by simulating thousands or millions of randomized scenarios and examining the distribution of outcomes. In the collision risk context, the uncertainties in the two objects&#8217; positions and velocities, which propagate from imperfect tracking measurements and atmospheric drag variations, are sampled repeatedly to generate an ensemble of possible encounter geometries. Rather than collapsing this rich uncertainty into a single point estimate, the framework preserves the full spread of simulated outcomes and feeds distributional features derived from it into the learning pipeline. This is a deliberate marriage of classical astrodynamics and modern data science: the physics of orbital uncertainty is expressed in the language of probability, and the machine learning layer is then asked to learn how those probabilistic signatures map onto actual risk.</p>
<p>On top of the Monte Carlo foundation, the researchers constructed a stacked ensemble, an architecture in which multiple diverse models are trained on the same problem and a higher-level learner combines their predictions. The base layer integrates gradient boosting implementations, including the family of algorithms exemplified by XGBoost, LightGBM, and CatBoost, alongside deep neural networks designed for tabular data. The choice is well grounded in the recent machine learning literature, which has repeatedly shown that tree-based models still outperform deep networks on structured tabular datasets of the kind CDMs represent, while neural networks contribute complementary representations of the same underlying features. Stacking, a technique whose lineage traces back to David Wolpert&#8217;s work on stacked generalization in the early 1990s, allows a meta-model to learn when to trust each base model, extracting signal from their disagreements rather than discarding it.</p>
<p>The team went further, evaluating event-level sequence models that treat the successive CDMs issued for a single conjunction event as a temporal trajectory rather than as isolated snapshots. This matters because a close approach is not judged once; it is monitored over days as tracking data improves and the predicted miss distance is refined again and again. The pattern of how a risk estimate evolves across those updates carries information that no single message contains. A conjunction whose predicted probability creeps steadily upward across successive CDMs tells a different story from one whose estimate flickers around the detection floor, and models that can read those temporal patterns gain access to a richer evidentiary basis for classification.</p>
<p>Perhaps the most operationally significant contribution is the calibration strategy the authors introduce. In forecasting, a model is said to be calibrated when its stated probabilities mean what they say: if it assigns a ten percent risk to a hundred different events, roughly ten of those events should actually materialize. Uncalibrated models may rank risks correctly while systematically overstating or understating them, which is disastrous when a stated probability is the trigger for spending propellant and interrupting a mission. The study draws on established calibration theory, including the work of Kuleshov, Fenner, and Ermon on calibrated regression and the classical DeGroot and Fienberg framework for comparing forecasters, to ensure that the final probabilistic outputs are trustworthy, not merely discriminative. The distinction between ranking events well and assigning them honest probabilities is central to the paper&#8217;s philosophy.</p>
<p>The experimental stage of the work rests on a substantial and publicly available benchmark: the European Space Agency&#8217;s Spacecraft Collision Avoidance Challenge dataset, hosted on the ESA Kelvins platform and originally released to spur machine learning competition in this domain. The dataset comprises 199,082 Conjunction Data Messages spanning 15,321 distinct conjunction events, a scale that makes it one of the most demanding resources available for this task. It was also the proving ground for a 2021 machine learning competition whose design and results were later documented by Uriot, Izzo, and colleagues, giving the community a shared reference point. Against this benchmark, the hybrid framework delivered an F2 score of 0.808, a metric that deliberately weights recall more heavily than precision, reflecting the operational reality that missing a genuine collision threat is far worse than investigating a false alarm. The model also achieved an area under the receiver operating characteristic curve of 0.981, indicating near-perfect separation between dangerous and benign encounters across all decision thresholds.</p>
<p>Those numbers, strong as they are, only tell half the story. The authors emphasize that the framework maintains well-calibrated probabilistic forecasts alongside its classification performance, meaning the model does not have to sacrifice honest uncertainty for discriminative power. This dual achievement is rare. Many high-performing classifiers produce probability outputs that are badly distorted, particularly under severe class imbalance, and post-hoc fixes often trade one quality for the other. Demonstrating both simultaneously on a dataset of this size suggests that the Monte Carlo ensemble architecture is capturing genuine structure in the conjunction data rather than exploiting statistical shortcuts. For satellite operators, that combination translates directly into better decisions: fewer wasted maneuvers on phantom threats, fewer sleepless nights over ambiguous alerts, and a defensible quantitative basis for the threshold at which action is taken.</p>
<p>The broader context makes the timing of this work significant. The population of resident space objects in low Earth orbit has grown dramatically, driven by large commercial constellations, an expanding launch cadence, and the legacy debris documented in foundational studies such as Liou and Johnson&#8217;s 2006 assessment of orbital debris risks in Science. Every new satellite multiplies the number of potential conjunctions that screening systems must evaluate, and manual analysis cannot scale to that volume. Automated, AI-driven risk assessment is therefore not a luxury but a necessity, and the Algerian team&#8217;s results, building on prior benchmarking efforts at European space debris conferences and on their own earlier work with physics-informed generative adversarial networks, chart a credible path toward systems that screen conjunctions autonomously while reserving human judgment for the genuinely marginal cases.</p>
<p>There are, of course, limits to what any data-driven system can promise. Conjunction events that end in collision are so rare that even a dataset of nearly two hundred thousand messages contains few true positives, and no benchmark can fully reproduce the stakes of a real operational decision. The authors are candid that their framework is a step toward reliable AI-driven collision risk assessment, not a replacement for the full conjunction assessment pipelines maintained by major space agencies. Yet the study&#8217;s central lesson is likely to resonate well beyond orbital mechanics: when decisions are made under extreme imbalance and uncertainty, the winning recipe combines physically grounded probabilistic modeling, ensembles of complementary learners, temporal context, and rigorous calibration. As the sky grows busier, the algorithms that keep it safe will be the ones that not only know which encounters are dangerous, but can say exactly how confident they are.</p>
<p><strong>Subject of Research:</strong> Hybrid Monte Carlo and ensemble machine learning for probabilistic satellite collision risk prediction from Conjunction Data Messages</p>
<p><strong>Article Title:</strong> Probabilistic satellite collision risk prediction via Monte Carlo ensembles</p>
<p><strong>Article References:</strong> Ouari, M., Zerrouki, F. M., Bouziane, S. E., &amp; Gacem, A. (2026). Probabilistic satellite collision risk prediction via Monte Carlo ensembles. <em>Applied Intelligence, 56</em>(15), Article 443. <a href="https://doi.org/10.1007/s10489-026-07494-6" rel="noopener noreferrer">https://doi.org/10.1007/s10489-026-07494-6</a></p>
<p><strong>Image Credits:</strong> AI Generated</p>
<p><strong>DOI:</strong> <a href="https://doi.org/10.1007/s10489-026-07494-6" rel="noopener noreferrer">10.1007/s10489-026-07494-6</a></p>
<p><strong>Keywords:</strong> satellite collision risk, conjunction data messages, Monte Carlo simulation, ensemble learning, gradient boosting, deep neural networks, probabilistic forecasting, calibration, space debris, low Earth orbit, ESA collision avoidance challenge, stacked generalization</p>
]]></content:encoded>
					
		
		
		<post-id xmlns="com-wordpress:feed-additions:1">234778</post-id>	</item>
		<item>
		<title>Smarter Client Selection Cuts Federated Learning Costs and Thwarts Privacy Attacks</title>
		<link>https://scienmag.com/smarter-client-selection-cuts-federated-learning-costs-and-thwarts-privacy-attacks/</link>
		
		<dc:creator><![CDATA[Veronica Carney]]></dc:creator>
		<pubDate>Sat, 26 Sep 2026 00:24:41 +0000</pubDate>
				<category><![CDATA[Technology and Engineering]]></category>
		<category><![CDATA[adaptive participant selection methods]]></category>
		<category><![CDATA[addressing data heterogeneity in collaborative AI]]></category>
		<category><![CDATA[Applied Intelligence]]></category>
		<category><![CDATA[bandwidth-efficient federated model training]]></category>
		<category><![CDATA[client selection]]></category>
		<category><![CDATA[client selection strategies in federated learning]]></category>
		<category><![CDATA[combating privacy attacks in federated systems]]></category>
		<category><![CDATA[communication efficiency]]></category>
		<category><![CDATA[convergence analysis]]></category>
		<category><![CDATA[deep neural networks]]></category>
		<category><![CDATA[distributed optimization]]></category>
		<category><![CDATA[enhancing privacy security in decentralized AI]]></category>
		<category><![CDATA[federated learning]]></category>
		<category><![CDATA[federated learning optimization]]></category>
		<category><![CDATA[improving convergence speed in federated learning]]></category>
		<category><![CDATA[Machine learning]]></category>
		<category><![CDATA[membership inference attacks]]></category>
		<category><![CDATA[non-IID data]]></category>
		<category><![CDATA[phased client selection in machine learning]]></category>
		<category><![CDATA[POCS]]></category>
		<category><![CDATA[POCS client selection algorithm]]></category>
		<category><![CDATA[privacy]]></category>
		<category><![CDATA[privacy-preserving AI training]]></category>
		<category><![CDATA[reducing bandwidth in distributed AI]]></category>
		<guid isPermaLink="false">https://scienmag.com/?p=215603</guid>

					<description><![CDATA[A new phased client selection method for federated learning improves accuracy, cuts training time and communication costs, and strengthens defenses against membership inference attacks.]]></description>
										<content:encoded><![CDATA[<p>Federated learning has become one of the most important tools for training artificial intelligence systems without centralizing sensitive data, allowing millions of smartphones, hospitals, and other devices to build a shared model while their raw information never leaves the device. But the technique has persistent weaknesses: it hogs bandwidth with round after round of model exchanges, converges slowly when data is spread unevenly across participants, and remains vulnerable to attacks that can leak private information from the updates themselves. A new study published in Applied Intelligence by Xuerui Li and Chunming Qiao of the University at Buffalo and Yangming Zhao of the University of Science and Technology of China argues that a surprising amount of these problems can be solved with one deceptively simple idea: choose different clients to train on at different stages of the learning process.</p>
<p>The researchers call their method POCS, short for Phased Optimal Client Selection. Rather than selecting participants randomly, or applying the same selection rule in every training round, POCS tailors its selection strategy to the phase the model is in. Early on, when the model is most impressionable, it recruits a carefully chosen representative set. In the middle of training, it filters out low-value updates. Near convergence, it deliberately seeks out clients whose updates are as diverse as possible, squeezing out the last improvements to accuracy.</p>
<p>The motivation comes from an observation made in earlier work on what researchers call critical learning phases. Deep neural networks, it turns out, are acutely sensitive to what happens during their first few training rounds. If the model learns from low-quality or unrepresentative data at the start, that damage can never fully be repaired later. One prior approach, CriticalFL, tried to exploit this by enrolling more clients in the first twenty rounds and fewer afterward. But flooding the server with participants early creates uplink congestion, and clients that fail to finish their local training or fall prey to adversaries can poison the whole global model. Conversely, shrinking participation too aggressively near the end starves the model of the varied information it still needs.</p>
<p>POCS attacks the early phase with a combination of clustering and median-gradient selection. Before training begins, the server groups clients according to their data distributions, and it re-clusters whenever clients join or leave. Within each cluster, it identifies a representative client whose gradients sit close to the median of the group, on the mathematical logic that a single well-chosen device can approximate the collective contribution of its entire cluster. The method builds on a formal bound showing that the difference between the full gradient of all clients and the weighted gradient of a selected subset can be controlled by minimizing, for every client, the distance to the nearest selected one. This turns client selection into a constrained maximization problem that a sub-modular optimization approach can solve efficiently. The framework also incorporates the team&#8217;s earlier robust client selection and replacement technique, RCSR, which identifies problematic clients that drop out or misbehave and substitutes normal clients with similar data distributions to avoid biasing the model.</p>
<p>After the critical first rounds, the challenge shifts. Gradient norms shrink as the model improves, so many updates carry little useful signal while still costing bandwidth. POCS therefore applies an adaptive threshold to decide which clients should upload at all. Rather than a fixed cutoff, the threshold follows an Ornstein-Uhlenbeck process, a Gauss-Markov model from stochastic physics that naturally decays toward a mean, mirroring how stochastic gradient descent itself drifts toward a minimum. Parameters of this process are tuned with a multi-armed bandit algorithm, so the system learns in real time which cutoffs capture meaningful updates without discarding information the model still needs.</p>
<p>A notable strength of the work is that the authors prove their algorithm converges, a step that fewer than ten percent of client selection papers in the field take. Under the assumptions that each objective function is smooth and strongly convex, that gradient variances are bounded, and that the selected subset approximates the full population&#8217;s gradients within a bounded error, they show the expected distance to the optimal model shrinks on the order of one over the number of rounds, plus a term governed by the approximation error. In other words, being selective does not break the mathematics of federated learning; it merely shifts the fixed point by a controlled amount.</p>
<p>To test the method empirically, the team ran experiments on CIFAR-10, Fashion-MNIST, and the Shakespeare text dataset, using ResNet-18, AlexNet, VGG-11, and LSTM architectures. Crucially, they simulated the non-I.I.D. conditions of real federated deployments by partitioning data across clients according to a Dirichlet distribution, with skewness parameters ranging from 0.1 to 0.3. Each configuration was run five times on GeForce RTX Titan GPUs and the results averaged. The experiments confirmed that twenty critical training rounds strike the best balance, so that number anchors the method&#8217;s first phase.</p>
<p>Against five state-of-the-art competitors, including FedPod, DynamicFL, FedHD, DPFL-BCS, and BSFL, POCS came out ahead on every metric tested. It achieved higher final accuracy on all three datasets and at all levels of data heterogeneity, and the advantage grew as the data became more skewed across clients. It also reached target accuracies in fewer training rounds and accumulated lower communication costs by the time the model converged, a direct consequence of sending fewer, better-chosen updates over the network. In settings where bandwidth and battery life are the limiting resources, those savings translate into meaningfully cheaper deployments.</p>
<p>Perhaps the most striking result concerns privacy. Membership inference attacks attempt to determine whether a particular data record was used in training, exploiting traces left in model updates. Because federated learning servers aggregate updates from many clients, a single compromised or vulnerable participant can expose information about everyone&#8217;s data. The researchers tested POCS against this threat in a deliberately harsh worst-case scenario, telling the attackers exactly which clients were invulnerable and which defense was in place. Even so, POCS reduced the success rate of membership inference attacks compared with FedPod on both image datasets. The mechanism is straightforward: because the server selects clients judiciously and filters the updates it accepts, updates from vulnerable devices simply never reach the aggregate. The team also found that attack accuracy barely changed whether measured at round twenty or at the end of training, suggesting the protection holds throughout the process.</p>
<p>The work does not claim to have solved federated learning&#8217;s every problem. The authors note that performance under severe non-I.I.D. conditions remains a target for future improvement, and the theoretical guarantees apply to the strongly convex setting rather than the fully general deep learning case. Still, the core insight is likely to influence how the field thinks about training orchestration: the composition of participants should evolve with the model, not stay fixed. As federated learning scales toward the massive, heterogeneous fleets of devices envisioned for next-generation privacy-preserving AI, techniques like POCS suggest that the biggest gains may come not from smarter models, but from smarter decisions about who gets to teach them.</p>
<p><strong>Subject of Research:</strong> Phased client selection strategies to improve efficiency and privacy in federated learning</p>
<p><strong>Article Title:</strong> POCS: phased optimal client selection for federated learning</p>
<p><strong>Article References:</strong> Li, X., Zhao, Y., &amp; Qiao, C. (2026). POCS: phased optimal client selection for federated learning. <em>Applied Intelligence, 56</em>(15), Article 448. <a href="https://doi.org/10.1007/s10489-026-07462-0" rel="noopener noreferrer">https://doi.org/10.1007/s10489-026-07462-0</a></p>
<p><strong>Image Credits:</strong> AI Generated</p>
<p><strong>DOI:</strong> <a href="https://doi.org/10.1007/s10489-026-07462-0" rel="noopener noreferrer">10.1007/s10489-026-07462-0</a></p>
<p><strong>Keywords:</strong> federated learning, client selection, POCS, machine learning, communication efficiency, membership inference attacks, non-IID data, convergence analysis, privacy, distributed optimization, deep neural networks, Applied Intelligence</p>
]]></content:encoded>
					
		
		
		<post-id xmlns="com-wordpress:feed-additions:1">215603</post-id>	</item>
		<item>
		<title>Fuzzy AI Model Promises Smarter Risk Prediction for Oil and Gas Pipelines</title>
		<link>https://scienmag.com/fuzzy-ai-model-promises-smarter-risk-prediction-for-oil-and-gas-pipelines/</link>
		
		<dc:creator><![CDATA[Blake Davidson]]></dc:creator>
		<pubDate>Mon, 21 Sep 2026 02:53:50 +0000</pubDate>
				<category><![CDATA[Climate]]></category>
		<category><![CDATA[Artificial Intelligence]]></category>
		<category><![CDATA[asset integrity]]></category>
		<category><![CDATA[corrosion]]></category>
		<category><![CDATA[deep neural networks]]></category>
		<category><![CDATA[fuzzy logic]]></category>
		<category><![CDATA[Intuitionistic fuzzy sets]]></category>
		<category><![CDATA[Machine learning]]></category>
		<category><![CDATA[oil and gas pipelines]]></category>
		<category><![CDATA[pipeline integrity management]]></category>
		<category><![CDATA[risk assessment]]></category>
		<category><![CDATA[risk-based inspection]]></category>
		<category><![CDATA[uncertainty modeling]]></category>
		<guid isPermaLink="false">https://scienmag.com/?p=205064</guid>

					<description><![CDATA[Researchers have developed a hybrid intuitionistic fuzzy deep neural network that markedly improves risk assessment accuracy for onshore oil and gas pipelines.]]></description>
										<content:encoded><![CDATA[<p>Pipeline networks are the hidden arteries of the global energy system, quietly moving crude oil, produced water, and refined hydrocarbons across thousands of kilometers of terrain every day. When these systems fail, the consequences can be catastrophic: loss of containment, environmental devastation, financial ruin, and in the worst cases, loss of human life. History offers sobering reminders, from the Macondo well blowout that drove a leading oil and gas company into bankruptcy to countless smaller corrosion-related leaks that quietly erode both profits and public trust. Now, a team of researchers from Institut Teknologi Sepuluh Nopember in Surabaya, Indonesia, has developed a hybrid artificial intelligence framework that promises to make pipeline risk assessment dramatically more accurate, more transparent, and more honest about its own uncertainty.</p>
<p>The study, published in the journal Cleaner Engineering and Technology, introduces an intuitionistic fuzzy deep neural network (IFDNN) method designed to overcome one of the most stubborn problems in industrial safety engineering: uncertainty. Traditional risk assessment models, however sophisticated, ultimately force messy, incomplete, and subjective real-world information into neat numerical categories. The researchers argue that this simplification is precisely where safety margins are lost, because the world of pipeline integrity is governed not by crisp numbers but by vague expert judgments, sparse inspection records, and damage mechanisms that evolve in ways no single probability distribution can capture.</p>
<p>Lead author Tri Wahono and colleagues Imam Mukhlash, Endah R.M. Putri, and Agung Purniawan built their model on a mathematical foundation first laid out in 1986, when mathematician Krassimir Atanassov extended classical fuzzy set theory. Ordinary fuzzy logic, pioneered by Lotfi Zadeh in 1965, allows an element to belong to a set to a partial degree, capturing the vagueness of linguistic judgments such as &#8220;corrosion risk is fairly high.&#8221; Intuitionistic fuzzy sets go one step further by assigning each element both a membership degree and a non-membership degree, with the gap between them representing an explicit hesitation component. This three-part structure means the model does not merely say how strongly a factor contributes to risk, but also how strongly it does not, and how much doubt remains in between.</p>
<p>The new framework unfolds in three carefully sequenced stages. First, the team anchored their approach in two established industry standards, the Kent Muhlbauer pipeline risk model and the American Petroleum Institute&#8217;s RP 581 risk-based inspection methodology, which together organize pipeline threats into eight main factors and thirty-one sub-factors. Failure probability is evaluated against corrosion, third-party damage, sabotage, incorrect operation, and geohazards, while consequences are assessed across safety, environmental, and financial dimensions, each rated on a scale from one to five. In the second stage, these numerical ratings are transformed into triangular intuitionistic fuzzy numbers through a fuzzification process, allowing every judgment about the pipeline to carry its own envelope of uncertainty.</p>
<p>At the heart of the method sits an intuitionistic fuzzy inference system built on the Mamdani architecture, which propagates fuzzy, rather than fixed, output values through a rule base of conditional statements. For the probability of failure alone, combining five input factors across five linguistic categories generates 3,125 distinct intuitionistic fuzzy implications, while the three consequence factors generate another 125. Each rule computes a membership degree through a sup-min operator and a non-membership degree through an inf-max operator, aggregating thousands of rules into a coherent fuzzy picture of risk. A tunable defuzzification operator then converts these fuzzy outputs back into crisp numbers, with a parameter that lets analysts decide how sensitive the final risk score should be to lingering uncertainty.</p>
<p>The third stage is where deep learning enters. The intuitionistic fuzzy membership and non-membership degrees produced by the inference system become the training inputs for a deep neural network constructed in TensorFlow-Keras. After systematic experimentation, the researchers settled on a feedforward architecture with four fully connected hidden layers of 128, 64, 32, and 16 neurons, using the Gaussian error linear unit (GELU) activation function, which outperformed ReLU and SiLU alternatives. Trained with the Adam optimizer on data split into 70 percent training, 20 percent testing, and 10 percent validation subsets, the network achieved an R-squared of 0.99443 with a mean squared error of just 0.000101, performance the authors describe as robust across training, testing, and validation data alike.</p>
<p>The model was not tested on toy data. The case study drew on approximately 1,750 kilometers of onshore upstream oil and gas pipelines spread across 15 operational fields, divided into 19,405 sub-segments. Diameters ranged from 4 to 40 inches and asset ages from under a decade to more than half a century, capturing the full diversity of a mature pipeline estate, including aging networks near populated areas where decades of corrosion pose genuine integrity concerns. The network transports produced fluids from wells to processing facilities, produced water to injection wells, and crude oil to storage and refinery units, providing exactly the kind of heterogeneous operating conditions that break simpler models.</p>
<p>The comparative results are striking. Where the traditional Muhlbauer-based model classified the first of three representative pipeline segments as high risk, the intuitionistic fuzzy deep neural network downgraded it to medium risk after properly weighing the relative importance of each contributing factor. Segment 2 remained medium risk, while Segment 3, an aging transmission line near public and environmentally sensitive areas, was consistently flagged as highest risk by all three approaches. Crucially, the risk prioritization order survived the transition to the new model, with Segment 3 ranking above Segment 1 and Segment 2 last, demonstrating that the hybrid method sharpens resolution without distorting the underlying risk landscape. Corrosion emerged as the dominant driver of failure probability, pointing operators toward targeted interventions: high-resolution internal inspection, chemical injection programs suited to specific mechanisms such as microbiologically influenced corrosion or CO2 corrosion, protective coatings, and repair or replacement of sections failing fit-for-service criteria.</p>
<p>The practical implications extend well beyond academic benchmarking. Because risk-based inspection concentrates resources where they matter most, a model that more accurately distinguishes high-risk from low-risk equipment translates directly into fewer unnecessary inspections, longer intervals between interventions on genuinely safe segments, and lower lifecycle costs without sacrificing safety. The researchers emphasize that overestimating risk is expensive in its own right, since inspecting low-risk equipment more frequently drains budgets that could be protecting genuinely dangerous assets. They envision the framework transforming fixed-cycle inspection plans into predictive, risk-informed maintenance programs, though they caution that successful deployment requires user training, data validation, phased integration, and pilot testing. Limitations remain: the model has so far been validated only on onshore pipelines, does not yet capture interactions among multiple simultaneous threats, and would benefit from integration with real-time monitoring for dynamic risk prediction. Extending the framework to offshore systems and to the tangled dependencies among corrosion, mechanical damage, and material defects stands as the team&#8217;s next frontier in the ongoing effort to keep the world&#8217;s energy arteries safe.</p>
<p><strong>Subject of Research:</strong> A hybrid intuitionistic fuzzy deep neural network method for risk assessment of oil and gas pipelines</p>
<p><strong>Article Title:</strong> An intuitionistic fuzzy deep neural network method for risk assessment of oil and gas pipelines</p>
<p><strong>Article References:</strong> Wahono, T., Mukhlash, I., Putri, E. R., &amp; Purniawan, A. (2026). An intuitionistic fuzzy deep neural network method for risk assessment of oil and gas pipelines. <em>Cleaner Engineering and Technology, 34</em>, Article 101299. <a href="https://doi.org/10.1016/j.clet.2026.101299" rel="noopener noreferrer">https://doi.org/10.1016/j.clet.2026.101299</a></p>
<p><strong>Image Credits:</strong> AI Generated</p>
<p><strong>DOI:</strong> <a href="https://doi.org/10.1016/j.clet.2026.101299" rel="noopener noreferrer">10.1016/j.clet.2026.101299</a></p>
<p><strong>Keywords:</strong> oil and gas pipelines, risk assessment, intuitionistic fuzzy sets, deep neural networks, risk-based inspection, pipeline integrity management, artificial intelligence, corrosion, fuzzy logic, uncertainty modeling, machine learning, asset integrity</p>
]]></content:encoded>
					
		
		
		<post-id xmlns="com-wordpress:feed-additions:1">205064</post-id>	</item>
	</channel>
</rss>
