<?xml version="1.0" encoding="UTF-8"?><rss version="2.0"
	xmlns:content="http://purl.org/rss/1.0/modules/content/"
	xmlns:wfw="http://wellformedweb.org/CommentAPI/"
	xmlns:dc="http://purl.org/dc/elements/1.1/"
	xmlns:atom="http://www.w3.org/2005/Atom"
	xmlns:sy="http://purl.org/rss/1.0/modules/syndication/"
	xmlns:slash="http://purl.org/rss/1.0/modules/slash/"
	>

<channel>
	<title>prototypical networks &#8211; Science</title>
	<atom:link href="https://scienmag.com/tag/prototypical-networks/feed/" rel="self" type="application/rss+xml" />
	<link>https://scienmag.com</link>
	<description></description>
	<lastBuildDate>Sat, 10 Oct 2026 22:06:34 +0000</lastBuildDate>
	<language>en-US</language>
	<sy:updatePeriod>
	hourly	</sy:updatePeriod>
	<sy:updateFrequency>
	1	</sy:updateFrequency>
	<generator>https://wordpress.org/?v=7.1.3</generator>

<image>
	<url>https://scienmag.com/wp-content/uploads/2024/07/cropped-scienmag_ico-32x32.jpg</url>
	<title>prototypical networks &#8211; Science</title>
	<link>https://scienmag.com</link>
	<width>32</width>
	<height>32</height>
</image> 
<site xmlns="com-wordpress:feed-additions:1">73899611</site>	<item>
		<title>Teaching AI Defenses to Survive Attacks With Just Three Examples</title>
		<link>https://scienmag.com/teaching-ai-defenses-to-survive-attacks-with-just-three-examples/</link>
		
		<dc:creator><![CDATA[Hailey Crawford]]></dc:creator>
		<pubDate>Sat, 10 Oct 2026 22:06:34 +0000</pubDate>
				<category><![CDATA[Technology and Engineering]]></category>
		<category><![CDATA[adversarial attack defense]]></category>
		<category><![CDATA[adversarial attacks]]></category>
		<category><![CDATA[adversarial training]]></category>
		<category><![CDATA[AI resilience against attacks]]></category>
		<category><![CDATA[AI-based intrusion detection]]></category>
		<category><![CDATA[cybersecurity]]></category>
		<category><![CDATA[Few-shot learning]]></category>
		<category><![CDATA[few-shot learning in cybersecurity]]></category>
		<category><![CDATA[FGSM]]></category>
		<category><![CDATA[heterogeneous networks security]]></category>
		<category><![CDATA[Internet of Things]]></category>
		<category><![CDATA[intrusion detection]]></category>
		<category><![CDATA[IoT device vulnerability]]></category>
		<category><![CDATA[IoT security]]></category>
		<category><![CDATA[limited data cybersecurity solutions]]></category>
		<category><![CDATA[Machine learning]]></category>
		<category><![CDATA[machine learning robustness]]></category>
		<category><![CDATA[network security]]></category>
		<category><![CDATA[network traffic anomaly detection]]></category>
		<category><![CDATA[PGD]]></category>
		<category><![CDATA[privacy concerns in IoT security]]></category>
		<category><![CDATA[prototypical networks]]></category>
		<category><![CDATA[resource-constrained devices]]></category>
		<category><![CDATA[smart environment security]]></category>
		<guid isPermaLink="false">https://scienmag.com/?p=260070</guid>

					<description><![CDATA[Researchers have combined prototypical few-shot learning with adversarial training to build an IoT intrusion detection system that learns attacks from three examples per class and retains 80 to 90 percent accuracy under white-box adversarial attacks.]]></description>
										<content:encoded><![CDATA[<p>Internet of Things devices have quietly become the nervous system of modern life, pulsing through smart homes, hospital wards, factories, and power grids. Yet the same devices that make our environments intelligent also make them dangerously exposed. Most IoT hardware runs on modest processors, carries inconsistent security configurations, and sits in heterogeneous networks that change constantly. That combination makes them prime targets for attackers, and increasingly for attackers who wield artificial intelligence themselves. A new study published in Cluster Computing by Fatima Asiri of King Khalid University and colleagues proposes a way to fight back: an intrusion detection system that learns to recognize attacks from only a handful of examples and, crucially, refuses to be fooled by deliberately corrupted inputs.</p>
<p>The core problem the researchers tackled is twofold. First, conventional intrusion detection systems rely on enormous, carefully labeled datasets of network traffic. In IoT settings, such datasets are nearly impossible to assemble, because privacy concerns, thin monitoring infrastructure, and the sheer cost of manual annotation get in the way. Second, even the newer generation of few-shot learning systems, which are designed to learn from scarce data, turn out to be exquisitely vulnerable to adversarial examples: inputs that have been nudged by tiny, mathematically optimized perturbations designed to push them across a classifier&#8217;s decision boundary. A model can look brilliant on clean traffic and collapse catastrophically the moment an adversary bends it.</p>
<p>The team&#8217;s answer, which they call Adv-ProtoNet, fuses two ideas that had previously lived separate lives. The first is a Prototypical Network, a metric-based few-shot learning architecture. Instead of memorizing decision boundaries from millions of samples, the network learns an embedding function that maps network traffic into a space where each class of traffic, benign or malicious, is represented by a prototype, essentially the center of mass of its few labeled examples. A new packet is classified by measuring its squared Euclidean distance to each prototype and applying a softmax over those distances. The second idea is adversarial training, in which the model is deliberately attacked during training with perturbed versions of its own data so that it learns to withstand such attacks in the wild.</p>
<p>The integration is formulated as a min-max optimization problem. In the inner loop, the system generates the worst-case perturbation it can within a small, norm-bounded ball around each query sample, using one of four canonical gradient-based attacks: the Fast Gradient Sign Method (FGSM), the optimization-based Carlini and Wagner (C&amp;W) attack, the boundary-seeking DeepFool, and the iterative Projected Gradient Descent (PGD), widely regarded as the gold-standard benchmark for first-order adversaries. In the outer loop, the network minimizes a weighted sum of the standard few-shot loss and the adversarial loss, with a hyperparameter lambda balancing clean accuracy against robustness. The effect, the authors explain, is to enforce local smoothness in the embedding space: small perturbations no longer drag a sample away from its true class prototype, so the entire neighborhood around each example remains inside the correct decision region.</p>
<p>Importantly, the researchers evaluated their system under a strict white-box threat model, the most pessimistic assumption possible. The adversary is assumed to know the model&#8217;s architecture, its feature representation, and its internal weights, and can therefore compute full gradients to craft highly optimized attacks. The security goals were correspondingly framed as worst-case guarantees against first-order adversaries. This is a deliberately conservative choice; a system that survives white-box attacks is far harder to defeat in the messier, information-poor conditions of a real network.</p>
<p>The experimental stage was the IDSIoT2024 dataset, a large and recent collection of more than 16 million network traffic samples spanning 96 features and seven classes: benign traffic plus six attack categories, including denial of service, injection, man-in-the-middle, malware, routing, and vulnerability analysis. The data was standardized to zero mean and unit variance, then split into 64 percent training, 16 percent validation, and 20 percent testing subsets with a fixed random seed to prevent leakage. Training followed an episodic protocol: across 5,000 episodes, each task sampled all seven classes with just three support examples per class to build the prototypes and five query examples to compute the loss. This three-shot regime deliberately mimics the data poverty of real IoT deployments.</p>
<p>Under benign conditions, the framework performed impressively. The baseline Prototypical Network achieved a mean accuracy of 93.83 percent, with precision at 93.72 percent and an F1-score of 93.75 percent. The class-wise picture was even more striking: the model correctly identified 99 percent of denial of service attacks and a perfect 100 percent of man-in-the-middle, malware, and routing attacks, with only the injection class lagging at 80 percent detection. For a system that never saw more than three labeled examples per class, this is a strong demonstration that metric learning can anchor reliable class prototypes even in extremely low-data regimes.</p>
<p>Then came the adversarial stress tests, and the initial results were sobering. Without adversarial training, accuracy collapsed to 11.43 percent under FGSM, 14.23 percent under C&amp;W, 14.23 percent under DeepFool, and 14.46 percent under PGD, a near-random level of performance that shows how thoroughly perturbations scrambled the distance relationships in the embedding space. After integrating each attack into the episodic training loop, however, the picture transformed. Accuracy recovered to 86.57 percent against FGSM, 87.43 percent against C&amp;W, 87.83 percent against PGD, and a remarkable 94.97 percent against DeepFool, effectively matching the clean baseline. The confusion matrices confirmed the recovery, with true-positive diagonals restored and class accuracies returning to 100 percent for several attack types under the DeepFool scenario.</p>
<p>Ablation studies and comparisons sharpened the message. A standard deep neural network, despite reaching 93.66 percent on clean data, fell to between roughly 43 and 51 percent under attack. A standard Prototypical Network did even better on clean data at 94.69 percent but collapsed to between 20 and 29 percent under adversarial pressure, proving that metric learning alone offers no immunity. Only the hybrid Adv-ProtoNet, trading a few points of clean accuracy for consistent robustness in the 78 to 83 percent range across all four attacks, held the line. Classical baselines constrained to the same three-shot regime fared far worse on clean data, with a support vector machine managing just 55.94 percent and a random forest 74.69 percent, compared with 95.71 percent for the standard ProtoNet. Matching Networks and Relation Networks, other state-of-the-art few-shot methods, matched or exceeded the clean accuracy of the proposed model but crumbled under PGD to below 21 percent, leaving Adv-ProtoNet as the only framework in the comparison that survived the full adversarial gauntlet.</p>
<p>Just as important for real-world deployment is the computational profile. The framework&#8217;s memory footprint stays between roughly 20 and 20.4 megabytes even with adversarial optimization enabled, because the perturbation generation reuses existing computational graph allocations. Meta-training, which takes between about 32 and 182 seconds depending on the attack, runs offline on centralized hardware, so the burden never touches the IoT edge. Inference is the critical metric for live defense, and here the numbers are compelling: standard queries are classified in 0.06 to 0.09 milliseconds, and even the heaviest adversarial evaluation stays under one millisecond. The authors caution that future work must extend the approach to black-box and transfer-based attacks and to lightweight adaptations for real-time edge deployment, but the study makes a persuasive case that the dual challenges of data scarcity and adversarial vulnerability in IoT security are not separate problems to be solved in isolation. They are, it turns out, best solved together, by teaching a model to recognize attacks from almost nothing and to hold its ground when those attacks fight back.</p>
<p><strong>Subject of Research:</strong> Adversarially robust few-shot learning for intrusion detection in Internet of Things networks</p>
<p><strong>Article Title:</strong> Adversarially robust few-shot learning for aI-enabled attack mitigation in the internet of things</p>
<p><strong>Article References:</strong> Asiri, F., Alturki, N., Alnazzawi, N., Khattak, A. A., Ali, H., Naeem, U., &amp; Latif, S. (2026). Adversarially robust few-shot learning for aI-enabled attack mitigation in the internet of things. <em>Cluster Computing, 29</em>(12), Article 731. <a href="https://doi.org/10.1007/s10586-026-06528-5" rel="noopener noreferrer">https://doi.org/10.1007/s10586-026-06528-5</a></p>
<p><strong>Image Credits:</strong> AI Generated</p>
<p><strong>DOI:</strong> <a href="https://doi.org/10.1007/s10586-026-06528-5" rel="noopener noreferrer">10.1007/s10586-026-06528-5</a></p>
<p><strong>Keywords:</strong> Internet of Things, few-shot learning, adversarial training, intrusion detection, prototypical networks, cybersecurity, machine learning, adversarial attacks, FGSM, PGD, network security, resource-constrained devices</p>
]]></content:encoded>
					
		
		
		<post-id xmlns="com-wordpress:feed-additions:1">260070</post-id>	</item>
		<item>
		<title>AI Learns to Grade Crohn&#8217;s Disease Severity From Just a Handful of Expert-Labeled Cases</title>
		<link>https://scienmag.com/ai-learns-to-grade-crohns-disease-severity-from-just-a-handful-of-expert-labeled-cases/</link>
		
		<dc:creator><![CDATA[Ophelia Keating]]></dc:creator>
		<pubDate>Fri, 09 Oct 2026 07:57:00 +0000</pubDate>
				<category><![CDATA[Medicine]]></category>
		<category><![CDATA[AI in medical diagnosis]]></category>
		<category><![CDATA[AI-driven gastroenterology diagnostics]]></category>
		<category><![CDATA[clinical decision support]]></category>
		<category><![CDATA[clinical severity grading]]></category>
		<category><![CDATA[Crohn's disease severity assessment]]></category>
		<category><![CDATA[Crohn’s disease]]></category>
		<category><![CDATA[CT enterography]]></category>
		<category><![CDATA[electronic medical records]]></category>
		<category><![CDATA[endoscopic findings in Crohn's disease]]></category>
		<category><![CDATA[expert-labeled medical data]]></category>
		<category><![CDATA[Few-shot learning]]></category>
		<category><![CDATA[few-shot learning in healthcare]]></category>
		<category><![CDATA[inflammatory bowel disease]]></category>
		<category><![CDATA[innovative approaches in Crohn's disease management]]></category>
		<category><![CDATA[limited data machine learning applications]]></category>
		<category><![CDATA[Machine learning]]></category>
		<category><![CDATA[machine learning for inflammatory bowel disease]]></category>
		<category><![CDATA[medical imaging and AI]]></category>
		<category><![CDATA[nested cross-validation]]></category>
		<category><![CDATA[personalized treatment planning in Crohn's]]></category>
		<category><![CDATA[predictive markers]]></category>
		<category><![CDATA[prototypical networks]]></category>
		<category><![CDATA[severity stratification]]></category>
		<category><![CDATA[SHAP interpretability]]></category>
		<guid isPermaLink="false">https://scienmag.com/?p=252629</guid>

					<description><![CDATA[Researchers in China built a prototypical network-based few-shot learning framework that reproduces expert consensus severity stratification in newly diagnosed Crohn's disease from small electronic medical record datasets.]]></description>
										<content:encoded><![CDATA[<p>When a patient is newly diagnosed with Crohn&#8217;s disease, one of the most consequential questions a gastroenterologist must answer is deceptively simple: how severe is the disease right now? The answer shapes everything that follows, from the choice of first-line therapy to the urgency of escalation to biologic drugs. Yet severity assessment at initial diagnosis remains a stubbornly subjective exercise, dependent on expert judgment that synthesizes endoscopic findings, cross-sectional imaging, laboratory values, and clinical symptoms. A new study published in the Journal of Translational Medicine suggests that artificial intelligence may be able to shoulder part of that burden, even when the training data available to it is far smaller than what machine learning typically demands.</p>
<p>The research, led by JiaLi Zhou and colleagues at Zhongshan Hospital of Xiamen University in China, tackled a problem that has long frustrated the application of deep learning to medicine: the scarcity of expertly labeled data. Standard supervised learning algorithms generally require thousands of examples to learn reliably, but assembling large cohorts of newly diagnosed Crohn&#8217;s disease patients with consensus severity grades from multiple specialists is expensive, slow, and often impractical in a single center. The team&#8217;s solution was to turn to few-shot learning, a family of techniques specifically designed to extract maximum signal from minimal labeled data.</p>
<p>The study drew on the electronic medical records of 106 patients with newly diagnosed Crohn&#8217;s disease treated at Zhongshan Hospital. For each patient, a panel of experts produced a consensus severity classification, which served as the reference standard the algorithms would attempt to reproduce. Rather than treating severity as a single continuous score, the framework aimed to replicate the categorical stratification that expert consensus produces, effectively teaching a machine to mimic the collective judgment of experienced clinicians at the moment of diagnosis.</p>
<p>Three distinct few-shot learning architectures were built and compared. The first was a metric learning approach, which trains a model to map patient records into a mathematical space where similar cases land close together and dissimilar cases land far apart. The second, matching networks, extends this idea by comparing each new patient against a small set of labeled examples at prediction time, weighing the evidence from each comparison. The third, and ultimately the star of the study, was the prototypical network, which computes a representative prototype, essentially an average embedding, for each severity class and then classifies new patients by measuring which prototype they most resemble. This approach is elegant in its simplicity: instead of memorizing individual cases, the model learns a compact summary of what mild, moderate, and severe disease each look like in the data.</p>
<p>To evaluate the models rigorously, the researchers employed nested cross-validation, a demanding scheme in which model selection and performance estimation are kept separate to avoid optimistic bias. For standardized comparison, each trained feature embedding backbone was followed by a logistic regression classifier fitted on training-set embeddings and applied to the corresponding validation fold. Performance was measured using accuracy, macro-F1 score, and the area under the receiver operating characteristic curve, or AUC, across different combinations of input features. The prototypical network emerged as the strongest performer, achieving a mean macro-F1 of 0.817, narrowly ahead of matching networks at 0.812 and metric learning at 0.796. Given the modest size of the dataset, the consistency of these results across architectures is itself noteworthy, suggesting that the underlying clinical features carry genuine, learnable structure related to severity.</p>
<p>One of the most important contributions of the study lies in its commitment to interpretability. Black-box predictions are a hard sell in clinical medicine, where physicians need to understand why a model assigns a particular grade before trusting it. The researchers applied SHAP, or SHapley Additive exPlanations, a technique borrowed from cooperative game theory that assigns each input feature a quantitative contribution to every individual prediction. Combined with Pearson correlation analysis, the SHAP framework identified which clinical variables drove the severity classifications, giving clinicians a window into the model&#8217;s reasoning rather than forcing them to accept its verdicts on faith.</p>
<p>The team also probed how much the model depended on cross-sectional imaging. CT enterography, or CTE, provides detailed structural information about the bowel wall and surrounding tissues, and it is a cornerstone of severity assessment in Crohn&#8217;s disease. In a feature-ablation analysis centered on the prototypical network, the researchers removed the CTE-derived features and re-evaluated performance in a temporally independent validation cohort of 23 patients, meaning patients diagnosed after the model development period. The results were revealing: the model retained acceptable AUCs for classifying mild and moderate disease without imaging data, but the AUC for the severe class dropped to 0.842. The message is clear that structural information from cross-sectional imaging remains particularly important for recognizing severe disease, precisely the category where treatment decisions are most consequential.</p>
<p>The authors are candid about the limitations of their work, and this transparency matters for how the findings should be interpreted. Because some of the same clinical information that informed the expert consensus labels also served as model predictors, the performance estimates are subject to incorporation bias. In other words, the model is, to some extent, learning to reproduce the inputs that experts themselves weighed, rather than discovering entirely independent markers of severity. The validation cohort of 23 patients is also small, and the study was conducted at a single center, raising questions about how well the framework would generalize to populations with different demographics, care pathways, or data recording practices.</p>
<p>Despite these caveats, the study represents a meaningful proof of concept for a scenario that is increasingly common in clinical machine learning: the expert-labeled dataset that is too small for conventional deep learning but too valuable to ignore. Few-shot learning offers a principled middle path, leveraging metric-space reasoning and prototype construction to squeeze reliable classification out of dozens rather than thousands of cases. If larger, multicenter, and fully independent validations confirm these preliminary results, the framework could evolve into a decision-support tool that standardizes baseline risk stratification at diagnosis, helping to ensure that patients with severe Crohn&#8217;s disease are identified and treated aggressively from the outset, regardless of which clinician first evaluates them.</p>
<p>The work also highlights a broader trend in translational medicine, where the bottleneck is shifting from algorithmic capability to the quality and consistency of clinical reference standards. Expert consensus labels are the gold standard by necessity, but they are labor-intensive and inherently subjective at the margins. A machine learning framework that can approximate that consensus reliably, and explain its reasoning through tools like SHAP, could eventually help harmonize severity assessment across centers, making clinical trials more comparable and everyday care more consistent. For now, the Xiamen team&#8217;s prototypical network remains a promising prototype in its own right, awaiting the larger independent cohorts that will determine whether it can move from retrospective analysis to the clinic.</p>
<p><strong>Subject of Research:</strong> Few-shot machine learning for expert-consensus severity stratification in newly diagnosed Crohn&#x27;s disease</p>
<p><strong>Article Title:</strong> Few-shot learning for expert consensus severity stratification in newly diagnosed crohn’s disease</p>
<p><strong>Article References:</strong> Zhou, J., Chen, Y., Chen, Y., Bao, J., Xu, J., Deng, L., Hu, Y., &amp; Dong, J. (2026). Few-shot learning for expert consensus severity stratification in newly diagnosed crohn’s disease. <em>Journal of Translational Medicine</em>. <a href="https://doi.org/10.1186/s12967-026-09041-w" rel="noopener noreferrer">https://doi.org/10.1186/s12967-026-09041-w</a></p>
<p><strong>Image Credits:</strong> AI Generated</p>
<p><strong>DOI:</strong> <a href="https://doi.org/10.1186/s12967-026-09041-w" rel="noopener noreferrer">10.1186/s12967-026-09041-w</a></p>
<p><strong>Keywords:</strong> few-shot learning, Crohn&#x27;s disease, machine learning, electronic medical records, prototypical networks, severity stratification, inflammatory bowel disease, SHAP interpretability, CT enterography, clinical decision support, nested cross-validation, predictive markers</p>
]]></content:encoded>
					
		
		
		<post-id xmlns="com-wordpress:feed-additions:1">252629</post-id>	</item>
		<item>
		<title>Federated AI Learns to Spot IoT Cyberattacks Without Sharing Private Data</title>
		<link>https://scienmag.com/federated-ai-learns-to-spot-iot-cyberattacks-without-sharing-private-data/</link>
		
		<dc:creator><![CDATA[Veronica Carney]]></dc:creator>
		<pubDate>Sun, 04 Oct 2026 10:04:09 +0000</pubDate>
				<category><![CDATA[Technology and Engineering]]></category>
		<category><![CDATA[collaborative AI models for IoT device protection]]></category>
		<category><![CDATA[contrastive learning]]></category>
		<category><![CDATA[cross-device cyberattack detection in IoT]]></category>
		<category><![CDATA[cybersecurity]]></category>
		<category><![CDATA[decentralized intrusion detection systems]]></category>
		<category><![CDATA[distributed machine learning for healthcare and home IoT security]]></category>
		<category><![CDATA[extreme value theory]]></category>
		<category><![CDATA[Federated AI for IoT cybersecurity]]></category>
		<category><![CDATA[federated AI frameworks for industrial IoT security]]></category>
		<category><![CDATA[federated learning]]></category>
		<category><![CDATA[federated learning for heterogeneous Io]]></category>
		<category><![CDATA[federated learning in smart city security]]></category>
		<category><![CDATA[Few-shot learning]]></category>
		<category><![CDATA[intrusion detection]]></category>
		<category><![CDATA[IoT network traffic anomaly detection]]></category>
		<category><![CDATA[IoT security]]></category>
		<category><![CDATA[non-IID data]]></category>
		<category><![CDATA[non-IID data challenges in IoT cybersecurity]]></category>
		<category><![CDATA[open-set recognition]]></category>
		<category><![CDATA[privacy-aware intrusion detection in connected devices]]></category>
		<category><![CDATA[privacy-preserving machine learning for IoT]]></category>
		<category><![CDATA[prototypical networks]]></category>
		<category><![CDATA[smart cities]]></category>
		<category><![CDATA[zero-day attacks]]></category>
		<guid isPermaLink="false">https://scienmag.com/?p=234582</guid>

					<description><![CDATA[A new federated learning framework called FedCAMP-IDS detects known and zero-day cyberattacks across heterogeneous IoT networks with up to 99.16 percent accuracy while keeping all training data on local devices.]]></description>
										<content:encoded><![CDATA[<p>Researchers in India and Taiwan have unveiled a new artificial intelligence framework that can detect cyberattacks across sprawling networks of Internet of Things devices while keeping the underlying data locked away on each device. The system, called FedCAMP-IDS, was described in a study published in the journal Cluster Computing by Amrendra Singh Yadav of ABV-Indian Institute of Information Technology and Management Gwalior, Vijayant Pawar of Bennett University, and Roshni Yadav of National Chung Hsing University. Their work tackles one of the most stubborn problems in modern cybersecurity: how to train a single, powerful intrusion detection model when the devices that need protection are wildly different from one another, generate non-uniform traffic, and cannot legally or practically pool their data in one place.</p>
<p>The challenge the team set out to solve is rooted in the architecture of the Internet of Things itself. Smart cities, factories, hospitals, and homes now host billions of connected sensors, cameras, controllers, and industrial instruments, each producing its own distinctive stream of network traffic. A security model trained on data from one site often fails dismally when deployed at another, because the statistical distribution of traffic differs from client to client. Machine learning researchers call this non-independent and non-identically distributed data, or non-IID data for short, and it is the bane of federated learning, the technique in which many devices collaboratively train a shared model by exchanging only model updates rather than raw records. Centralized intrusion detection systems, meanwhile, raise privacy concerns because they require collecting sensitive network logs in one location, and they generalize poorly across domains.</p>
<p>FedCAMP-IDS answers these problems with a layered design that combines several ideas from the frontiers of machine learning into one federated pipeline. The first stage is what the authors call Cluster-Aware Contrastive Pretraining, or CACP. Before the network ever learns to classify traffic as benign or malicious, it groups similar traffic patterns using K-means clustering and then applies a contrastive optimization objective guided by cosine similarity. In plain terms, the model is rewarded for pulling representations of similar network behavior closer together in its internal embedding space while pushing dissimilar behavior apart. This produces compact, consistent embeddings that remain comparable across clients even when each client sees a very different slice of the network world, which is precisely the condition that breaks most federated systems.</p>
<p>The second pillar of the framework is a memory-augmented prototypical network, a class of model built for few-shot learning, meaning it can learn to recognize attack categories from only a handful of examples. Prototypical networks work by computing a representative vector, or prototype, for each class of traffic and then classifying new samples by measuring their distance to those prototypes. FedCAMP-IDS enhances this mechanism with an external memory module and an adaptive prototype mixing and refinement procedure, allowing each participating device to personalize its prototypes to local conditions while still benefiting from the collective knowledge of the federation. Because the prototypes, rather than entire datasets or full models, are what get shared, the communication burden stays light and the memory footprint remains bounded, two properties the authors highlight as essential for deployment on resource-constrained IoT infrastructure.</p>
<p>Perhaps the most consequential feature for real-world defenders is the framework&#8217;s approach to the unknown. Most intrusion detectors are closed-set classifiers: they can only assign traffic to the attack categories they were trained on. A genuinely novel exploit, a zero-day attack, or an out-of-distribution anomaly simply gets forced into the nearest familiar bucket, often labeled as benign. FedCAMP-IDS incorporates open-set recognition based on Extreme Value Theory, a statistical framework for modeling the tails of probability distributions. By calibrating how extreme a sample&#8217;s distance from known prototypes is, the system can flag traffic that does not belong to any known class as suspicious without retraining the model. The authors report that this EVT-based calibration enabled robust detection of zero-day and anomalous attacks across their experiments, a capability that could buy network operators precious time when facing adversaries wielding techniques no dataset has ever recorded.</p>
<p>To test the framework, the team ran comprehensive experiments in a distributed federated setting using five widely used benchmark datasets: UNSW-NB15, Bot-IoT, ToN-IoT, CICIDS2018, and NF-UQ-NIDS-v2. These datasets collectively span consumer IoT botnets, industrial telemetry, enterprise network attacks, and modern flow-based traffic captures, giving the evaluation a breadth that mirrors the heterogeneity of real deployments. The results were striking. FedCAMP-IDS achieved up to 99.16 percent accuracy, a 98.53 percent F1-score, and 98.57 percent AUROC, a measure of the model&#8217;s ability to separate malicious from benign traffic across all decision thresholds. Against existing federated intrusion detection baselines, the system outperformed by up to 5.7 percentage points in heterogeneous environments, the very settings where competing approaches tend to falter.</p>
<p>Even more telling was the framework&#8217;s performance under blind cross-dataset evaluation, a brutal test in which a model trained on one dataset is unleashed on an entirely different one it has never seen. Without any additional retraining, FedCAMP-IDS maintained an average accuracy of 82.5 percent across these cross-domain trials. That figure signals strong generalization and open-set robustness, suggesting the learned representations capture fundamental structure in network behavior rather than overfitting to the quirks of a particular capture environment. For security teams, this kind of transferability matters enormously, because attackers do not respect the boundaries between datasets, vendors, or network segments, and retraining models from scratch for every new deployment is rarely feasible at scale.</p>
<p>The design choices also carry practical weight for the economics of deployment. Federated learning systems can choke on communication costs when they require frequent exchange of large model updates among thousands of devices. FedCAMP-IDS sidesteps this with a lightweight prototype-sharing strategy and a bounded-memory design, which the authors say reduces both communication and storage overhead enough to make the framework suitable for scalable rollout in smart-city, enterprise, and industrial IoT infrastructures. The work forms part of the Blockchain Technology Research Group, known as BTrust Lab, at ABV-IIITM Gwalior, and the authors note that the study received no external funding and that they declare no competing interests.</p>
<p>The study arrives amid a wave of research into federated and privacy-preserving intrusion detection, with recent efforts exploring graph-based clustering for aggregation, personalized federated learning, knowledge distillation, contrastive federated approaches, and few-shot self-supervised frameworks for IoT defense. Against that backdrop, FedCAMP-IDS distinguishes itself by unifying pretraining, few-shot prototypical learning, personalization, and open-set recognition in a single architecture rather than treating them as separate problems. If its reported numbers hold up in field deployments, the framework could offer a template for securing the next generation of connected infrastructure, one in which devices learn collectively to defend themselves without ever surrendering the sensitive traffic data that makes them vulnerable in the first place.</p>
<p><strong>Subject of Research:</strong> Privacy-preserving federated learning for intrusion detection in heterogeneous IoT environments</p>
<p><strong>Article Title:</strong> FedCAMP-IDS: a federated cluster-aware memory-augmented prototypical network for intrusion detection in heterogeneous IoT environments</p>
<p><strong>Article References:</strong> Yadav, A. S., Pawar, V., &amp; Yadav, R. (2026). FedCAMP-IDS: a federated cluster-aware memory-augmented prototypical network for intrusion detection in heterogeneous IoT environments. <em>Cluster Computing, 29</em>(14), Article 794. <a href="https://doi.org/10.1007/s10586-026-06538-3" rel="noopener noreferrer">https://doi.org/10.1007/s10586-026-06538-3</a></p>
<p><strong>Image Credits:</strong> AI Generated</p>
<p><strong>DOI:</strong> <a href="https://doi.org/10.1007/s10586-026-06538-3" rel="noopener noreferrer">10.1007/s10586-026-06538-3</a></p>
<p><strong>Keywords:</strong> intrusion detection, federated learning, IoT security, prototypical networks, contrastive learning, zero-day attacks, open-set recognition, extreme value theory, few-shot learning, cybersecurity, non-IID data, smart cities</p>
]]></content:encoded>
					
		
		
		<post-id xmlns="com-wordpress:feed-additions:1">234582</post-id>	</item>
		<item>
		<title>AI Learns to Denoise Features to Master Fine-Grained Images With Almost No Data</title>
		<link>https://scienmag.com/ai-learns-to-denoise-features-to-master-fine-grained-images-with-almost-no-data/</link>
		
		<dc:creator><![CDATA[Blake Davidson]]></dc:creator>
		<pubDate>Fri, 02 Oct 2026 22:35:17 +0000</pubDate>
				<category><![CDATA[Technology and Engineering]]></category>
		<category><![CDATA[advanced techniques for fine-grained computer vision]]></category>
		<category><![CDATA[Applied Intelligence]]></category>
		<category><![CDATA[bird species identification with limited examples]]></category>
		<category><![CDATA[computer vision]]></category>
		<category><![CDATA[CUB-200-2011]]></category>
		<category><![CDATA[deep learning regularization for scarce datasets]]></category>
		<category><![CDATA[diffusion models]]></category>
		<category><![CDATA[diffusion models applied to feature denoising]]></category>
		<category><![CDATA[diffusion-inspired neural network denoising]]></category>
		<category><![CDATA[feature denoising]]></category>
		<category><![CDATA[few-shot fine-grained image classification]]></category>
		<category><![CDATA[Few-shot learning]]></category>
		<category><![CDATA[fine-grained classification]]></category>
		<category><![CDATA[image feature enhancement for limited data]]></category>
		<category><![CDATA[improving model generalization with minimal data]]></category>
		<category><![CDATA[Machine learning]]></category>
		<category><![CDATA[neural network noise injection in feature space]]></category>
		<category><![CDATA[prototypical networks]]></category>
		<category><![CDATA[regularization techniques for scarce training data]]></category>
		<category><![CDATA[self-supervised learning]]></category>
		<category><![CDATA[small sample image recognition challenges]]></category>
		<category><![CDATA[Stanford Cars]]></category>
		<category><![CDATA[Stanford Dogs]]></category>
		<category><![CDATA[subtle visual differences in fine-grained classification]]></category>
		<guid isPermaLink="false">https://scienmag.com/?p=229387</guid>

					<description><![CDATA[Researchers have developed DiffProNet, a framework that applies diffusion-inspired feature-space denoising to prototypical networks, achieving competitive few-shot fine-grained image classification on birds, dogs, and cars benchmarks.]]></description>
										<content:encoded><![CDATA[<p>Telling one bird species from another can be hard enough for humans, but for artificial intelligence systems trained on only a handful of labeled examples, it has long been one of computer vision&#8217;s most stubborn challenges. A new study published in Applied Intelligence introduces a framework called Diffusion-inspired Prototypical Network, or DiffProNet, that borrows a core idea from diffusion models and applies it in an unexpected place: not to generate images, but to clean up the internal feature representations a neural network relies on when learning from scarce data. The work, led by Jia Min Lim and colleagues at Multimedia University in Malaysia and the University of Nottingham Ningbo China, demonstrates that injecting and then removing noise inside a network&#8217;s feature space can act as a powerful regularizer, helping models generalize from just one or a few examples per category.</p>
<p>The problem the researchers set out to solve is known as few-shot fine-grained image classification. Fine-grained classification refers to tasks where the categories differ only in subtle visual details, such as the wing markings that separate two nearly identical bird species, the grille shape that distinguishes one car model from another, or the muzzle proportions that differentiate closely related dog breeds. Few-shot learning adds a second layer of difficulty: the model must learn to recognize new categories from only one or five labeled examples, called support samples, rather than the thousands typically used in modern deep learning. Under these extreme constraints, standard training procedures often fail in a characteristic way. Instead of learning the meaningful semantic features that define a category, the network latches onto spurious background details, lighting conditions, or incidental textures that happen to correlate with the few examples it has seen. This overfitting severely limits generalization to new, unseen images.</p>
<p>Prototypical networks, first introduced by Snell and colleagues in 2017, remain one of the most popular foundations for few-shot learning. The idea is elegant: for each class, the network computes a prototype, essentially an average of the feature embeddings of the support examples, and then classifies a query image by measuring which prototype lies closest to the query&#8217;s embedding in feature space. The approach is simple, fast, and effective, but its Achilles heel is the quality of the embeddings themselves. When support sets are tiny, the prototypes are computed from very few points, and if those embeddings are noisy or dominated by irrelevant visual information, the entire classification scheme collapses. Previous efforts to strengthen prototypical networks for fine-grained tasks have explored part-level contrastive learning, trilinear spatial-awareness modules, bi-similarity networks, and attention-based meta learning, all attempting to force the encoder to focus on the discriminative regions that actually separate similar categories.</p>
<p>DiffProNet takes a different route, one inspired by the mathematics of diffusion models. Diffusion models, which power many of today&#8217;s most impressive image generators, work by gradually adding Gaussian noise to data and then training a network to reverse the process, predicting and removing the noise step by step. The Applied Intelligence team realized that the denoising objective itself, separate from any image generation, could serve as a self-supervised training signal. Rather than corrupting pixels, DiffProNet injects Gaussian noise directly into the support feature representations produced by the encoder. A dedicated component, called the Feature Denoising Head, is then trained to predict exactly which noise was injected. Because the network knows the ground-truth noise it added, this becomes a self-supervised auxiliary objective requiring no additional labels whatsoever.</p>
<p>The effect of this denoising task on the learning pipeline is subtle but significant. To predict injected noise accurately, the encoder must produce feature representations that are smooth, structured, and informative enough that the noise signal can be disentangled from the underlying semantic content. In practice, this pressure encourages the encoder to learn robust and discriminative features rather than memorizing the quirks of individual support images. The researchers describe the mechanism as regularizing the latent feature space: the denoising objective spreads the learned representations in a way that mitigates overfitting to irrelevant visual details. In other words, the network is forced to keep its internal geometry clean, and a clean geometry makes the prototype-based classification of query images far more reliable when only one or five examples define each class.</p>
<p>Importantly, the authors emphasize that DiffProNet does not perform image generation at all. This distinction matters both conceptually and computationally. Full diffusion models require many iterative denoising steps to synthesize an image, making them expensive to run. By operating entirely in feature space and using the diffusion-inspired objective only as an auxiliary training signal, DiffProNet captures the regularizing benefit of the denoising principle while keeping the few-shot classification pipeline lightweight. The Feature Denoising Head adds a modest amount of architecture, but the core classification mechanism remains the familiar prototype comparison, preserving the simplicity that has made prototypical networks a mainstay of the field.</p>
<p>To evaluate the framework, the team ran extensive experiments on three of the most widely used fine-grained benchmarks in computer vision. CUB-200-2011, developed by Wah and colleagues, contains roughly 12,000 images spanning 200 species of birds, and is famous for demanding attention to minute plumage and morphological differences. Stanford Dogs, introduced by Khosla and colleagues, covers 120 dog breeds with visually overlapping characteristics. Stanford Cars, from Krause and colleagues, includes 196 makes and models of vehicles where distinctions often hinge on small details of trim, badges, and body shape. Across all three datasets, DiffProNet delivered competitive performance in both the 1-shot setting, where a single example defines each new class, and the 5-shot setting, which offers slightly more support data. The consistency across datasets with very different subject matter suggests that feature-space denoising is a general-purpose remedy for the overfitting that plagues few-shot fine-grained recognition, rather than a trick tailored to one domain.</p>
<p>The study also situates itself within a broader wave of research connecting self-supervised learning to few-shot classification. Earlier work by members of the same team, including self-supervised contrastive learning approaches and the SSL-ProtoNet framework, showed that auxiliary self-supervised tasks can substantially improve few-shot performance. Other groups have pursued related directions, such as self-supervised knowledge distillation, reinforced self-supervised training, and progressive dual-domain feature fusion. DiffProNet extends this lineage by importing the denoising principle from diffusion models, a family of techniques that had previously been applied mainly to generative tasks. The result is a hybrid: the metric-based simplicity of prototypical networks, the label-free training signal of self-supervision, and the noise-prediction mathematics of diffusion, all combined into a single framework that can be trained end to end.</p>
<p>The practical implications reach well beyond benchmark leaderboards. Fine-grained recognition with minimal labeled data is exactly the situation faced in many real-world applications: identifying endangered species from camera-trap photos where only a few verified images exist, detecting rare manufacturing defects on production lines, cataloging newly discovered specimens in biodiversity surveys, or assisting medical specialists who can only annotate a small number of cases. In each of these settings, collecting large labeled datasets is expensive or impossible, and models that overfit to backgrounds or incidental details produce unreliable predictions. A regularizer that improves the robustness of learned features without requiring extra labels could therefore translate directly into more dependable systems in the field.</p>
<p>The researchers have released their source code and experimental configurations in a public GitHub repository, along with instructions for obtaining and preparing the three benchmark datasets, allowing other teams to reproduce and build on the results. The work was supported by the Fundamental Research Grant Scheme of the Malaysian Ministry of Higher Education, awarded to Multimedia University. As diffusion models continue to dominate headlines for their generative prowess, DiffProNet offers a reminder that the ideas behind them can be even more versatile than the images they produce. By teaching a network to find its way back from noise, the researchers have shown that sometimes the best way to help a model see clearly is to first let it practice un-blurring its own view of the world, one feature at a time.</p>
<p><strong>Subject of Research:</strong> Few-shot fine-grained image classification using diffusion-inspired feature-space denoising in prototypical networks</p>
<p><strong>Article Title:</strong> Diffusion-inspired prototypical network for few-shot fine-grained classification</p>
<p><strong>Article References:</strong> Lim, J. M., Lim, K. M., Goh, P. Y., &amp; Lee, C. P. (2026). Diffusion-inspired prototypical network for few-shot fine-grained classification. <em>Applied Intelligence, 56</em>(15), Article 471. <a href="https://doi.org/10.1007/s10489-026-07509-2" rel="noopener noreferrer">https://doi.org/10.1007/s10489-026-07509-2</a></p>
<p><strong>Image Credits:</strong> AI Generated</p>
<p><strong>DOI:</strong> <a href="https://doi.org/10.1007/s10489-026-07509-2" rel="noopener noreferrer">10.1007/s10489-026-07509-2</a></p>
<p><strong>Keywords:</strong> few-shot learning, fine-grained classification, prototypical networks, diffusion models, self-supervised learning, feature denoising, computer vision, machine learning, CUB-200-2011, Stanford Dogs, Stanford Cars, Applied Intelligence</p>
]]></content:encoded>
					
		
		
		<post-id xmlns="com-wordpress:feed-additions:1">229387</post-id>	</item>
	</channel>
</rss>
