<?xml version="1.0" encoding="UTF-8"?><rss version="2.0"
	xmlns:content="http://purl.org/rss/1.0/modules/content/"
	xmlns:wfw="http://wellformedweb.org/CommentAPI/"
	xmlns:dc="http://purl.org/dc/elements/1.1/"
	xmlns:atom="http://www.w3.org/2005/Atom"
	xmlns:sy="http://purl.org/rss/1.0/modules/syndication/"
	xmlns:slash="http://purl.org/rss/1.0/modules/slash/"
	>

<channel>
	<title>CIFAR-100 &#8211; Science</title>
	<atom:link href="https://scienmag.com/tag/cifar-100/feed/" rel="self" type="application/rss+xml" />
	<link>https://scienmag.com</link>
	<description></description>
	<lastBuildDate>Mon, 05 Oct 2026 05:45:32 +0000</lastBuildDate>
	<language>en-US</language>
	<sy:updatePeriod>
	hourly	</sy:updatePeriod>
	<sy:updateFrequency>
	1	</sy:updateFrequency>
	<generator>https://wordpress.org/?v=7.1.3</generator>

<image>
	<url>https://scienmag.com/wp-content/uploads/2024/07/cropped-scienmag_ico-32x32.jpg</url>
	<title>CIFAR-100 &#8211; Science</title>
	<link>https://scienmag.com</link>
	<width>32</width>
	<height>32</height>
</image> 
<site xmlns="com-wordpress:feed-additions:1">73899611</site>	<item>
		<title>Earth Mover&#8217;s Distance Steers Smarter Knowledge Sharing in Federated Learning</title>
		<link>https://scienmag.com/earth-movers-distance-steers-smarter-knowledge-sharing-in-federated-learning/</link>
		
		<dc:creator><![CDATA[Veronica Carney]]></dc:creator>
		<pubDate>Mon, 05 Oct 2026 05:45:32 +0000</pubDate>
				<category><![CDATA[Technology and Engineering]]></category>
		<category><![CDATA[CIFAR-100]]></category>
		<category><![CDATA[client drift]]></category>
		<category><![CDATA[client drift mitigation in federated AI]]></category>
		<category><![CDATA[data heterogeneity]]></category>
		<category><![CDATA[decoupled knowledge distillation]]></category>
		<category><![CDATA[decoupled knowledge distillation for federated models]]></category>
		<category><![CDATA[distributed machine learning]]></category>
		<category><![CDATA[distributional distance metrics in federated learning]]></category>
		<category><![CDATA[Earth Mover's Distance]]></category>
		<category><![CDATA[Earth Mover's Distance in distributed machine learning]]></category>
		<category><![CDATA[enhancing AI collaboration across devices]]></category>
		<category><![CDATA[federated learning]]></category>
		<category><![CDATA[federated learning data heterogeneity]]></category>
		<category><![CDATA[federated learning with non-i.i.d. data]]></category>
		<category><![CDATA[federated meta-learning techniques]]></category>
		<category><![CDATA[improved knowledge sharing in federated systems]]></category>
		<category><![CDATA[knowledge distillation]]></category>
		<category><![CDATA[meta-learning]]></category>
		<category><![CDATA[model aggregation]]></category>
		<category><![CDATA[model aggregation strategies in heterogeneous environments]]></category>
		<category><![CDATA[multi-device AI model training challenges]]></category>
		<category><![CDATA[non-IID data]]></category>
		<category><![CDATA[privacy-preserving AI]]></category>
		<category><![CDATA[scalable federated learning frameworks]]></category>
		<guid isPermaLink="false">https://scienmag.com/?p=236988</guid>

					<description><![CDATA[Researchers have developed FedML-DKD, a federated learning framework that uses Earth Mover's Distance to adaptively balance knowledge distillation and meta-learning, boosting accuracy by up to 10.87 percentage points under highly heterogeneous data.]]></description>
										<content:encoded><![CDATA[<p>Federated learning has long promised a world in which smartphones, hospitals, and factories can jointly train powerful artificial intelligence models without ever shipping their raw data to a central server. Yet the reality on the ground has been messier than the vision. Each participating device holds a sliver of data that reflects only its own users and environment, so the statistical landscapes seen by individual clients can differ wildly from one another. A new study published in Cluster Computing by Debao Wang and Shaopeng Guan of Shandong Technology and Business University tackles this stubborn problem, known as data heterogeneity, with a framework called FedML-DKD that combines two ideas from the machine learning toolbox: decoupled knowledge distillation and federated meta-learning, tied together by a distributional yardstick known as the Earth Mover&#8217;s Distance.</p>
<p>The core difficulty the researchers set out to address is client drift. In a standard federated training round, each client updates a shared model on its own local data before sending the updated parameters back to a server for aggregation. When those local datasets are skewed, for example when one phone contains mostly images of cats while another holds mostly images of cars, each client pulls the model in a different direction. The averaged global model ends up oscillating between incompatible preferences, converging slowly and often settling at a worse solution than a model trained on pooled data would reach. This non-independent-and-identically-distributed data problem has spawned an entire subfield of research, and knowledge distillation has emerged as one of its more promising remedies.</p>
<p>Knowledge distillation, in its classic form, asks a smaller or newer model to mimic the output probabilities of a teacher model, transferring not just the correct answers but the teacher&#8217;s nuanced confidence across all classes. In federated settings, the global model on the server typically acts as the teacher for local students. But Wang and Guan point out a subtle weakness in the conventional, coupled formulation of distillation when data are highly heterogeneous. The distillation loss blends two distinct signals: the knowledge about the target class, meaning the probability assigned to the correct label, and the knowledge about non-target classes, the relative ordering of all the wrong answers. Under skewed local distributions, a client can develop biased confidence in its dominant target classes, and that bias contaminates the coupled loss, misguiding the learning process rather than correcting it.</p>
<p>Their remedy builds on decoupled knowledge distillation, a technique introduced at the 2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition, which separates the distillation objective into a target-class component, abbreviated TCKD, and a non-target-class component, abbreviated NCKD, each weighted independently. Decoupling alone, however, uses fixed weights that ignore how heterogeneous a given client&#8217;s data actually are. The key innovation of FedML-DKD is a heterogeneity-aware weighting mechanism that adjusts the balance between TCKD and NCKD dynamically for each client. The measure used to gauge heterogeneity is the Earth Mover&#8217;s Distance, a metric with roots in computer vision and transportation theory that quantifies the minimum work needed to transform one probability distribution into another, like measuring how much soil must be moved to reshape one pile of earth into the shape of another.</p>
<p>In practice, the framework computes the distributional divergence between each client&#8217;s local label distribution and a reference distribution, then uses that EMD value to set the relative contributions of the two distillation components. Clients whose data deviate sharply from the global distribution receive a rebalanced distillation signal that prevents them from overfitting to their biased local samples, while clients with more representative data can lean more heavily on the standard knowledge transfer pathway. This adaptive decoupling improves the reliability of the knowledge flowing between server and clients, because the teacher&#8217;s guidance is no longer distorted by the statistical quirks of any single participant. The result, according to the authors, is a training process that remains stable even as the degree of heterogeneity across clients increases.</p>
<p>The second pillar of FedML-DKD concerns what happens on the server after clients upload their updates. Conventional federated learning aggregates those parameters, typically through weighted averaging, to produce the next global model. Wang and Guan instead replace this aggregation step with a meta-learning objective. Meta-learning, often described as learning to learn, seeks an initialization from which a model can rapidly adapt to new tasks with only a few gradient steps. In the federated context, the uploaded client parameters are treated as a shared initialization that must generalize across the diverse local tasks represented by the participating devices. Rather than simply averaging away the differences between clients, the meta-learning objective explicitly optimizes for a starting point that can be fine-tuned quickly and effectively on each client&#8217;s particular distribution.</p>
<p>This design choice addresses a persistent tension in federated systems between personalization and generalization. A single global model must serve clients with very different data profiles, and pure averaging can wash out the specialized competence each client develops locally. By framing the global model as a meta-learned initialization, the framework preserves the ability of each client to adapt rapidly while ensuring that the shared foundation remains broadly capable. The approach connects to a growing literature on federated meta-learning, including model-agnostic meta-learning formulations with theoretical guarantees and group-based personalization methods, but the integration with adaptive decoupled distillation guided by EMD is what distinguishes the new framework from its predecessors.</p>
<p>The empirical evidence presented in the paper is substantial. The authors evaluated FedML-DKD on three widely used image classification benchmarks: CIFAR-10, CIFAR-100, and EMNIST-Letters. These datasets were partitioned across simulated clients under different levels of data heterogeneity, replicating the skewed, non-IID conditions that plague real deployments. Across these experiments, FedML-DKD consistently outperformed six representative baseline methods drawn from the federated learning and distillation literature. The reported gains are striking: accuracy improvements of up to 10.87 percentage points on the more challenging classification tasks, alongside stable convergence behavior, meaning the training did not exhibit the erratic oscillations that often accompany heterogeneous federated optimization.</p>
<p>The significance of a ten-percentage-point improvement in this domain should not be understated. Benchmarks like CIFAR-100, with one hundred fine-grained classes, are notoriously sensitive to distributional skew, and many published federated methods report gains of only one or two points over baselines. A framework that maintains both accuracy and convergence stability under severe heterogeneity could matter for applications where data cannot be centralized for legal or practical reasons, such as healthcare systems that must protect patient privacy, intrusion detection in resource-constrained networks, and mobile-edge computing scenarios where devices learn collaboratively over limited bandwidth. The paper&#8217;s reference list itself maps this landscape, citing recent work on privacy-preserving federated learning for smart healthcare, green federated learning, and data-free distillation techniques that avoid sharing even synthetic data.</p>
<p>Like any study, the work has boundaries worth noting. The experiments were conducted on standard computer vision benchmarks rather than production-scale deployments, and the authors state that no new datasets were generated or analyzed during the study. The computational cost of computing Earth Mover&#8217;s Distance between distributions at each round, while modest compared with model training itself, is a factor that future deployments will need to characterize. Nevertheless, the conceptual contribution is clear and elegant: by measuring how far each client&#8217;s data distribution sits from the collective norm and using that measurement to recalibrate what kind of knowledge gets distilled, FedML-DKD turns heterogeneity from a silent saboteur into an explicit signal that the training algorithm can respond to. As federated learning moves from research prototypes toward the infrastructure of privacy-conscious AI, techniques that make collaborative learning robust to the messy reality of uneven data will only grow in importance, and this study offers a concrete, empirically validated step in that direction.</p>
<p><strong>Subject of Research:</strong> Adaptive decoupled knowledge distillation and meta-learning for federated learning under data heterogeneity</p>
<p><strong>Article Title:</strong> EMD-guided adaptive decoupled knowledge distillation for federated meta-learning under data heterogeneity</p>
<p><strong>Article References:</strong> Wang, D., &amp; Guan, S. (2026). EMD-guided adaptive decoupled knowledge distillation for federated meta-learning under data heterogeneity. <em>Cluster Computing, 29</em>(14), Article 786. <a href="https://doi.org/10.1007/s10586-026-06617-5" rel="noopener noreferrer">https://doi.org/10.1007/s10586-026-06617-5</a></p>
<p><strong>Image Credits:</strong> AI Generated</p>
<p><strong>DOI:</strong> <a href="https://doi.org/10.1007/s10586-026-06617-5" rel="noopener noreferrer">10.1007/s10586-026-06617-5</a></p>
<p><strong>Keywords:</strong> federated learning, knowledge distillation, meta-learning, data heterogeneity, Earth Mover&#x27;s Distance, client drift, non-IID data, CIFAR-100, decoupled knowledge distillation, distributed machine learning, privacy-preserving AI, model aggregation</p>
]]></content:encoded>
					
		
		
		<post-id xmlns="com-wordpress:feed-additions:1">236988</post-id>	</item>
		<item>
		<title>Hybrid CNN-ViT Model With Triple Loss Boosts Image Search Accuracy</title>
		<link>https://scienmag.com/hybrid-cnn-vit-model-with-triple-loss-boosts-image-search-accuracy/</link>
		
		<dc:creator><![CDATA[Blake Davidson]]></dc:creator>
		<pubDate>Sun, 04 Oct 2026 09:23:22 +0000</pubDate>
				<category><![CDATA[Technology and Engineering]]></category>
		<category><![CDATA[AI-powered image similarity matching]]></category>
		<category><![CDATA[CIFAR-100]]></category>
		<category><![CDATA[content-based image retrieval]]></category>
		<category><![CDATA[content-based image retrieval advancements]]></category>
		<category><![CDATA[contrastive loss]]></category>
		<category><![CDATA[convolutional neural networks]]></category>
		<category><![CDATA[Convolutional Neural Networks and Vision Transformers]]></category>
		<category><![CDATA[cross-entropy loss]]></category>
		<category><![CDATA[deep learning in image search]]></category>
		<category><![CDATA[deep metric learning]]></category>
		<category><![CDATA[feature embedding]]></category>
		<category><![CDATA[fine-grained retrieval]]></category>
		<category><![CDATA[fusion of CNN and ViT in computer vision]]></category>
		<category><![CDATA[HCV-MLO]]></category>
		<category><![CDATA[hybrid architecture]]></category>
		<category><![CDATA[hybrid CNN-vision transformer architecture]]></category>
		<category><![CDATA[improving image search accuracy with hybrid models]]></category>
		<category><![CDATA[innovative deep learning frameworks in image retrieval]]></category>
		<category><![CDATA[machine learning models for visual search]]></category>
		<category><![CDATA[multi-loss optimization for image retrieval]]></category>
		<category><![CDATA[semantic image similarity detection]]></category>
		<category><![CDATA[triple loss function image retrieval]]></category>
		<category><![CDATA[triplet loss]]></category>
		<category><![CDATA[Vision Transformers]]></category>
		<guid isPermaLink="false">https://scienmag.com/?p=234462</guid>

					<description><![CDATA[Researchers have combined convolutional neural networks and vision transformers with a three-loss training strategy to significantly improve content-based image retrieval performance.]]></description>
										<content:encoded><![CDATA[<p>Image search is quietly becoming one of the most demanding tests of artificial intelligence. When a user submits a photo and asks a system to find visually similar images across a database of millions, the machine must do far more than match colors or shapes. It must understand what makes two pictures semantically alike, a task that has pushed researchers to combine the two most powerful architectures in modern computer vision: convolutional neural networks and vision transformers. A new study published in the International Journal of Machine Learning and Cybernetics shows that fusing these architectures, and then training the result with three different loss functions at once, can substantially sharpen the quality of image retrieval.</p>
<p>The research, led by Hanh Nguyen Thi of Thuyloi University and Hanoi Architectural University together with colleagues at CMC University, the Posts and Telecommunications Institute of Technology, the Vietnam Academy of Science and Technology, and Hanoi University of Science and Technology, introduces a framework called HCV-MLO, short for Hybrid CNN-ViT with Multi-Loss Optimization. The work extends a conference paper the team presented at MAPR 2025, and it arrives at a moment when content-based image retrieval, known in the field as CBIR, is under growing pressure from ever-larger image collections and increasingly subtle queries.</p>
<p>To understand why the hybrid approach matters, it helps to look at what each architecture does well. Convolutional neural networks, the workhorses of deep learning since the breakthrough ImageNet results of 2012, scan images with filters that detect local patterns: edges, textures, corners, and small motifs that build up into recognizable objects. They are exceptionally good at capturing these fine-grained visual signatures. But convolutions look through a narrow window at each step, so a CNN can struggle to relate a detail in the top-left corner of an image to a feature in the bottom-right, especially when that relationship spans a large distance.</p>
<p>Vision transformers, introduced by Dosovitskiy and colleagues in 2021 with the memorable paper title declaring that an image is worth sixteen by sixteen words, take a different route. They chop an image into patches, treat each patch like a word in a sentence, and use self-attention to let every patch weigh its relationship to every other patch. This gives ViTs a natural talent for modeling long-range dependencies and global context, the kind of scene-level understanding that tells a retrieval system a dog on a beach belongs with other outdoor animal scenes even if the local textures differ. The catch is that transformers, on their own, can be less sensitive to the fine local detail that CNNs capture so effortlessly.</p>
<p>The Vietnamese team&#8217;s insight was that these weaknesses are complementary, and that a retrieval system should not have to choose. HCV-MLO runs parallel CNN and ViT branches over the same input image and merges their feature representations into a single embedding, a compact numerical vector that encodes the image&#8217;s semantic content. In a retrieval system, similarity between images is computed as distance between these vectors, so the entire game is to learn embeddings in which images of the same category cluster tightly while images of different categories spread apart. The hybrid design gives the embedding both the local texture sensitivity of the convolutional branch and the global relational awareness of the transformer branch.</p>
<p>But architecture alone, the researchers argue, is only half the story. The second pillar of HCV-MLO is its multi-loss optimization strategy, which trains the network by simultaneously minimizing three distinct loss functions: triplet loss, contrastive loss, and cross-entropy loss. Each of these objectives shapes the embedding space in a different way. Triplet loss, made famous by the FaceNet face recognition system in 2015, pulls an anchor image closer to a positive example of the same class while pushing it away from a negative example, directly enforcing the relative ordering that retrieval depends on. Contrastive loss works on pairs of images, rewarding the network when similar images map to nearby points and dissimilar images map to distant ones. Cross-entropy loss, the standard objective for classification, anchors the embedding to clear category boundaries and provides a stable supervisory signal.</p>
<p>To find out what each loss actually contributes, the team built three single-loss variants of their hybrid model: CNN-ViT-CE using cross-entropy alone, CNN-ViT-Contrastive using contrastive loss alone, and CNN-ViT-Triplet using triplet loss alone. This ablation-style analysis, more comprehensive than what appeared in their earlier conference version, allowed them to isolate the effect of each objective on the learned representations. The experiments covered three widely used benchmark datasets that together span a demanding range of retrieval challenges: CIFAR-100, with its one hundred diverse object categories in small, low-resolution images; CUB-200-2011, a fine-grained dataset of two hundred bird species where distinguishing one sparrow from another requires exquisite attention to subtle detail; and Stanford Dogs, another fine-grained benchmark covering one hundred twenty dog breeds.</p>
<p>The results were consistent across all three datasets. The full HCV-MLO model outperformed both single-network baselines, meaning pure CNN or pure ViT systems, and the single-loss variants, meaning the hybrid architecture trained with only one of the three objectives. The headline figure comes from CIFAR-100, where HCV-MLO achieved a mean average precision at rank one hundred, or mAP@100, of 81.99, a clear improvement over recent competitive methods in the field. Mean average precision is a strict metric for retrieval because it rewards systems that place all the relevant results near the top of the ranked list, not merely somewhere in the first hundred. The fact that the gains held up on fine-grained datasets like birds and dogs, where inter-class differences are tiny, suggests that the combination of local and global features with multi-loss training produces embeddings that are genuinely more discriminative, not just better tuned to one benchmark.</p>
<p>The study&#8217;s broader message resonates with a trend running through recent deep metric learning research, a field that has produced a rich catalog of loss functions including proxy-based objectives, multi-similarity loss, ranked list loss, and circle loss. Rather than betting on any single recipe, HCV-MLO demonstrates that stacking complementary objectives on top of a complementary architecture yields a practical and effective solution for embedding quality. The authors also note that the datasets used in the study, CIFAR-100, CUB-200-2011, and Stanford Dogs, are all publicly available, and that no new datasets were generated, making the work straightforward for other groups to reproduce and compare against.</p>
<p>For everyday applications, the implications are tangible. Better retrieval embeddings mean medical image archives where a clinician can find prior cases resembling a new scan, e-commerce platforms where a shopper&#8217;s camera snapshot surfaces the right product, and digital libraries where a rough sketch or photo unlocks visually related material. As image collections continue to balloon, the hybrid CNN-ViT strategy with multi-loss optimization offers a blueprint for systems that see both the trees and the forest, capturing the fine texture of an individual leaf while never losing sight of the shape of the whole canopy. The research was carried out without specific grant funding, and the authors report no competing financial interests, leaving the door open for the broader community to build on their hybrid, multi-loss recipe.</p>
<p><strong>Subject of Research:</strong> A hybrid CNN-ViT feature embedding framework with multi-loss optimization for content-based image retrieval</p>
<p><strong>Article Title:</strong> Hybrid CNN-ViT feature embedding for image retrieval with multi-loss optimization</p>
<p><strong>Article References:</strong> Thi, H. N., Huu, Q. N., Thuy, Q. D. T., Le, N. T. T., Van, T. N., &amp; Huu, H. N. (2026). Hybrid CNN-ViT feature embedding for image retrieval with multi-loss optimization. <em>International Journal of Machine Learning and Cybernetics, 17</em>(9), Article 446. <a href="https://doi.org/10.1007/s13042-026-03271-6" rel="noopener noreferrer">https://doi.org/10.1007/s13042-026-03271-6</a></p>
<p><strong>Image Credits:</strong> AI Generated</p>
<p><strong>DOI:</strong> <a href="https://doi.org/10.1007/s13042-026-03271-6" rel="noopener noreferrer">10.1007/s13042-026-03271-6</a></p>
<p><strong>Keywords:</strong> content-based image retrieval, convolutional neural networks, vision transformers, hybrid architecture, triplet loss, contrastive loss, cross-entropy loss, deep metric learning, feature embedding, CIFAR-100, fine-grained retrieval, HCV-MLO</p>
]]></content:encoded>
					
		
		
		<post-id xmlns="com-wordpress:feed-additions:1">234462</post-id>	</item>
		<item>
		<title>AI Heatmaps May Be Lying: New Test Exposes Flawed Explanations in Image-Recognition Networks</title>
		<link>https://scienmag.com/ai-heatmaps-may-be-lying-new-test-exposes-flawed-explanations-in-image-recognition-networks/</link>
		
		<dc:creator><![CDATA[Blake Davidson]]></dc:creator>
		<pubDate>Thu, 01 Oct 2026 01:29:57 +0000</pubDate>
				<category><![CDATA[Technology and Engineering]]></category>
		<category><![CDATA[AI heatmaps]]></category>
		<category><![CDATA[AI interpretability research]]></category>
		<category><![CDATA[AI model decision visualization]]></category>
		<category><![CDATA[attribution fidelity]]></category>
		<category><![CDATA[CIFAR-100]]></category>
		<category><![CDATA[class activation mapping]]></category>
		<category><![CDATA[contrastive explanations]]></category>
		<category><![CDATA[convolutional neural networks]]></category>
		<category><![CDATA[DenseNet]]></category>
		<category><![CDATA[explainable AI]]></category>
		<category><![CDATA[flaws in AI heatmap methods]]></category>
		<category><![CDATA[Grad-CAM]]></category>
		<category><![CDATA[Grad-CAM reliability issues]]></category>
		<category><![CDATA[heatmap explanation validity]]></category>
		<category><![CDATA[image recognition explanation flaws]]></category>
		<category><![CDATA[ImageNet]]></category>
		<category><![CDATA[Machine learning]]></category>
		<category><![CDATA[machine learning model explanations]]></category>
		<category><![CDATA[model interpretability]]></category>
		<category><![CDATA[neural network transparency challenges]]></category>
		<category><![CDATA[saliency map limitations]]></category>
		<category><![CDATA[saliency maps]]></category>
		<category><![CDATA[understanding CNN decision processes]]></category>
		<category><![CDATA[visual justification in AI]]></category>
		<guid isPermaLink="false">https://scienmag.com/?p=220746</guid>

					<description><![CDATA[A new study shows that popular AI explanation methods produce nearly identical heatmaps for different class labels, and introduces CASE, a contrastive technique that restores genuine class-specificity to neural network explanations.]]></description>
										<content:encoded><![CDATA[<p>Saliency maps have become the public face of artificial intelligence transparency. When a convolutional neural network declares that a photograph contains a tiger shark, a colorful heatmap shows which pixels supposedly drove that decision, offering engineers, regulators, and end users a reassuring window into the model&#8217;s reasoning. But a new study from the University of Virginia, published in the journal Machine Learning, suggests that this window may be far murkier than it appears. The research demonstrates that many of the most widely used explanation methods produce nearly identical heatmaps regardless of which class label they are asked to explain, raising uncomfortable questions about whether these visual justifications actually explain anything at all.</p>
<p>The study, led by doctoral researcher Dane Williamson together with Yangfeng Ji and Matthew Dwyer, begins with a deceptively simple observation. When the popular Grad-CAM method is asked to explain why a network chose its top prediction for an image, and then asked again to explain the second-ranked prediction, the highlighted regions barely change. This happens even when the two candidate labels describe semantically unrelated objects, such as an airplane and a barbell. If an explanation method highlights the same pixels whether the model claims to see a bird or an airplane, the researchers argue, that explanation is not telling anyone what distinguishes one hypothesis from another. It is, in effect, a plausible-looking picture with little diagnostic content.</p>
<p>The stakes are higher than they might seem. Prior human-centered research cited in the paper, including the HIVE evaluation study, found that visual explanations can increase user trust even when the underlying model is wrong. In other words, a beautiful heatmap can manufacture confidence in a decision that the heatmap does not actually illuminate. The problem becomes acute in domains such as medical imaging, where documented failures have shown networks latching onto dataset artifacts like text tokens or positional cues instead of actual pathology. If the saliency maps generated in those settings are insensitive to the class label, clinicians auditing a diagnosis could be misled by an explanation that looks informative but is essentially identical to the explanation the model would have produced for any other condition.</p>
<p>To move beyond anecdotes, the researchers formalized a diagnostic test for what they call class sensitivity. For each validation image, they generated saliency maps for the top-1 and top-2 predicted classes and measured the overlap between the top 5 percent of pixels highlighted in each map. A method that genuinely distinguishes between competing labels should produce substantially different maps. They then applied a one-sided Wilcoxon signed-rank test, asking whether the median agreement between maps fell below 50 percent. If a method cannot statistically beat a coin-flip level of overlap, it fails the test of distinguishing one class explanation from another. This framework is deliberately method-agnostic and model-agnostic, meaning it can be applied to any saliency technique and any convolutional backbone.</p>
<p>The results of that diagnostic were sobering. Across five widely used class activation map methods, Grad-CAM, Grad-CAM++, ScoreCAM, AblationCAM, and LayerCAM, evaluated on four architectures spanning ResNet-50, VGG-19, DenseNet-201, and ConvNeXt-Large, and on two datasets, ImageNet and CIFAR-100, most baseline methods failed to distinguish between competing classes in a large fraction of settings. Grad-CAM and AblationCAM in particular frequently produced explanations for the top and second predictions that were statistically indistinguishable. The failure was not confined to one model family or benchmark, suggesting a systemic weakness in how activation-based attribution is computed rather than an artifact of any single network.</p>
<p>Motivated by these findings, the team introduced CASE, short for Contrastive Activation for Class-Sensitive Explanations. The method works by explicitly removing the attribution that a target class shares with its most confusable competitors. Concretely, CASE first computes the gradient of the target class score with respect to the final convolutional activation maps. It then identifies a contrast set consisting of the classes the model most frequently confuses with the target, using the model&#8217;s confusion matrix computed on a held-out validation set. The gradients for those contrast classes are averaged into a single vector, and the component of the target gradient that points along this shared direction is subtracted away through an orthogonal projection. What remains is a residual gradient encoding only evidence that is uniquely discriminative for the target class, which is then used to weight the activation maps and produce the final heatmap after a ReLU and upsampling step.</p>
<p>The design choices behind CASE are notable for what they avoid. Unlike prior contrastive explanation approaches such as CWOX, which relies on learned cluster structures, or Contrastive LRP, which is tied to backpropagation-based relevance propagation, CASE requires no architectural modifications, no external baselines, and no auxiliary models. It operates directly on the internal activations of any already-trained convolutional network. The confusion-based contrast selection is also behaviorally grounded: because the contrast set is drawn from classes the model empirically mixes up, the method suppresses exactly the attribution directions that compete with the target in practice, rather than those suggested by semantic similarity alone.</p>
<p>In evaluations across all four architectures and both datasets, CASE was the only method that consistently rejected the null hypothesis of the class-sensitivity test with high confidence, achieving p-values below 0.0001 in every tested setting. ScoreCAM also performed well on most models but stumbled on VGG, while traditional methods failed more often. The study also uncovered a surprising architectural insight: DenseNet proved the most naturally class-sensitive network, and a channel-activity analysis revealed why. Its final convolutional layer activates fewer than 20 channels per class on average, an unusually sparse but highly selective representation, whereas VGG and ConvNeXt activate hundreds of channels that dilute class-specific signals. When the researchers swapped DenseNet&#8217;s attribution layer to the final normalization layer, which activates nearly all channels uniformly, most methods lost their class sensitivity entirely. Even retraining across five random seeds confirmed the effect was a stable property of the architecture, and CASE retained its sensitivity even in the diffuse regime.</p>
<p>Class sensitivity alone is not sufficient, of course. A good explanation should also be faithful, meaning the highlighted regions should genuinely matter to the model&#8217;s output. The team tested this by ablating the top 5 percent of salient pixels and measuring the drop in the model&#8217;s confidence. Here the picture was more nuanced. CASE matched the strongest baselines on DenseNet, ResNet, and ConvNeXt, and significantly outperformed AblationCAM and LayerCAM on ConvNeXt, but on VGG three methods, Grad-CAM++, LayerCAM, and ScoreCAM, produced larger confidence drops. The authors are candid about these failure cases, noting that uniquely discriminative regions are not always the regions whose removal maximally reduces confidence. When class evidence is diffuse and shared across labels, perturbing broadly activated regions can produce bigger confidence swings even if those regions are less informative for separating one class from another.</p>
<p>The paper also probes the robustness of the method itself. A pre-registered degenerate-residual check searched for cases where the target and contrast gradients were nearly collinear, which would collapse the orthogonal projection toward zero; across 4,774 generated maps, not a single near-zero residual was found. Ablations over the contrast set size showed that three confused classes are sufficient, with larger sets yielding no consistent benefit. The authors are explicit about the method&#8217;s boundaries: CASE applies to single-label classification with convolutional networks, and extending it to transformers, multi-label tasks, or multimodal models would require rethinking the contrast formulation. Those limitations aside, the study delivers a message that should resonate far beyond the machine learning community. Explanation tools are trusted as safeguards, and this work shows that trust must be earned through formal diagnostics rather than visual plausibility. As deep learning spreads into medicine, safety monitoring, and high-stakes auditing, the researchers argue, we need explanations that reveal what truly sets a model&#8217;s decision apart, not just what makes a convincing picture.</p>
<p><strong>Subject of Research:</strong> Class sensitivity and contrastive saliency methods for explaining convolutional neural network image classifiers</p>
<p><strong>Article Title:</strong> CASE: Contrastive Activation for Class-Sensitive Explanations</p>
<p><strong>Article References:</strong> Williamson, D., Ji, Y., &amp; Dwyer, M. (2026). CASE: Contrastive Activation for Class-Sensitive Explanations. <em>Machine Learning, 115</em>(10), Article 230. <a href="https://doi.org/10.1007/s10994-026-07169-w" rel="noopener noreferrer">https://doi.org/10.1007/s10994-026-07169-w</a></p>
<p><strong>Image Credits:</strong> AI Generated</p>
<p><strong>DOI:</strong> <a href="https://doi.org/10.1007/s10994-026-07169-w" rel="noopener noreferrer">10.1007/s10994-026-07169-w</a></p>
<p><strong>Keywords:</strong> explainable AI, saliency maps, Grad-CAM, contrastive explanations, convolutional neural networks, class activation mapping, machine learning, attribution fidelity, ImageNet, CIFAR-100, DenseNet, model interpretability</p>
]]></content:encoded>
					
		
		
		<post-id xmlns="com-wordpress:feed-additions:1">220746</post-id>	</item>
		<item>
		<title>A Hesitation Score Helps AI Models Survive Wrong Labels and Wrong Questions</title>
		<link>https://scienmag.com/a-hesitation-score-helps-ai-models-survive-wrong-labels-and-wrong-questions/</link>
		
		<dc:creator><![CDATA[Denise Maddox]]></dc:creator>
		<pubDate>Thu, 24 Sep 2026 21:28:58 +0000</pubDate>
				<category><![CDATA[Technology and Engineering]]></category>
		<category><![CDATA[AI training data reliability]]></category>
		<category><![CDATA[annotation errors in machine learning]]></category>
		<category><![CDATA[BERT]]></category>
		<category><![CDATA[binary classification]]></category>
		<category><![CDATA[CIFAR-100]]></category>
		<category><![CDATA[compound task-class noise]]></category>
		<category><![CDATA[formalization of annotation errors]]></category>
		<category><![CDATA[GLUE benchmark]]></category>
		<category><![CDATA[handling wrong labels in AI models]]></category>
		<category><![CDATA[improving AI model resilience]]></category>
		<category><![CDATA[Intuitionistic fuzzy sets]]></category>
		<category><![CDATA[intuitionistic fuzzy sets in AI]]></category>
		<category><![CDATA[Machine learning]]></category>
		<category><![CDATA[multi-label data quality issues]]></category>
		<category><![CDATA[multi-task classification challenges]]></category>
		<category><![CDATA[multi-task learning]]></category>
		<category><![CDATA[multi-task learning robustness]]></category>
		<category><![CDATA[noise mitigation in ML training]]></category>
		<category><![CDATA[noisy labels]]></category>
		<category><![CDATA[semantic meaning in labels]]></category>
		<category><![CDATA[task and class label noise]]></category>
		<category><![CDATA[task-agnostic inference]]></category>
		<category><![CDATA[trust-weighted loss]]></category>
		<category><![CDATA[uncertainty quantification]]></category>
		<guid isPermaLink="false">https://scienmag.com/?p=212667</guid>

					<description><![CDATA[Researchers at Hanoi University of Science and Technology have developed a fuzzy-set-based hesitation score that makes multi-task AI models robust to coupled task and label noise, even when no task name is given at inference time.]]></description>
										<content:encoded><![CDATA[<p>Machine learning systems that juggle several tasks at once share a hidden vulnerability that has little to do with the sophistication of their architectures: the reliability of the annotations they learn from. In a multi-task classification pipeline, every training example typically arrives with two pieces of supervision, a task identity and a class label whose meaning only makes sense in the context of that task. When annotators, automated pipelines, or dataset merges assign the wrong task to an example, the attached class label effectively answers the wrong question. A sentiment label appended to a paraphrase-detection example, for instance, is not merely noisy; it is semantically meaningless. A team of researchers at Hanoi University of Science and Technology has now formalized this failure mode and proposed a remedy built on a decades-old mathematical idea, intuitionistic fuzzy sets.</p>
<p>The study, published in Complex &amp; Intelligent Systems by Hong Son Nguyen, Khac Trung Nguyen, Ngoc Linh Pham, Ngoc Thang Tran, and Ngoc Chi Lê, introduces the concept of compound task-class noise. The key insight is that task errors and class-label errors should not be treated as two independent sources of corruption. Because the interpretation of a class label depends on the task it is attached to, an error in the observed task identity can change what the observed class label means, coupling the two noise processes in a way that standard label-noise-robust methods never anticipate. The problem becomes acute in what the authors call task-agnostic inference, a deployment setting in which no task name is supplied at test time and the model must decide on its own which task should interpret the class label it predicts.</p>
<p>Most existing defenses against noisy labels operate under a simplifying assumption: the label is wrong, but the question it answers is right. Techniques such as generalized cross-entropy loss or transition-matrix correction methods like MTL-NL model how likely a true class is to be flipped into an observed one, yet they presume the task assignment is trustworthy. The new work shows that this assumption collapses precisely where it matters most. In experiments across text and synthetic benchmarks, baselines that remain competitive when a human verifies the task at test time degrade severely when the task must be inferred blindly, with some configurations experiencing near-total collapse under the harshest noise profile the authors tested, which they term maximal distortion.</p>
<p>The proposed method, named IFS-Hesitant, draws on intuitionistic fuzzy sets, a generalization of classical fuzzy set theory in which each element is characterized not only by a degree of membership and a degree of non-membership but also by a hesitation margin capturing the uncertainty that remains after both are accounted for. In the authors&#8217; architecture, a shared encoder feeds task-specific prediction heads that output a membership value and a non-membership value for each candidate task, normalized through a softmax, together with an independent hesitation score produced by its own output channel. The joint membership used for classification is recovered by multiplying the normalized membership by one minus the hesitation, a construction based on the product T-norm from fuzzy mathematics.</p>
<p>What makes this design more than a notational exercise is how the hesitation score is used. During training, it acts as a trust gate: the contribution of each example to the loss is weighted by the product of the hesitation-adjusted task fit and the class satisfaction under the inferred task. Examples whose task assignment looks suspicious are automatically down-weighted, so corrupted supervision exerts less pull on the shared representation. The authors implement a floor on this weight, set to 0.1 at BERT-base scale, to prevent an early-training pathology they describe as optimization collapse, in which an overconfident hesitation signal starves the model of gradient signal before it has learned anything useful. Smaller architectures, where this starvation effect is empirically inactive, default to no floor at all.</p>
<p>The same hesitation signal does double duty at inference time. Because the model produces a task-fit uncertainty for each candidate task, it can route an unlabeled input to the task whose head fits best, without any external task classifier. This is what enables task-agnostic deployment: the model both selects the question and answers it, while the hesitation margin flags cases where neither selection is trustworthy. The authors show that this single scalar also supports post-hoc corruption detection, allowing practitioners to identify suspicious task-class pairs in a dataset after the fact rather than only tolerating them during training.</p>
<p>The empirical evaluation spans a deliberately diverse set of benchmarks. A low-capacity configuration uses a two-layer multilayer perceptron with hidden dimensions of 64 and 32 on the Blitzer cross-domain sentiment benchmark, which contains roughly 2,000 product reviews from each of four domains, and on synthetic Gaussian data with three binary tasks. A high-capacity configuration attaches the IFS heads to a BERT-base encoder on two GLUE-derived suites, one combining the Microsoft Research Paraphrase Corpus, the Recognizing Textual Entailment corpus, and the Corpus of Linguistic Acceptability, and another replacing the sentence-pair entailment task with the Stanford Sentiment Treebank. A multi-class extension uses a ResNet-18 backbone on a CIFAR-100 superclass problem with three tasks of five classes each, drawn from insects, small mammals, and non-insect invertebrates. All splits and feature extraction pipelines were refit across independent random seeds to prevent data leakage, and reported metrics are means over five seeds.</p>
<p>The results follow a consistent pattern across five operational noise profiles, ranging from clean data through structured corruption, annotator error, and mixed degradation to maximal distortion. When the correct task is handed to the model at test time, IFS-Hesitant is competitive with the strongest baselines, confirming that the hesitation mechanism does not sacrifice accuracy in the easy setting. When the task must be inferred without external labels, the method achieves the highest blind accuracy in every evaluated task-corrupted noise setting, with the largest margins appearing exactly where task and class errors are cross-coupled. The margins are widest on the synthetic benchmark, where task-routing signals are mathematically separable from localized class distributions, and tightest on the GLUE sentence-pair suite, where structurally dense multi-task noise makes routing intrinsically harder.</p>
<p>Beyond the specific benchmarks, the study makes a conceptual contribution that is likely to outlast its particular architecture. By separating task fit from class evidence and expressing the gap between them as a structured hesitation quantity, the authors offer a primitive that other robust-learning methods could adopt: a single, interpretable number that says how much a training example, or a test input, should be trusted before any prediction is made. The intuitionistic fuzzy formulation gives this quantity a principled algebra, with membership, non-membership, and hesitation combining through well-defined operations rather than ad hoc heuristics. The authors report no external funding for the work and have submitted the source code for reproduction as a supplementary file, with public release planned upon acceptance.</p>
<p>For practitioners deploying multi-task models in the wild, where annotation pipelines are imperfect and users do not announce which task they want solved, the message is sobering and constructive at once. Label noise is bad enough on its own, but noise that changes the question a label answers is categorically worse, and the standard toolkit was never built for it. The Hanoi team&#8217;s results suggest that teaching a model to hesitate, in a mathematically explicit way, may be one of the most economical defenses available: the same signal that protects training also routes inference and exposes corrupted data, all without requiring a separate task classifier or any change to the underlying encoder.</p>
<p><strong>Subject of Research:</strong> Robust multi-task binary classification under compound task-class noise using intuitionistic fuzzy sets</p>
<p><strong>Article Title:</strong> Compound task-class noise in task-agnostic inference for multi-task binary classification: an intuitionistic fuzzy approach</p>
<p><strong>Article References:</strong> Nguyen, H. S., Nguyen, K. T., Pham, N. L., Tran, N. T., &amp; Lê, N. C. (2026). Compound task-class noise in task-agnostic inference for multi-task binary classification: an intuitionistic fuzzy approach. <em>Complex &amp;amp; Intelligent Systems</em>. <a href="https://doi.org/10.1007/s40747-026-02493-z" rel="noopener noreferrer">https://doi.org/10.1007/s40747-026-02493-z</a></p>
<p><strong>Image Credits:</strong> AI Generated</p>
<p><strong>DOI:</strong> <a href="https://doi.org/10.1007/s40747-026-02493-z" rel="noopener noreferrer">10.1007/s40747-026-02493-z</a></p>
<p><strong>Keywords:</strong> compound task-class noise, multi-task learning, task-agnostic inference, intuitionistic fuzzy sets, noisy labels, uncertainty quantification, trust-weighted loss, binary classification, BERT, CIFAR-100, GLUE benchmark, machine learning</p>
]]></content:encoded>
					
		
		
		<post-id xmlns="com-wordpress:feed-additions:1">212667</post-id>	</item>
	</channel>
</rss>
