<?xml version="1.0" encoding="UTF-8"?><rss version="2.0"
	xmlns:content="http://purl.org/rss/1.0/modules/content/"
	xmlns:wfw="http://wellformedweb.org/CommentAPI/"
	xmlns:dc="http://purl.org/dc/elements/1.1/"
	xmlns:atom="http://www.w3.org/2005/Atom"
	xmlns:sy="http://purl.org/rss/1.0/modules/syndication/"
	xmlns:slash="http://purl.org/rss/1.0/modules/slash/"
	>

<channel>
	<title>adaptive aggregation &#8211; Science</title>
	<atom:link href="https://scienmag.com/tag/adaptive-aggregation/feed/" rel="self" type="application/rss+xml" />
	<link>https://scienmag.com</link>
	<description></description>
	<lastBuildDate>Sun, 04 Oct 2026 12:31:35 +0000</lastBuildDate>
	<language>en-US</language>
	<sy:updatePeriod>
	hourly	</sy:updatePeriod>
	<sy:updateFrequency>
	1	</sy:updateFrequency>
	<generator>https://wordpress.org/?v=7.1.2</generator>

<image>
	<url>https://scienmag.com/wp-content/uploads/2024/07/cropped-scienmag_ico-32x32.jpg</url>
	<title>adaptive aggregation &#8211; Science</title>
	<link>https://scienmag.com</link>
	<width>32</width>
	<height>32</height>
</image> 
<site xmlns="com-wordpress:feed-additions:1">73899611</site>	<item>
		<title>New Contribution Scoring Method Boosts Federated Learning Accuracy</title>
		<link>https://scienmag.com/new-contribution-scoring-method-boosts-federated-learning-accuracy/</link>
		
		<dc:creator><![CDATA[Veronica Carney]]></dc:creator>
		<pubDate>Sun, 04 Oct 2026 12:31:35 +0000</pubDate>
				<category><![CDATA[Technology and Engineering]]></category>
		<category><![CDATA[adaptive aggregation]]></category>
		<category><![CDATA[adaptive weighting algorithms for federated updates]]></category>
		<category><![CDATA[addressing client variability and trustworthiness]]></category>
		<category><![CDATA[ASHA (Adaptive Scalable Hybrid Algorithm) for federated learning]]></category>
		<category><![CDATA[challenges of data imbalance across clients]]></category>
		<category><![CDATA[CIFAR]]></category>
		<category><![CDATA[client heterogeneity]]></category>
		<category><![CDATA[communication efficiency in federated learning]]></category>
		<category><![CDATA[contribution score]]></category>
		<category><![CDATA[data heterogeneity in federated models]]></category>
		<category><![CDATA[distributed machine learning]]></category>
		<category><![CDATA[edge computing]]></category>
		<category><![CDATA[enhancing federated learning robustness and reliability]]></category>
		<category><![CDATA[Fashion-MNIST]]></category>
		<category><![CDATA[Fed-Adam]]></category>
		<category><![CDATA[Federated Averaging]]></category>
		<category><![CDATA[federated learning]]></category>
		<category><![CDATA[improving model accuracy in heterogeneous environments]]></category>
		<category><![CDATA[new algorithms for trust assessment in federated systems]]></category>
		<category><![CDATA[non-IID data]]></category>
		<category><![CDATA[privacy-preserving AI]]></category>
		<category><![CDATA[privacy-preserving distributed machine learning]]></category>
		<category><![CDATA[scalable solutions for federated learning]]></category>
		<guid isPermaLink="false">https://scienmag.com/?p=235030</guid>

					<description><![CDATA[Researchers in India have developed ASHA, a federated learning algorithm that weights each client's updates by a dynamic contribution score, achieving higher accuracy than Federated Averaging, Federated Adagrad and Fed-Adam on standard benchmarks.]]></description>
										<content:encoded><![CDATA[<p>Federated learning has quietly become one of the most consequential ideas in modern machine learning. Instead of pooling sensitive data in a central server, the technique trains a shared model across thousands of devices—phones, hospitals, edge servers—while the raw data never leaves its source. Yet the approach has long struggled with a stubborn trio of problems: data on different clients is rarely distributed evenly, communication between clients and servers is expensive, and the clients themselves vary wildly in computing power and reliability. A new study published in Cluster Computing by Asha Kumari A, Saravana Kumar E and Prajwal B of The Oxford College of Engineering and Visvesvaraya Technological University in India proposes a fresh answer to these challenges, an algorithm called ASHA, short for Adaptive Scalable Hybrid Algorithm, which rethinks how much each participant should be trusted when a global model is assembled.</p>
<p>The core insight of the paper is deceptively simple. In the most widely used federated learning scheme, Federated Averaging, the server simply blends the model updates it receives from clients, typically weighting them by the amount of data each client holds. That works reasonably well when participants are similar, but it falters when some clients hold skewed data, train on weak hardware, or produce updates that pull the shared model in unhelpful directions. The Indian team&#8217;s algorithm introduces what they call a contribution score, a dynamic, performance-driven measure that assigns a relative importance to every client based on how much its updates actually improve the model. Rather than treating all participants as equal contributors, ASHA lets the quality of each client&#8217;s work determine its influence on the collective result.</p>
<p>To arrive at this design, the authors first conducted an extensive survey of the state of the art in federated learning, organizing existing algorithms by their optimization techniques, their aggregation methods and their approaches to personalization. This taxonomy allowed them to identify recurring weaknesses. Non-IID data distribution—where each client&#8217;s local dataset differs sharply from the others—causes the local models to diverge and the averaged global model to converge slowly or to a worse solution. Communication inefficiency means that round after round of model updates must be exchanged between server and clients, straining bandwidth. Client heterogeneity, meanwhile, means that devices with different processing speeds and data volumes can dominate or stall the training process. The survey, the authors argue, shows that no single existing algorithm addresses all three problems at once, which motivated a hybrid design.</p>
<p>ASHA&#8217;s contribution score works as a weighting mechanism layered on top of the aggregation step. Each client is evaluated by performance-based contribution parameters, and the resulting score determines how strongly that client&#8217;s update shapes the global model. A client whose local training consistently improves accuracy on validation data earns a higher score; one whose updates degrade performance sees its influence shrink. The mechanism is dynamic, meaning scores are recalculated as training progresses, so a client that starts poorly but improves over time can regain influence. The authors describe this as enhancing the algorithm&#8217;s adaptability, scalability and hybridity—three properties they identify as essential for federated learning deployed at real-world scale, where the population of participating devices is constantly shifting.</p>
<p>The team did not rely on intuition alone. The paper provides both a theoretical proof and an experimental demonstration that the contribution-score mechanism improves learning outcomes. On the theoretical side, the authors developed mathematical arguments showing that weighting updates by measured contribution leads the global model toward better solutions than uniform averaging under heterogeneous conditions. Prajwal B was responsible for developing the corresponding mathematical proofs, while Asha Kumari A proposed and formulated the algorithm itself, and Saravana Kumar E carried out critical revisions of the manuscript. The division of labor reflects the dual nature of the contribution: a practical algorithmic idea grounded in formal analysis.</p>
<p>Experimentally, ASHA was benchmarked against three of the most established baseline algorithms in the field: Federated Averaging, Federated Adagrad and Fed-Adam. The last two represent the family of adaptive federated optimization methods, which adapt learning rates on the server side in the way that Adam and Adagrad revolutionized centralized deep learning. The evaluation used two standard image classification benchmarks, CIFAR and Fashion-MNIST, datasets that are widely employed to test how well learning algorithms handle realistic visual data. The results showed that ASHA achieved higher accuracy than all three baselines when appropriate contribution constants were selected—the tunable parameters that govern how aggressively the contribution score reshapes the aggregation weights.</p>
<p>That caveat about contribution constants matters, and the authors are candid about it. The advantage of ASHA depends on choosing suitable values for the constants that calibrate the scoring mechanism, which introduces a hyperparameter that practitioners must tune for their particular deployment. This is a familiar trade-off in machine learning research: added adaptivity often comes with added configuration burden. Still, the experimental evidence suggests that when the constants are set sensibly, the payoff in accuracy is real, and the scoring framework offers a principled way to think about a question that uniform averaging ignores entirely—which clients deserve to be heard.</p>
<p>The broader context makes the contribution timely. Federated learning was famously introduced by McMahan and colleagues in 2017 as a way to train deep networks on decentralized data with communication-efficient updates, and it has since become the backbone of privacy-conscious machine learning in mobile keyboards, healthcare analytics and industrial IoT. But the field has fragmented into dozens of specialized remedies: FedProx tackles heterogeneity by adding a proximal term to local objectives, SCAFFOLD uses control variates to correct client drift, FedBN keeps batch normalization layers local to handle non-IID features, and meta-learning approaches pursue personalization for individual users. Cloud-edge collaborative architectures, dynamic regularization, trust-aware incentive mechanisms and even genetic algorithms applied to clustered federated learning have all been proposed in recent years. ASHA&#8217;s authors position their method as a hybrid that draws on this rich landscape rather than replacing it, combining adaptive aggregation with per-client scoring in a single framework.</p>
<p>What distinguishes the contribution score from earlier client-selection strategies is its continuous, performance-driven character. Some prior work has focused on choosing which clients participate in each round—for instance, power-of-choice selection strategies that pick clients with higher loss in the hope of faster convergence. ASHA instead keeps clients engaged but modulates their influence, which the authors argue improves adaptability and scalability simultaneously. In a network of heterogeneous devices, where a hospital&#8217;s server, a farmer&#8217;s phone and a factory sensor might all contribute to the same model, a mechanism that automatically downweights unreliable or unhelpful participants while rewarding strong ones could prove valuable well beyond the benchmark datasets used in the study.</p>
<p>The research, published on 25 September 2026 in Cluster Computing as volume 29, article 792, arrives as demand for privacy-preserving machine learning continues to accelerate. Regulatory pressure around data protection and the sheer impracticality of centralizing data from millions of devices guarantee that federated approaches will keep growing. Whether ASHA&#8217;s contribution scoring becomes a standard ingredient in production systems will depend on how it holds up under large-scale deployment, adversarial conditions and the messy realities of real client populations. But the study offers a clear and testable proposition: that measuring what each participant actually contributes, and weighting accordingly, can make distributed learning both more accurate and more resilient. For a field whose central promise is learning together without sharing data, that is a proposition worth watching closely.</p>
<p><strong>Subject of Research:</strong> A hybrid federated learning algorithm that uses performance-based contribution scoring to improve accuracy under heterogeneous, non-IID client data</p>
<p><strong>Article Title:</strong> ASHA: Adaptive Scalable Hybrid Algorithm for federated learning</p>
<p><strong>Article References:</strong> A, A. K., E, S. K., &amp; B, P. (2026). ASHA: Adaptive Scalable Hybrid Algorithm for federated learning. <em>Cluster Computing, 29</em>(14), Article 792. <a href="https://doi.org/10.1007/s10586-026-06574-z" rel="noopener noreferrer">https://doi.org/10.1007/s10586-026-06574-z</a></p>
<p><strong>Image Credits:</strong> AI Generated</p>
<p><strong>DOI:</strong> <a href="https://doi.org/10.1007/s10586-026-06574-z" rel="noopener noreferrer">10.1007/s10586-026-06574-z</a></p>
<p><strong>Keywords:</strong> federated learning, contribution score, adaptive aggregation, non-IID data, client heterogeneity, Federated Averaging, Fed-Adam, distributed machine learning, privacy-preserving AI, edge computing, CIFAR, Fashion-MNIST</p>
]]></content:encoded>
					
		
		
		<post-id xmlns="com-wordpress:feed-additions:1">235030</post-id>	</item>
		<item>
		<title>New Defense Lets Decentralized AI Networks Learn Safely Despite Malicious Peers</title>
		<link>https://scienmag.com/new-defense-lets-decentralized-ai-networks-learn-safely-despite-malicious-peers/</link>
		
		<dc:creator><![CDATA[Veronica Carney]]></dc:creator>
		<pubDate>Mon, 21 Sep 2026 02:20:54 +0000</pubDate>
				<category><![CDATA[Technology and Engineering]]></category>
		<category><![CDATA[adaptive aggregation]]></category>
		<category><![CDATA[adversarial attacks]]></category>
		<category><![CDATA[Byzantine resilience]]></category>
		<category><![CDATA[consensus]]></category>
		<category><![CDATA[Data Privacy]]></category>
		<category><![CDATA[decentralized learning]]></category>
		<category><![CDATA[distributed machine learning]]></category>
		<category><![CDATA[federated learning]]></category>
		<category><![CDATA[non-convex optimization]]></category>
		<category><![CDATA[non-IID data]]></category>
		<category><![CDATA[peer-to-peer machine learning]]></category>
		<category><![CDATA[resilient learning]]></category>
		<guid isPermaLink="false">https://scienmag.com/?p=205032</guid>

					<description><![CDATA[Researchers at Vanderbilt University have developed a resilient adaptive aggregation method that enables peer-to-peer machine learning networks to reach consensus and maintain high accuracy even when some workers are malicious.]]></description>
										<content:encoded><![CDATA[<p>Every time you unlock your phone with your face, ask a smart speaker a question, or let a car assist you on the highway, a machine learning model is at work. Traditionally, training such models has meant gathering mountains of data in one place, a practice that raises privacy concerns and creates tempting targets for attackers. Federated learning promised a fix by letting devices train models locally and share only updates with a central server. But that server is itself a weakness: knock it out, compromise it, or subvert it, and the whole learning process collapses. Now, researchers at Vanderbilt University have unveiled a new technique that pushes collaborative machine learning one step further toward a serverless future, one in which devices learn directly from each other while fending off malicious participants in their midst.</p>
<p>The new study, published in the journal Machine Learning by Chandreyee Bhowmick and Xenofon Koutsoukos of Vanderbilt&#8217;s Institute of Software Integrated Systems, tackles a problem that has long haunted peer-to-peer machine learning: what happens when some of the workers in a decentralized network are adversaries bent on poisoning the shared model? In a peer-to-peer setting, there is no central coordinator to vet incoming updates. Each device, or worker, exchanges model parameters only with its immediate neighbors on a communication graph. If even a handful of those neighbors are compromised, they can inject corrupted parameters that drag everyone&#8217;s model toward garbage, a scenario known in the field as a Byzantine attack, named after the Byzantine Generals Problem in distributed computing.</p>
<p>The Vanderbilt team&#8217;s answer is a resilient adaptive aggregation scheme built around a deceptively simple idea: encourage similarity among honest workers. Rather than treating all neighbor contributions equally, each worker solves an optimization problem that assigns weights to its neighbors&#8217; model parameters, favoring those whose learning behavior resembles its own. The weights emerge from a principled formulation rather than hand-tuned heuristics, and the optimization is designed so that no worker ever needs to see another worker&#8217;s private data. Instead, each worker evaluates its neighbors&#8217; models against its own local dataset, computing losses that reflect how well a neighbor&#8217;s model performs on data it was never trained on. This preserves privacy while still giving the aggregation step the information it needs to distinguish helpful peers from hostile ones.</p>
<p>The technical machinery matters here. In each round of training, a worker receives the current model parameters of its neighbors and blends them into a weighted sum, with the weights determined by solving a constrained optimization that balances fitting the local objective against staying close to the collective consensus. The formulation effectively learns, on the fly, which neighbors are pulling in the same direction and which are outliers. Adversarial workers, whose parameters are crafted to mislead rather than to learn, tend to produce models whose behavior diverges sharply from that of honest peers, and the weighting scheme naturally down-weights them. Because the weights are recomputed adaptively as training proceeds, the method can track changing conditions, including the non-convex loss landscapes that arise in deep learning, where standard convergence arguments often break down.</p>
<p>What sets this work apart from earlier Byzantine-resilient approaches is the combination of three hard conditions at once: non-convex loss functions, non-iid data distributions, and a fully decentralized topology. Most real-world deployments face all three. Data on different devices is rarely identically distributed; a hospital&#8217;s patient records, a phone&#8217;s photo library, and a factory&#8217;s sensor logs all look wildly different. Non-iid data makes it harder to tell a malicious outlier from an honest worker that simply has unusual data, since both may produce parameters that deviate from the crowd. Non-convex losses, characteristic of neural networks, mean the loss surface is riddled with local minima and saddle points, complicating both the algorithm design and the mathematical analysis of whether the method actually works.</p>
<p>And the authors do provide such analysis. Their theoretical results establish two key guarantees for honest workers. First, the workers&#8217; model parameters reach consensus, meaning that despite the presence of adversaries and the heterogeneity of their data, the honest devices converge to agreement on a shared model. Second, the gap between the honest workers&#8217; parameters and their respective optimal values remains bounded, and crucially, that bound is expressed as a function of a small number of hyperparameters and the variance of the non-iid data distribution across the network. In plain terms, the more heterogeneous the data, the looser the guarantee, which is an honest and interpretable characterization rather than an idealized claim that assumes away the messiness of real deployments.</p>
<p>The empirical side of the study puts those guarantees to the test across three classification tasks, drawing on widely used benchmark datasets including human activity recognition from smartphone sensors, the MNIST handwritten digit collection, the Spambase email dataset, and CIFAR image data. The experiments span multiple adversarial scenarios and attack models, simulating networks in which a fraction of workers behave maliciously in different ways. Across these settings, the proposed adaptive aggregation method consistently improved the test accuracy achieved by honest workers compared with state-of-the-art resilient aggregation techniques. The improvement is meaningful in practice: in adversarial distributed learning, the difference between a defense that merely limits damage and one that preserves high accuracy can determine whether a system is deployable at all.</p>
<p>The implications reach well beyond benchmark datasets. Decentralized, peer-to-peer learning is attractive for settings where a central server is impractical, untrusted, or simply absent: fleets of autonomous vehicles coordinating in real time, swarms of drones, industrial IoT networks, smart city infrastructure, and healthcare consortia where no single institution can legally pool patient data. In such environments, resilience is not optional. A connected vehicle network in which one compromised node can poison the collective perception model is a safety hazard, not just a security nuisance. By removing the single point of failure that plagues federated learning and simultaneously hardening the network against Byzantine participants, the new approach sketches a blueprint for collaborative AI that is both decentralized and trustworthy.</p>
<p>The privacy dimension deserves equal emphasis. The scheme&#8217;s design ensures that workers never share raw data; the only information exchanged is model parameters, and even the loss evaluations that guide the aggregation weights are computed locally, with each worker testing neighbor models against its own private dataset. This stands in contrast to approaches that require sharing gradients or statistics that can leak information about training data. Combined with the elimination of a central aggregation server, the method reduces the number of parties that must be trusted, a shift that security researchers often describe as moving from trusting a single authority to trusting a protocol.</p>
<p>Challenges remain before such systems see widespread adoption. The optimization required to compute aggregation weights adds computational overhead on each device, and the theoretical bounds, while informative, depend on hyperparameters that practitioners must tune. The convergence guarantees also assume a certain network structure and adversary budget, and real deployments may face adversaries that adapt their strategies over time. Still, the work represents a notable step forward in a research area that sits at the intersection of machine learning, distributed systems, and cybersecurity. As AI models increasingly live at the edge, on phones, vehicles, sensors, and medical devices, the question is no longer whether decentralized learning will matter, but whether it can be made safe. This study offers a rigorous, empirically validated answer to that question, showing that a network of peers, even one infiltrated by adversaries, can still learn well, provided its members know how to weigh each other&#8217;s advice.</p>
<p><strong>Subject of Research:</strong> Byzantine-resilient adaptive aggregation for peer-to-peer distributed machine learning under non-convex losses and non-iid data</p>
<p><strong>Article Title:</strong> Similarity-Promoting Resilient Adaptive Aggregation in Peer-to-Peer Machine Learning</p>
<p><strong>Article References:</strong> Bhowmick, C., &amp; Koutsoukos, X. (2026). Similarity-Promoting Resilient Adaptive Aggregation in Peer-to-Peer Machine Learning. <em>Machine Learning, 115</em>(10), Article 223. <a href="https://doi.org/10.1007/s10994-026-07162-3" rel="noopener noreferrer">https://doi.org/10.1007/s10994-026-07162-3</a></p>
<p><strong>Image Credits:</strong> AI Generated</p>
<p><strong>DOI:</strong> <a href="https://doi.org/10.1007/s10994-026-07162-3" rel="noopener noreferrer">10.1007/s10994-026-07162-3</a></p>
<p><strong>Keywords:</strong> peer-to-peer machine learning, decentralized learning, Byzantine resilience, adaptive aggregation, federated learning, non-iid data, non-convex optimization, distributed machine learning, adversarial attacks, data privacy, consensus, resilient learning</p>
]]></content:encoded>
					
		
		
		<post-id xmlns="com-wordpress:feed-additions:1">205032</post-id>	</item>
	</channel>
</rss>
