<?xml version="1.0" encoding="UTF-8"?><rss version="2.0"
	xmlns:content="http://purl.org/rss/1.0/modules/content/"
	xmlns:wfw="http://wellformedweb.org/CommentAPI/"
	xmlns:dc="http://purl.org/dc/elements/1.1/"
	xmlns:atom="http://www.w3.org/2005/Atom"
	xmlns:sy="http://purl.org/rss/1.0/modules/syndication/"
	xmlns:slash="http://purl.org/rss/1.0/modules/slash/"
	>

<channel>
	<title>Fashion-MNIST &#8211; Science</title>
	<atom:link href="https://scienmag.com/tag/fashion-mnist/feed/" rel="self" type="application/rss+xml" />
	<link>https://scienmag.com</link>
	<description></description>
	<lastBuildDate>Thu, 08 Oct 2026 20:48:18 +0000</lastBuildDate>
	<language>en-US</language>
	<sy:updatePeriod>
	hourly	</sy:updatePeriod>
	<sy:updateFrequency>
	1	</sy:updateFrequency>
	<generator>https://wordpress.org/?v=7.1.3</generator>

<image>
	<url>https://scienmag.com/wp-content/uploads/2024/07/cropped-scienmag_ico-32x32.jpg</url>
	<title>Fashion-MNIST &#8211; Science</title>
	<link>https://scienmag.com</link>
	<width>32</width>
	<height>32</height>
</image> 
<site xmlns="com-wordpress:feed-additions:1">73899611</site>	<item>
		<title>New Incentive Scheme Pays Fairer Rewards to Federated Learning&#8217;s Unsung Data Heroes</title>
		<link>https://scienmag.com/new-incentive-scheme-pays-fairer-rewards-to-federated-learnings-unsung-data-heroes/</link>
		
		<dc:creator><![CDATA[Veronica Carney]]></dc:creator>
		<pubDate>Thu, 08 Oct 2026 20:48:18 +0000</pubDate>
				<category><![CDATA[Technology and Engineering]]></category>
		<category><![CDATA[collaborative fairness]]></category>
		<category><![CDATA[contribution evaluation]]></category>
		<category><![CDATA[Distributed Computing]]></category>
		<category><![CDATA[economic challenges in federated learning]]></category>
		<category><![CDATA[energy and bandwidth costs in federated learning]]></category>
		<category><![CDATA[fair reward distribution in federated learning]]></category>
		<category><![CDATA[fairness in collaborative AI]]></category>
		<category><![CDATA[Fashion-MNIST]]></category>
		<category><![CDATA[federated learning]]></category>
		<category><![CDATA[federated learning incentive mechanisms]]></category>
		<category><![CDATA[heterogeneous client participation]]></category>
		<category><![CDATA[incentive mechanism]]></category>
		<category><![CDATA[incentivizing local model updates]]></category>
		<category><![CDATA[Machine learning]]></category>
		<category><![CDATA[mathematically grounded incentive fixes]]></category>
		<category><![CDATA[measurement of contribution in federated systems]]></category>
		<category><![CDATA[non-IID data]]></category>
		<category><![CDATA[personalized model]]></category>
		<category><![CDATA[privacy-preserving machine learning]]></category>
		<category><![CDATA[regulation impacts on data sharing]]></category>
		<category><![CDATA[reward systems for distributed training]]></category>
		<category><![CDATA[reward-weighted aggregation]]></category>
		<category><![CDATA[Shapley value]]></category>
		<category><![CDATA[SVHN]]></category>
		<guid isPermaLink="false">https://scienmag.com/?p=249293</guid>

					<description><![CDATA[Researchers at Shanghai Polytechnic University have developed CDAFIM, a class-difficulty-aware incentive mechanism that uses Shapley values to fairly reward federated learning clients who contribute rare and hard-to-learn data.]]></description>
										<content:encoded><![CDATA[<p>Federated learning has become one of the most consequential ideas in modern machine learning: instead of pooling sensitive data in a central server, a coordinating model travels to the data, trains locally on smartphones, hospitals, or factory sensors, and sends back only parameter updates. This architecture promises the statistical power of massive datasets while respecting the privacy boundaries that regulations such as the European General Data Protection Regulation have drawn around raw personal information. Yet the paradigm carries a persistent economic weakness. Because participation is voluntary and often costly, in terms of computation, bandwidth, and energy, the entire enterprise depends on convincing a heterogeneous crowd of clients to keep contributing. A new study published in Cluster Computing by Xinyu Bian, Xiaoming Hu, Anbao Wang, and Shuangjie Bai of Shanghai Polytechnic University argues that the incentive systems currently used to reward those clients are systematically unfair, and it proposes a mathematically grounded fix that could change how collaborative AI ecosystems distribute their rewards.</p>
<p>The core of the problem, the researchers explain, lies in how contribution is measured. Most existing incentive mechanisms evaluate a client by asking a single blunt question: how much did this participant&#8217;s update improve the overall accuracy of the global model? That framing sounds reasonable, but it hides a crucial asymmetry. In real-world federated settings, data across clients is almost never independently and identically distributed, the notorious Non-IID condition that plagues federated deployments. One hospital may hold thousands of images of common conditions while another specializes in rare diseases; one phone may photograph everyday scenes while another captures unusual lighting or underrepresented objects. When the yardstick is aggregate accuracy, clients whose samples belong to rare or intrinsically hard-to-learn classes appear to contribute little, even when their data is precisely what the global model needs most. The result is a feedback loop in which the most valuable niche data providers are undervalued, lose motivation, and eventually drop out, degrading the very model everyone depends on.</p>
<p>Bian and colleagues call their solution CDAFIM, a Class-Difficulty-Aware Fair Incentive Mechanism, and its intellectual centerpiece is a contribution evaluation engine the authors name CDAFIM-Eval. The engine builds on the Shapley value, a concept borrowed from cooperative game theory that has become the gold standard for attributing credit in machine learning collaborations. The Shapley value of a participant is, in essence, the average marginal improvement that participant brings across every possible order in which the coalition of learners could have formed. Because it accounts for all permutations, it resists gaming and satisfies axioms of fairness that simpler heuristics lack. Its Achilles&#8217; heel is computational cost: evaluating every subset of clients is exponentially expensive, which has spawned an entire research literature on efficient approximations, including grouped evaluation methods such as GTG-Shapley and gradient-driven reward schemes presented at venues like NeurIPS. CDAFIM adopts the Shapley framework but modifies what counts as a marginal gain.</p>
<p>The modification is the class-difficulty-aware part. Rather than scoring a client solely by its effect on top-line model performance, CDAFIM-Eval weighs improvements class by class, and it weights those classes unequally according to how difficult they are for the model to learn. The mechanism incorporates an adaptive thresholding strategy that dynamically identifies hard-to-learn categories as training progresses. Intuitively, if a particular class consistently exhibits poor performance across rounds, the system flags it as critical and amplifies the contribution scores of clients whose high-quality samples belong to that class. A participant supplying well-labeled examples of a rare garment type in Fashion-MNIST, or of a digit class that the collective data renders visually ambiguous in SVHN, therefore receives recognition that a naive accuracy-based evaluator would never grant. This is a deliberate inversion of the usual incentive logic: instead of rewarding clients whose data is easy and whose gains show up immediately in aggregate metrics, CDAFIM rewards clients who shore up the model&#8217;s weakest links.</p>
<p>Quantifying contribution, however, is only half of the design. The second half is a dual reward allocation mechanism that translates contribution scores into two distinct currencies of reward. The first is reward-weighted aggregation. In standard federated averaging, each client&#8217;s update is weighted by its local dataset size, a choice that implicitly privileges participants with the most data regardless of its quality or uniqueness. CDAFIM instead maps each client&#8217;s class-difficulty-aware contribution score to its aggregation weight, so that updates from clients who genuinely improve the model, especially on hard classes, exert more influence on the shared global model. The authors report that this weighting improves both convergence speed and generalization, a plausible consequence of letting the aggregation step filter out noisy or redundant updates while amplifying informative ones.</p>
<p>The second reward channel is more novel: a personalized model distribution strategy. In many federated deployments, clients do not merely want to feel appreciated; they want a model that works well on their own data. CDAFIM assigns differentiated, personalized models to clients according to their relative contribution levels, so that higher contributors receive models better tailored to their needs. This converts the incentive from an abstract, and often fictional, promise of monetary payment into a concrete, immediately useful asset. The approach echoes a growing line of research on incentive-aware model rewards, in which the trained model itself, rather than cash, is the compensation, but CDAFIM ties the quality of that personalized model directly to a fine-grained, class-sensitive measure of fairness rather than to coarse participation metrics.</p>
<p>The empirical case for the mechanism rests on experiments with two widely used image benchmarks, Fashion-MNIST, a collection of grayscale clothing images introduced in 2017 as a harder successor to handwritten-digit recognition, and SVHN, the Street View House Numbers dataset of real-world digit photographs. The authors evaluated CDAFIM across a range of Non-IID scenarios, the settings that most faithfully mimic real federated deployments, where each client&#8217;s local label distribution deviates sharply from the global one. According to the study, CDAFIM consistently outperformed advanced competing methods under these conditions. The consistency across both datasets and multiple heterogeneity regimes matters, because incentive mechanisms are notoriously sensitive to experimental configuration; a scheme that only works under one skewed distribution is of limited practical value.</p>
<p>The broader significance of the work extends beyond the specific datasets. Federated learning is increasingly deployed in domains where the rare classes are the ones that matter most: medical imaging consortia, where unusual pathologies are exactly the cases a diagnostic model must not miss; industrial IoT networks, where fault conditions are rare by definition; and intrusion detection systems for edge-enabled industrial networks, where attack traffic is a tiny fraction of the data. In each of these settings, an incentive mechanism that undervalues the holders of rare-class data is not merely unfair, it is dangerous, because it starves the model of the examples it most desperately needs. By making class difficulty a first-class citizen of the reward calculus, CDAFIM aligns individual client motivation with collective model robustness, a alignment that game theorists would recognize as mechanism design working as intended.</p>
<p>There are, of course, caveats that temper the enthusiasm. The Shapley value, even with efficient approximations, remains computationally demanding, and the paper&#8217;s experiments rely on publicly available benchmarks rather than large-scale production deployments; the authors note that code availability is not applicable, and the datasets used, including Fashion-MNIST, SVHN, and the Fed-ISIC2019 medical imaging benchmark referenced in their data availability statement, are standard research resources. Whether the adaptive thresholding strategy remains stable when class difficulty shifts over long training horizons, or when clients behave strategically to game the difficulty detection itself, are questions that future work will need to address. The authors declare no conflicts of interest and received no external funding for the study, and the paper, received in July 2025 and published on 18 September 2026 in Cluster Computing, is the product of a team at Shanghai Polytechnic University&#8217;s Institute for Artificial Intelligence, with Bian and Hu credited with the core methodology and experimental design.</p>
<p>Still, the conceptual contribution is likely to outlast its benchmarks. CDAFIM belongs to a maturing second wave of federated learning research, one that has moved past the initial privacy-versus-accuracy trade-offs and now grapples with the socio-economic machinery that keeps decentralized AI systems alive. Contribution evaluation, collaborative fairness, and incentive-aware model rewards have each advanced separately; the Shanghai team&#8217;s synthesis, folding class-level difficulty into Shapley-based credit assignment and then feeding that score into both aggregation weights and personalized model distribution, offers a template for how fine-grained fairness can be engineered into the plumbing of distributed learning. If federated learning is to fulfill its promise in healthcare, urban IoT, and edge computing, the clients holding the rarest, hardest, most irreplaceable data will need reasons to stay at the table. CDAFIM&#8217;s message is simple and resonant: in collaborative intelligence, the hardest examples deserve the loudest applause.</p>
<p><strong>Subject of Research:</strong> A class-difficulty-aware fair incentive mechanism for federated learning based on Shapley values</p>
<p><strong>Article Title:</strong> CDAFIM: a class-difficulty-aware fair incentive mechanism for federated learning</p>
<p><strong>Article References:</strong> Bian, X., Hu, X., Wang, A., &amp; Bai, S. (2026). CDAFIM: a class-difficulty-aware fair incentive mechanism for federated learning. <em>Cluster Computing, 29</em>(13), Article 760. <a href="https://doi.org/10.1007/s10586-026-06570-3" rel="noopener noreferrer">https://doi.org/10.1007/s10586-026-06570-3</a></p>
<p><strong>Image Credits:</strong> AI Generated</p>
<p><strong>DOI:</strong> <a href="https://doi.org/10.1007/s10586-026-06570-3" rel="noopener noreferrer">10.1007/s10586-026-06570-3</a></p>
<p><strong>Keywords:</strong> federated learning, incentive mechanism, Shapley value, contribution evaluation, Non-IID data, collaborative fairness, reward-weighted aggregation, personalized model, machine learning, Fashion-MNIST, SVHN, distributed computing</p>
]]></content:encoded>
					
		
		
		<post-id xmlns="com-wordpress:feed-additions:1">249293</post-id>	</item>
		<item>
		<title>New Contribution Scoring Method Boosts Federated Learning Accuracy</title>
		<link>https://scienmag.com/new-contribution-scoring-method-boosts-federated-learning-accuracy/</link>
		
		<dc:creator><![CDATA[Veronica Carney]]></dc:creator>
		<pubDate>Sun, 04 Oct 2026 12:31:35 +0000</pubDate>
				<category><![CDATA[Technology and Engineering]]></category>
		<category><![CDATA[adaptive aggregation]]></category>
		<category><![CDATA[adaptive weighting algorithms for federated updates]]></category>
		<category><![CDATA[addressing client variability and trustworthiness]]></category>
		<category><![CDATA[ASHA (Adaptive Scalable Hybrid Algorithm) for federated learning]]></category>
		<category><![CDATA[challenges of data imbalance across clients]]></category>
		<category><![CDATA[CIFAR]]></category>
		<category><![CDATA[client heterogeneity]]></category>
		<category><![CDATA[communication efficiency in federated learning]]></category>
		<category><![CDATA[contribution score]]></category>
		<category><![CDATA[data heterogeneity in federated models]]></category>
		<category><![CDATA[distributed machine learning]]></category>
		<category><![CDATA[edge computing]]></category>
		<category><![CDATA[enhancing federated learning robustness and reliability]]></category>
		<category><![CDATA[Fashion-MNIST]]></category>
		<category><![CDATA[Fed-Adam]]></category>
		<category><![CDATA[Federated Averaging]]></category>
		<category><![CDATA[federated learning]]></category>
		<category><![CDATA[improving model accuracy in heterogeneous environments]]></category>
		<category><![CDATA[new algorithms for trust assessment in federated systems]]></category>
		<category><![CDATA[non-IID data]]></category>
		<category><![CDATA[privacy-preserving AI]]></category>
		<category><![CDATA[privacy-preserving distributed machine learning]]></category>
		<category><![CDATA[scalable solutions for federated learning]]></category>
		<guid isPermaLink="false">https://scienmag.com/?p=235030</guid>

					<description><![CDATA[Researchers in India have developed ASHA, a federated learning algorithm that weights each client's updates by a dynamic contribution score, achieving higher accuracy than Federated Averaging, Federated Adagrad and Fed-Adam on standard benchmarks.]]></description>
										<content:encoded><![CDATA[<p>Federated learning has quietly become one of the most consequential ideas in modern machine learning. Instead of pooling sensitive data in a central server, the technique trains a shared model across thousands of devices—phones, hospitals, edge servers—while the raw data never leaves its source. Yet the approach has long struggled with a stubborn trio of problems: data on different clients is rarely distributed evenly, communication between clients and servers is expensive, and the clients themselves vary wildly in computing power and reliability. A new study published in Cluster Computing by Asha Kumari A, Saravana Kumar E and Prajwal B of The Oxford College of Engineering and Visvesvaraya Technological University in India proposes a fresh answer to these challenges, an algorithm called ASHA, short for Adaptive Scalable Hybrid Algorithm, which rethinks how much each participant should be trusted when a global model is assembled.</p>
<p>The core insight of the paper is deceptively simple. In the most widely used federated learning scheme, Federated Averaging, the server simply blends the model updates it receives from clients, typically weighting them by the amount of data each client holds. That works reasonably well when participants are similar, but it falters when some clients hold skewed data, train on weak hardware, or produce updates that pull the shared model in unhelpful directions. The Indian team&#8217;s algorithm introduces what they call a contribution score, a dynamic, performance-driven measure that assigns a relative importance to every client based on how much its updates actually improve the model. Rather than treating all participants as equal contributors, ASHA lets the quality of each client&#8217;s work determine its influence on the collective result.</p>
<p>To arrive at this design, the authors first conducted an extensive survey of the state of the art in federated learning, organizing existing algorithms by their optimization techniques, their aggregation methods and their approaches to personalization. This taxonomy allowed them to identify recurring weaknesses. Non-IID data distribution—where each client&#8217;s local dataset differs sharply from the others—causes the local models to diverge and the averaged global model to converge slowly or to a worse solution. Communication inefficiency means that round after round of model updates must be exchanged between server and clients, straining bandwidth. Client heterogeneity, meanwhile, means that devices with different processing speeds and data volumes can dominate or stall the training process. The survey, the authors argue, shows that no single existing algorithm addresses all three problems at once, which motivated a hybrid design.</p>
<p>ASHA&#8217;s contribution score works as a weighting mechanism layered on top of the aggregation step. Each client is evaluated by performance-based contribution parameters, and the resulting score determines how strongly that client&#8217;s update shapes the global model. A client whose local training consistently improves accuracy on validation data earns a higher score; one whose updates degrade performance sees its influence shrink. The mechanism is dynamic, meaning scores are recalculated as training progresses, so a client that starts poorly but improves over time can regain influence. The authors describe this as enhancing the algorithm&#8217;s adaptability, scalability and hybridity—three properties they identify as essential for federated learning deployed at real-world scale, where the population of participating devices is constantly shifting.</p>
<p>The team did not rely on intuition alone. The paper provides both a theoretical proof and an experimental demonstration that the contribution-score mechanism improves learning outcomes. On the theoretical side, the authors developed mathematical arguments showing that weighting updates by measured contribution leads the global model toward better solutions than uniform averaging under heterogeneous conditions. Prajwal B was responsible for developing the corresponding mathematical proofs, while Asha Kumari A proposed and formulated the algorithm itself, and Saravana Kumar E carried out critical revisions of the manuscript. The division of labor reflects the dual nature of the contribution: a practical algorithmic idea grounded in formal analysis.</p>
<p>Experimentally, ASHA was benchmarked against three of the most established baseline algorithms in the field: Federated Averaging, Federated Adagrad and Fed-Adam. The last two represent the family of adaptive federated optimization methods, which adapt learning rates on the server side in the way that Adam and Adagrad revolutionized centralized deep learning. The evaluation used two standard image classification benchmarks, CIFAR and Fashion-MNIST, datasets that are widely employed to test how well learning algorithms handle realistic visual data. The results showed that ASHA achieved higher accuracy than all three baselines when appropriate contribution constants were selected—the tunable parameters that govern how aggressively the contribution score reshapes the aggregation weights.</p>
<p>That caveat about contribution constants matters, and the authors are candid about it. The advantage of ASHA depends on choosing suitable values for the constants that calibrate the scoring mechanism, which introduces a hyperparameter that practitioners must tune for their particular deployment. This is a familiar trade-off in machine learning research: added adaptivity often comes with added configuration burden. Still, the experimental evidence suggests that when the constants are set sensibly, the payoff in accuracy is real, and the scoring framework offers a principled way to think about a question that uniform averaging ignores entirely—which clients deserve to be heard.</p>
<p>The broader context makes the contribution timely. Federated learning was famously introduced by McMahan and colleagues in 2017 as a way to train deep networks on decentralized data with communication-efficient updates, and it has since become the backbone of privacy-conscious machine learning in mobile keyboards, healthcare analytics and industrial IoT. But the field has fragmented into dozens of specialized remedies: FedProx tackles heterogeneity by adding a proximal term to local objectives, SCAFFOLD uses control variates to correct client drift, FedBN keeps batch normalization layers local to handle non-IID features, and meta-learning approaches pursue personalization for individual users. Cloud-edge collaborative architectures, dynamic regularization, trust-aware incentive mechanisms and even genetic algorithms applied to clustered federated learning have all been proposed in recent years. ASHA&#8217;s authors position their method as a hybrid that draws on this rich landscape rather than replacing it, combining adaptive aggregation with per-client scoring in a single framework.</p>
<p>What distinguishes the contribution score from earlier client-selection strategies is its continuous, performance-driven character. Some prior work has focused on choosing which clients participate in each round—for instance, power-of-choice selection strategies that pick clients with higher loss in the hope of faster convergence. ASHA instead keeps clients engaged but modulates their influence, which the authors argue improves adaptability and scalability simultaneously. In a network of heterogeneous devices, where a hospital&#8217;s server, a farmer&#8217;s phone and a factory sensor might all contribute to the same model, a mechanism that automatically downweights unreliable or unhelpful participants while rewarding strong ones could prove valuable well beyond the benchmark datasets used in the study.</p>
<p>The research, published on 25 September 2026 in Cluster Computing as volume 29, article 792, arrives as demand for privacy-preserving machine learning continues to accelerate. Regulatory pressure around data protection and the sheer impracticality of centralizing data from millions of devices guarantee that federated approaches will keep growing. Whether ASHA&#8217;s contribution scoring becomes a standard ingredient in production systems will depend on how it holds up under large-scale deployment, adversarial conditions and the messy realities of real client populations. But the study offers a clear and testable proposition: that measuring what each participant actually contributes, and weighting accordingly, can make distributed learning both more accurate and more resilient. For a field whose central promise is learning together without sharing data, that is a proposition worth watching closely.</p>
<p><strong>Subject of Research:</strong> A hybrid federated learning algorithm that uses performance-based contribution scoring to improve accuracy under heterogeneous, non-IID client data</p>
<p><strong>Article Title:</strong> ASHA: Adaptive Scalable Hybrid Algorithm for federated learning</p>
<p><strong>Article References:</strong> A, A. K., E, S. K., &amp; B, P. (2026). ASHA: Adaptive Scalable Hybrid Algorithm for federated learning. <em>Cluster Computing, 29</em>(14), Article 792. <a href="https://doi.org/10.1007/s10586-026-06574-z" rel="noopener noreferrer">https://doi.org/10.1007/s10586-026-06574-z</a></p>
<p><strong>Image Credits:</strong> AI Generated</p>
<p><strong>DOI:</strong> <a href="https://doi.org/10.1007/s10586-026-06574-z" rel="noopener noreferrer">10.1007/s10586-026-06574-z</a></p>
<p><strong>Keywords:</strong> federated learning, contribution score, adaptive aggregation, non-IID data, client heterogeneity, Federated Averaging, Fed-Adam, distributed machine learning, privacy-preserving AI, edge computing, CIFAR, Fashion-MNIST</p>
]]></content:encoded>
					
		
		
		<post-id xmlns="com-wordpress:feed-additions:1">235030</post-id>	</item>
		<item>
		<title>Hinton&#8217;s Forward-Forward Algorithm Gets a Hyper-Parameter Tune-Up That Closes the Accuracy Gap</title>
		<link>https://scienmag.com/hintons-forward-forward-algorithm-gets-a-hyper-parameter-tune-up-that-closes-the-accuracy-gap/</link>
		
		<dc:creator><![CDATA[Blake Davidson]]></dc:creator>
		<pubDate>Wed, 30 Sep 2026 21:52:25 +0000</pubDate>
				<category><![CDATA[Technology and Engineering]]></category>
		<category><![CDATA[AI research advancements]]></category>
		<category><![CDATA[alternative AI training methods]]></category>
		<category><![CDATA[Artificial Intelligence Review]]></category>
		<category><![CDATA[automated hyper-parameter tuning]]></category>
		<category><![CDATA[back-propagation]]></category>
		<category><![CDATA[backpropagation limitations]]></category>
		<category><![CDATA[deep learning algorithm]]></category>
		<category><![CDATA[error signal propagation]]></category>
		<category><![CDATA[Fashion-MNIST]]></category>
		<category><![CDATA[forward-forward algorithm]]></category>
		<category><![CDATA[Geoffrey Hinton]]></category>
		<category><![CDATA[hyper-parameter optimization]]></category>
		<category><![CDATA[Machine learning]]></category>
		<category><![CDATA[MedMnist]]></category>
		<category><![CDATA[memory constraints in AI]]></category>
		<category><![CDATA[memory efficiency]]></category>
		<category><![CDATA[metaheuristics]]></category>
		<category><![CDATA[neural network optimization]]></category>
		<category><![CDATA[neural network training]]></category>
		<category><![CDATA[neural networks]]></category>
		<category><![CDATA[positive and negative data training]]></category>
		<category><![CDATA[Tanta University]]></category>
		<guid isPermaLink="false">https://scienmag.com/?p=219250</guid>

					<description><![CDATA[A new study shows that automated metaheuristic hyper-parameter optimization substantially boosts the accuracy of Hinton's memory-efficient Forward-Forward training algorithm across six datasets.]]></description>
										<content:encoded><![CDATA[<p>Deep learning has been built, almost without interruption, on a single computational habit: the backward pass. Since the popularization of back-propagation in the 1980s, neural networks have learned by pushing error signals backwards through their layers, a process that demands that every intermediate activation be stored during the forward pass so that gradients can be computed on the way back. That memory bill has become one of the defining constraints of modern artificial intelligence, shaping what can be trained and on what hardware. Now, a study published in Artificial Intelligence Review by Yomna Abdulgawad Elnady, Amany Mahmoud Sarhan and Mohammad Ali Eita of Tanta University in Egypt examines what happens when the backward pass is abandoned altogether, and shows that with the right automated tuning, the alternative can come surprisingly close to matching the incumbent.</p>
<p>The alternative in question is the Forward-Forward (FF) algorithm, introduced by Geoffrey Hinton, one of the founding figures of deep learning. Where back-propagation performs one forward pass to generate predictions and one backward pass to distribute blame, FF performs two forward passes. The first runs on positive, real data drawn from the training set; the second runs on negative data, which may be generated by the network itself. Each pass produces a measure of goodness at every layer, and layers are trained to assign high goodness to positive data and low goodness to negative data. Because no gradients need to flow backwards, activations do not need to be cached for a reverse sweep, and the memory footprint of training shrinks dramatically.</p>
<p>That memory efficiency is precisely what makes FF interesting for a particular and growing class of problems: training neural networks on low-resource hardware. Edge devices, embedded controllers and medical monitoring systems often cannot afford the memory overhead of back-propagation, which scales with the number of stored activations. FF&#8217;s two-pass structure, by contrast, opens the door to on-device learning without the same storage demands. The catch, as the Tanta University team documents across six diverse datasets, is that FF in its basic form lags behind back-propagation in predictive accuracy. The algorithm trades memory for performance, and until now that trade has been steep enough to keep it largely a research curiosity rather than a practical training method.</p>
<p>The new study attacks that gap not by redesigning the algorithm itself but by treating its configuration as an optimization problem in its own right. Neural network training is governed by a constellation of hyper-parameters, settings such as learning rates, layer configurations and goodness thresholds that are fixed before training begins and that can make the difference between a model that converges gracefully and one that stalls. In conventional practice these values are chosen by hand, guided by intuition and trial and error. The researchers instead deployed automated hyper-parameter optimization, using metaheuristic search algorithms, computational procedures inspired by natural processes that explore large configuration spaces far more systematically than manual tuning ever could.</p>
<p>The scope of the evaluation is notable. The team first assessed FF&#8217;s baseline performance across six diverse datasets to establish how the algorithm behaves in general. They then narrowed to four datasets for the optimization phase, applying two well-established metaheuristic algorithms alongside four state-of-the-art ones, a total of six search strategies competing to find the hyper-parameter settings that would squeeze the most performance out of FF. This comparative design matters, because the choice of optimizer for hyper-parameter search is itself a hyper-parameter of sorts, and the study&#8217;s structure allows the relative strength of different search strategies to be assessed on the same footing.</p>
<p>The results are striking. On Pneumonia-MedMnist, a medical imaging benchmark, validation accuracy rose from 93 percent to 97 percent after optimization. On Fashion-MNIST, a standard clothing-image classification set, accuracy climbed from 87 percent to 91 percent. The most dramatic gains appeared on the organ-segmentation datasets from the MedMnist collection: OrganC-MedMnist jumped from 82 percent to 94 percent, a twelve-point improvement, and OrganA-MedMnist rose from 88 percent to 95 percent. Crucially, these gains came while maintaining or even reducing training time, meaning the optimization did not simply buy accuracy by burning more compute. The study also reports that metaheuristic optimization accelerated convergence, allowing the networks to reach good solutions faster than they otherwise would.</p>
<p>Those numbers deserve unpacking, because they speak to a broader tension in machine learning research. The gap between memory efficiency and accuracy has long been framed as a fundamental trade-off: algorithms that avoid back-propagation&#8217;s memory bill pay for it in performance. What this study demonstrates is that at least part of that gap is not fundamental at all, but an artifact of under-tuned configuration. FF&#8217;s hyper-parameter space is evidently sensitive enough that default or manually chosen settings leave substantial performance on the table. When a systematic search is applied, much of that lost performance is recovered, in one case recovering nearly the entire distance to the sort of accuracy figures typically associated with conventionally trained networks on these benchmarks.</p>
<p>The technical explanation for why hyper-parameters matter so much to FF lies in its layered goodness objective. Because each layer is trained locally to discriminate positive from negative data, the overall behavior of the network emerges from the interaction of many local objectives rather than from a single global loss gradient. Small changes in threshold settings or layer-wise learning dynamics can therefore ripple through the network in ways that are hard to anticipate manually. Metaheuristic algorithms, which iteratively propose, evaluate and refine candidate solutions using mechanisms borrowed from processes such as evolution or swarm behavior, are well suited to navigating such rugged configuration landscapes, where the relationship between settings and outcomes is nonlinear and riddled with local optima.</p>
<p>The implications extend beyond a single algorithm. Interest in back-propagation-free training has grown as the field confronts the energy and memory costs of ever-larger models, and as researchers look to the brain, which clearly learns without any known reverse-phase error propagation, for inspiration. Hinton&#8217;s Forward-Forward proposal was framed partly in these terms, as a step toward learning procedures that might be more biologically plausible and more hardware-friendly. The Egyptian team&#8217;s contribution is to show that the practical viability of such procedures depends heavily on the surrounding optimization machinery, and that investing in automated tuning can transform a promising but underperforming idea into a competitive one.</p>
<p>For practitioners working at the edge, the message is concrete. Medical imaging tasks of the kind tested here, including pneumonia detection and organ identification, are exactly the workloads targeted at resource-constrained clinical hardware, and the demonstrated accuracy levels after optimization, reaching 94 to 97 percent validation accuracy on several benchmarks, suggest that memory-efficient training is approaching the point where it can be taken seriously for such applications. The study, published open access on 30 September 2026, received open access funding from Egypt&#8217;s Science, Technology and Innovation Funding Authority in cooperation with the Egyptian Knowledge Bank. Whether Forward-Forward can scale to the large architectures that dominate contemporary artificial intelligence remains an open question, but this work establishes that the algorithm&#8217;s accuracy deficit is neither fixed nor mysterious, and that the tools for closing it were already sitting in the metaheuristic toolbox.</p>
<p><strong>Subject of Research:</strong> Optimizing the Forward-Forward neural network training algorithm with metaheuristic hyper-parameter search</p>
<p><strong>Article Title:</strong> Towards optimized forward–forward training for neural networks</p>
<p><strong>Article References:</strong> Elnady, Y. A., Sarhan, A. M., &amp; Eita, M. A. (2026). Towards optimized forward–forward training for neural networks. <em>Artificial Intelligence Review, 59</em>(11), Article 232. <a href="https://doi.org/10.1007/s10462-026-11668-6" rel="noopener noreferrer">https://doi.org/10.1007/s10462-026-11668-6</a></p>
<p><strong>Image Credits:</strong> AI Generated</p>
<p><strong>DOI:</strong> <a href="https://doi.org/10.1007/s10462-026-11668-6" rel="noopener noreferrer">10.1007/s10462-026-11668-6</a></p>
<p><strong>Keywords:</strong> Forward-Forward algorithm, back-propagation, neural networks, metaheuristics, hyper-parameter optimization, Geoffrey Hinton, memory efficiency, machine learning, MedMnist, Fashion-MNIST, Tanta University, Artificial Intelligence Review</p>
]]></content:encoded>
					
		
		
		<post-id xmlns="com-wordpress:feed-additions:1">219250</post-id>	</item>
	</channel>
</rss>
