<?xml version="1.0" encoding="UTF-8"?><rss version="2.0"
	xmlns:content="http://purl.org/rss/1.0/modules/content/"
	xmlns:wfw="http://wellformedweb.org/CommentAPI/"
	xmlns:dc="http://purl.org/dc/elements/1.1/"
	xmlns:atom="http://www.w3.org/2005/Atom"
	xmlns:sy="http://purl.org/rss/1.0/modules/syndication/"
	xmlns:slash="http://purl.org/rss/1.0/modules/slash/"
	>

<channel>
	<title>credit assignment &#8211; Science</title>
	<atom:link href="https://scienmag.com/tag/credit-assignment/feed/" rel="self" type="application/rss+xml" />
	<link>https://scienmag.com</link>
	<description></description>
	<lastBuildDate>Fri, 02 Oct 2026 21:49:54 +0000</lastBuildDate>
	<language>en-US</language>
	<sy:updatePeriod>
	hourly	</sy:updatePeriod>
	<sy:updateFrequency>
	1	</sy:updateFrequency>
	<generator>https://wordpress.org/?v=7.1.2</generator>

<image>
	<url>https://scienmag.com/wp-content/uploads/2024/07/cropped-scienmag_ico-32x32.jpg</url>
	<title>credit assignment &#8211; Science</title>
	<link>https://scienmag.com</link>
	<width>32</width>
	<height>32</height>
</image> 
<site xmlns="com-wordpress:feed-additions:1">73899611</site>	<item>
		<title>Electric Fish Wiring Map Reveals How Brains Learn to Predict Their Own Senses</title>
		<link>https://scienmag.com/electric-fish-wiring-map-reveals-how-brains-learn-to-predict-their-own-senses/</link>
		
		<dc:creator><![CDATA[Cassandra Pierce]]></dc:creator>
		<pubDate>Fri, 02 Oct 2026 21:49:54 +0000</pubDate>
				<category><![CDATA[Medicine]]></category>
		<category><![CDATA[Technology and Engineering]]></category>
		<category><![CDATA[brain wiring diagrams for predictive learning]]></category>
		<category><![CDATA[cell-type-specific neural physiology]]></category>
		<category><![CDATA[cerebellum-like brain structures]]></category>
		<category><![CDATA[cerebellum-like circuit]]></category>
		<category><![CDATA[computational modeling]]></category>
		<category><![CDATA[computational modeling of neural circuits]]></category>
		<category><![CDATA[connectomics]]></category>
		<category><![CDATA[continual learning]]></category>
		<category><![CDATA[corollary discharge]]></category>
		<category><![CDATA[corollary discharge mechanisms]]></category>
		<category><![CDATA[credit assignment]]></category>
		<category><![CDATA[electric fish]]></category>
		<category><![CDATA[electric fish sensory prediction]]></category>
		<category><![CDATA[electrosensory lateral line lobe function]]></category>
		<category><![CDATA[electrosensory lobe]]></category>
		<category><![CDATA[nanoscale electron microscopy in neuroscience]]></category>
		<category><![CDATA[negative imaging]]></category>
		<category><![CDATA[neural basis of sensory cancellation]]></category>
		<category><![CDATA[neural circuit mapping]]></category>
		<category><![CDATA[neural circuits]]></category>
		<category><![CDATA[neural connectome analysis]]></category>
		<category><![CDATA[sensory prediction]]></category>
		<category><![CDATA[sensory-motor integration in electric fish]]></category>
		<category><![CDATA[synaptic plasticity]]></category>
		<guid isPermaLink="false">https://scienmag.com/?p=229207</guid>

					<description><![CDATA[A complete wiring diagram of an electric fish cerebellum-like circuit reveals how structured synaptic connectivity enables fast, accurate and continually updated sensory prediction.]]></description>
										<content:encoded><![CDATA[<p>In a landmark study published in Nature, a team of neuroscientists led by Krista E. Perks, Mariela D. Petkova and Salomon Z. Muller, working across Columbia University, Harvard University and Google Research, has reconstructed the complete wiring diagram of a cerebellum-like brain structure in an electric fish, exposing in unprecedented detail how neural circuits learn to predict and cancel out the sensory consequences of an animal&#8217;s own behavior. The work, published under the title Connectome analysis of a cerebellum-like circuit for sensory prediction, combines nanoscale electron microscopy, cell-type-specific physiology and computational modeling to answer one of neuroscience&#8217;s most stubborn questions: how does a brain coordinate learning that is spread across many cell types and many layers of a network at once?</p>
<p>The animal at the center of the study is the mormyrid electric fish, a creature that generates its own weak electric field and senses the world through distortions of that field. Every time the fish fires its electric organ, it also sends a copy of the motor command, known as the corollary discharge, to a hindbrain structure called the electrosensory lateral line lobe, or ELL. This structure, architecturally reminiscent of the cerebellum, uses the corollary discharge to generate a prediction of the sensory input that the fish&#8217;s own discharge will produce. That prediction is then subtracted from the actual sensory stream, a process scientists call negative imaging. The result is elegant: predictable self-generated signals vanish, while unexpected signals, such as the electrical signature of nearby prey or a communicating neighbor, stand out in sharp relief.</p>
<p>What makes the fish such a powerful model is that this cancellation is learned continually. When the fish&#8217;s environment changes, for example when the amplitude of its electric organ discharge shifts, the circuit adjusts within minutes, and it does so without erasing previously learned predictions. This is a continual learning problem, the biological counterpart of a challenge that plagues artificial neural networks, where new training catastrophically overwrites old memories. Previous work from the same laboratories had shown that learning in the ELL is distributed across multiple synaptic sites, but the detailed wiring needed to explain how those sites cooperate had never been mapped.</p>
<p>To build that map, the team reconstructed a volume of the ELL at a resolution of 4 by 4 by 30 nanometers using serial section electron microscopy, a dataset generated in Jeff Lichtman&#8217;s laboratory at Harvard and segmented with automated tools developed at Google. The researchers painstakingly proofread and classified hundreds of neurons, including more than one hundred MG cells and nearly six hundred SG cells, tracing their axons and dendrites and annotating thousands of synapses. Every reconstructed connection was catalogued, allowing the team to ask not just which cells talk to which, but whether the pattern of that conversation is structured or random, and what such structure implies for computation.</p>
<p>The first major discovery concerns how sensory information enters the circuit. Theoretical models of cerebellum-like learning require that the instructive signals driving synaptic plasticity be conveyed through specific, separable pathways. The connectome revealed exactly that: sensory input reaches the output neurons of the ELL through both inhibitory and disinhibitory routes, carried by distinct classes of interneurons whose connectivity is far from arbitrary. These pathways fulfill long-standing theoretical requirements for instructing anti-Hebbian synaptic plasticity, the temporally asymmetric learning rule that allows the circuit to associate a prediction with the sensory event it precedes. In other words, the anatomy itself encodes the teaching signal.</p>
<p>The second discovery addresses the credit assignment problem, a puzzle that arises whenever learning must be distributed across network stages. If synapses at multiple sites need to change to produce a single learned behavior, how does each site know how much it should contribute? The connectome showed that the wiring between network stages is structured in a way that solves this problem. MG cells, which sit between the granule cell input layer and the output neurons, come in two subtypes, MG+ and MG-, distinguished by the relative positions of their axons and basal dendrites. These subtypes connect selectively to ON and OFF output cells respectively, matching the polarity of the sensory signals they carry. Recurrent connections among MG cells are likewise structured, linking cells of the same subtype rather than connecting indiscriminately, and this recurrence accelerates the generation of the sensory prediction and sharpens its cancellation.</p>
<p>To confirm that this intricate wiring actually performs as its structure suggests, the team built a computational model constrained by electrophysiological recordings from the fish brain. The simulations showed that when the connectivity follows the patterns observed in the connectome, multiple sites of plasticity cooperate to overcome their individual limitations. Plasticity at the granule cell to MG cell synapses does the heavy lifting early in learning, while plasticity at the granule cell to output cell synapses refines the result, and the recurrent MG circuitry amplifies the instructive signals where needed. The outcome is cancellation that is fast, accurate and robust to noise, precisely the properties measured in the living fish. When the researchers perturbed the model, breaking the selectivity of the connections or removing the recurrence, cancellation degraded in ways that matched the specific computational roles assigned to each wiring feature.</p>
<p>The model also illuminated how the circuit handles the continual learning problem without catastrophic forgetting. During periods of unpredictable sensory noise, changes in the excitatory granule cell inputs and the inhibitory MG cell inputs to output cells oppose one another, so that the circuit can absorb disruption without losing its stored predictions. SG cells appear to play a complementary role, enhancing output responses to unpredictable stimuli while MG cells suppress responses to predictable ones, together producing a cleaned-up sensory signal in which behaviorally relevant surprises are preserved. This division of labor across cell types and synaptic sites offers a concrete biological solution to a problem that machine learning researchers have attacked with techniques such as elastic weight consolidation and complementary learning systems.</p>
<p>Beyond its implications for learning theory, the study demonstrates the maturing power of connectomics as a tool for deciphering neural computation. Just as wiring diagrams of the fly central complex and the mushroom body revealed motifs for navigation and associative memory, this reconstruction of a vertebrate cerebellum-like circuit shows how structured connectivity can implement a learning algorithm with known theoretical properties. The authors emphasize that the combination of connectomics, cell-type-specific physiological recordings and computational modeling was essential; none of the three approaches alone could have resolved how distributed plasticity produces fast, accurate and continually updated sensory prediction. The full electron microscopy dataset, along with all analysis code and model files, has been made publicly available through browsable platforms and archived repositories, inviting the wider community to explore the circuit further.</p>
<p>The findings resonate far beyond electric fish. Cerebellum-like structures appear across the vertebrate lineage, and the cerebellum itself is thought to perform analogous predictive computations for motor control, with distributed synaptic plasticity across its granular, molecular and deep nuclear layers. Understanding how a small, tractable circuit coordinates learning at multiple sites provides a template for investigating the same question in larger brains, including our own. As connectomic datasets grow to encompass ever larger volumes of mammalian tissue, the electric fish ELL stands as a proof of principle: given the complete wiring diagram, grounded in physiology and captured in a computational model, the algorithm of a learning circuit can finally be read directly from its wiring.</p>
<p><strong>Subject of Research:</strong> Connectomic analysis of sensory prediction and distributed synaptic plasticity in a cerebellum-like electrosensory circuit</p>
<p><strong>Article Title:</strong> Connectome analysis of a cerebellum-like circuit for sensory prediction</p>
<p><strong>Article References:</strong> Perks, K. E., Petkova, M. D., Muller, S. Z., Genecin, M., Ghatare, A., Schalek, R., Wu, Y., Januszewski, M., Jain, V., Lichtman, J. W., Abbott, L. F., &amp; Sawtell, N. B. (2026). Connectome analysis of a cerebellum-like circuit for sensory prediction. <em>Nature</em>. <a href="https://doi.org/10.1038/s41586-026-10690-6" rel="noopener noreferrer">https://doi.org/10.1038/s41586-026-10690-6</a></p>
<p><strong>Image Credits:</strong> AI Generated</p>
<p><strong>DOI:</strong> <a href="https://doi.org/10.1038/s41586-026-10690-6" rel="noopener noreferrer">10.1038/s41586-026-10690-6</a></p>
<p><strong>Keywords:</strong> connectomics, electric fish, cerebellum-like circuit, sensory prediction, synaptic plasticity, continual learning, electrosensory lobe, credit assignment, corollary discharge, negative imaging, neural circuits, computational modeling</p>
]]></content:encoded>
					
		
		
		<post-id xmlns="com-wordpress:feed-additions:1">229207</post-id>	</item>
		<item>
		<title>AI That Imagines Rewards: Diffusion Models Rewrite Traffic Signal Control</title>
		<link>https://scienmag.com/ai-that-imagines-rewards-diffusion-models-rewrite-traffic-signal-control/</link>
		
		<dc:creator><![CDATA[Denise Maddox]]></dc:creator>
		<pubDate>Wed, 23 Sep 2026 00:13:28 +0000</pubDate>
				<category><![CDATA[Technology and Engineering]]></category>
		<category><![CDATA[AI for traffic flow optimization]]></category>
		<category><![CDATA[Applied Intelligence]]></category>
		<category><![CDATA[autonomous traffic signal decision-making]]></category>
		<category><![CDATA[black-box optimization]]></category>
		<category><![CDATA[credit assignment]]></category>
		<category><![CDATA[decentralized traffic control]]></category>
		<category><![CDATA[diffusion model]]></category>
		<category><![CDATA[diffusion models for reinforcement learning]]></category>
		<category><![CDATA[diffusion models in traffic management]]></category>
		<category><![CDATA[generative modeling in transportation]]></category>
		<category><![CDATA[multi-agent reinforcement learning]]></category>
		<category><![CDATA[multi-intersection coordination]]></category>
		<category><![CDATA[offline reinforcement learning]]></category>
		<category><![CDATA[queue length]]></category>
		<category><![CDATA[reward generation]]></category>
		<category><![CDATA[reward signal generation]]></category>
		<category><![CDATA[semi-offline learning]]></category>
		<category><![CDATA[smart infrastructure]]></category>
		<category><![CDATA[traffic congestion reduction]]></category>
		<category><![CDATA[traffic network performance improvement]]></category>
		<category><![CDATA[traffic signal control]]></category>
		<category><![CDATA[Traffic signal optimization]]></category>
		<category><![CDATA[travel time]]></category>
		<guid isPermaLink="false">https://scienmag.com/?p=209017</guid>

					<description><![CDATA[A new framework called BootDiffLights uses a conditional diffusion model to generate reward signals for decentralized traffic signal control, outperforming state-of-the-art multi-agent reinforcement learning baselines on regional traffic metrics.]]></description>
										<content:encoded><![CDATA[<p>City traffic grids are among the most stubborn optimization problems in modern engineering. Every intersection acts as its own decision-maker, yet the performance that matters — average queue length, travel time, congestion across a whole district — emerges from the interaction of dozens of signals acting simultaneously. A new framework called BootDiffLights, described in Applied Intelligence by researchers at Chengdu University of Information Technology and Chengdu Jiaotou Information, proposes a strikingly different way to coordinate these lights: instead of painstakingly assigning credit for a region&#8217;s traffic outcomes to each individual signal, it lets a generative diffusion model imagine what good reward signals should look like, and then optimizes against those imagined rewards.</p>
<p>The work targets a long-standing pain point in multi-agent reinforcement learning (MARL), the dominant modern approach to decentralized traffic signal control. In a MARL setup, each intersection hosts an agent that learns its own policy — when to switch phases, how long to hold green, when to yield to cross traffic. The trouble is that the global reward, such as a network-wide reduction in travel time, is shared among all agents. Determining which intersection&#8217;s decisions actually produced the improvement is the credit assignment problem, and it is notoriously difficult when the effects of one signal ripple through neighboring blocks.</p>
<p>Conventional solutions tackle credit assignment with critic networks that attempt to decompose the global reward into per-agent contributions. These approaches carry two fundamental limitations, the authors argue. First, they are sample-hungry: agents must engage in extensive trial-and-error interactions with the traffic environment before the critics learn to allocate credit meaningfully, and every trial in a live or simulated network is expensive. Second, the critics must possess strong extrapolation and generalization capabilities — they must interpret policies they were never trained on and still distribute credit sensibly. When traffic patterns shift, as they constantly do, critic networks can produce misleading credit signals that push agents toward worse policies.</p>
<p>BootDiffLights sidesteps this entire machinery. The key insight is a reframing: rather than asking how to divide a global reward among agents, the framework adopts a semi-offline multi-agent reinforcement learning paradigm that transforms the problem from credit assignment into black-box optimization. In practical terms, the system no longer focuses on exploring optimal policies directly. Instead, it concentrates on generating optimal sample data — high-quality trajectories of traffic states and actions — and optimizes in that data space. The generative engine doing this work is a conditional diffusion model, the same class of model that has powered recent breakthroughs in image synthesis and, increasingly, decision-making.</p>
<p>Diffusion models work by learning to reverse a gradual noising process. Trained on data, they learn to transform pure noise into samples that resemble the training distribution, and conditioning signals can steer what they generate. In BootDiffLights, the conditional diffusion model serves as an implicit credit-assignment mechanism: it learns the relationship between traffic conditions, agent behaviors, and resulting rewards, and can then synthesize reward signals consistent with desired regional outcomes. Because the model captures the joint structure of the multi-intersection system, it implicitly encodes how each signal&#8217;s actions contribute to network-level performance — without an explicit critic network attempting the decomposition.</p>
<p>The semi-offline aspect matters as much as the diffusion engine. Fully offline reinforcement learning restricts agents to a fixed dataset, which is safe but often suboptimal; fully online learning requires costly and sometimes dangerous exploration. A semi-offline approach lets the system bootstrap from logged traffic data while selectively gathering new interaction data where it matters most. This is what enables BootDiffLights to improve sampling efficiency: the diffusion model can propose promising regions of the behavior space, and the learning system refines its data generation around those regions rather than wandering blindly through trial and error. The framework essentially shifts computational effort from interacting with the environment to generating better synthetic experience.</p>
<p>The authors evaluated the framework on both synthetic and real-world traffic datasets, running all experiments with five random seeds and reporting results as mean plus or minus standard deviation — a rigorous protocol that guards against lucky draws inflating performance claims. Across these benchmarks, BootDiffLights outperformed state-of-the-art baselines on regional traffic metrics, including average queue length and travel time. The comparison field includes well-established MARL techniques built on value decomposition and multi-agent actor-critic architectures, meaning the generative approach did not merely match conventional methods but surpassed them on the metrics that commuters actually feel.</p>
<p>The significance of this work extends beyond one benchmark suite. Traffic signal control has been dominated for decades by fixed-time plans and adaptive schemes such as SCOOT and SCATS, with reinforcement learning offering a data-driven alternative since the late 2010s. The field&#8217;s persistent obstacle has been scale: methods that work beautifully on a handful of intersections degrade as networks grow, because credit assignment becomes combinatorially harder. By replacing explicit credit decomposition with generative reward synthesis, BootDiffLights offers a path that may scale more gracefully. The diffusion model&#8217;s capacity to model complex joint distributions could prove decisive in dense urban cores where dozens of signals interact within a few blocks.</p>
<p>The approach also connects to a broader trend in machine learning: the migration of generative modeling into sequential decision-making. Diffusion-based policies and planners have recently shown impressive results in robotics and offline control, and BootDiffLights brings that momentum to a civic infrastructure problem with enormous practical stakes. Congestion costs cities billions annually in lost time and fuel, and emissions from idling vehicles degrade urban air quality. A control framework that learns efficiently from existing data, requires no explicit reward decomposition, and improves region-wide metrics could translate into real deployments — though the authors note that data availability constraints limit what can be shared publicly for now.</p>
<p>Challenges remain before such systems direct real intersections. Diffusion models carry their own computational burden at inference time, and traffic agencies will demand robustness guarantees that simulation studies alone cannot fully provide. Yet the conceptual shift is compelling: where previous frameworks asked a critic to guess who deserved credit, BootDiffLights asks a generative model to imagine the rewards worth pursuing — and then optimizes toward that imagination. For a problem as tangled as city-wide traffic coordination, that creative reframing may be exactly the kind of fresh thinking the field has been waiting for.</p>
<p><strong>Subject of Research:</strong> Diffusion-based reward generation for decentralized multi-intersection traffic signal control in semi-offline multi-agent reinforcement learning</p>
<p><strong>Article Title:</strong> BootDiffLights: Decentralized traffic signal control via diffusion-based reward generation</p>
<p><strong>Article References:</strong> Hao, B., He, J., Zheng, J., Dong, W., Yang, Q., &amp; Ma, X. (2026). BootDiffLights: Decentralized traffic signal control via diffusion-based reward generation. <em>Applied Intelligence, 56</em>(15), Article 437. <a href="https://doi.org/10.1007/s10489-026-07487-5" rel="noopener noreferrer">https://doi.org/10.1007/s10489-026-07487-5</a></p>
<p><strong>Image Credits:</strong> AI Generated</p>
<p><strong>DOI:</strong> <a href="https://doi.org/10.1007/s10489-026-07487-5" rel="noopener noreferrer">10.1007/s10489-026-07487-5</a></p>
<p><strong>Keywords:</strong> diffusion model, traffic signal control, multi-agent reinforcement learning, credit assignment, offline reinforcement learning, semi-offline learning, black-box optimization, reward generation, queue length, travel time, smart infrastructure, Applied Intelligence</p>
]]></content:encoded>
					
		
		
		<post-id xmlns="com-wordpress:feed-additions:1">209017</post-id>	</item>
	</channel>
</rss>
