The question the researchers tackled is one of the oldest debates in multisensory science. Decades of work, beginning with the classic neurophysiological studies of the superior colliculus by Stein and Meredith, established that neurons in the midbrain respond most powerfully when visual and auditory inputs converge on the same spatial location. This gave rise to the so-called spatial rule of multisensory integration: signals from different senses enhance one another most when they plausibly originate from the same object or event. Yet behavioral studies of simple, meaningless stimuli, such as a flash paired with a brief tone, have sometimes suggested that cross-modal interactions persist even when observers are instructed to ignore one modality entirely. That persistence has been interpreted as evidence that audiovisual integration is automatic, running to completion regardless of attentional control, much like the Stroop effect or preattentive feature binding described in Anne Treisman’s feature-integration theory.

But automaticity has its skeptics. Work by Nilli Lavie on perceptual load has shown that when the primary task is easy, spare attentional capacity spills over onto irrelevant stimuli, producing what looks like automatic processing. Under high load, that spillover disappears, and distractors are effectively filtered out. Critics such as Tsal and Benoni have argued that many apparent load effects are actually dilution effects, driven by the number of items competing for processing rather than by a genuine exhaustion of perceptual resources. Against this backdrop, the question of whether audiovisual integration truly requires attentional resources, or merely appears to, remained unresolved, particularly for the simple, arbitrary sound-flash pairings that dominate the experimental literature.

There was a second, equally important gap. Previous experiments had rarely asked whether the spatial relationship between the sound and the visual target changes how attentional load affects integration. Most studies either presented stimuli from a single location or did not systematically manipulate spatial coincidence. Yet if the spatial rule holds, then a spatially congruent sound and a spatially incongruent sound might tap into fundamentally different neural mechanisms, one that is robust and resource-independent, the other fragile and dependent on spare capacity. The new study was designed to separate these possibilities cleanly.

To manipulate attentional load, the researchers adopted a rapid serial visual presentation paradigm, one of the most reliable tools in cognitive psychology for controlling how much attention a distractor task consumes. Participants watched a fast-moving stream of characters at fixation while searching for targets within the stream. In the no-load condition, the stream demanded minimal attention; in the low-load condition, it demanded a moderate amount; and in the high-load condition, the task was tuned to consume nearly all available attentional resources. This graded approach allowed the team to trace how integration behaves as resources are progressively drained, rather than simply comparing easy and hard tasks.

On top of this load manipulation, the researchers controlled spatial coincidence. Visual targets and task-irrelevant auditory stimuli were presented either at the same spatial position or at different positions. Participants were instructed to ignore the sounds completely, so any influence of the tones on visual target identification would reflect an involuntary cross-modal interaction. The design therefore crossed three levels of attentional load with two levels of spatial congruency, producing a matrix of conditions in which the contributions of resources and space could be disentangled statistically.

The results were clear and, in places, surprising. Spatially congruent auditory stimuli improved the identification of visual targets across all three load conditions, including the high-load condition in which the RSVP stream was consuming the bulk of participants’ attention. In other words, even when observers were pushed close to their attentional limits, a sound arriving from the same location as the visual target still made that target easier to detect. This resilience suggests that spatially coincident audiovisual integration operates through a mechanism that is largely automatic, one that does not compete meaningfully for the limited resources taxed by the RSVP task. It is consistent with the idea that spatially aligned signals are bound early and efficiently, perhaps at subcortical or early cortical levels where the spatial rule was originally discovered.

The story changed dramatically for spatially incongruent sounds. When the auditory stimulus appeared at a different location from the visual target, it failed to enhance visual identification under high-load conditions. Under no load and low load, some cross-modal influence could still be observed, but as the RSVP task drained resources, the benefit of the mismatched sound vanished. This dissociation is the paper’s key contribution: it demonstrates that not all audiovisual integration is created equal. Spatially congruent integration survives the harshest attentional conditions, whereas spatially incongruent integration depends on the availability of spare attentional capacity. The findings therefore reconcile two seemingly contradictory literatures, showing that studies reporting automatic integration may have relied on conditions, or on spatial arrangements, in which the congruent, resource-independent mechanism was doing the work.

The theoretical implications reach into several active debates. For proponents of load theory, the results support the view that high load filters out stimuli that lack a privileged link to the attended event, while leaving intact interactions that are structurally embedded in the spatial layout of the scene. For multisensory researchers, the study adds a crucial qualification to the spatial rule: spatial coincidence is not merely a facilitator of integration but a determinant of whether integration can occur without attention. The work also echoes earlier findings by Ho, Santangelo, and Spence on multisensory warning signals, which showed that spatial correspondence matters enormously for the effectiveness of cross-modal alerts, and by McDonald and colleagues, who identified neural substrates of perceptual enhancement by cross-modal spatial attention. The new data extend this line by showing that the spatial rule becomes decisive precisely when attention runs out.

Beyond the laboratory, the findings carry practical weight. Warning signals in aircraft cockpits, operating theaters, and vehicles often pair a sound with a visual indicator, and designers generally assume the pairing will help even when operators are overloaded. This study suggests that assumption holds only when the sound and the visual signal share a location. A warning tone emitted from a speaker far from the relevant display may fail to boost detection in a stressed, overloaded operator, whereas a spatially aligned cue could still cut through. Similarly, the results inform the design of assistive technologies and virtual reality environments, where multisensory cues are increasingly used to guide attention, and they may help explain why multisensory enhancement can break down in conditions of fatigue or divided attention.

The study, conducted with approval from the Academic Committee of the Department of Psychology at Soochow University in line with the Declaration of Helsinki, was supported by the Japan Society for the Promotion of Science, the Pre-approved Project of the Wenzhou Key Research Base for Philosophy and Social Sciences, and the Social Science project of Suzhou University of Science and Technology. Data and code are available from the corresponding authors upon reasonable request. As multisensory research moves toward real-world applications, this work delivers a deceptively simple message with deep consequences: the brain’s ability to merge sight and sound is not a single switch but a layered system, and only the layer built on spatial coincidence keeps working when everything else is asked to give.

Subject of Research: How attentional load and spatial coincidence modulate audiovisual integration of simple stimuli

Article Title: The effect of attentional loads on audiovisual integration: When spatial coincidence matters

Article References: The effect of attentional loads on audiovisual integration: When spatial coincidence matters. (n.d.). https://doi.org/10.3758/s13414-026-03257-0

Image Credits: AI Generated

DOI: 10.3758/s13414-026-03257-0

Keywords: attentional load, audiovisual integration, spatial coincidence, multisensory perception, RSVP, cross-modal interaction, selective attention, perceptual load, spatial rule, visual target detection, auditory stimuli, cognitive psychology

The puzzle at the heart of the study concerns what psychologists call the alerting-congruency interaction. In everyday laboratory tasks, people respond to targets—say, identifying the color of a word or the direction of a central arrow—while ignoring distracting information flanking or embedded in the display. When the distractor suggests the wrong response, performance slows and errors increase; this is the congruency effect, a cornerstone measure of cognitive control. Since the early 2000s, researchers led by studies such as Callejas and colleagues’ work on the three attentional networks had shown that presenting a sudden alerting cue, like an auditory warning tone shortly before the display, reliably enlarges this congruency effect. The alert makes you faster overall, but paradoxically it also makes distractors more potent saboteurs. One influential interpretation holds that alertness broadens the attentional spotlight or boosts global processing, letting irrelevant information flood in alongside the relevant signal.

Yet a persistent anomaly complicated this tidy picture. The alerting-congruency interaction shows up robustly in the arrow version of the Eriksen flanker task, where participants report the direction of a central arrow flanked by misleading arrows, but it stubbornly fails to appear in Stroop tasks, where people must report the color of a color word whose meaning conflicts with the correct answer. Because arrows carry pre-existing directional associations with left and right responses, while color words in the versions used do not map directly onto motor responses, several theorists proposed that the interaction requires stimulus-response directional associations. In this view, alerting signals amplify only those distractors that can automatically activate a motor response through learned directional links. The claim mattered theoretically because it touched on foundational debates about automaticity, dimensional overlap, and the architecture of stimulus-response translation—a taxonomy famously laid out by Kornblum and colleagues in 1990.

Golden and her team, including Thomas G. Hutcheon of Bard College, Katherine M. Mathis of Bates College, Emily R. Cohen-Shikora of Washington University in St. Louis, and Todd A. Kahan of Bates College as senior author, saw a different possible culprit: the timing of distractor processing. In standard implementations of both the flanker and Stroop tasks, the distractor and target appear simultaneously and remain visible until response. But the two tasks differ subtly in how quickly their distractors activate competing information. Arrows are potent, rapidly processed directional signals whose interference typically peaks early in the reaction-time distribution and then declines as cognitive control suppresses the wrong response. Stroop-type distractors in keypress versions, by contrast, produce interference that builds more gradually across the distribution. If alerting signals accelerate processing overall, they reasoned, then the interaction might simply depend on where in time the distractor’s activation lands relative to the target’s—rather than on whether the distractor has directional meaning.

To test this, the researchers manipulated distractor preview. In the preview condition, the distracting information appeared on the screen alone for a brief interval before the target was added, giving the distractor a head start. In the no-preview condition, distractor and target appeared together, replicating the standard arrangement. Each display was either preceded by an alerting cue or not, and each trial was either congruent or incongruent. Experiment 1 used Stroop stimuli—color words printed in colors—with 158 participants responding via keypress. Experiment 2 used the arrow flanker task with 157 participants. The factorial design yielded 32 trials of each of eight conditions across 256 total trials, with the first six treated as practice and the rest split into five blocks of 50. Crucially, both experiments were conducted online, with subject-level data made publicly available on the Open Science Framework.

The results in the standard, no-preview conditions replicated the literature precisely. Stroop performers showed no significant alerting-congruency interaction—the alert sped people up but did not reliably change how much the conflicting word hurt them. Flanker performers, meanwhile, showed the classic robust interaction: following an alerting cue, the cost of incongruent flanking arrows was magnified. If the field had stopped here, the directional-association hypothesis would have stood unchallenged for another round. But the preview conditions rewrote the story entirely. When Stroop distractors were previewed before the target, a significant alerting-congruency interaction emerged for the first time in this paradigm—alerting now amplified the congruency effect. And when flanker distractors were previewed, the interaction not only vanished but reversed in tendency, with the congruency effect becoming numerically smaller after an alerting cue. Timing, in other words, did what a decade of stimulus-selection arguments could not: it flipped the pattern in both tasks.

The authors supported these conclusions with delta plots, a distributional analysis technique that plots the congruency effect across quantiles of the reaction-time distribution, from the fastest responses to the slowest. Derived from the activation-suppression framework developed by Ridderinkhof and formalized in models by Ulrich, Schröter, Leuthold, and Birngruber, delta plots reveal the time course of automatic distractor activation and its suppression. In the flanker task with simultaneous presentation, congruency effects are typically largest in fast responses and shrink with slower ones—the signature of a distractor whose activation arrives early and is then inhibited. Stroop-type keypress tasks often show the opposite, with interference growing across the distribution. The delta plots in the new experiments confirmed that previewing the distractor shifted this temporal signature in exactly the way the timing account predicts, supporting the conclusion that when distractor activation peaks relative to target processing is the critical variable governing whether alertness helps or hinders conflict resolution.

Several additional details strengthen the interpretation. In the flanker experiment, participants were significantly faster on alerted trials overall, F(1, 116) = 38.18, p < .001, ηp² = .25, a substantial main effect of alerting that counters any argument the interaction should only be recognized when accompanied by such an effect. The team also checked robustness: rather than excluding reaction times by arbitrary cutoffs, they used geometric means to preserve the full distribution, and a supplementary trimming analysis removing values beyond two standard deviations from each participant’s condition mean reproduced the identical pattern of significance in every experiment, including replication sub-experiments labeled 1b, 2a, and 2b. The research formed part of Golden’s undergraduate honors thesis at Bates College, supported by a Bates College Student Research Fund grant, and was approved by the Bates College Institutional Review Board in accordance with APA ethical standards and the Declaration of Helsinki.

What does this mean for theories of attention? First, the results undermine the claim that alerting-congruency interactions require pre-existing stimulus-response directional associations. Stroop stimuli lacking such associations produced the interaction once distractors were given a temporal head start, while arrow stimuli possessing those associations lost the interaction under the same manipulation. Directionality, whatever its other roles, cannot be the deciding factor. Second, the findings breathe new life into temporal-overlap accounts of conflict, echoing classic work by Hommel on the Simon task and more recent electrophysiological and behavioral studies by Mackenzie, Mittelstädt, Ulrich, and Leuthold on the temporal order of relevant and irrelevant dimensions. Alerting signals appear to accelerate the engine of processing; whether this acceleration inflates or deflates measured conflict depends on whether the distractor’s activation curve is ahead of or behind the target’s at the moment responses are selected. A distractor that has already accumulated activation when alertness surges gets amplified; a distractor still ramping up may be caught by the target’s head start and suppressed more effectively.

The practical and methodological implications ripple outward. Task comparison studies that attribute differences between paradigms to stimulus properties may instead be capturing differences in processing dynamics—something researchers such as Pratte and Mittelstädt and colleagues have emphasized in recent distributional work on flanker and Stroop tasks. Experimenters who choose stimulus durations and preview intervals are implicitly choosing a point on the distractor’s activation curve, and the new results suggest this choice can determine whether alertness and control appear coupled or independent. Beyond the laboratory, the work speaks to the broader question of how phasic alertness—the brief surge of arousal produced by warnings, alarms, and sudden events—interacts with selective attention in real-world settings, from cockpit warnings to medical monitor alarms. Whether an alerting signal helps you ignore the noise or makes the noise louder may depend less on what the noise means than on when it started talking.

The authors caution that their studies were not preregistered, and they frame the discussion as a challenge for formal models of the interaction rather than a definitive verdict. Activation-suppression race models, diffusion-based dual-process accounts, and conflict-monitoring theories will each need to accommodate the preview reversal. Still, with subject-level data openly available, the findings offer a concrete empirical anchor. For now, the message is strikingly simple: to understand why being alert sometimes makes distraction worse, watch the clock, not the arrow.

In traditional literature on affordances, the concept has often been simplified into a notion that all actions we perceive in our environment are similarly understood across different contexts. This research takes a different approach, probing deeper into the nuanced interactions that govern task type and spatial associations. The study highlights how these two elements can significantly modulate how affordances are perceived, effectively suggesting that environment and context play critical roles in cognitive processing.

The authors utilized an array of behavioral experiments to explore the discrepancies in affordance perception linked to different task types. By manipulating variables and using diverse spatial associations, the researchers set out to capture how participants’ reactions to affordances were influenced by the specific tasks they were engaged in. The results were revelatory; rather than seeing a uniform compatibility effect across the board, the data indicated a differentiated response based on the nature of the task presented to the individuals.

One of the primary findings of the study is that in certain task conditions, participants experienced a negative compatibility effect, which suggests that the presence of competing affordances can hinder rather than facilitate correct responses. This contradicts the traditional view, wherein affordances are seen solely as enhancers of action. Instead, this research opens up new avenues of understanding that frame affordances within a complex interplay of task demands and spatial configurations.

The implications of this research stretch far beyond academic curiosity; they call into question how we design products, tools, and even urban landscapes. As designers and city planners begin to understand that people may not inherently grasp affordances as universally applicable, they can reconsider how environments are structured. This understanding could lead to more intuitive designs that proactively account for the varying perceptions based on the contexts in which they are encountered.

Of notable interest in the study were the task types employed by the researchers. By creating scenarios that mimicked real-world tasks but varied the spatial affordances, they were able to elucidate how task nature could directly impact cognitive capabilities related to those affordances. For instance, certain tasks seemed to place higher cognitive loads on participants, resulting in varied outcomes in terms of perceived affordance effectiveness.

Reflecting on the study’s methodology, one cannot overlook the robustness of the experimental design. The researchers implemented a variety of controls that ensured the data collected were not only reliable but also highly relevant to real-world situations. By employing different spatial arrangements and carefully curated tasks, they could draw stronger correlations between task engagement and affordance perception.

Furthermore, this nuanced perspective on cognitive processing might inform future studies, encouraging researchers to explore the interplay between different variables further. As cognitive psychology continuously seeks to unravel the complexities of human perception and interaction, studies like this mark an essential step toward understanding the non-universality of affordances.

One of the standout conclusions drawn from this research is the shift in thinking regarding the application of affordances in behavioral prediction. Instead of relying on preconceived notions that suggest uniform responses across varying contexts, researchers and practitioners can begin to consider the potential for significant deviations in perception based on task and spatial factors. This paradigm shift holds potential for practical application in therapy, education, and user interface design.

What’s particularly significant about the findings is the actionable intelligence gleaned from the research. For educators, for example, the understanding that task type can modify affordance engagement can inform how subjects are taught and learned. In therapeutic settings, it encourages practitioners to consider the contextual factors of their environments when developing strategies to support clients.

In conclusion, the research by Türkan, Schöpper, and Vainio provides a potent reminder of the complexity surrounding human perception. By delving into the intricacies of affordances, task types, and spatial associations, it encourages both scholars and practitioners to reconsider outdated assumptions and embrace a more nuanced view of human interaction with the world. As we advance our understanding of cognitive processes, studies like this will certainly play a pivotal role in shaping future innovations and designs.

This exploration into the complexities of affordance perception is a critical reminder that our understanding of cognitive psychology is still unfolding. By continually challenging existing paradigms and introducing new variables for consideration, researchers will pave the way for greater insights into how we navigate and make sense of our surroundings.

Indeed, the findings from this study should invigorate more extensive dialogue in the field, inviting experts to investigate further the variations in affordance perception based on task and spatial context. With these insights, we can look to foster a more adaptable approach in our interaction with the diverse stimuli and environments we encounter daily.

Subject of Research: The modulation of the negative compatibility effect by task type and spatial association in the perception of affordances.

Article Title: When affordances are not universal: The negative compatibility effect is modulated by task type and spatial association.

Article References:

Türkan, B.N., Schöpper, LM., Vainio, L. et al. When affordances are not universal: The negative compatibility effect is modulated by task type and spatial association.
Atten Percept Psychophys 88, 24 (2026). https://doi.org/10.3758/s13414-025-03202-7

Image Credits: AI Generated

DOI: https://doi.org/10.3758/s13414-025-03202-7

Keywords: Affordances, cognitive psychology, spatial association, task type, negative compatibility effect.