The question the researchers tackled is one of the oldest debates in multisensory science. Decades of work, beginning with the classic neurophysiological studies of the superior colliculus by Stein and Meredith, established that neurons in the midbrain respond most powerfully when visual and auditory inputs converge on the same spatial location. This gave rise to the so-called spatial rule of multisensory integration: signals from different senses enhance one another most when they plausibly originate from the same object or event. Yet behavioral studies of simple, meaningless stimuli, such as a flash paired with a brief tone, have sometimes suggested that cross-modal interactions persist even when observers are instructed to ignore one modality entirely. That persistence has been interpreted as evidence that audiovisual integration is automatic, running to completion regardless of attentional control, much like the Stroop effect or preattentive feature binding described in Anne Treisman’s feature-integration theory.

But automaticity has its skeptics. Work by Nilli Lavie on perceptual load has shown that when the primary task is easy, spare attentional capacity spills over onto irrelevant stimuli, producing what looks like automatic processing. Under high load, that spillover disappears, and distractors are effectively filtered out. Critics such as Tsal and Benoni have argued that many apparent load effects are actually dilution effects, driven by the number of items competing for processing rather than by a genuine exhaustion of perceptual resources. Against this backdrop, the question of whether audiovisual integration truly requires attentional resources, or merely appears to, remained unresolved, particularly for the simple, arbitrary sound-flash pairings that dominate the experimental literature.

There was a second, equally important gap. Previous experiments had rarely asked whether the spatial relationship between the sound and the visual target changes how attentional load affects integration. Most studies either presented stimuli from a single location or did not systematically manipulate spatial coincidence. Yet if the spatial rule holds, then a spatially congruent sound and a spatially incongruent sound might tap into fundamentally different neural mechanisms, one that is robust and resource-independent, the other fragile and dependent on spare capacity. The new study was designed to separate these possibilities cleanly.

To manipulate attentional load, the researchers adopted a rapid serial visual presentation paradigm, one of the most reliable tools in cognitive psychology for controlling how much attention a distractor task consumes. Participants watched a fast-moving stream of characters at fixation while searching for targets within the stream. In the no-load condition, the stream demanded minimal attention; in the low-load condition, it demanded a moderate amount; and in the high-load condition, the task was tuned to consume nearly all available attentional resources. This graded approach allowed the team to trace how integration behaves as resources are progressively drained, rather than simply comparing easy and hard tasks.

On top of this load manipulation, the researchers controlled spatial coincidence. Visual targets and task-irrelevant auditory stimuli were presented either at the same spatial position or at different positions. Participants were instructed to ignore the sounds completely, so any influence of the tones on visual target identification would reflect an involuntary cross-modal interaction. The design therefore crossed three levels of attentional load with two levels of spatial congruency, producing a matrix of conditions in which the contributions of resources and space could be disentangled statistically.

The results were clear and, in places, surprising. Spatially congruent auditory stimuli improved the identification of visual targets across all three load conditions, including the high-load condition in which the RSVP stream was consuming the bulk of participants’ attention. In other words, even when observers were pushed close to their attentional limits, a sound arriving from the same location as the visual target still made that target easier to detect. This resilience suggests that spatially coincident audiovisual integration operates through a mechanism that is largely automatic, one that does not compete meaningfully for the limited resources taxed by the RSVP task. It is consistent with the idea that spatially aligned signals are bound early and efficiently, perhaps at subcortical or early cortical levels where the spatial rule was originally discovered.

The story changed dramatically for spatially incongruent sounds. When the auditory stimulus appeared at a different location from the visual target, it failed to enhance visual identification under high-load conditions. Under no load and low load, some cross-modal influence could still be observed, but as the RSVP task drained resources, the benefit of the mismatched sound vanished. This dissociation is the paper’s key contribution: it demonstrates that not all audiovisual integration is created equal. Spatially congruent integration survives the harshest attentional conditions, whereas spatially incongruent integration depends on the availability of spare attentional capacity. The findings therefore reconcile two seemingly contradictory literatures, showing that studies reporting automatic integration may have relied on conditions, or on spatial arrangements, in which the congruent, resource-independent mechanism was doing the work.

The theoretical implications reach into several active debates. For proponents of load theory, the results support the view that high load filters out stimuli that lack a privileged link to the attended event, while leaving intact interactions that are structurally embedded in the spatial layout of the scene. For multisensory researchers, the study adds a crucial qualification to the spatial rule: spatial coincidence is not merely a facilitator of integration but a determinant of whether integration can occur without attention. The work also echoes earlier findings by Ho, Santangelo, and Spence on multisensory warning signals, which showed that spatial correspondence matters enormously for the effectiveness of cross-modal alerts, and by McDonald and colleagues, who identified neural substrates of perceptual enhancement by cross-modal spatial attention. The new data extend this line by showing that the spatial rule becomes decisive precisely when attention runs out.

Beyond the laboratory, the findings carry practical weight. Warning signals in aircraft cockpits, operating theaters, and vehicles often pair a sound with a visual indicator, and designers generally assume the pairing will help even when operators are overloaded. This study suggests that assumption holds only when the sound and the visual signal share a location. A warning tone emitted from a speaker far from the relevant display may fail to boost detection in a stressed, overloaded operator, whereas a spatially aligned cue could still cut through. Similarly, the results inform the design of assistive technologies and virtual reality environments, where multisensory cues are increasingly used to guide attention, and they may help explain why multisensory enhancement can break down in conditions of fatigue or divided attention.

The study, conducted with approval from the Academic Committee of the Department of Psychology at Soochow University in line with the Declaration of Helsinki, was supported by the Japan Society for the Promotion of Science, the Pre-approved Project of the Wenzhou Key Research Base for Philosophy and Social Sciences, and the Social Science project of Suzhou University of Science and Technology. Data and code are available from the corresponding authors upon reasonable request. As multisensory research moves toward real-world applications, this work delivers a deceptively simple message with deep consequences: the brain’s ability to merge sight and sound is not a single switch but a layered system, and only the layer built on spatial coincidence keeps working when everything else is asked to give.

Subject of Research: How attentional load and spatial coincidence modulate audiovisual integration of simple stimuli

Article Title: The effect of attentional loads on audiovisual integration: When spatial coincidence matters

Article References: The effect of attentional loads on audiovisual integration: When spatial coincidence matters. (n.d.). https://doi.org/10.3758/s13414-026-03257-0

Image Credits: AI Generated

DOI: 10.3758/s13414-026-03257-0

Keywords: attentional load, audiovisual integration, spatial coincidence, multisensory perception, RSVP, cross-modal interaction, selective attention, perceptual load, spatial rule, visual target detection, auditory stimuli, cognitive psychology

The study was inspired by an earlier hypothesis in the field sometimes called sound-induced visual segmentation. When two two-dimensional objects approach one another and reach their point of closest approach, a coincident sound appears to lead observers to overestimate the distance between them, as though the auditory event slices the visual scene into distinct objects. The research team, led by Wenxuan Song, Xiaoying Li, Yuan Guo, and Song Zhao of Soochow University in China, reasoned that if a sound can segment approaching objects in this way, it might also amplify the non-contact illusion that arises when two moving squares disappear precisely at the instant their edges meet. Across two experiments, they tested whether a sound presented at contact would increase the probability that observers report the squares as having never touched.

The results were clear and consistent. In both Experiment 1 and Experiment 2, participants were significantly more likely to give a non-contact response when a sound accompanied the moment of visual contact than when the squares collided in silence. This sound-induced increase in the illusion occurred even though the sound carried no information about the visual stimulus and participants were explicitly instructed to ignore it. The effect is therefore a genuine cross-modal influence: an auditory signal, meaningless on its own, reshapes the conscious perception of a visual event in a systematic and reproducible way.

What makes the finding particularly striking is that the effect runs in the opposite direction from what a simple collision interpretation would predict. The classic stream-bounce literature, dating back to Sekuler and colleagues’ 1997 demonstration that a sound can make two crossing discs appear to bounce off one another, has often been interpreted through the lens of causal inference: the sound suggests a collision, so the brain infers a collision. But in the new study, the sound produced more non-contact judgments, not more contact judgments. If the sound had merely signaled that two objects struck one another, it should have biased observers toward reporting contact. Instead, it deepened the impression that the objects remained apart, ruling out this response-bias account.

The researchers also tested and rejected an attentional explanation. One possibility is that the abrupt sound simply distracts observers, impairing their ability to encode the visual event and thereby pushing them toward a default or guess response. If that were true, non-contact responses in the sound-present condition should have been slower than contact responses, reflecting a disruption of processing. The reaction-time data told a different story: the non-contact response was never slower than the contact response when the sound was present. In fact, supplementary analyses showed that reaction times for non-contact responses were significantly shorter in the sound-present condition than in the sound-absent condition, while contact responses did not differ between sound conditions. This pattern contradicts any account based on attentional distraction or slowed processing.

To probe the neural mechanisms underlying the effect, the team recorded high time-resolution event-related potentials, or ERPs, during Experiment 2. The critical comparison focused on an early cross-modal component known as PD170, a positivity peaking between roughly 125 and 175 milliseconds after sound onset that has previously been associated with low-level audiovisual interactions in early sensory cortex. The results showed that the PD170 was significantly larger on sound-present trials in which participants ultimately reported the non-contact percept than on sound-present trials in which they reported contact. This dissociation, emerging within the first fifth of a second after the sound, indicates that the sound-induced enhancement of the illusion is rooted in early, low-level cross-modal interactions rather than in later cognitive evaluation or decision processes.

The PD170 finding carries substantial theoretical weight. Early cross-modal components of this kind have been linked to interactions between auditory and visual cortex that occur automatically, before attention and higher-order cognition can shape the percept. By tying the strength of the behavioral illusion to the amplitude of this early component, the study substantiates the perceptual nature of the effect: the sound does not merely change what people say about the display but genuinely alters what they see. This aligns the new phenomenon with a family of well-documented sound-induced visual illusions, including the sound-induced flash illusion, in which a single flash accompanied by two beeps is perceived as two flashes, and the audiovisual bounce-inducing effect, in which a sound at the crossing point of two moving discs promotes a bouncing percept.

At the same time, the non-contact illusion and its sound-induced enhancement differ in an important way from the stream-bounce paradigm. The non-contact illusion does not require a sound to emerge; it arises purely from the visual statistics of the display, specifically the sudden disappearance of two squares at the moment their edges make contact. The sound merely strengthens an already-existing visual illusion rather than resolving an ambiguous motion event. This makes the paradigm a particularly clean tool for studying how auditory signals modulate visual spatial perception, because baseline and sound-modulated conditions can be compared within the same unambiguous geometric event. The authors note, following recent work by Zeljko and Grove, that there is no inherent bias toward any particular percept in the sound-absent condition unless it is intermixed with sound-present trials, further underscoring the importance of careful experimental design in this domain.

The methodological rigor of the study strengthens its conclusions. The researchers used mixed-effects logistic modeling with maximal random-effects structures, in line with contemporary best practices for categorical data analysis, and complemented frequentist tests with Bayesian analyses to evaluate null results. All trial-level data, subject-level data, analysis scripts, and experimental files for both experiments are openly available on the Open Science Framework, allowing independent verification and reuse. The study was approved by the Institutional Review Board of Soochow University, informed consent was obtained from all participants, and the work was supported by the National Natural Science Foundation of China and an undergraduate innovation training program at Soochow University.

Looking forward, the authors suggest that the sound-induced enhancement of the non-contact illusion constitutes a promising new paradigm for investigating multisensory processing. Because the effect is behaviorally robust, mechanistically traceable to an identifiable early ERP component, and free from the confounds that complicate stream-bounce designs, it offers researchers a versatile instrument for dissecting when, where, and how the brain integrates sound and sight. Some limitations remain: the design’s contact-duration constraints restricted reaction-time analyses to a single duration condition, and ERP requirements limited the number of participants meeting trial-count criteria in some conditions, pointing toward richer future experiments. Even so, the demonstration that a meaningless beep can tip the brain’s reconstruction of a visual collision toward the conviction that no contact ever occurred is a vivid reminder that perception is not a passive recording of the world. It is an active, multisensory construction, one that sound can quietly rewrite within a fraction of a second.

Subject of Research: Sound-induced enhancement of the non-contact illusion, a cross-modal audiovisual perceptual effect studied with behavioral and ERP measures.

Article Title: A novel cross-modal perceptual effect: Sound-induced increase of the non-contact illusion

Article References: Song, W., Li, X., Guo, Y., & Zhao, S. (2026). A novel cross-modal perceptual effect: Sound-induced increase of the non-contact illusion. Attention, Perception, & Psychophysics, 88(7), Article 183. https://doi.org/10.3758/s13414-026-03332-6

Image Credits: AI Generated

DOI: 10.3758/s13414-026-03332-6

Keywords: non-contact illusion, cross-modal interaction, audiovisual perception, multisensory integration, event-related potential, PD170, sound-induced illusion, visual motion perception, stream-bounce effect, perceptual psychology, ERP, attention perception psychophysics