Traditional neuroscience has held that the visual system must subtract out the retinal motion generated by eye movements to isolate the motion of objects relative to the environment. However, this longstanding notion has been challenged by new research from the University of Rochester. Their groundbreaking investigation reveals that the visual motion caused by our eye movements is far from meaningless interference. Instead, these specific patterns of image motion are valuable clues that the brain actively analyzes to decipher how objects move and, critically, how they occupy three-dimensional space.

Leading this innovative inquiry is Professor Greg DeAngelis, a distinguished figure in brain and cognitive sciences, neuroscience, and biomedical engineering. According to DeAngelis, the assumption that image motion produced by eye movements is merely a nuisance variable to be discarded is a misconception. Their findings illustrate that the brain harnesses these global patterns of image flow to infer the relative movements of the eyes in the surrounding space. This insight revolutionizes our understanding of visual processing by framing eye movement-induced image motion as an essential component for depth and motion interpretation, not as a problem to be erased.

To systematically investigate these dynamics, the research team devised an advanced theoretical framework predicting human perception of motion and depth under different eye movement conditions. This model accounts for the complex interplay between target object motion, eye fixation, and the accompanying retinal image displacement. By simulating multiple scenarios with varying object trajectories and gaze directions, they formulated precise predictions on observers’ perceptual errors regarding depth and motion.

The team validated these predictions through controlled experiments employing immersive 3D virtual reality environments. Participants maintained fixation on a stable point while observing target objects moving in the scene. In one perceptual assessment, subjects adjusted a dial to align a secondary object’s motion direction with their perceived trajectory of the target. In another depth perception task, participants indicated whether the target appeared closer or farther than the fixation point. The observed consistent and systematic perceptual biases in both tasks matched the theoretical expectations remarkably well, underscoring the model’s robustness.

Importantly, this body of work demonstrates that the brain integrates multiple streams of information—especially the image motions generated by eye movements—when constructing its representation of the three-dimensional world. Rather than suppressing these retinal signals as noise, the visual system evaluates their spatial patterns to infer the real-world layout accurately. This nuanced understanding challenges canonical perspectives in vision science that have dominated for decades.

The implications of these findings extend beyond basic neuroscience, touching on real-world applications such as technological interfaces and virtual reality. DeAngelis points out that current VR systems largely ignore the dynamic relationship between eye movements and the visual scene when rendering images. This disconnect may produce visual conflicts causing discomfort or motion sickness among users, as the artificial image motion does not align with the brain’s expected sensory input during eye movements.

By incorporating models of how the brain processes eye movement-induced image motion, future VR technologies could render more naturalistic and stable visual environments. Such advancements have the potential not only to enhance user comfort and reduce motion sickness but also to improve immersion and accuracy in virtual spaces. This line of research opens pathways toward a new generation of visually intelligent systems that harmonize with the brain’s perceptual strategies.

Furthermore, these discoveries inform our understanding of neurological disorders affecting visual perception and motion processing. Conditions that impair the brain’s ability to integrate eye movement signals might underlie difficulties in spatial navigation, object recognition, or depth perception. By elucidating how the healthy brain solves these challenges, this research sets the stage for targeted therapies and diagnostic tools.

The study involved contributions from graduate and postdoctoral researchers, reflecting a collaborative endeavor across multiple domains of expertise. Zhe-Xin Xu, formerly a doctoral student and now a postdoc at Harvard, and Jiayi Pang, currently continuing graduate studies at Brown University, brought critical insights. Akiyuki Anzai, a research associate at Rochester, also played a key role, underscoring the multidisciplinary nature of the investigation within neuroscience and visual cognition.

Supported by the National Institutes of Health, this research underscores the value of integrating theoretical modeling with immersive experimental paradigms to unravel complex brain functions. The fusion of computational and behavioral approaches emerges as a powerful tool for deciphering perception mechanisms that govern human experience of space and motion.

Ultimately, this paradigm-shifting work not only redefines our conception of how eye movements affect visual perception but also paves the way for innovations across health sciences and technology. By revealing that eye movement-induced image motion serves as an informative signal rather than unwanted noise, this study illuminates the sophisticated strategies the brain employs to interpret and navigate the three-dimensional world around us.

Subject of Research: Neuroscience, Visual Perception, Eye Movement, 3D Spatial Interpretation

Article Title: The Brain’s Use of Eye Movement-Induced Image Motion to Interpret 3D Space and Object Motion

Web References:

• University of Rochester: http://www.rochester.edu/
• Greg DeAngelis Lab: https://www.sas.rochester.edu/bcs/people/faculty/deangelis_greg/index.html
• Nature Communications article: https://www.nature.com/articles/s41467-025-67857-4
• DOI: http://dx.doi.org/10.17605/OSF.IO/ZY8W6

References:
DeAngelis, G.C., Xu, Z.-X., Pang, J., Anzai, A. (2025). Patterns of visual motion produced by eye movements inform the brain’s perception of 3D motion and depth. Nature Communications. https://doi.org/10.17605/OSF.IO/ZY8W6

Image Credits: John Schlia Photography, University of Rochester

Keywords: Neuroscience, Visual Perception, Eye Movements, 3D Vision, Depth Perception, Motion Perception, Virtual Reality, Cognitive Psychology, Brain and Cognitive Sciences

At the core of this research is the concept of processing fluency, which refers to the ease with which information is perceived and processed. This study innovatively investigates how auditory fluency—our ability to effortlessly process sounds—transfers to the realm of visual perception. The implications of this phenomenon extend beyond mere academic interest, opening up potential applications in marketing, design, and even therapeutic modalities.

To conduct the study, the researchers designed a series of experiments involving a diverse group of participants. They assessed auditory processing fluency through various auditory stimuli, measuring participants’ responses and preferences in subsequent visual tasks. By manipulating auditory cues and analyzing the resulting visual preferences, the team effectively illustrated how one sensory modality can sway the perception of another.

One of the most compelling findings of the study is the demonstrated influence of auditory stimuli on visual preferences. Participants exposed to easily processed auditory cues consistently displayed a heightened preference for visually appealing objects. This correlation suggests that the brain’s processing systems are interconnected, where the ease of auditory processing enhances positive evaluations of visual stimuli. Essentially, sounds that are easier to recognize and enjoy may make certain visual objects more appealing.

This research not only deepens our understanding of sensory integration but also highlights the significance of context in our perceptions. The findings suggest that environments designed with a harmonious blend of sound and visual appeal can create more engaging experiences. This could have profound implications in various fields, from creating better retail experiences to designing captivating multimedia artwork.

Moreover, the implications of this study extend into the realms of advertising and media production. Marketers could leverage these insights to create more compelling campaigns by ensuring that auditory elements complement visual messaging. By aligning sound with visual aesthetics, brands can effectively enhance consumer attraction and retention.

The methods employed in the study were rigorous and multifaceted. Participants not only engaged with different auditory stimuli but also underwent tests measuring their visual preferences. Statistical analyses provided robust evidence for the auditory influence on visual processes, helping to establish a stronger theoretical framework for future research in this area.

Importantly, this research opens the door for further exploration into different sensory combinations. Future studies may venture into how other sensory modalities interact, such as olfactory cues influencing taste perception or tactile sensations altering visual preferences. Each layer of complexity in sensory understanding offers thrilling opportunities for advancements across various disciplines.

The neurological basis of these findings may lie in the brain’s processing networks, where regions responsible for auditory and visual processing might overlap or communicate in unexpected ways. Investigating the brain’s functional connectivity could yield deeper insights into how we form multisensory experiences and preferences.

In practical usage, this study signals a shift in how professionals across industries might consider sensory applications. Designers, educators, and advertisers may now contemplate auditory elements as crucial components of holistic experience creation. The focus is shifting toward creating multisensory harmony, where sound and vision work in tandem to enhance overall enjoyment and effectiveness.

This research not only enriches academia but also urges real-world applications. For instance, in educational settings, incorporating soundscapes that match educational visuals could enhance learning environments. This finding underscores the importance of a multisensory approach in enhancing engagement and retention among learners.

As technology continues to evolve, integrating auditory and visual stimuli in virtual environments also presents exciting prospects. Virtual reality experiences could become even more immersive when they employ soundscapes that align with visual content, fostering deeper connections for users and enhanced authenticity of virtual interactions.

In conclusion, the study by Knight, Flavell, and Mattys offers exciting insights into the relationship between auditory processing and visual preference. By illuminating the dynamic interplay between these senses, this research not only advances scientific knowledge but also proposes practical frameworks for applications across various domains. This deeper understanding of sensory integration will undoubtedly propel future studies, informing fields from marketing to education, ultimately enriching our multisensory experiences of the world.

Subject of Research: Crossmodal transfer of auditory processing fluency to visual object preference

Article Title: Sounds easy, looks nice: Crossmodal transfer of auditory processing fluency to visual object preference

Article References:

Knight, S., Flavell, J.C. & Mattys, S. Sounds easy, looks nice: Crossmodal transfer of auditory processing fluency to visual object preference.
Atten Percept Psychophys 88, 14 (2026). https://doi.org/10.3758/s13414-025-03177-5

Image Credits: AI Generated

DOI: https://doi.org/10.3758/s13414-025-03177-5

Keywords: crossmodal perception, auditory processing fluency, visual object preference, sensory integration, processing fluency, multisensory experiences, marketing applications, educational settings.