<?xml version="1.0" encoding="UTF-8"?><rss version="2.0"
	xmlns:content="http://purl.org/rss/1.0/modules/content/"
	xmlns:wfw="http://wellformedweb.org/CommentAPI/"
	xmlns:dc="http://purl.org/dc/elements/1.1/"
	xmlns:atom="http://www.w3.org/2005/Atom"
	xmlns:sy="http://purl.org/rss/1.0/modules/syndication/"
	xmlns:slash="http://purl.org/rss/1.0/modules/slash/"
	>

<channel>
	<title>depth perception &#8211; Science</title>
	<atom:link href="https://scienmag.com/tag/depth-perception/feed/" rel="self" type="application/rss+xml" />
	<link>https://scienmag.com</link>
	<description></description>
	<lastBuildDate>Mon, 21 Sep 2026 00:57:12 +0000</lastBuildDate>
	<language>en-US</language>
	<sy:updatePeriod>
	hourly	</sy:updatePeriod>
	<sy:updateFrequency>
	1	</sy:updateFrequency>
	<generator>https://wordpress.org/?v=7.1.2</generator>

<image>
	<url>https://scienmag.com/wp-content/uploads/2024/07/cropped-scienmag_ico-32x32.jpg</url>
	<title>depth perception &#8211; Science</title>
	<link>https://scienmag.com</link>
	<width>32</width>
	<height>32</height>
</image> 
<site xmlns="com-wordpress:feed-additions:1">73899611</site>	<item>
		<title>Cheap 3D Cameras Could Transform How Surgeons Learn Laparoscopy, Trial Finds</title>
		<link>https://scienmag.com/cheap-3d-cameras-could-transform-how-surgeons-learn-laparoscopy-trial-finds/</link>
		
		<dc:creator><![CDATA[Courtney Benton]]></dc:creator>
		<pubDate>Mon, 21 Sep 2026 00:57:12 +0000</pubDate>
				<category><![CDATA[Social Science]]></category>
		<category><![CDATA[2D visualization]]></category>
		<category><![CDATA[3D stereoscopic vision in surgery]]></category>
		<category><![CDATA[3D visualization]]></category>
		<category><![CDATA[affordable technology in surgical training]]></category>
		<category><![CDATA[box trainer]]></category>
		<category><![CDATA[cost-effective laparoscopic training tools]]></category>
		<category><![CDATA[depth perception]]></category>
		<category><![CDATA[enhancing learning curves for laparoscopic procedures]]></category>
		<category><![CDATA[impact of 3D visualization on surgical accuracy]]></category>
		<category><![CDATA[improving depth perception in minimally invasive surgery]]></category>
		<category><![CDATA[laparoscopic surgical training]]></category>
		<category><![CDATA[laparoscopy]]></category>
		<category><![CDATA[low-cost 3D cameras for medical education]]></category>
		<category><![CDATA[low-cost simulator]]></category>
		<category><![CDATA[medical student surgical simulation]]></category>
		<category><![CDATA[novice surgical skill development]]></category>
		<category><![CDATA[novice trainees]]></category>
		<category><![CDATA[psychomotor skills]]></category>
		<category><![CDATA[randomized cross-over trial]]></category>
		<category><![CDATA[Simulation training]]></category>
		<category><![CDATA[stereopsis]]></category>
		<category><![CDATA[surgical education]]></category>
		<category><![CDATA[surgical education innovation]]></category>
		<category><![CDATA[virtual reality and 3D imaging in surgery]]></category>
		<guid isPermaLink="false">https://scienmag.com/?p=204808</guid>

					<description><![CDATA[A randomized cross-over trial found that a low-cost 3D high-definition setup helped laparoscopic novices complete tasks faster and with fewer errors than standard 2D vision.]]></description>
										<content:encoded><![CDATA[<p>For decades, one of the most stubborn barriers in surgical education has been deceptively simple: seeing in depth. Conventional laparoscopic systems deliver a flat, two-dimensional image of the operative field, stripping away the stereoscopic cues that the human visual system relies on to judge distance and position. Now a randomized cross-over trial conducted at a medical school in southern Brazil suggests that restoring true depth perception does not require expensive commercial 3D towers or robotic platforms. A deliberately low-cost stereoscopic setup, assembled from a consumer-grade 3D video camera, a standard 27-inch LED monitor, and off-the-shelf 3D glasses, allowed novice medical students to complete laparoscopic tasks faster and with fewer errors than when they performed the same tasks under two-dimensional high-definition vision.</p>
<p>The study, published in Global Surgical Education, the journal of the Association for Surgical Education, enrolled 48 medical students who had completed a course in operative technique and experimental surgery. Every participant was a genuine laparoscopic novice: none had undertaken formal simulation training, practiced on the study platform, or received structured instruction in laparoscopic suturing before the experiment. This naive cohort was a deliberate choice. By testing learners before they could compensate for lost depth cues with experience, the investigators could isolate the pure effect of visualization modality on early skill acquisition, the phase of training where the cognitive burden of learning instrument handling, camera interpretation, and task sequencing is heaviest.</p>
<p>The trial used a randomized cross-over design to control for the wide individual variability that plagues surgical skills research. Participants were allocated one-to-one to two sequences. One group performed four standardized laparoscopic tasks first under two-dimensional high-definition visualization and then repeated them under three-dimensional high-definition vision; the other group followed the reverse order. Because the intervention was a visual display, blinding of participants and investigators was impossible, but the cross-over structure allowed each student to serve as their own control. Task completion time in seconds and the number of predefined errors served as the primary objective outcomes, while a study-specific post-task questionnaire captured perceived depth perception, performance, speed, visual adaptation, and adverse symptoms.</p>
<p>The four tasks were calibrated to test progressively demanding psychomotor skills on a physical box trainer using real graspers and needle holders. Task one required positioning ten metal cylinders at predefined locations on a board, with an error counted for any misplaced cylinder. Task two involved transferring ten pearls, one at a time, from a container with a 42-millimeter opening into one with a tighter 35-millimeter opening. Task three demanded that participants grasp a disposable needle and its cap from the bottom of the box and cap the needle above the floor, with punctures and dropped objects counted as errors. Task four, the most complex, tested suturing and knot tying on a sponge model with 3-0 nylon on a CTI 3/8 circle needle, timed from the first stitch through the third knot.</p>
<p>The results were striking, particularly among students who moved from two-dimensional to three-dimensional visualization. In this sequence, three-dimensional vision produced statistically significant improvements in every single task. Cylinder positioning was completed 32.9 percent faster with 40.8 percent fewer errors. Pearl transfer was 24.6 percent faster with errors reduced by 67.6 percent. Needle capping improved by 38.5 percent in time and 32.6 percent in errors, while knots and suturing were 22.3 percent faster with 29.4 percent fewer errors. All comparisons reached statistical significance, with p values at or below 0.002 for the time outcomes and p less than 0.001 for error counts.</p>
<p>The reverse sequence, in which students began with three-dimensional vision and switched to two-dimensional, told a subtler story, as expected when learning from task repetition can mask the benefit of a second modality. Here, three-dimensional visualization still produced 50 percent fewer errors in pearl transfer and a 27.4 percent faster completion of needle capping with 27 percent fewer errors, both statistically significant, though some differences narrowed or lost significance. To address carryover learning directly, the investigators compared initial performance between the two groups, contrasting students who had never seen the tasks with those starting on three-dimensional vision. This first-exposure comparison favored 3D in three of the four tasks, including a 21.7 percent faster cylinder positioning with 38.8 percent fewer errors and a dramatic 50.4 percent faster needle capping with 36.9 percent fewer errors, strengthening the case that stereopsis confers a genuine advantage rather than a mere order effect.</p>
<p>The subjective data reinforced the objective measurements with remarkable consistency. An overwhelming 97.9 percent of participants reported better depth perception with three-dimensional vision, 79.2 percent reported better performance and more accurate gestures, and 85.4 percent reported faster task execution. A slimmer majority, 52.1 percent, found the three-dimensional display easier to adapt to, and 47.9 percent actually considered the two-dimensional image more natural, a finding the authors attribute to limited prior exposure to stereoscopic displays, variation in individual tolerance to 3D imaging, monitor positioning, and discomfort related to the glasses. Adverse symptoms were modest but real: 33.3 percent reported discomfort or hand pain during instrument manipulation, 25 percent reported blurred vision, and 8.3 percent reported dizziness, while one-third of participants experienced no symptoms at all.</p>
<p>The technical significance of the study lies less in the individual percentages than in the platform itself. The authors intentionally excluded virtual reality, augmented reality, and force-feedback haptics so that the experiment would isolate the effect of stereoscopic visualization while preserving the tactile interaction of real instruments within a physical trainer. The configuration combined a Sony HDR-TD20 camera capable of both 2D and 3D high-definition recording, an HDMI cable, a Samsung LED TD950 2D/3D monitor, and a standard laparoscopic box trainer with conventional graspers and needle holders. Commercial 3D laparoscopic towers and robotic platforms remain prohibitively expensive for many training programs, and the authors situate their work within a broader movement toward affordable simulation, citing recent examples including biodegradable 3D-printed simulators, validated low-cost trainers, and automated error-detection systems that improve trainee confidence.</p>
<p>The findings also engage with ongoing debates about validity in surgical education. The authors are careful to note that their simulator should not be described as valid in isolation; rather, the completion times, error counts, and preference responses constitute context-specific evidence about immediate simulator performance among novices. They also acknowledge a caution raised in prior literature that two-dimensional versus three-dimensional comparisons vary widely in task type, participant experience, endpoints, and subjective assessment. Among the study&#8217;s stated limitations are its exclusive novice population, the short interval between modalities that may have permitted carryover learning, the absence of delayed retention testing or transfer to clinical performance, and a study-specific questionnaire that was not formally psychometrically validated. Baseline measures of video-game use and other visuospatial experience were also not collected.</p>
<p>Nevertheless, the message for global surgical education is clear and potentially transformative. Where access to robotic simulators, high-fidelity virtual reality trainers, or commercial 3D towers is limited by capital and maintenance costs, a low-cost stereoscopic trainer may allow students and residents to acquire fundamental visuospatial and psychomotor skills before entering the operating room. The authors position such platforms not as replacements for emerging autostereoscopic and augmented-reality systems, which may eventually combine depth perception with image-guided overlays and remote instruction, but as a pragmatic bridge until those technologies become widely accessible. Future studies, they suggest, should include delayed retention testing, transfer tasks, clinical outcome measures, and baseline visuospatial profiling. If replicated, the demonstration that a few hundred dollars of consumer hardware can outperform flat high-definition vision on every measure that matters in early laparoscopic training could help democratize surgical skills education in precisely the settings where trained surgeons are scarcest.</p>
<p><strong>Subject of Research:</strong> Three-dimensional versus two-dimensional visualization in low-cost laparoscopic skills training for novices</p>
<p><strong>Article Title:</strong> 3-Dimensional versus 2-dimensional visualization on laparoscopic skills training in a low-cost simulation model: a randomized cross-over trial</p>
<p><strong>Article References:</strong> Heldwein, F. L., Freire, E. S., Vicente, M. V. S., Porath, H., &amp; Veiga, C. B. (2026). 3-Dimensional versus 2-dimensional visualization on laparoscopic skills training in a low-cost simulation model: a randomized cross-over trial. <em>Global Surgical Education &#8211; Journal of the Association for Surgical Education, 5</em>(1), Article 164. <a href="https://doi.org/10.1007/s44186-026-00567-7" rel="noopener noreferrer">https://doi.org/10.1007/s44186-026-00567-7</a></p>
<p><strong>Image Credits:</strong> AI Generated</p>
<p><strong>DOI:</strong> <a href="https://doi.org/10.1007/s44186-026-00567-7" rel="noopener noreferrer">10.1007/s44186-026-00567-7</a></p>
<p><strong>Keywords:</strong> laparoscopy, simulation training, 3D visualization, 2D visualization, stereopsis, depth perception, surgical education, box trainer, randomized cross-over trial, low-cost simulator, novice trainees, psychomotor skills</p>
]]></content:encoded>
					
		
		
		<post-id xmlns="com-wordpress:feed-additions:1">204808</post-id>	</item>
		<item>
		<title>AI Teaches Stereo Cameras to See Depth Without Real-World Labels</title>
		<link>https://scienmag.com/ai-teaches-stereo-cameras-to-see-depth-without-real-world-labels/</link>
		
		<dc:creator><![CDATA[Denise Maddox]]></dc:creator>
		<pubDate>Sun, 13 Sep 2026 01:52:46 +0000</pubDate>
				<category><![CDATA[Technology and Engineering]]></category>
		<category><![CDATA[AI-driven augmented reality depth measurement]]></category>
		<category><![CDATA[computer vision]]></category>
		<category><![CDATA[consistency-aware learning]]></category>
		<category><![CDATA[cross-environment robustness of stereo cameras]]></category>
		<category><![CDATA[deep learning]]></category>
		<category><![CDATA[deep learning for autonomous navigation]]></category>
		<category><![CDATA[depth perception]]></category>
		<category><![CDATA[disparity estimation]]></category>
		<category><![CDATA[disparity estimation without ground-truth labels]]></category>
		<category><![CDATA[domain adaptation]]></category>
		<category><![CDATA[domain adaptation in computer vision]]></category>
		<category><![CDATA[ETH3D]]></category>
		<category><![CDATA[improving stereo vision reliability in diverse environments]]></category>
		<category><![CDATA[KITTI]]></category>
		<category><![CDATA[Middlebury]]></category>
		<category><![CDATA[monocular depth estimation]]></category>
		<category><![CDATA[monocular foundation models for depth perception]]></category>
		<category><![CDATA[multi-camera depth sensing in robotics]]></category>
		<category><![CDATA[real-world challenges in stereo matching]]></category>
		<category><![CDATA[self-supervised learning]]></category>
		<category><![CDATA[self-supervised stereo depth estimation]]></category>
		<category><![CDATA[stereo matching]]></category>
		<category><![CDATA[synthetic versus real-world training data]]></category>
		<category><![CDATA[unsupervised learning in 3D scene reconstruction]]></category>
		<guid isPermaLink="false">https://scienmag.com/?p=200600</guid>

					<description><![CDATA[A new self-supervised domain adaptation framework uses monocular depth foundation models and consistency-aware learning to make stereo matching networks reliable in real-world scenes without ground-truth labels.]]></description>
										<content:encoded><![CDATA[<p>Depth perception is one of the most fundamental challenges in computer vision, and for robots, autonomous vehicles, and augmented reality systems, it is the difference between smooth navigation and costly failure. Deep learning has produced stereo matching networks that achieve remarkable scores on academic benchmarks, yet a persistent and frustrating gap remains between laboratory performance and real-world reliability. When a model trained on synthetic or carefully curated data encounters the messy conditions of an actual street, factory floor, or greenhouse, its accuracy can collapse. A new study published in the International Journal of Machine Learning and Cybernetics tackles this domain-shift problem head-on with a self-supervised framework that borrows its sense of depth from monocular foundation models, requiring no real-world ground-truth disparity labels at all.</p>
<p>The research, led by Shu Zhang of Huazhong Agricultural University together with Jiapeng Chen, Huan Shen, Quan Liu, and corresponding author Jing Xie, addresses a problem that has long plagued practitioners: labeled stereo data is scarce, expensive, and often unavailable for the specific environments in which a vision system must operate. Stereo matching works by comparing two images captured from slightly offset cameras and computing disparity, the horizontal shift of corresponding pixels, which is inversely proportional to depth. Networks trained on benchmark datasets such as Scene Flow learn this correspondence task superbly, but the statistical properties of those images differ from those of new deployment scenes in lighting, texture, camera geometry, and noise characteristics. This distribution mismatch, known as domain shift, degrades disparity predictions precisely in the regions that matter most for safety, such as thin structures, reflective surfaces, and textureless expanses.</p>
<p>Previous approaches to adaptation have taken several routes. Some methods fine-tune on the target domain using self-supervised photometric losses, exploiting the fact that a correct disparity map should allow one stereo view to be reconstructed from the other. Others rely on domain translation, synthesizing target-like images, or on confidence-based selection of reliable predictions. The new framework departs from these strategies by drawing on an entirely different source of supervision: the recent generation of monocular depth foundation models, such as Depth Anything, Metric3D, and UniDepth, which have been trained on massive unlabeled image collections and generalize impressively across scenes. Rather than ignoring this wealth of relative depth knowledge, the authors harness it as weak ordinal supervision for the stereo network.</p>
<p>The key insight lies in how that supervision is used. Converting monocular depth predictions directly into metric disparity labels is fraught with difficulty. Monocular depth estimates suffer from scale ambiguity, meaning the model may predict depths that are globally stretched or compressed relative to true geometry. Moreover, when depth is expressed in inverse form, as is common in disparity-based formulations, errors are amplified for distant objects, where small absolute depth errors translate into large inverse-depth errors. The team sidesteps both pitfalls by using only relative depth ordering. Their proposed Relative Disparity Loss enforces a simple ordinal constraint: whenever the monocular model judges one pixel to be closer than another, the stereo network is encouraged to predict a larger disparity for that pixel. Because ordinal relationships are invariant to scale and far more robust than absolute values, this constraint transfers reliable geometric knowledge across domains without importing the monocular model&#8217;s metric errors.</p>
<p>Ordinal cues alone, however, cannot guarantee accurate and stable adaptation, so the framework adds a consistency-aware learning mechanism with two complementary components. The first is multi-resolution prediction consistency. The stereo network&#8217;s predictions are computed at multiple input scales, and the variance across these scales serves as a pixel-wise reliability estimate. Pixels whose disparity predictions fluctuate wildly when the image is resized are deemed unstable and down-weighted in the training loss, while pixels that remain consistent across scales are trusted more heavily. This automatic reliability weighting protects the adaptation process from being corrupted by unreliable regions such as occlusions, sky, and reflective surfaces, which are precisely the areas where naive self-supervision tends to fail.</p>
<p>The second component is feature-level stereo consistency. Instead of constraining only the final disparity maps, the method enforces alignment between left and right image features after warping by the predicted disparity. This feature-space constraint gives the network a richer learning signal than photometric reconstruction alone, because it operates on learned representations that encode semantic and geometric structure rather than raw pixel intensities. As a result, the model becomes markedly more robust under illumination variations, one of the most common causes of performance collapse when synthetic-trained models meet the real world. Importantly, both the monocular depth model and the multi-resolution prediction machinery are used only during training; at inference time, the adapted stereo network runs as a standard, efficient two-view model with no additional computational burden.</p>
<p>The experimental evaluation spans three of the most demanding benchmarks in stereo vision: KITTI, with its autonomous-driving imagery; Middlebury, featuring high-resolution indoor scenes with subpixel-accurate ground truth; and ETH3D, which includes challenging textureless and outdoor environments. Across these targets, the framework achieves competitive or superior domain adaptation performance compared with existing self-adaptive methods, all without ever touching real-world ground-truth disparity during training. Qualitative results are particularly striking in the regions that have historically defeated stereo algorithms. In textureless walls where correspondence matching has no traction, on specular and reflective surfaces where photometric assumptions break down, and around thin structures such as poles and branches where disparity discontinuities are sharp, the adapted network produces visibly cleaner and more coherent depth maps than baselines.</p>
<p>The significance of this work extends beyond a single benchmark leaderboard. It demonstrates a practical recipe for combining the generalization strength of large monocular foundation models with the metric precision of stereo geometry, using the former to supervise the latter in a way that respects the strengths and weaknesses of each. Ordinal supervision sidesteps scale ambiguity, consistency weighting filters out unreliable pixels, and feature alignment hardens the network against lighting shifts. For industries deploying 3D vision, from agricultural robotics to autonomous navigation and industrial inspection, the approach promises models that can be adapted to a new site using only unlabeled stereo pairs captured on location, dramatically reducing the cost and time of deployment.</p>
<p>The study was supported by the National Natural Science Foundation of China under grant 42271357 and the Biological Breeding-National Science and Technology Major Project under grant 2023ZD04029. As monocular depth foundation models continue to improve, the framework&#8217;s reliance on relative depth ordering positions it to benefit automatically from future advances, since better ordinal predictions will yield stronger adaptation signals. The work points toward a future in which the divide between benchmark excellence and field reliability finally narrows, allowing stereo vision systems to earn their impressive numbers where it counts: in the unpredictable, uncontrolled, and unlabeled real world.</p>
<p><strong>Subject of Research:</strong> Self-supervised domain-adaptive stereo matching using monocular depth cues and consistency-aware learning</p>
<p><strong>Article Title:</strong> Domain adaptive stereo matching with consistency-aware learning and monocular depth cues</p>
<p><strong>Article References:</strong> Zhang, S., Chen, J., Shen, H., Liu, Q., &amp; Xie, J. (2026). Domain adaptive stereo matching with consistency-aware learning and monocular depth cues. <em>International Journal of Machine Learning and Cybernetics, 17</em>(9), Article 459. <a href="https://doi.org/10.1007/s13042-026-03295-y" rel="noopener noreferrer">https://doi.org/10.1007/s13042-026-03295-y</a></p>
<p><strong>Image Credits:</strong> AI Generated</p>
<p><strong>DOI:</strong> <a href="https://doi.org/10.1007/s13042-026-03295-y" rel="noopener noreferrer">10.1007/s13042-026-03295-y</a></p>
<p><strong>Keywords:</strong> stereo matching, domain adaptation, monocular depth estimation, consistency-aware learning, self-supervised learning, disparity estimation, depth perception, computer vision, KITTI, Middlebury, ETH3D, deep learning</p>
]]></content:encoded>
					
		
		
		<post-id xmlns="com-wordpress:feed-additions:1">200600</post-id>	</item>
		<item>
		<title>Depth perception drives sound visualization in virtual reality experiences</title>
		<link>https://scienmag.com/depth-perception-drives-sound-visualization-in-virtual-reality-experiences/</link>
		
		<dc:creator><![CDATA[Glenn Wilkins]]></dc:creator>
		<pubDate>Sat, 05 Sep 2026 10:00:58 +0000</pubDate>
				<category><![CDATA[Psychology & Psychiatry]]></category>
		<category><![CDATA[challenges in accurate sound-source alignment in VR]]></category>
		<category><![CDATA[cross-modal perception in VR]]></category>
		<category><![CDATA[depth perception]]></category>
		<category><![CDATA[depth perception in VR]]></category>
		<category><![CDATA[immersive headset effects]]></category>
		<category><![CDATA[impact of virtual world depth cues on sound perception]]></category>
		<category><![CDATA[influence of visual perception distortions on auditory localization]]></category>
		<category><![CDATA[multisensory integration]]></category>
		<category><![CDATA[multisensory integration in VR]]></category>
		<category><![CDATA[proximity image effect]]></category>
		<category><![CDATA[proximity image effect in VR]]></category>
		<category><![CDATA[sound localization and visual cues in VR]]></category>
		<category><![CDATA[sound localization in virtual environments]]></category>
		<category><![CDATA[spatial perception distortion]]></category>
		<category><![CDATA[spatial perception distortion in virtual reality]]></category>
		<category><![CDATA[ventriloquist effect in virtual environments]]></category>
		<category><![CDATA[ventriloquist effect in VR]]></category>
		<category><![CDATA[virtual reality]]></category>
		<category><![CDATA[virtual reality perceptual effects]]></category>
		<category><![CDATA[virtual reality sensory illusions]]></category>
		<category><![CDATA[Virtual reality sound visualization]]></category>
		<category><![CDATA[visual capture phenomenon]]></category>
		<category><![CDATA[visual distance underestimation]]></category>
		<category><![CDATA[visual distance underestimation in immersive headsets]]></category>
		<guid isPermaLink="false">https://scienmag.com/depth-perception-drives-sound-visualization-in-virtual-reality-experiences/</guid>

					<description><![CDATA[In a finding that challenges long-held assumptions about how our brains merge sight and sound, researchers at the University of Utah have shown that the famous &#8220;ventriloquist effect&#8221; survives the leap into virtual reality, but with a surprising twist. When people wearing immersive headsets tried to align real-world sounds with virtual objects, their brains pulled [&#8230;]]]></description>
										<content:encoded><![CDATA[<p>In a finding that challenges long-held assumptions about how our brains merge sight and sound, researchers at the University of Utah have shown that the famous &#8220;ventriloquist effect&#8221; survives the leap into virtual reality, but with a surprising twist. When people wearing immersive headsets tried to align real-world sounds with virtual objects, their brains pulled the sounds toward the objects just as previous laboratory work predicted. Yet the direction of that pull was reversed relative to classic real-world studies, and the culprit appears to be one of virtual reality&#8217;s best-known flaws: the systematic underestimation of visual distance. The study, published in the journal Attention, Perception, &amp; Psychophysics, suggests that the fundamental rules of multisensory integration are robust enough to transfer into synthetic worlds, but that the distorted spatial perception those worlds induce can flip the sign of established perceptual effects.</p>
<p>The phenomenon at the heart of the research is known as visual capture, or more specifically in the depth dimension, the proximity image effect. First described in the acoustics literature in the late 1960s, the proximity image effect refers to the tendency of listeners to perceive a sound as originating closer to a plausible visual source than it actually is. When a ventriloquist&#8217;s puppet&#8217;s mouth moves, the audience hears the voice coming from the puppet, not the performer. In laboratory settings, when a sound is emitted slightly behind or in front of a visible object, listeners systematically misjudge its location, biasing it toward the object. Decades of work, including influential Bayesian models of cue integration, have explained this as the brain weighing visual information more heavily than auditory information for spatial localization, particularly along the depth axis where hearing is comparatively imprecise. Vision dominates because it is typically the more reliable sense for spatial tasks, and the brain behaves like a near-optimal statistical integrator, combining sensory estimates weighted by their respective reliabilities.</p>
<p>What remained unclear, however, was whether these principles, derived mostly from experiments in real rooms with real objects, generalize to virtual environments. Virtual reality is not a neutral replica of the physical world. Decades of research have documented a persistent &#8220;distance compression&#8221; effect in head-mounted displays: people consistently judge objects in VR as closer, often around 74 to 90 percent of their actual distance, even in modern high-resolution consumer headsets. If the visual representation of space is systematically shrunk, the question becomes how the auditory system, which in these experiments received real, physically accurate sound, interacts with a visual system operating on distorted coordinates. The Utah team, led by Maggie K. McCracken together with Macy E. Rowland, Hunter C. Finney, Jeanine K. Stefanucci, and Sarah H. Creem-Regehr, designed two experiments to answer exactly this question.</p>
<p>The experimental logic was elegant. Participants wore an immersive head-mounted display in a real laboratory room while hearing sounds from an actual, physical sound source positioned at various depths. At the same time, they saw a virtual object rendered at a specified depth in the virtual scene. Their task was a perceptual matching judgment: they indicated when they perceived the real-world sound source to be aligned in depth with the virtual object. If no visual capture occurred, their judgments should track the true physical co-location of sound and virtual object. If visual capture occurred, their points of subjective alignment should be biased toward the visible object, and the magnitude and direction of that bias would reveal how the brain was combining the two spatial estimates. Crucially, this setup created a genuine cross-reality conflict: the ears received physically veridical information about the real world, while the eyes received rendered information about a virtual object occupying a different depth position.</p>
<p>The results of the first experiment delivered a double surprise. Visual capture did reliably occur, confirming that the multisensory machinery at work in physical rooms also operates when one of the signals belongs to a synthetic environment. But the asymmetry of the effect ran opposite to what real-world studies had established. In classic experiments, capture was stronger when the sound originated behind the visual object, presumably because listeners are more uncertain about sounds located behind opaque surfaces and therefore lean more heavily on vision. In the Utah study, capture was stronger when the sound originated in front of the virtual object rather than behind it. At first glance, this reversal looked like a failure of the classical model, a suggestion that the ventriloquist effect might not behave the same way in VR at all.</p>
<p>The second experiment resolved the puzzle. The team replicated the reversed asymmetry pattern, but they also added an independent measurement of the participants&#8217; visual distance perception using a blind-walking task, a gold-standard procedure in which participants view a target and then walk to it without vision, allowing researchers to infer perceived distance from walked distance. The measurements confirmed what the VR literature had long predicted: participants significantly underestimated the visual distances of virtual objects. When the researchers reanalyzed the audiovisual alignment judgments not relative to the physical distance of the virtual objects, but relative to each participant&#8217;s perceived, compressed visual distance, the expected real-world symmetry reemerged. In other words, the brain&#8217;s integration rule had not changed; the coordinate system had. Once the analysis was anchored to what participants actually perceived visually rather than where the virtual object &#8220;really&#8221; was in the rendered scene, the classic pattern of capture fell back into place.</p>
<p>This reframing carries significant theoretical weight. It implies that multisensory integration operates on perceived space, not physical space. The brain does not have access to the ground-truth coordinates programmed into the virtual environment; it only has access to the noisy perceptual estimates generated by the visual and auditory systems. If the visual estimate is compressed, then the point at which sound and vision appear co-located shifts accordingly, and the pattern of capture shifts with it. The findings thus demonstrate that core principles of multisensory integration, including visual dominance in depth and the statistical weighting of cues by reliability, are preserved in virtual reality, but that VR-specific biases can alter, and even reverse, the direction of well-established effects when measured against physical reality. This is a powerful demonstration that the same computational rules apply across real and virtual worlds, provided researchers account for how those worlds are actually perceived.</p>
<p>The methodological implications are substantial for anyone building or studying virtual environments. Developers of spatial audio for VR often assume that rendering sound at a physically correct position relative to a visually rendered object will produce the intended percept. This study shows that the perceived relationship between a real sound and a virtual object can deviate in systematic, predictable ways from the physical arrangement, and that these deviations are driven by the visual system&#8217;s compressed representation of depth. Applications that depend on precise audiovisual alignment, such as virtual training simulations, spatial audio design for games and cinematic VR, accessibility tools that use sound to guide attention to visual targets, and clinical or research paradigms involving multisensory integration, may all need to compensate for distance compression when placing sounds relative to visual content. Conversely, the effect could be exploited deliberately: if visual capture reliably pulls perceived sound location toward virtual objects, designers could use visual anchors to sharpen the perceived localization of audio without changing the audio itself.</p>
<p>The work also contributes to a deeper scientific conversation about why distance compression occurs in head-mounted displays and how it interacts with other perceptual processes. Hypotheses have ranged from limited field of view and display resolution to the absence of accurate accommodative and vergence cues, the influence of the virtual environment&#8217;s layout, and the lack of natural body-based scaling information. By showing that distance compression propagates into the domain of multisensory perception, the study adds a new consequence to the list: the distortion does not merely make virtual rooms feel smaller, it reshapes how the brain binds together information from different senses within those rooms. That makes distance perception in VR not just a curiosity of display technology but a foundational parameter that conditions virtually every spatial judgment a user makes.</p>
<p>The research, conducted at the University of Utah&#8217;s Department of Psychology and approved by the university&#8217;s Institutional Review Board, was supported in part by a National Science Foundation Graduate Research Fellowship. Trial-level data and analysis scripts for both experiments have been made publicly available on the Open Science Framework, reflecting a growing commitment to transparency in perception science. As head-mounted displays become everyday consumer technology and spatial audio becomes a standard feature of digital experiences, understanding how the brain reconciles real sound with virtual sight will matter far beyond the laboratory. This study offers both a caution, that virtual worlds distort space in ways that silently reshape multisensory perception, and a reassurance, that the brain&#8217;s integration rules remain coherent, lawful, and ultimately predictable even in worlds that do not physically exist.</p>
<div class="scienmag-article-metadata"><strong>Subject of Research:</strong> Depth-based visual capture of real-world sound sources by virtual objects in immersive virtual reality, and the role of perceived visual distance in audiovisual integration</p>
<p><strong>Article Title:</strong> Depth-based visual capture of sound in virtual reality is driven by perceived distance</p>
<p><strong>Article References:</strong> McCracken, M. K., Rowland, M. E., Finney, H. C., Stefanucci, J. K., &amp; Creem-Regehr, S. H. (2026). Depth-based visual capture of sound in virtual reality is driven by perceived distance. <em>Attention, Perception, &amp; Psychophysics, 88</em>(7), Article 187. <a href="https://doi.org/10.3758/s13414-026-03291-y" target="_blank" rel="noopener noreferrer">https://doi.org/10.3758/s13414-026-03291-y</a></p>
<p><strong>Image Credits:</strong> AI Generated</p>
<p><strong>DOI:</strong> <a href="https://doi.org/10.3758/s13414-026-03291-y" target="_blank" rel="noopener noreferrer">10.3758/s13414-026-03291-y</a></p>
<p><strong>Keywords:</strong> visual capture, ventriloquist effect, proximity image effect, virtual reality, auditory distance perception, multisensory integration, distance compression, blind-walking task, spatial localization, perceived distance, audiovisual integration, head-mounted display</p>
</div>
]]></content:encoded>
					
		
		
		<post-id xmlns="com-wordpress:feed-additions:1">187917</post-id>	</item>
	</channel>
</rss>
